00000100:00100000:1.0:1767317519.854509:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15521
00000100:00100000:1.0:1767317519.854521:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940027264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317519.854540:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317519.854571:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940027264:12345-0@lo:38:kworker.0 Request processed in 49us (1012us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317519.854577:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15521
00000100:00100000:1.0:1767317519.854588:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15522
00000100:00100000:1.0:1767317519.854592:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940027904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317519.854600:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317519.854621:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940027904:12345-0@lo:38:kworker.0 Request processed in 27us (932us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317519.854626:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15522
00000100:00100000:1.0:1767317519.854637:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15523
00000100:00100000:1.0:1767317519.854641:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940028160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317519.856404:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317519.856447:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940028160:12345-0@lo:38:kworker.0 Request processed in 1804us (2713us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317519.856454:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15523
00010000:00010000:1.0:1767317520.813358:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317523.534662:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317523.534717:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767317523.540839:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000001:00100000:1.0:1767317523.953362:0:38689:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a586faf-b087-472d-9665-d3bc7d15b908
00000020:00000080:1.0:1767317523.953374:0:38689:0:(genops.c:904:class_export_put()) final put ffff93cf4d715800/9a586faf-b087-472d-9665-d3bc7d15b908
00000100:00100000:1.0:1767317524.973438:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940028800:0@lo:400:kworker.0
00000100:00100000:1.0:1767317524.979016:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317524.979068:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940028800
00000100:00100000:1.0:1767317524.979071:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940028800
00000100:00100000:1.0:1767317524.979104:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:1.0:1767317524.979110:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940028800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317524.979139:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940028800:12345-0@lo:400:kworker.0 Request processed in 30us (124us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317524.979145:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00080000:1.0:1767317524.979157:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317524.979171:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940028800:0@lo:400:kworker.0
00000100:00100000:1.0:1767317524.979226:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940028672
00000100:00100000:1.0:1767317524.979229:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940028672
00000100:00100000:1.0:1767317524.979248:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764
00000100:00100000:1.0:1767317524.979252:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940028672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317524.979262:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317524.979285:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940028672:12345-0@lo:38:kworker.0 Request processed in 33us (83us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317524.979291:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764
00000100:00100000:1.0:1767317524.979591:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940029440
00000100:00100000:1.0:1767317524.979595:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940029440
00000100:00100000:1.0:1767317524.979621:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15527
00000100:00100000:1.0:1767317524.979625:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940029440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317524.979635:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317524.979663:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940029440:12345-0@lo:38:kworker.0 Request processed in 36us (284us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317524.979669:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15527
00000100:00100000:1.0:1767317524.985547:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940028928
00000100:00100000:1.0:1767317524.985562:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940028928
00000100:00100000:1.0:1767317524.985826:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222
00000100:00100000:1.0:1767317524.985838:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940028928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317524.985942:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940028928:12345-0@lo:400:kworker.0 Request processed in 107us (2425us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317524.985948:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222
00010000:00010000:1.0:1767317525.933574:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317528.654248:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317528.654361:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317529.070815:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317504/real 1767317504]  req@ffff93d046add880 x1853163940023296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317529 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317529.070853:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d046add880 x1853163940023296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317529 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767317529.070876:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317529.070902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767317529.070906:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940023296:0@lo:250:kworker.0
00000100:00100000:1.0:1767317529.072726:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940029824:0@lo:250:kworker.0
00000400:00000100:1.0:1767317529.072765:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940029824 offset 0 length 520: 4
00000100:00100000:1.0:1767317529.072816:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940029952:0@lo:38:kworker.0
00000100:00100000:1.0:1767317529.072836:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317529.072861:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940030080:0@lo:38:kworker.0
00000100:00100000:1.0:1767317529.072884:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317529.072901:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940030592:0@lo:38:kworker.0
00000100:00100000:1.0:1767317529.072920:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317529.072933:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940030848:0@lo:38:kworker.0
00000100:00100000:1.0:1767317529.072961:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317529.072988:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940030080
00000100:00100000:1.0:1767317529.072992:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940030080
00000100:00100000:1.0:1767317529.073012:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765
00000100:00100000:1.0:1767317529.073017:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940030080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317529.073036:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317529.073070:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940030080:12345-0@lo:38:kworker.0 Request processed in 51us (185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317529.073076:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765
00000100:00100000:1.0:1767317529.073096:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940029952
00000100:00100000:1.0:1767317529.073100:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940029952
00000100:00100000:1.0:1767317529.073114:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940030592
00000100:00100000:1.0:1767317529.073116:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940030592
00000100:00100000:1.0:1767317529.073127:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940030848
00000100:00100000:1.0:1767317529.073130:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940030848
00000100:00100000:1.0:1767317529.073140:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15529
00000100:00100000:1.0:1767317529.073144:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940029952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317529.073153:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317529.073177:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940029952:12345-0@lo:38:kworker.0 Request processed in 31us (339us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317529.073345:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15529
00000100:00100000:1.0:1767317529.073362:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15530
00000100:00100000:1.0:1767317529.073366:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940030592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317529.073376:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317529.073401:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940030592:12345-0@lo:38:kworker.0 Request processed in 33us (479us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317529.073406:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15530
00000100:00100000:1.0:1767317529.073423:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15531
00000100:00100000:1.0:1767317529.073428:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940030848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317529.073436:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317529.073460:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940030848:12345-0@lo:38:kworker.0 Request processed in 31us (498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317529.073464:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15531
00000100:00080000:1.0:1767317529.073492:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317529.073497:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317529.073500:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940029952:0@lo:38:kworker.0
00000100:00080000:1.0:1767317529.073510:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317529.073514:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317529.073516:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940030080:0@lo:38:kworker.0
00000100:00080000:1.0:1767317529.073524:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317529.073528:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317529.073530:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940030592:0@lo:38:kworker.0
00000100:00080000:1.0:1767317529.073537:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317529.073540:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317529.073543:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940030848:0@lo:38:kworker.0
00010000:00010000:1.0:1767317531.054057:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317531.629452:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940031104:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317531.629520:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317531.634895:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940031104:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317534.190297:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940031232:0@lo:38:kworker.0
00000100:00100000:1.0:1767317534.190690:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317534.190712:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940031360:0@lo:38:kworker.0
00000100:00100000:1.0:1767317534.190750:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317534.190769:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940031872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317534.190805:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317534.191005:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940032128:0@lo:38:kworker.0
00000100:00100000:1.0:1767317534.191026:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317534.196176:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317534.196209:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317534.196215:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940031360:0@lo:38:kworker.0
00000100:00100000:1.0:1767317535.726532:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317535.726558:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940032256:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317535.726641:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317535.727564:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940032256:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317536.173275:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317536.753809:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940032384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317536.753896:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317536.759897:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940032384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317538.887722:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894211328
00000100:00100000:1.0:1767317538.887728:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894211328
00000100:00100000:1.0:1767317538.887763:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15536
00000100:00100000:1.0:1767317538.887769:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894211328:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317538.887829:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317538.887875:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894211328:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 105us (205us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317538.887883:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15536
00000100:00100000:1.0:1767317539.309253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940032512:0@lo:38:kworker.0
00000100:00100000:1.0:1767317539.309336:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317539.309392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940032640:0@lo:38:kworker.0
00000100:00100000:1.0:1767317539.309417:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317539.309446:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940033152:0@lo:38:kworker.0
00000100:00100000:1.0:1767317539.309467:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317539.309482:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940033408:0@lo:38:kworker.0
00000100:00100000:1.0:1767317539.309500:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317539.309526:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940033152
00000100:00100000:1.0:1767317539.309529:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940033152
00000100:00100000:1.0:1767317539.309546:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346
00000100:00100000:1.0:1767317539.309555:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940033280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317539.309604:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940033280:12345-0@lo:400:kworker.0 Request processed in 50us (207us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317539.309611:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346
00000100:00100000:1.0:1767317540.846800:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940033536
00000100:00100000:1.0:1767317540.846808:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940033536
00000100:00100000:1.0:1767317540.846858:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726
00000100:00100000:1.0:1767317540.846866:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940033536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317540.847628:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317540.849425:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940033536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2552us (3038us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317540.849457:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726
00010000:00010000:1.0:1767317541.298351:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317541.891038:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940033664
00000100:00100000:1.0:1767317541.891055:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940033664
00000100:00100000:1.0:1767317541.891154:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727
00000100:00100000:1.0:1767317541.891165:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940033664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317541.891209:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317541.891301:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940033664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (17001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317541.891309:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727
00000100:00100000:1.0:1767317544.009219:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894211584
00000100:00100000:1.0:1767317544.009229:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894211584
00000100:00100000:1.0:1767317544.009286:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15540
00000100:00100000:1.0:1767317544.009294:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894211584:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317544.009318:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317544.009396:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894211584:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (255us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317544.009403:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15540
00000100:00100000:1.0:1767317544.429241:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940033792:0@lo:38:kworker.0
00000100:00100000:1.0:1767317544.429320:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317544.429382:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940033920:0@lo:38:kworker.0
00000100:00100000:1.0:1767317544.429414:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317544.429452:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940034432:0@lo:38:kworker.0
00000100:00100000:1.0:1767317544.429475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317544.429505:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940034688:0@lo:38:kworker.0
00000100:00100000:1.0:1767317544.429531:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317544.429566:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940033792
00000100:00100000:1.0:1767317544.429574:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940033792
00000100:00100000:1.0:1767317544.429621:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940034688
00000100:00100000:1.0:1767317544.429625:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940034688
00000100:00100000:1.0:1767317544.434485:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15542
00000100:00100000:1.0:1767317544.434741:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940034432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317544.436896:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317544.437068:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940034432:12345-0@lo:38:kworker.0 Request processed in 2566us (7589us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317544.437080:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15542
00000100:00100000:1.0:1767317544.437120:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15543
00000100:00100000:1.0:1767317544.437126:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940034688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317544.437144:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317544.437329:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940034688:12345-0@lo:38:kworker.0 Request processed in 201us (7796us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317544.437337:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15543
00000100:00100000:1.0:1767317544.437368:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940033920
00000100:00100000:1.0:1767317544.437377:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940033920
00000100:00100000:1.0:1767317544.437597:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768
00000100:00100000:1.0:1767317544.437702:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940033920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317544.437715:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317544.437756:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940033920:12345-0@lo:38:kworker.0 Request processed in 152us (8345us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317544.437764:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768
00000100:00080000:1.0:1767317544.438060:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317544.438067:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317544.438071:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940034688:0@lo:38:kworker.0
00000100:00080000:1.0:1767317544.438084:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317544.438089:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317544.438096:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940033920:0@lo:38:kworker.0
00000100:00080000:1.0:1767317544.438109:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317544.438114:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317544.438119:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940034432:0@lo:38:kworker.0
00000100:00080000:1.0:1767317544.438134:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317544.438139:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317544.438143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940033792:0@lo:38:kworker.0
00000100:00100000:1.0:1767317544.458963:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940034304:0@lo:400:kworker.0
00000100:00100000:1.0:1767317545.967464:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940034816
00000100:00100000:1.0:1767317545.967473:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940034816
00000100:00100000:1.0:1767317545.967529:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728
00000100:00100000:1.0:1767317545.967538:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940034816:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317545.967568:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317545.967628:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940034816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (510us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317545.967635:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728
00010000:00010000:1.0:1767317546.413954:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317546.995116:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940034944
00000100:00100000:1.0:1767317546.995135:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940034944
00000100:00100000:1.0:1767317546.995248:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729
00000100:00100000:1.0:1767317546.995276:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940034944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317546.995335:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317546.995444:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940034944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (5907us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317546.995452:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729
00000100:00100000:1.0:1767317549.549247:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940035072:0@lo:38:kworker.0
00000100:00100000:1.0:1767317549.549315:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317549.549373:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940035200:0@lo:38:kworker.0
00000100:00100000:1.0:1767317549.549397:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317549.549414:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940035712:0@lo:38:kworker.0
00000100:00100000:1.0:1767317549.549434:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317549.549452:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940035968:0@lo:38:kworker.0
00000100:00100000:1.0:1767317549.549470:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317549.549497:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940035072
00000100:00100000:1.0:1767317549.549505:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940035072
00000100:00100000:1.0:1767317549.549532:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940035712
00000100:00100000:1.0:1767317549.549535:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940035712
00000100:00100000:1.0:1767317549.549545:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940035968
00000100:00100000:1.0:1767317549.549548:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940035968
00000100:00100000:1.0:1767317549.549556:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940035584
00000100:00100000:1.0:1767317549.549558:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940035584
00000100:00100000:1.0:1767317549.549603:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352
00000100:00100000:1.0:1767317549.549611:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940035584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317549.549659:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940035584:12345-0@lo:400:kworker.0 Request processed in 50us (117us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317549.549666:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352
00000100:00100000:1.0:1767317549.549693:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940035840
00000100:00100000:1.0:1767317549.549701:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940035840
00000100:00100000:1.0:1767317549.549733:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353
00000100:00100000:1.0:1767317549.549738:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940035840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317549.549765:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940035840:12345-0@lo:400:kworker.0 Request processed in 27us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317549.549770:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353
00000100:00100000:1.0:1767317549.549805:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15546
00000100:00100000:1.0:1767317549.549809:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940035712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317549.549818:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317549.549838:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940035712:12345-0@lo:38:kworker.0 Request processed in 29us (403us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317549.549844:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15546
00010000:00010000:1.0:1767317551.543103:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317552.111132:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940036224
00000100:00100000:1.0:1767317552.111154:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940036224
00000100:00100000:1.0:1767317552.111266:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731
00000100:00100000:1.0:1767317552.111277:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940036224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317552.111312:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317552.111371:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940036224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (395us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317552.111378:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731
00000100:00100000:1.0:1767317554.670477:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317529/real 1767317529]  req@ffff93d060302a00 x1853163940029824/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317554.670501:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d060302a00 x1853163940029824/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317554.670515:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940036352:0@lo:38:kworker.0
00000100:00100000:1.0:1767317554.670570:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317554.670606:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940036480:0@lo:38:kworker.0
00000100:00100000:1.0:1767317554.670639:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317554.670664:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940036992:0@lo:38:kworker.0
00000100:00100000:1.0:1767317554.670690:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317554.670710:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940037248:0@lo:38:kworker.0
00000100:00100000:1.0:1767317554.670733:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317554.670748:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317554.670766:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767317554.670808:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940029824:0@lo:250:kworker.0
00000100:00100000:1.0:1767317554.670847:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940036480
00000100:00100000:1.0:1767317554.670852:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940036480
00000100:00100000:1.0:1767317554.670883:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770
00000100:00100000:1.0:1767317554.670892:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940036480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317554.671197:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317554.671237:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940036480:12345-0@lo:38:kworker.0 Request processed in 345us (598us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317554.671244:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770
00000100:00080000:1.0:1767317554.671270:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317554.671274:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767317554.671276:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317554.671280:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 2779
00000100:00080000:1.0:1767317554.671284:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317554.671289:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317554.671305:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060302a00 x1853163940037376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317554.671344:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940037376:0@lo:250:kworker.0
00000400:00000100:1.0:1767317554.671369:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940037376 offset 0 length 520: 4
00000100:00080000:1.0:1767317554.671395:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317554.671399:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317554.671402:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940036480:0@lo:38:kworker.0
00000100:00080000:1.0:1767317554.671440:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317554.671471:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940036864:0@lo:400:kworker.0
00000100:00100000:1.0:1767317554.671481:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940037120:0@lo:400:kworker.0
00000100:00080000:1.0:1767317554.678553:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317554.678561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317554.678566:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940036352:0@lo:38:kworker.0
00000100:00080000:1.0:1767317554.678578:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317554.678582:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317554.678585:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940036992:0@lo:38:kworker.0
00000100:00080000:1.0:1767317554.690017:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317554.690031:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317554.690036:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940037248:0@lo:38:kworker.0
00000100:00100000:1.0:1767317556.205204:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940037504
00000100:00100000:1.0:1767317556.205213:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940037504
00000100:00100000:1.0:1767317556.205283:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732
00000100:00100000:1.0:1767317556.205293:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940037504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317556.205323:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317556.207958:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940037504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2657us (2813us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317556.207973:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732
00010000:00010000:1.0:1767317556.654127:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317557.229448:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940037632
00000100:00100000:1.0:1767317557.229457:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940037632
00000100:00100000:1.0:1767317557.229563:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733
00000100:00100000:1.0:1767317557.229573:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940037632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317557.229603:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317557.229653:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940037632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317557.229661:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733
00000100:00100000:1.0:1767317557.229708:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940037632:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317557.231028:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317558.252898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317558.352918:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894212608
00000100:00100000:1.0:1767317558.352933:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894212608
00000100:00100000:1.0:1767317558.353344:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3357
00000100:00100000:1.0:1767317558.353355:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894212608:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317558.353454:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894212608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (7713us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317558.353462:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3357
00000100:00100000:1.0:1767317559.276899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317559.789663:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940037760:0@lo:38:kworker.0
00000100:00100000:1.0:1767317559.789705:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317559.789730:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940037888:0@lo:38:kworker.0
00000100:00100000:1.0:1767317559.789763:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317559.789798:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940038400:0@lo:38:kworker.0
00000100:00100000:1.0:1767317559.789816:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317559.789834:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940038656:0@lo:38:kworker.0
00000100:00100000:1.0:1767317559.789850:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317559.790173:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940037888
00000100:00100000:1.0:1767317559.790182:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940037888
00000100:00100000:1.0:1767317559.790212:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771
00000100:00100000:1.0:1767317559.790219:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940037888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317559.790239:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317559.790278:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940037888:12345-0@lo:38:kworker.0 Request processed in 58us (514us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317559.790286:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771
00000100:00100000:1.0:1767317559.790316:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940038528
00000100:00100000:1.0:1767317559.790319:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940038528
00000100:00100000:1.0:1767317559.790349:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940038272
00000100:00100000:1.0:1767317559.790352:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940038272
00000100:00100000:1.0:1767317559.790363:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940037760
00000100:00100000:1.0:1767317559.790365:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940037760
00000100:00100000:1.0:1767317559.790372:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940038400
00000100:00100000:1.0:1767317559.790374:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940038400
00000100:00100000:1.0:1767317559.790380:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940038656
00000100:00100000:1.0:1767317559.790382:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940038656
00000100:00100000:1.0:1767317559.790389:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358
00000100:00100000:1.0:1767317559.790395:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940038528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317559.790431:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940038528:12345-0@lo:400:kworker.0 Request processed in 36us (1002us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317559.790437:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358
00000100:00100000:1.0:1767317559.790454:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359
00000100:00100000:1.0:1767317559.790459:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940038272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317559.790481:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940038272:12345-0@lo:400:kworker.0 Request processed in 22us (967us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317559.790486:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359
00000100:00100000:1.0:1767317559.790507:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15553
00000100:00100000:1.0:1767317559.790511:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940037760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317559.790521:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317559.790540:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940037760:12345-0@lo:38:kworker.0 Request processed in 28us (835us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317559.790546:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15553
00000100:00100000:1.0:1767317559.790556:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15554
00000100:00100000:1.0:1767317559.790560:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940038400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317559.790568:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317559.790583:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940038400:12345-0@lo:38:kworker.0 Request processed in 23us (767us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317559.790589:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15554
00000100:00100000:1.0:1767317559.790597:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15555
00000100:00100000:1.0:1767317559.790601:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940038656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317559.790608:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317559.790624:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940038656:12345-0@lo:38:kworker.0 Request processed in 22us (773us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317559.790629:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15555
00000100:00080000:1.0:1767317559.790682:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317559.790687:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317559.791531:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940037760:0@lo:38:kworker.0
00000100:00080000:1.0:1767317559.791544:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317559.791548:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317559.791550:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940037888:0@lo:38:kworker.0
00000100:00080000:1.0:1767317559.791558:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317559.791561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317559.791564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940038400:0@lo:38:kworker.0
00000100:00080000:1.0:1767317559.791571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317559.791574:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317559.791576:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940038656:0@lo:38:kworker.0
00000100:00100000:1.0:1767317560.300913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317561.325325:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317561.776733:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317562.350042:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317564.909473:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940039040:0@lo:38:kworker.0
00000100:00100000:1.0:1767317564.909509:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317564.909541:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940039168:0@lo:38:kworker.0
00000100:00100000:1.0:1767317564.909569:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317564.909587:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940039680:0@lo:38:kworker.0
00000100:00100000:1.0:1767317564.909608:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317564.909624:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940039936:0@lo:38:kworker.0
00000100:00100000:1.0:1767317564.909643:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317564.909673:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940039168
00000100:00100000:1.0:1767317564.909680:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940039168
00000100:00100000:1.0:1767317564.909710:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772
00000100:00100000:1.0:1767317564.909724:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074279050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940039168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317564.909744:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317564.909806:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074279050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940039168:12345-0@lo:38:kworker.0 Request processed in 81us (235us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317564.909813:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772
00000100:00100000:1.0:1767317564.910000:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15558
00000100:00100000:1.0:1767317564.910504:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940039680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317564.910519:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317564.910549:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940039680:12345-0@lo:38:kworker.0 Request processed in 541us (939us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317564.927377:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15558
00000100:00100000:1.0:1767317566.446271:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317566.446301:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940040064:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317566.446561:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317566.448579:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940040064:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317566.893592:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317567.469298:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940040192:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317567.469370:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317567.470204:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317567.470249:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940040192:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317568.587913:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894213120
00000100:00100000:1.0:1767317568.587926:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894213120
00000100:00100000:1.0:1767317568.588004:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15560
00000100:00100000:1.0:1767317568.588019:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894212992:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317568.588044:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317568.591425:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894212992:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 3388us (3632us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317568.591445:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15560
00000100:00100000:1.0:1767317569.518133:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317570.030281:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940041088:0@lo:400:kworker.0
00000100:00100000:1.0:1767317570.030333:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317570.058754:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940041088:0@lo:400:kworker.0
00000100:00100000:1.0:1767317570.540954:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317571.565140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317571.566908:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317571.566930:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940041344:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317571.567004:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317571.569203:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940041344:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317572.013025:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317572.588922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317572.589150:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940041472:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317572.589222:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317573.613422:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317574.637226:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317575.660905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317576.684931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317576.685870:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940042624:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317577.133132:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317579.247155:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940043520
00000100:00100000:1.0:1767317579.247166:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940043520
00000100:00100000:1.0:1767317579.247239:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940043776
00000100:00100000:1.0:1767317579.247251:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940043776
00000100:00100000:1.0:1767317579.247281:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370
00000100:00100000:1.0:1767317579.247289:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940043520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317579.247361:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940043520:12345-0@lo:400:kworker.0 Request processed in 71us (700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317579.247369:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370
00000100:00100000:1.0:1767317579.247385:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371
00000100:00100000:1.0:1767317579.247391:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940043776:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317579.247418:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940043776:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317579.247424:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371
00000100:00100000:1.0:1767317579.247464:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940042880:0@lo:250:kworker.0
00000400:00000100:1.0:1767317579.247489:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940042880 offset 0 length 520: 4
00000100:00100000:1.0:1767317579.247523:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940043008:0@lo:38:kworker.0
00000100:00100000:1.0:1767317579.247545:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317579.247563:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940043136:0@lo:38:kworker.0
00000100:00100000:1.0:1767317579.247586:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317579.247601:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940043648:0@lo:38:kworker.0
00000100:00100000:1.0:1767317579.247620:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317579.247634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940043904:0@lo:38:kworker.0
00000100:00100000:1.0:1767317579.247654:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317579.247682:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940043008
00000100:00100000:1.0:1767317579.247686:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940043008
00000100:00100000:1.0:1767317579.247705:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940043648
00000100:00100000:1.0:1767317579.247708:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940043648
00000100:00100000:1.0:1767317579.247728:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940043904
00000100:00100000:1.0:1767317579.247731:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940043904
00000100:00100000:1.0:1767317579.247740:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15569
00000100:00100000:1.0:1767317579.247744:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317579.247765:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317579.247832:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043008:12345-0@lo:38:kworker.0 Request processed in 86us (286us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317579.248043:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15569
00000100:00100000:1.0:1767317579.248058:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15570
00000100:00100000:1.0:1767317579.248062:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317579.248072:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317579.248099:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043648:12345-0@lo:38:kworker.0 Request processed in 35us (478us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317579.248105:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15570
00000100:00100000:1.0:1767317579.248117:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15571
00000100:00100000:1.0:1767317579.248121:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317579.248130:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317579.248153:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940043904:12345-0@lo:38:kworker.0 Request processed in 30us (498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317579.248157:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15571
00000100:00080000:1.0:1767317579.248205:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317579.248211:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317579.248214:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940043008:0@lo:38:kworker.0
00000100:00080000:1.0:1767317579.248546:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317579.248550:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317579.248561:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0458bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940043648:0@lo:38:kworker.0
00000100:00080000:1.0:1767317579.248571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317579.248575:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317579.248577:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940043904:0@lo:38:kworker.0
00000100:00080000:1.0:1767317579.265049:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317579.265056:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317579.265060:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940043136:0@lo:38:kworker.0
00000100:00100000:1.0:1767317579.762184:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317580.781057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317581.805046:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317581.807977:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940044032:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317582.256385:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317582.829015:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317583.949908:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894214016
00000100:00100000:1.0:1767317583.949919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894214016
00000100:00100000:1.0:1767317583.949989:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894213888
00000100:00100000:1.0:1767317583.949993:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894213888
00000100:00100000:1.0:1767317583.950015:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3372
00000100:00100000:1.0:1767317583.950037:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894214016:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317583.950128:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894214016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 103us (815us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317583.950136:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3372
00000100:00100000:1.0:1767317583.950157:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15572
00000100:00100000:1.0:1767317583.950162:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894213888:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317583.950185:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317583.950224:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894213888:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (777us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317583.950231:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15572
00000100:00100000:1.0:1767317584.365400:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940044288:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.365473:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317584.366735:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940044416:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.366785:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317584.369693:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317584.369707:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317584.369712:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940044288:0@lo:38:kworker.0
00000100:00080000:1.0:1767317584.369752:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317584.369757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317584.369760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940044416:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.381237:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940044672:0@lo:400:kworker.0
00000100:00100000:1.0:1767317584.381283:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317584.386398:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940044672
00000100:00100000:1.0:1767317584.386407:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940044672
00000100:00100000:1.0:1767317584.386458:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:1.0:1767317584.386465:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0458bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940044672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317584.386506:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0458bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940044672:12345-0@lo:400:kworker.0 Request processed in 41us (5232us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317584.386514:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:1.0:1767317584.386553:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940044928:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.386593:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317584.386630:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940045184:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.386654:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317584.386683:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940044928
00000100:00100000:1.0:1767317584.386687:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940044928
00000100:00100000:1.0:1767317584.386703:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940045184
00000100:00100000:1.0:1767317584.386706:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940045184
00000100:00100000:1.0:1767317584.386715:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15574
00000100:00100000:1.0:1767317584.386720:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0458bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940044928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317584.386740:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317584.386790:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0458bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940044928:12345-0@lo:38:kworker.0 Request processed in 51us (178us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317584.386797:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15574
00000100:00100000:1.0:1767317584.387948:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15575
00000100:00100000:1.0:1767317584.387957:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940045184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317584.387978:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317584.388210:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940045184:12345-0@lo:38:kworker.0 Request processed in 251us (1553us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317584.388218:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15575
00000100:00080000:1.0:1767317584.388289:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317584.388295:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317584.388299:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940044928:0@lo:38:kworker.0
00000100:00080000:1.0:1767317584.388309:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317584.388313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317584.388316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940045184:0@lo:38:kworker.0
00000100:00100000:1.0:1767317584.388542:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940044672:0@lo:400:kworker.0
00000100:00080000:1.0:1767317584.388624:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317584.388631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317584.388655:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317584.388700:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940044544
00000100:00100000:1.0:1767317584.388706:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940044544
00000100:00100000:1.0:1767317584.388749:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246
00000100:00100000:1.0:1767317584.388757:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940044544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317584.388908:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940044544:12345-0@lo:400:kworker.0 Request processed in 151us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317584.388914:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246
00000100:00080000:1.0:1767317584.388930:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317584.388952:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940044544:0@lo:400:kworker.0
00000100:00100000:1.0:1767317584.395483:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940045056:0@lo:400:kworker.0
00000100:00100000:1.0:1767317584.395505:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940044800:0@lo:400:kworker.0
00000100:00100000:1.0:1767317586.925148:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940045312:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317586.925236:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317586.925789:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317587.373472:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317587.949065:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317587.949092:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940045440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317587.949169:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317587.949587:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317587.949625:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940045440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317589.062126:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894214272
00000100:00100000:1.0:1767317589.062136:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894214272
00000100:00100000:1.0:1767317589.062218:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3375
00000100:00100000:1.0:1767317589.062253:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894214272:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317589.062339:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894214272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (395us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317589.062349:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3375
00000100:00080000:1.0:1767317589.485484:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317589.485495:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317589.485498:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317589.485502:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317589.485507:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317589.485514:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2834
00000100:00080000:1.0:1767317589.485519:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317589.485526:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317589.485575:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940045568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317589.485608:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317589.485612:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317589.485613:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317589.485617:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2834
00000100:00080000:1.0:1767317589.485619:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317589.485623:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317589.485638:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221c00 x1853163940045696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317589.485703:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317589.485723:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317589.485725:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317589.485729:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2834
00000100:00080000:1.0:1767317589.485731:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317589.485735:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317589.485816:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47979180 x1853163940046208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317589.485835:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317589.485838:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317589.485839:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317589.485843:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2834
00000100:00080000:1.0:1767317589.485845:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317589.485849:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317589.485859:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aed0700 x1853163940046464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317589.485889:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940046080:0@lo:400:kworker.0
00000100:00100000:1.0:1767317589.485966:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317589.486030:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317589.486037:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940046336:0@lo:400:kworker.0
00000100:00100000:1.0:1767317589.486078:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317589.486113:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940046080
00000100:00100000:1.0:1767317589.486121:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940046080
00000100:00100000:1.0:1767317589.486165:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940046336
00000100:00100000:1.0:1767317589.486168:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940046336
00000100:00100000:1.0:1767317589.486189:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376
00000100:00100000:1.0:1767317589.486197:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940046080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317589.486286:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940046080:12345-0@lo:400:kworker.0 Request processed in 89us (319us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317589.486294:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376
00000100:00100000:1.0:1767317589.486325:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377
00000100:00100000:1.0:1767317589.486331:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940046336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317589.486359:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940046336:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317589.486365:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377
00000100:00100000:1.0:1767317589.486411:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940046336:0@lo:400:kworker.0
00000100:00100000:1.0:1767317589.486421:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940046080:0@lo:400:kworker.0
00000100:00080000:1.0:1767317592.048403:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317592.493256:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317593.072009:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317594.184853:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894214400
00000100:00100000:1.0:1767317594.184859:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894214400
00000100:00100000:1.0:1767317594.184911:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3378
00000100:00100000:1.0:1767317594.184925:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894214528:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317594.185008:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894214528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (688us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317594.185016:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3378
00000100:00100000:1.0:1767317594.185038:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15580
00000100:00100000:1.0:1767317594.185042:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894214400:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317594.185062:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317594.185087:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894214400:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (652us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317594.185108:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15580
00000100:00100000:1.0:1767317594.606016:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047104:0@lo:400:kworker.0
00000100:00100000:1.0:1767317594.606096:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.606217:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317594.606227:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047232:0@lo:400:kworker.0
00000100:00100000:1.0:1767317594.612307:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.612429:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940047232
00000100:00100000:1.0:1767317594.612438:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940047232
00000100:00100000:1.0:1767317594.612485:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250
00000100:00100000:1.0:1767317594.612494:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940047232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317594.612814:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940047232:12345-0@lo:400:kworker.0 Request processed in 320us (511us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317594.612823:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250
00000100:00100000:1.0:1767317594.612874:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047232:0@lo:400:kworker.0
00000100:00080000:1.0:1767317594.612919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317594.612959:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940046848:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.612996:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.613016:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940046976:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.613039:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.613066:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940047488:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.613087:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.613104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940047744:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.613124:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317594.617808:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940046848
00000100:00100000:1.0:1767317594.617838:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940046848
00000100:00100000:1.0:1767317594.617889:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940047488
00000100:00100000:1.0:1767317594.617892:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940047488
00000100:00100000:1.0:1767317594.617958:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940047744
00000100:00100000:1.0:1767317594.617962:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940047744
00000100:00100000:1.0:1767317594.617986:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15581
00000100:00100000:1.0:1767317594.617995:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940046848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317594.618021:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317594.618090:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940046848:12345-0@lo:38:kworker.0 Request processed in 95us (5092us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317594.618097:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15581
00000100:00100000:1.0:1767317594.618114:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15582
00000100:00100000:1.0:1767317594.618117:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940047488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317594.618143:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317594.618169:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940047488:12345-0@lo:38:kworker.0 Request processed in 50us (5081us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317594.618174:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15582
00000100:00100000:1.0:1767317594.618197:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15583
00000100:00100000:1.0:1767317594.618200:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940047744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317594.618208:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317594.618231:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940047744:12345-0@lo:38:kworker.0 Request processed in 29us (5106us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317594.618237:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15583
00000100:00080000:1.0:1767317594.618281:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317594.618287:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317594.618291:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940046848:0@lo:38:kworker.0
00000100:00080000:1.0:1767317594.618313:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317594.618317:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317594.618319:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940047488:0@lo:38:kworker.0
00000100:00080000:1.0:1767317594.618326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317594.618328:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317594.618331:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940047744:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.618406:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940046976
00000100:00100000:1.0:1767317594.618410:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940046976
00000100:00100000:1.0:1767317594.618437:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778
00000100:00100000:1.0:1767317594.618441:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940046976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317594.618451:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317594.618484:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940046976:12345-0@lo:38:kworker.0 Request processed in 41us (5443us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317594.618490:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778
00000100:00080000:1.0:1767317594.618514:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317594.618517:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317594.618521:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940046976:0@lo:38:kworker.0
00000100:00100000:1.0:1767317594.623113:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940047616
00000100:00100000:1.0:1767317594.626127:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940047616
00000100:00100000:1.0:1767317594.626213:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380
00000100:00100000:1.0:1767317594.626223:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940047616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317594.626309:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940047616:12345-0@lo:400:kworker.0 Request processed in 87us (5544us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317594.626317:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380
00000100:00100000:1.0:1767317594.626401:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047104:0@lo:400:kworker.0
00000100:00100000:1.0:1767317597.168271:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047872:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317597.168410:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317597.170460:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940047872:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317597.613007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317598.192133:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940048000:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317598.279044:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894214784
00000100:00100000:1.0:1767317598.279054:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894214784
00000100:00100000:1.0:1767317598.279095:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894214912
00000100:00100000:1.0:1767317598.279098:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894214912
00000100:00100000:1.0:1767317598.279139:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3381
00000100:00100000:1.0:1767317598.279160:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894214912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317598.279238:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894214912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317598.279247:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3381
00000100:00080000:1.0:1767317599.725533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317599.725545:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317599.725548:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317599.725552:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317599.725555:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317599.725563:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2844
00000100:00080000:1.0:1767317599.725568:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317599.725612:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317599.725648:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221c00 x1853163940048128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317599.725703:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317599.725707:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317599.725709:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317599.725722:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2844
00000100:00080000:1.0:1767317599.725724:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317599.725728:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317599.725743:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220a80 x1853163940048256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317599.725816:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317599.725820:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317599.725821:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317599.725825:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2844
00000100:00080000:1.0:1767317599.725828:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317599.725831:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317599.725844:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01500 x1853163940048768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317599.725860:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317599.725863:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317599.725865:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317599.725867:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2844
00000100:00080000:1.0:1767317599.725869:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317599.725872:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317599.725880:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02d80 x1853163940049024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317599.725914:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940048640:0@lo:400:kworker.0
00000100:00100000:1.0:1767317599.725979:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317599.726036:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317599.726041:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940048896:0@lo:400:kworker.0
00000100:00100000:1.0:1767317599.726063:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317599.727584:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317599.727602:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940048384
00000100:00100000:1.0:1767317599.727606:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940048384
00000100:00100000:1.0:1767317599.727664:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940048512
00000100:00100000:1.0:1767317599.727667:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940048512
00000100:00100000:1.0:1767317599.727689:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251
00000100:00100000:1.0:1767317599.727695:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940048384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317599.727731:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940048384:12345-0@lo:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317599.727737:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251
00000100:00100000:1.0:1767317599.727750:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:1.0:1767317599.727755:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940048512:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317599.727803:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940048512:12345-0@lo:400:kworker.0 Request processed in 47us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317599.727809:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00100000:1.0:1767317602.285745:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940049152
00000100:00100000:1.0:1767317602.285754:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940049152
00000100:00100000:1.0:1767317602.285859:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750
00000100:00100000:1.0:1767317602.285868:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940049152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317602.285906:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317602.285950:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940049152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317602.285971:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750
00010000:00010000:1.0:1767317602.734304:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317603.309353:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317603.309379:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940049280:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317603.309454:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317603.309969:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940049280:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317603.398640:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894215168
00000100:00100000:1.0:1767317603.398650:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894215168
00000100:00100000:1.0:1767317603.398728:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894215040
00000100:00100000:1.0:1767317603.398731:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894215040
00000100:00100000:1.0:1767317603.398753:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3384
00000100:00100000:1.0:1767317603.398762:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894215168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317603.402398:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894215168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3621us (4078us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317603.402414:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3384
00000100:00080000:1.0:1767317604.846228:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317604.846236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767317604.846240:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317604.846247:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 2829
00000100:00080000:1.0:1767317604.846252:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317604.846259:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317604.846299:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060300a80 x1853163940049408/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317604.846328:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317604.846332:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317604.846352:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317604.846356:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2849
00000100:00080000:1.0:1767317604.846358:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317604.846362:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317604.846387:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac700 x1853163940049536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317604.846396:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317604.846399:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317604.846401:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317604.846404:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2849
00000100:00080000:1.0:1767317604.846407:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317604.846410:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317604.846425:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf100 x1853163940049664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317604.846499:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317604.846503:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317604.846505:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317604.846510:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2849
00000100:00080000:1.0:1767317604.846513:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317604.846518:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317604.846532:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead500 x1853163940050176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317604.846557:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317604.846561:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317604.846569:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317604.846574:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2849
00000100:00080000:1.0:1767317604.846577:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317604.846581:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317604.846597:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaed80 x1853163940050432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317604.846630:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940050048:0@lo:400:kworker.0
00000100:00100000:1.0:1767317604.846677:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317604.846708:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317604.846718:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940050304:0@lo:400:kworker.0
00000100:00100000:1.0:1767317604.846766:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317604.846822:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940049920
00000100:00100000:1.0:1767317604.846829:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940049920
00000100:00100000:1.0:1767317604.846877:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253
00000100:00100000:1.0:1767317604.846886:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940049920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317604.846945:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940049920:12345-0@lo:400:kworker.0 Request processed in 58us (213us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317604.846960:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253
00000100:00100000:1.0:1767317604.846983:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254
00000100:00100000:1.0:1767317604.846992:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940049792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317604.847039:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940049792:12345-0@lo:400:kworker.0 Request processed in 46us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317604.847047:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254
00000100:00100000:1.0:1767317607.405285:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940050560
00000100:00100000:1.0:1767317607.405292:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940050560
00000100:00100000:1.0:1767317607.405348:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752
00000100:00100000:1.0:1767317607.405367:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940050560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317607.405393:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317607.406761:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940050560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1313us (1539us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317607.406784:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752
00010000:00010000:1.0:1767317607.856782:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317608.429568:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940050688
00000100:00100000:1.0:1767317608.429576:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940050688
00000100:00100000:1.0:1767317608.429641:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753
00000100:00100000:1.0:1767317608.429651:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940050688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317608.429682:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317608.429732:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940050688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317608.429739:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753
00000100:00100000:1.0:1767317608.429804:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940050688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317609.968765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940050816:0@lo:38:kworker.0
00000100:00100000:1.0:1767317609.968817:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317609.968847:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940050944:0@lo:38:kworker.0
00000100:00100000:1.0:1767317609.968869:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317609.968892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940051456:0@lo:38:kworker.0
00000100:00100000:1.0:1767317609.968919:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317609.968937:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940051712:0@lo:38:kworker.0
00000100:00100000:1.0:1767317609.968957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317609.968981:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940050816
00000100:00100000:1.0:1767317609.968985:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940050816
00000100:00100000:1.0:1767317609.969013:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940051456
00000100:00100000:1.0:1767317609.969016:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940051456
00000100:00100000:1.0:1767317609.969029:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940051712
00000100:00100000:1.0:1767317609.969032:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940051712
00000100:00100000:1.0:1767317609.969059:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15593
00000100:00100000:1.0:1767317609.969063:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940050816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317609.969085:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317609.969121:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940050816:12345-0@lo:38:kworker.0 Request processed in 56us (304us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317609.969125:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15593
00000100:00100000:1.0:1767317609.969139:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15594
00000100:00100000:1.0:1767317609.969142:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940051456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317609.969151:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317609.969170:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940051456:12345-0@lo:38:kworker.0 Request processed in 26us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317609.969175:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15594
00000100:00100000:1.0:1767317609.969184:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15595
00000100:00100000:1.0:1767317609.969188:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940051712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317609.969196:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317609.969221:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940051712:12345-0@lo:38:kworker.0 Request processed in 31us (262us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317609.969226:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15595
00000100:00080000:1.0:1767317609.969261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317609.969265:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317609.969269:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940050816:0@lo:38:kworker.0
00000100:00080000:1.0:1767317609.969276:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317609.969285:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317609.969288:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940051456:0@lo:38:kworker.0
00000100:00080000:1.0:1767317609.969298:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317609.969313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317609.969316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940051712:0@lo:38:kworker.0
00010000:00010000:1.0:1767317612.973050:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317613.550016:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940051968
00000100:00100000:1.0:1767317613.550026:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940051968
00000100:00100000:1.0:1767317613.550102:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755
00000100:00100000:1.0:1767317613.550111:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940051968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317613.550181:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317613.550240:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940051968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (985us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317613.550247:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755
00000100:00100000:1.0:1767317613.639816:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894215552
00000100:00100000:1.0:1767317613.639828:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894215552
00000100:00100000:1.0:1767317613.639875:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894215680
00000100:00100000:1.0:1767317613.639890:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894215680
00000100:00100000:1.0:1767317613.639941:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3390
00000100:00100000:1.0:1767317613.639951:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894215680:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317613.640005:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894215680:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 52us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317613.640132:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3390
00000100:00080000:1.0:1767317613.640170:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317615.085710:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940052480
00000100:00100000:1.0:1767317615.085718:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940052480
00000100:00100000:1.0:1767317615.085809:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940052352
00000100:00100000:1.0:1767317615.085813:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940052352
00000100:00100000:1.0:1767317615.085839:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257
00000100:00100000:1.0:1767317615.085847:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940052480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317615.087475:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940052480:12345-0@lo:400:kworker.0 Request processed in 1626us (2078us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317615.087483:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257
00000100:00100000:1.0:1767317617.645831:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940053120:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317617.645903:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317617.671295:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940053120:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317618.098445:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317618.669158:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317618.673633:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940053248:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317618.673709:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317618.677621:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940053248:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317620.205638:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317620.205648:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317620.205651:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317620.205655:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317620.205659:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317620.205667:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2865
00000100:00080000:1.0:1767317620.205672:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317620.205678:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317620.205718:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae300 x1853163940053376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317620.205753:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317620.205756:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317620.205758:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317620.205762:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2865
00000100:00080000:1.0:1767317620.205764:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317620.205767:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317620.205797:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaed80 x1853163940053504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317620.205853:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317620.205857:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317620.205858:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317620.205862:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2865
00000100:00080000:1.0:1767317620.205864:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317620.205867:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317620.205877:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead180 x1853163940054016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317620.205896:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317620.205898:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317620.205900:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317620.205903:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2865
00000100:00080000:1.0:1767317620.205905:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317620.205908:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317620.205917:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abca80 x1853163940054272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317620.205957:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940053888:0@lo:400:kworker.0
00000100:00100000:1.0:1767317620.206026:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317620.206079:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317620.206085:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940054144:0@lo:400:kworker.0
00000100:00100000:1.0:1767317620.206103:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317620.206132:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940053888
00000100:00100000:1.0:1767317620.206138:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940053888
00000100:00100000:1.0:1767317620.206178:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940054144
00000100:00100000:1.0:1767317620.206181:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940054144
00000100:00100000:1.0:1767317620.206199:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394
00000100:00100000:1.0:1767317620.206206:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940053888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317620.206247:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940053888:12345-0@lo:400:kworker.0 Request processed in 41us (222us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317620.206253:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394
00000100:00100000:1.0:1767317620.206268:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395
00000100:00100000:1.0:1767317620.206273:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940054144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317620.206292:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940054144:12345-0@lo:400:kworker.0 Request processed in 19us (188us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317620.206297:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395
00000100:00100000:1.0:1767317620.206340:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940054144:0@lo:400:kworker.0
00000100:00100000:1.0:1767317620.206350:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940053888:0@lo:400:kworker.0
00000100:00100000:1.0:1767317622.765336:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317622.765362:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940054400:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317622.765430:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317622.774374:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940054400:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317623.213231:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317623.790343:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940054528:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317623.790431:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317623.791911:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940054528:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317623.879079:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894216320
00000100:00100000:1.0:1767317623.879089:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894216320
00000100:00100000:1.0:1767317623.879171:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3396
00000100:00100000:1.0:1767317623.879182:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894216320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317623.879279:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894216320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (395us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317623.879288:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3396
00000100:00100000:1.0:1767317623.895160:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15604
00000100:00100000:1.0:1767317623.895173:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894216192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317623.895200:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317623.895297:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894216192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 124us (15121us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317623.895306:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15604
00000100:00080000:1.0:1767317625.325082:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317625.325093:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317625.325096:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317625.325099:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317625.325104:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317625.325111:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2870
00000100:00080000:1.0:1767317625.325134:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317625.325141:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317625.325179:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abd500 x1853163940054656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317625.325208:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317625.325211:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317625.325213:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317625.325216:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2870
00000100:00080000:1.0:1767317625.325219:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317625.325222:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317625.325236:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abe680 x1853163940054784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317625.326482:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317625.326486:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317625.326488:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317625.326492:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2870
00000100:00080000:1.0:1767317625.326495:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317625.326498:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317625.326512:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abd500 x1853163940055296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317625.326533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317625.326536:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317625.326538:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317625.326541:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2870
00000100:00080000:1.0:1767317625.326549:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317625.326553:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317625.326639:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead180 x1853163940055552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317625.326665:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940055168:0@lo:400:kworker.0
00000100:00100000:1.0:1767317625.326694:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317625.326715:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317625.326720:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940055424:0@lo:400:kworker.0
00000100:00100000:1.0:1767317625.326740:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317625.326768:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940055168
00000100:00100000:1.0:1767317625.326771:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940055168
00000100:00100000:1.0:1767317625.326932:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940055424
00000100:00100000:1.0:1767317625.326936:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940055424
00000100:00100000:1.0:1767317625.326958:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397
00000100:00100000:1.0:1767317625.326964:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940055168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317625.327001:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940055168:12345-0@lo:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317625.327006:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397
00000100:00100000:1.0:1767317625.327019:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398
00000100:00100000:1.0:1767317625.327025:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940055424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317625.327049:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940055424:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317625.327055:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398
00000100:00100000:1.0:1767317625.327092:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940055424:0@lo:400:kworker.0
00000100:00100000:1.0:1767317625.327101:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940055168:0@lo:400:kworker.0
00000100:00080000:1.0:1767317625.327123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317625.327135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940055296:0@lo:38:kworker.0
00000100:00100000:1.0:1767317625.327202:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317625.327218:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940055552:0@lo:38:kworker.0
00000100:00100000:1.0:1767317625.327234:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317625.327255:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940055296
00000100:00100000:1.0:1767317625.327258:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940055296
00000100:00100000:1.0:1767317625.327274:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940055552
00000100:00100000:1.0:1767317625.327276:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940055552
00000100:00100000:1.0:1767317625.327289:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15606
00000100:00100000:1.0:1767317625.327293:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940055296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317625.327306:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317625.327333:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940055296:12345-0@lo:38:kworker.0 Request processed in 38us (130us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317625.327338:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15606
00000100:00100000:1.0:1767317625.327349:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15607
00000100:00100000:1.0:1767317625.327352:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940055552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317625.327360:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317625.327380:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940055552:12345-0@lo:38:kworker.0 Request processed in 26us (145us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317625.327385:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15607
00000100:00080000:1.0:1767317625.327413:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317625.327416:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317625.327419:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940055296:0@lo:38:kworker.0
00000100:00080000:1.0:1767317625.327425:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317625.327436:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317625.327439:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940055552:0@lo:38:kworker.0
00000100:00100000:1.0:1767317627.885375:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940055680
00000100:00100000:1.0:1767317627.885384:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940055680
00000100:00100000:1.0:1767317627.885440:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1767317627.885449:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940055680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317627.885478:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317627.885526:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940055680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317627.885533:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1767317627.885574:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940055680:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317628.335918:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317628.913130:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317629.005217:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894216576
00000100:00100000:1.0:1767317629.005227:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894216576
00000100:00100000:1.0:1767317629.005302:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894216448
00000100:00100000:1.0:1767317629.005305:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894216448
00000100:00100000:1.0:1767317629.005327:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3399
00000100:00100000:1.0:1767317629.005337:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894216576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317629.005408:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894216576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (857us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317629.005420:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3399
00000100:00080000:1.0:1767317629.421951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317629.421956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767317629.421958:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317629.421963:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 2854
00000100:00080000:1.0:1767317629.421972:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317629.421977:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317629.422009:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead180 x1853163940055936/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317629.422097:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317629.422101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317629.422103:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317629.422107:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2875
00000100:00080000:1.0:1767317629.422109:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317629.422113:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317629.422129:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf480 x1853163940056064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317629.422138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317629.422142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317629.422143:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317629.422146:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2875
00000100:00080000:1.0:1767317629.422149:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317629.422152:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317629.422167:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf480 x1853163940056192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317629.422217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317629.422219:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317629.422220:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317629.422223:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2875
00000100:00080000:1.0:1767317629.422225:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317629.422232:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317629.422243:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc380 x1853163940056704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317629.422256:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317629.422259:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317629.422260:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317629.422263:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2875
00000100:00080000:1.0:1767317629.422265:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317629.422269:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317629.422278:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adea00 x1853163940056960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317629.422306:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940056448:0@lo:400:kworker.0
00000100:00100000:1.0:1767317629.422375:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317629.422425:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317629.422430:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940056320:0@lo:400:kworker.0
00000100:00100000:1.0:1767317629.422450:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317629.423540:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940056832:0@lo:400:kworker.0
00000100:00100000:1.0:1767317629.423560:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317633.005388:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940057088
00000100:00100000:1.0:1767317633.005398:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940057088
00000100:00100000:1.0:1767317633.005463:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762
00000100:00100000:1.0:1767317633.005472:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940057088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317633.005505:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317633.005549:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940057088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (361us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317633.005575:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762
00010000:00010000:1.0:1767317633.458576:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317634.030245:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317634.030268:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940057216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317634.030340:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317634.544343:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940057728:0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.549705:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317634.550293:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940057728
00000100:00100000:1.0:1767317634.550304:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940057728
00000100:00100000:1.0:1767317634.550532:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403
00000100:00100000:1.0:1767317634.550541:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940057728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.550626:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940057728:12345-0@lo:400:kworker.0 Request processed in 86us (929us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317634.550634:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403
00000100:00080000:1.0:1767317634.550657:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317634.550694:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940057728:0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.551214:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940057984
00000100:00100000:1.0:1767317634.551220:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940057984
00000100:00100000:1.0:1767317634.551272:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3404
00000100:00100000:1.0:1767317634.551280:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940057984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.551343:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940057984:12345-0@lo:400:kworker.0 Request processed in 65us (409us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317634.551349:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404
00000100:00100000:1.0:1767317634.551379:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940057984:0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.561903:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940057600
00000100:00100000:1.0:1767317634.561940:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940057600
00000100:00100000:1.0:1767317634.562004:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265
00000100:00100000:1.0:1767317634.562014:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940057600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317634.562120:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940057600:12345-0@lo:400:kworker.0 Request processed in 108us (8941us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317634.562129:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265
00000100:00100000:1.0:1767317638.127410:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940058240
00000100:00100000:1.0:1767317638.127419:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940058240
00000100:00100000:1.0:1767317638.127492:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764
00000100:00100000:1.0:1767317638.127504:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940058240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317638.127533:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317638.127591:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940058240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (242us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317638.127599:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764
00010000:00010000:1.0:1767317638.573101:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317639.149384:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317639.149407:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940058368:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317639.149479:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317639.150438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317639.150478:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940058368:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317639.243114:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894217088
00000100:00100000:1.0:1767317639.243125:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894217088
00000100:00100000:1.0:1767317639.243204:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894216960
00000100:00100000:1.0:1767317639.243207:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894216960
00000100:00100000:1.0:1767317639.243226:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3405
00000100:00100000:1.0:1767317639.243236:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894217088:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317639.243306:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894217088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (393us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317639.243327:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3405
00000100:00100000:1.0:1767317639.243347:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15616
00000100:00100000:1.0:1767317639.243351:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894216960:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317639.243371:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317639.243397:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894216960:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (405us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317639.243403:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15616
00000100:00100000:1.0:1767317639.663105:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940058752:0@lo:400:kworker.0
00000100:00100000:1.0:1767317639.663150:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317639.663375:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940059136:0@lo:400:kworker.0
00000100:00100000:1.0:1767317639.663408:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317639.663445:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940058752
00000100:00100000:1.0:1767317639.663451:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940058752
00000100:00100000:1.0:1767317639.663496:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1767317639.663508:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940058752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317639.663548:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940058752:12345-0@lo:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317639.663561:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1767317639.671369:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940058752:0@lo:400:kworker.0
00000100:00100000:1.0:1767317639.679449:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15618
00000100:00100000:1.0:1767317639.679457:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940059008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317639.679490:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317639.679572:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940059008:12345-0@lo:38:kworker.0 Request processed in 113us (5447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317639.679593:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15618
00000100:00100000:1.0:1767317639.679619:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15619
00000100:00100000:1.0:1767317639.679623:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940059264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317639.679633:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317639.679660:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940059264:12345-0@lo:38:kworker.0 Request processed in 36us (5418us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317639.679665:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15619
00000100:00080000:1.0:1767317643.246767:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317643.693293:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317644.269578:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317644.358813:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894217216
00000100:00100000:1.0:1767317644.358827:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894217216
00000100:00100000:1.0:1767317644.358884:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15620
00000100:00100000:1.0:1767317644.358894:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894217216:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317644.358920:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317644.358995:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894217216:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 102us (1190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317644.359002:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15620
00000100:00080000:1.0:1767317644.359831:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317644.785055:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940059904
00000100:00100000:1.0:1767317644.785070:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940059904
00000100:00100000:1.0:1767317644.785153:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267
00000100:00100000:1.0:1767317644.785163:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940059904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317644.785266:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940059904:12345-0@lo:400:kworker.0 Request processed in 105us (3408us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317644.785275:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267
00000100:00100000:1.0:1767317644.785341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940059648:0@lo:38:kworker.0
00000100:00100000:1.0:1767317644.785384:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317644.785422:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940059776:0@lo:38:kworker.0
00000100:00100000:1.0:1767317644.785449:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317644.785464:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940060160:0@lo:38:kworker.0
00000100:00100000:1.0:1767317644.785483:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317644.785501:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940060416:0@lo:38:kworker.0
00000100:00100000:1.0:1767317644.785524:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317644.785554:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940059648
00000100:00100000:1.0:1767317644.785558:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940059648
00000100:00100000:1.0:1767317644.785577:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940060160
00000100:00100000:1.0:1767317644.785580:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940060160
00000100:00100000:1.0:1767317644.785591:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940060416
00000100:00100000:1.0:1767317644.785593:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940060416
00000100:00100000:1.0:1767317644.785604:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15621
00000100:00100000:1.0:1767317644.785608:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940059648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317644.785627:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317644.785659:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940059648:12345-0@lo:38:kworker.0 Request processed in 48us (274us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317644.785664:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15621
00000100:00100000:1.0:1767317644.785676:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15622
00000100:00100000:1.0:1767317644.786382:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940060160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317644.786393:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317644.786431:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940060160:12345-0@lo:38:kworker.0 Request processed in 749us (948us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317644.786438:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15622
00000100:00080000:1.0:1767317648.373610:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317648.813100:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317649.392422:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940060672
00000100:00100000:1.0:1767317649.392435:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940060672
00000100:00100000:1.0:1767317649.392524:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769
00000100:00100000:1.0:1767317649.392534:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940060672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317649.392575:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317649.392669:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940060672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (2784us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317649.392677:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769
00000100:00100000:1.0:1767317649.909494:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940060800:0@lo:38:kworker.0
00000100:00100000:1.0:1767317649.909526:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317649.909554:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940060928:0@lo:38:kworker.0
00000100:00100000:1.0:1767317649.909577:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317649.909602:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940061312:0@lo:38:kworker.0
00000100:00100000:1.0:1767317649.909622:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317649.909640:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940061568:0@lo:38:kworker.0
00000100:00100000:1.0:1767317649.909665:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767317653.933074:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317654.010306:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940062208:0@lo:400:kworker.0
00000100:00100000:1.0:1767317654.010345:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317654.010373:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317654.010378:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940062720:0@lo:400:kworker.0
00000100:00100000:1.0:1767317654.010409:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317654.010432:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940062336
00000100:00100000:1.0:1767317654.010436:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940062336
00000100:00100000:1.0:1767317654.010475:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767317654.010481:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940062336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317654.010518:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940062336:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317654.010524:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767317654.509092:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940062976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317654.509167:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317654.509746:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940062976:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317658.605714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317659.052983:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317659.118304:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940063744:0@lo:400:kworker.0
00000100:00100000:1.0:1767317659.118345:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317659.118385:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940063488
00000100:00100000:1.0:1767317659.118389:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940063488
00000100:00100000:1.0:1767317659.118418:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271
00000100:00100000:1.0:1767317659.118424:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940063488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317659.118458:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940063488:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317659.118464:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271
00000100:00080000:1.0:1767317659.118480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317659.118497:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940063488:0@lo:400:kworker.0
00000100:00080000:1.0:1767317659.119998:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317659.120031:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317659.120037:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317659.120041:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940063232:0@lo:38:kworker.0
00000100:00080000:1.0:1767317659.120065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317659.120076:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317659.120079:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940063360:0@lo:38:kworker.0
00000100:00080000:1.0:1767317659.120088:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317659.120091:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317659.120093:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940063872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317659.120153:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940063744:0@lo:400:kworker.0
00000100:00100000:1.0:1767317659.125044:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940063616
00000100:00100000:1.0:1767317659.125053:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940063616
00000100:00100000:1.0:1767317659.125126:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272
00000100:00100000:1.0:1767317659.125135:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940063616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317659.125203:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940063616:12345-0@lo:400:kworker.0 Request processed in 68us (313us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317659.125210:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272
00000100:00080000:1.0:1767317659.127683:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317659.127690:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317659.127694:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940064128:0@lo:38:kworker.0
00000100:00100000:1.0:1767317659.629214:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940064256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317659.629291:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317659.630226:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940064256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317659.719166:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317663.729527:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940064384:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317664.173285:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317664.237087:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940064512:0@lo:38:kworker.0
00000100:00100000:1.0:1767317664.237167:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317664.237217:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940064640:0@lo:38:kworker.0
00000100:00100000:1.0:1767317664.237245:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317664.237269:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940065152:0@lo:38:kworker.0
00000100:00100000:1.0:1767317664.237306:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317664.237337:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940065408:0@lo:38:kworker.0
00000100:00100000:1.0:1767317664.237368:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317664.237583:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940064640
00000100:00100000:1.0:1767317664.237586:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940064640
00000100:00100000:1.0:1767317664.237605:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792
00000100:00100000:1.0:1767317664.237609:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940064640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317664.237620:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317664.252755:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940064640:12345-0@lo:38:kworker.0 Request processed in 15130us (15498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317664.252788:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792
00000100:00100000:1.0:1767317664.752538:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317664.752569:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940065536:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317664.752642:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767317669.293811:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317669.357790:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940066560:0@lo:400:kworker.0
00000100:00100000:1.0:1767317669.357823:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317669.357871:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940066304:0@lo:400:kworker.0
00000100:00100000:1.0:1767317669.357895:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317669.365623:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940066560
00000100:00100000:1.0:1767317669.365639:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940066560
00000100:00100000:1.0:1767317669.366044:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940066304
00000100:00100000:1.0:1767317669.366048:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940066304
00000100:00100000:1.0:1767317669.366079:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423
00000100:00100000:1.0:1767317669.366088:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940066560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317669.366182:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940066560:12345-0@lo:400:kworker.0 Request processed in 94us (8357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317669.366189:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423
00000100:00100000:1.0:1767317669.366209:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424
00000100:00100000:1.0:1767317669.366215:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940066304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317669.366248:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940066304:12345-0@lo:400:kworker.0 Request processed in 34us (8353us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317669.366254:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424
00000100:00100000:1.0:1767317669.366300:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940066560:0@lo:400:kworker.0
00000100:00100000:1.0:1767317669.366338:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940066304:0@lo:400:kworker.0
00000100:00080000:1.0:1767317669.366372:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317669.368264:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940065920
00000100:00100000:1.0:1767317669.368271:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940065920
00000100:00100000:1.0:1767317669.368318:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793
00000100:00100000:1.0:1767317669.368324:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940065920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317669.368345:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317669.368383:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940065920:12345-0@lo:38:kworker.0 Request processed in 57us (221us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317669.368389:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793
00000100:00100000:1.0:1767317669.394675:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15642
00000100:00100000:1.0:1767317669.394689:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940066688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317669.394718:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317669.394849:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940066688:12345-0@lo:38:kworker.0 Request processed in 160us (11660us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317669.394857:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15642
00000100:00100000:1.0:1767317669.869747:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940066816:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317669.869856:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317669.870167:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940066816:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317669.963429:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767317669.964805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317669.973446:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894218624
00000100:00100000:1.0:1767317669.973457:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894218624
00000100:00100000:1.0:1767317669.973517:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15643
00000100:00100000:1.0:1767317669.973526:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894218624:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317669.973552:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317669.973625:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894218624:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 97us (475us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317669.973634:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15643
00000100:00100000:1.0:1767317673.965403:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940066944
00000100:00100000:1.0:1767317673.965413:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940066944
00000100:00100000:1.0:1767317673.965549:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778
00000100:00100000:1.0:1767317673.965558:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940066944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317673.965588:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317673.965635:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940066944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317673.965643:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778
00000100:00100000:1.0:1767317674.056393:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894219008
00000100:00100000:1.0:1767317674.056421:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894219008
00000100:00100000:1.0:1767317674.056476:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15644
00000100:00100000:1.0:1767317674.056485:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894219008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317674.056513:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317674.056592:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894219008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 106us (290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317674.056599:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15644
00010000:00010000:1.0:1767317674.413861:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317674.477146:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317674.477160:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317674.477163:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317674.477168:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317674.477175:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317674.477184:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2919
00000100:00080000:1.0:1767317674.477189:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317674.477196:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317674.477240:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940067072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317674.477274:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317674.477278:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317674.477280:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317674.477283:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2919
00000100:00080000:1.0:1767317674.477286:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317674.477289:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317674.477302:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965f80 x1853163940067200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317674.477395:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317674.477398:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317674.477401:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317674.477409:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2919
00000100:00080000:1.0:1767317674.477413:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317674.477418:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317674.477431:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964a80 x1853163940067712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317674.477450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317674.477453:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317674.477455:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317674.477458:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2919
00000100:00080000:1.0:1767317674.477470:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317674.477474:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317674.477488:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940067968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317674.477524:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940067456:0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.477558:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.477590:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317674.477600:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940067584:0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.477632:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.477671:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940067840
00000100:00100000:1.0:1767317674.477675:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940067840
00000100:00100000:1.0:1767317674.477704:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940067584
00000100:00100000:1.0:1767317674.477715:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940067584
00000100:00100000:1.0:1767317674.477740:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3427
00000100:00100000:1.0:1767317674.477747:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940067840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.477819:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940067840:12345-0@lo:400:kworker.0 Request processed in 71us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317674.477826:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3427
00000100:00100000:1.0:1767317674.477846:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428
00000100:00100000:1.0:1767317674.477852:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940067584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.477881:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940067584:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317674.477887:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428
00000100:00100000:1.0:1767317674.477926:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940067584:0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.482477:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940067840:0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.482503:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940067328:0@lo:400:kworker.0
00000100:00100000:1.0:1767317674.482670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940067072:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.482742:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.482804:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940067072
00000100:00100000:1.0:1767317674.482812:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940067072
00000100:00100000:1.0:1767317674.482853:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15645
00000100:00100000:1.0:1767317674.482859:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940067072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317674.482885:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317674.482927:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940067072:12345-0@lo:38:kworker.0 Request processed in 66us (185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317674.482934:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15645
00000100:00080000:1.0:1767317674.482986:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317674.482991:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317674.482994:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940067072:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.483000:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940067200:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.483023:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.483040:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940067712:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.483057:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.483073:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940067712
00000100:00100000:1.0:1767317674.483076:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940067712
00000100:00100000:1.0:1767317674.483093:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15646
00000100:00100000:1.0:1767317674.483098:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940067712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317674.483108:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317674.483235:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940067712:12345-0@lo:38:kworker.0 Request processed in 136us (177us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317674.483241:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15646
00000100:00080000:1.0:1767317674.483267:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317674.483272:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317674.483274:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940067712:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.483281:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940067968:0@lo:38:kworker.0
00000100:00100000:1.0:1767317674.483301:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317674.483319:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940067968
00000100:00100000:1.0:1767317674.483322:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940067968
00000100:00100000:1.0:1767317674.483337:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15647
00000100:00100000:1.0:1767317674.483342:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940067968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317674.483352:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317674.484336:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940067968:12345-0@lo:38:kworker.0 Request processed in 990us (1031us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317674.484344:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15647
00000100:00100000:1.0:1767317674.989085:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940068096:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317674.989155:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317679.086130:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940068224
00000100:00100000:1.0:1767317679.086139:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940068224
00000100:00100000:1.0:1767317679.086207:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780
00000100:00100000:1.0:1767317679.086216:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940068224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317679.086257:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317679.086309:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940068224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317679.086316:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780
00000100:00100000:1.0:1767317679.176679:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894219392
00000100:00100000:1.0:1767317679.176689:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894219392
00000100:00100000:1.0:1767317679.176760:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894219264
00000100:00100000:1.0:1767317679.176764:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894219264
00000100:00100000:1.0:1767317679.176821:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3429
00000100:00100000:1.0:1767317679.176833:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894219392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317679.176907:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894219392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (457us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317679.176916:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3429
00000100:00100000:1.0:1767317679.176937:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15648
00000100:00100000:1.0:1767317679.176941:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894219264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317679.176962:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317679.177001:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894219264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (424us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317679.177008:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15648
00010000:00010000:1.0:1767317679.533016:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317679.597552:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940068608:0@lo:400:kworker.0
00000100:00100000:1.0:1767317679.597593:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317679.599539:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431
00000100:00100000:1.0:1767317679.599561:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940068992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317679.599633:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940068992:12345-0@lo:400:kworker.0 Request processed in 85us (1376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317679.599647:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431
00000100:00100000:1.0:1767317679.599696:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940068864:0@lo:38:kworker.0
00000100:00100000:1.0:1767317679.599731:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317679.599752:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940069120:0@lo:38:kworker.0
00000100:00100000:1.0:1767317679.599798:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317679.599819:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940069248:0@lo:250:kworker.0
00000400:00000100:1.0:1767317679.599836:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940069248 offset 0 length 520: 4
00000100:00080000:1.0:1767317679.599870:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317679.599874:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317679.599878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940068480:0@lo:38:kworker.0
00000100:00080000:1.0:1767317679.599888:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317679.599891:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317679.599893:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940068352:0@lo:38:kworker.0
00000100:00100000:1.0:1767317679.599922:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940068864
00000100:00100000:1.0:1767317679.599939:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940068864
00000100:00100000:1.0:1767317679.599956:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940069120
00000100:00100000:1.0:1767317679.599958:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940069120
00000100:00100000:1.0:1767317679.599969:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15650
00000100:00100000:1.0:1767317679.599973:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940068864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317679.599984:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317679.600015:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940068864:12345-0@lo:38:kworker.0 Request processed in 40us (284us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317679.600021:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15650
00000100:00100000:1.0:1767317679.600034:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15651
00000100:00100000:1.0:1767317679.600038:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940069120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317679.600045:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317679.600065:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940069120:12345-0@lo:38:kworker.0 Request processed in 26us (292us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317679.600070:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15651
00000100:00080000:1.0:1767317679.600341:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317679.600346:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317679.600349:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940068864:0@lo:38:kworker.0
00000100:00080000:1.0:1767317679.600363:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317679.600366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317679.600369:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940069120:0@lo:38:kworker.0
00000100:00080000:1.0:1767317679.600404:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317679.600409:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317679.600441:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940068608:0@lo:400:kworker.0
00000100:00100000:1.0:1767317679.600514:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940068992:0@lo:400:kworker.0
00000100:00100000:1.0:1767317679.600536:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940068736:0@lo:400:kworker.0
00000100:00100000:1.0:1767317680.116482:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940069376:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317680.116556:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317684.293922:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317684.306628:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894219520
00000100:00100000:0.0:1767317684.306640:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894219520
00000100:00100000:0.0:1767317684.306694:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15652
00000100:00100000:0.0:1767317684.306703:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894219520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317684.306731:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317684.306841:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894219520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 137us (407us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317684.306848:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15652
00010000:00010000:1.0:1767317684.662091:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317684.718697:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940069632:0@lo:38:kworker.0
00000100:00100000:1.0:1767317684.718747:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317684.718796:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940069760:0@lo:38:kworker.0
00000100:00100000:1.0:1767317684.718821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317684.718837:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940070144:0@lo:38:kworker.0
00000100:00100000:1.0:1767317684.718855:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317684.718870:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940070400:0@lo:38:kworker.0
00000100:00100000:1.0:1767317684.718889:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317684.718924:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940069888
00000100:00100000:1.0:1767317684.718931:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940069888
00000100:00100000:1.0:1767317684.718984:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280
00000100:00100000:1.0:1767317684.718995:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940069888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317684.719049:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940069888:12345-0@lo:400:kworker.0 Request processed in 52us (1472us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317684.719057:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280
00000100:00100000:1.0:1767317684.719084:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940069632
00000100:00100000:1.0:1767317684.719087:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940069632
00000100:00100000:1.0:1767317684.719108:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940070144
00000100:00100000:1.0:1767317684.719111:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940070144
00000100:00100000:1.0:1767317684.719127:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940070400
00000100:00100000:1.0:1767317684.719132:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940070400
00000100:00100000:1.0:1767317684.719144:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15653
00000100:00100000:1.0:1767317684.719158:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940069632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317684.719176:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317684.719206:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940069632:12345-0@lo:38:kworker.0 Request processed in 47us (463us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317684.719212:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15653
00000100:00100000:1.0:1767317684.719223:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15654
00000100:00100000:1.0:1767317684.719226:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940070144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317684.719235:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317684.719252:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940070144:12345-0@lo:38:kworker.0 Request processed in 24us (396us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317684.719481:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940069760
00000100:00100000:0.0:1767317684.719486:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940069760
00000100:00100000:0.0:1767317684.719527:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796
00000100:00100000:0.0:1767317684.719531:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940069760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317684.719553:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317684.719599:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940069760:12345-0@lo:38:kworker.0 Request processed in 63us (773us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317684.719609:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796
00000100:00080000:0.0:1767317684.719660:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317684.719740:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15654
00000100:00100000:0.0:1767317684.720153:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15655
00000100:00100000:0.0:1767317684.720159:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940070400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317684.720170:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317684.720203:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940070400:12345-0@lo:38:kworker.0 Request processed in 44us (1313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317684.720209:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15655
00000100:00080000:0.0:1767317684.720305:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317684.720311:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317684.720314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940069632:0@lo:38:kworker.0
00000100:00080000:0.0:1767317684.720354:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317684.720360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317684.720363:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940069760:0@lo:38:kworker.0
00000100:00080000:0.0:1767317684.720401:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317684.720408:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317684.720413:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940070144:0@lo:38:kworker.0
00000100:00080000:0.0:1767317684.720421:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317684.720424:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317684.720427:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940070400:0@lo:38:kworker.0
00000100:00100000:0.0:1767317685.229181:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317685.229202:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940070528:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317685.229270:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317685.229795:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940070528:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317689.326339:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317689.415089:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317689.415189:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317689.415420:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15656
00000100:00100000:1.0:1767317689.415430:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894219776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317689.415454:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767317689.415646:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317689.416129:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894219776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 697us (938us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317689.416137:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15656
00010000:00010000:0.0:1767317689.773611:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317689.838801:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317689.838811:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317689.838814:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317689.838817:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317689.838821:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317689.838843:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2934
00000100:00080000:1.0:1767317689.838848:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317689.838969:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317689.839008:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940070784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317689.839045:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317689.839049:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317689.839052:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317689.839055:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2934
00000100:00080000:1.0:1767317689.839058:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317689.839061:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317689.839181:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940070784:0@lo:38:kworker.0
00000100:00100000:0.0:1767317689.839259:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317689.840067:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d880 x1853163940070912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317689.840572:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317689.840576:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317689.840579:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317689.840584:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2934
00000100:00080000:1.0:1767317689.840589:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317689.840594:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317689.840612:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d500 x1853163940071296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317689.840631:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317689.840634:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317689.840636:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317689.840651:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2934
00000100:00080000:1.0:1767317689.840653:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317689.840657:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317689.840667:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7fb80 x1853163940071552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317689.840723:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940071424:0@lo:400:kworker.0
00000100:00100000:0.0:1767317689.841450:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940071168:0@lo:400:kworker.0
00000100:00100000:1.0:1767317689.842986:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317689.844202:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940071424:0@lo:400:kworker.0
00000100:00100000:0.0:1767317690.348926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317690.349113:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940071680:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317690.349184:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317690.349734:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940071680:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317691.372878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317692.397494:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317693.420899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317694.447034:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940071808
00000100:00100000:0.0:1767317694.447046:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940071808
00000100:00100000:0.0:1767317694.447148:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786
00000100:00100000:0.0:1767317694.447158:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940071808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317694.447190:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317694.447266:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940071808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (2030us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317694.447273:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786
00000100:00100000:0.0:1767317694.447337:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940071808:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317694.534126:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317694.535376:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00010000:00010000:0.0:1767317694.896180:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317694.957848:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317694.957861:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317694.957865:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317694.957869:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317694.957875:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317694.957885:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2939
00000100:00080000:1.0:1767317694.957890:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317694.957897:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317694.957942:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7fb80 x1853163940071936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317694.957992:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317694.957995:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317694.957997:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317694.958000:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2939
00000100:00080000:1.0:1767317694.958003:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317694.958006:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317694.958019:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d500 x1853163940072064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317694.958067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317694.958070:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317694.958072:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317694.958075:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2939
00000100:00080000:1.0:1767317694.958077:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317694.958081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317694.958089:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ea00 x1853163940072448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317694.958116:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317694.958119:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317694.958123:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317694.958128:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2939
00000100:00080000:1.0:1767317694.958133:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317694.958137:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317694.958154:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09c00 x1853163940072704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317694.958195:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940072320:0@lo:400:kworker.0
00000100:00100000:0.0:1767317694.958496:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940071936:0@lo:38:kworker.0
00000100:00100000:1.0:1767317694.959570:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317694.959651:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940072576:0@lo:400:kworker.0
00000100:00100000:1.0:1767317694.959682:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317694.959717:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072320
00000100:00100000:1.0:1767317694.959723:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072320
00000100:00100000:1.0:1767317694.959761:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072576
00000100:00100000:1.0:1767317694.959764:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072576
00000100:00100000:1.0:1767317694.959807:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439
00000100:00100000:1.0:1767317694.959814:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940072320:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317694.968321:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317694.968390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940072064:0@lo:38:kworker.0
00000100:00100000:0.0:1767317694.968568:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317694.968593:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940072448:0@lo:38:kworker.0
00000100:00100000:0.0:1767317694.968615:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317694.968633:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940072704:0@lo:38:kworker.0
00000100:00100000:0.0:1767317694.968652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317694.968705:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072064
00000100:00100000:0.0:1767317694.968713:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072064
00000100:00100000:0.0:1767317694.968749:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767317694.968756:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940072064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317694.968796:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317694.968837:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940072064:12345-0@lo:38:kworker.0 Request processed in 80us (268us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317694.968845:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767317694.968868:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940071936
00000100:00100000:0.0:1767317694.968883:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940071936
00000100:00100000:0.0:1767317694.968904:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072448
00000100:00100000:0.0:1767317694.968907:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072448
00000100:00100000:0.0:1767317694.968917:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072704
00000100:00100000:0.0:1767317694.968920:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072704
00000100:00100000:0.0:1767317694.968930:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15661
00000100:00100000:0.0:1767317694.968935:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940071936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317694.968945:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317694.968972:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940071936:12345-0@lo:38:kworker.0 Request processed in 36us (662us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317694.968978:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15661
00000100:00100000:0.0:1767317694.968989:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15662
00000100:00100000:0.0:1767317694.968993:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940072448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317694.969002:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317694.969025:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940072448:12345-0@lo:38:kworker.0 Request processed in 30us (408us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317694.969030:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15662
00000100:00100000:0.0:1767317694.969040:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15663
00000100:00100000:0.0:1767317694.969043:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940072704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317694.969051:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317694.969072:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940072704:12345-0@lo:38:kworker.0 Request processed in 27us (420us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317694.969077:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15663
00000100:00080000:0.0:1767317694.969121:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317694.969126:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317694.969129:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940071936:0@lo:38:kworker.0
00000100:00080000:0.0:1767317694.969148:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317694.969151:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317694.969154:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940072064:0@lo:38:kworker.0
00000100:00080000:0.0:1767317694.970646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317694.970653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317694.970657:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940072448:0@lo:38:kworker.0
00000100:00080000:0.0:1767317694.970848:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317694.970854:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317694.970858:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940072704:0@lo:38:kworker.0
00000100:00100000:0.0:1767317694.971026:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940072576:0@lo:400:kworker.0
00000100:00100000:1.0:1767317694.972579:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940072320:12345-0@lo:400:kworker.0 Request processed in 12759us (13007us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317694.972592:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439
00000100:00100000:0.0:1767317694.974682:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940072320:0@lo:400:kworker.0
00000100:00100000:0.0:1767317695.469193:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317695.469213:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940072832:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317695.469294:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317695.469854:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072832
00000100:00100000:1.0:1767317695.469865:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072832
00000100:00100000:1.0:1767317695.469935:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787
00000100:00100000:1.0:1767317695.469944:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940072832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317695.469983:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317695.470050:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940072832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (752us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317695.470057:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787
00000100:00100000:0.0:1767317699.565035:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317699.565057:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940072960:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317699.565136:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317699.565284:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940072960
00000100:00100000:1.0:1767317699.565292:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940072960
00000100:00100000:1.0:1767317699.565369:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788
00000100:00100000:1.0:1767317699.565378:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940072960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317699.565408:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317699.569940:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940072960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4551us (4792us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317699.569955:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788
00000100:00100000:0.0:1767317699.570209:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940072960:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317699.661304:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894220288
00000100:00100000:1.0:1767317699.661317:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894220288
00000100:00100000:1.0:1767317699.661370:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894220416
00000100:00100000:1.0:1767317699.661373:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894220416
00000100:00100000:1.0:1767317699.661423:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3441
00000100:00100000:1.0:1767317699.661433:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894220416:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317699.661506:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894220416:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (816us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317699.661513:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3441
00000100:00100000:1.0:1767317699.661530:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15664
00000100:00100000:1.0:1767317699.661534:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894220288:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317699.661554:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317699.661574:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894220288:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (974us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317699.661579:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15664
00010000:00010000:0.0:1767317700.013123:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317700.079222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317700.079240:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317700.079243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317700.079265:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317700.079270:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317700.079277:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2944
00000100:00080000:0.0:1767317700.079281:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317700.079287:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317700.079325:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399e680 x1853163940073088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317700.079342:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317700.079345:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317700.079347:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317700.079351:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2944
00000100:00080000:0.0:1767317700.079353:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317700.079356:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317700.079369:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399d880 x1853163940073216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317700.079441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317700.079445:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317700.079447:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317700.079450:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2944
00000100:00080000:0.0:1767317700.079453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317700.079457:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317700.079467:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7f480 x1853163940073728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317700.079482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317700.079492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317700.079494:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317700.079498:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2944
00000100:00080000:0.0:1767317700.079501:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317700.079505:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317700.079515:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d500 x1853163940073984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317700.079546:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940073600:0@lo:400:kworker.0
00000100:00100000:0.0:1767317700.079612:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317700.079679:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317700.079686:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940073472:0@lo:400:kworker.0
00000100:00100000:0.0:1767317700.079713:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317700.079749:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940073600
00000100:00100000:0.0:1767317700.079755:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940073600
00000100:00100000:1.0:1767317700.081064:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940073472:0@lo:400:kworker.0
00000100:00100000:1.0:1767317700.081821:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940073216
00000100:00100000:1.0:1767317700.081825:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940073216
00000100:00100000:1.0:1767317700.081862:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799
00000100:00100000:1.0:1767317700.081866:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940073216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317700.081876:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317700.081926:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940073216:12345-0@lo:38:kworker.0 Request processed in 44us (629us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317700.081939:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799
00000100:00080000:1.0:1767317700.081968:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317700.081972:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317700.081975:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940073216:0@lo:38:kworker.0
00000100:00100000:0.0:1767317700.082468:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443
00000100:00100000:0.0:1767317700.082479:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940073600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317700.082532:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940073600:12345-0@lo:400:kworker.0 Request processed in 56us (2919us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317700.082537:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443
00000100:00100000:1.0:1767317700.084727:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940073600:0@lo:400:kworker.0
00000100:00100000:1.0:1767317700.589179:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940074112:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317700.589271:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317700.589389:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940074112
00000100:00100000:0.0:1767317700.589413:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940074112
00000100:00100000:0.0:1767317700.589486:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789
00000100:00100000:0.0:1767317700.589496:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940074112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317700.589528:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317700.598768:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940074112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9261us (9485us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317700.598799:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940074112:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317700.598828:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789
00000100:00100000:1.0:1767317704.173126:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317679/real 1767317679]  req@ffff93cf45b92a00 x1853163940069248/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317704.173157:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45b92a00 x1853163940069248/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767317704.173176:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317704.173225:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767317704.173228:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940069248:0@lo:250:kworker.0
00000100:00080000:0.0:1767317704.173683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317704.173689:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767317704.173692:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317704.173697:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 2929
00000100:00080000:0.0:1767317704.173701:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317704.173708:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317704.173739:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5500 x1853163940074240/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317704.173765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317704.173769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317704.173787:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317704.173791:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2950
00000100:00080000:0.0:1767317704.173793:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317704.173797:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317704.173810:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940074368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317704.173818:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317704.173820:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317704.173822:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317704.173825:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2950
00000100:00080000:0.0:1767317704.173827:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317704.173829:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317704.173841:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7480 x1853163940074496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317704.173911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317704.173915:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317704.173916:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317704.173920:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2950
00000100:00080000:0.0:1767317704.173922:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317704.173926:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317704.173937:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940075008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317704.173949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317704.173953:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317704.173954:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317704.173958:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2950
00000100:00080000:0.0:1767317704.173960:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317704.173963:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317704.173972:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940075264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317704.174000:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940074880:0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.174060:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317704.174127:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317704.174133:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940075136:0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.174156:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317704.174187:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940074880
00000100:00100000:0.0:1767317704.174204:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940074880
00000100:00100000:0.0:1767317704.174251:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940075136
00000100:00100000:0.0:1767317704.174260:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940075136
00000100:00100000:0.0:1767317704.174286:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444
00000100:00100000:0.0:1767317704.174295:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940074880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.174344:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940074880:12345-0@lo:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317704.174351:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444
00000100:00100000:0.0:1767317704.174367:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445
00000100:00100000:0.0:1767317704.174373:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940075136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.174401:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940075136:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317704.174406:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445
00000100:00100000:0.0:1767317704.174456:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940075136:0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.174466:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940074880:0@lo:400:kworker.0
00000100:00100000:1.0:1767317704.174917:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940074240:0@lo:250:kworker.0
00000400:00000100:1.0:1767317704.174941:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940074240 offset 0 length 520: 4
00000100:00100000:1.0:1767317704.174959:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940074368:0@lo:38:kworker.0
00000100:00100000:1.0:1767317704.174979:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317704.175006:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940074496:0@lo:38:kworker.0
00000100:00100000:1.0:1767317704.175029:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317704.175043:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940075008:0@lo:38:kworker.0
00000100:00100000:1.0:1767317704.175088:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317704.175106:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940075264:0@lo:38:kworker.0
00000100:00100000:1.0:1767317704.175125:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317704.175154:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940074368
00000100:00100000:1.0:1767317704.175158:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940074368
00000100:00100000:1.0:1767317704.175178:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940075008
00000100:00100000:1.0:1767317704.175181:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940075008
00000100:00100000:1.0:1767317704.175189:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940075264
00000100:00100000:1.0:1767317704.175203:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940075264
00000100:00100000:1.0:1767317704.175215:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15668
00000100:00100000:1.0:1767317704.175220:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940074368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317704.175238:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317704.175272:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940074368:12345-0@lo:38:kworker.0 Request processed in 51us (291us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317704.175278:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15668
00000100:00100000:1.0:1767317704.175291:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15669
00000100:00100000:1.0:1767317704.175295:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940075008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317704.175304:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317704.175328:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940075008:12345-0@lo:38:kworker.0 Request processed in 31us (240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317704.175333:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15669
00000100:00100000:1.0:1767317704.175345:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15670
00000100:00100000:1.0:1767317704.175348:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940075264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317704.175356:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317704.175426:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940075264:12345-0@lo:38:kworker.0 Request processed in 75us (299us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317704.175655:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15670
00000100:00080000:1.0:1767317704.175687:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317704.175693:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317704.175696:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940074368:0@lo:38:kworker.0
00000100:00080000:1.0:1767317704.175705:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317704.175709:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317704.175712:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940075008:0@lo:38:kworker.0
00000100:00080000:1.0:1767317704.175719:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317704.175722:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317704.175725:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940075264:0@lo:38:kworker.0
00000100:00100000:0.0:1767317704.176292:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940074752
00000100:00100000:0.0:1767317704.176298:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940074752
00000100:00100000:0.0:1767317704.176354:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940074624
00000100:00100000:0.0:1767317704.176358:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940074624
00000100:00100000:0.0:1767317704.176376:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285
00000100:00100000:0.0:1767317704.176383:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940074752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.176441:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940074752:12345-0@lo:400:kworker.0 Request processed in 49us (1732us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317704.176447:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285
00000100:00100000:0.0:1767317704.176457:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286
00000100:00100000:0.0:1767317704.176463:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940074624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317704.176485:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940074624:12345-0@lo:400:kworker.0 Request processed in 24us (1726us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317704.176498:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286
00000100:00100000:0.0:1767317704.689566:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940075392
00000100:00100000:0.0:1767317704.689580:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940075392
00000100:00100000:0.0:1767317704.689719:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790
00000100:00100000:0.0:1767317704.689728:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940075392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317704.689759:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317704.689854:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940075392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (4263us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317704.689863:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790
00000100:00100000:1.0:1767317704.776602:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317704.784396:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00010000:00010000:0.0:1767317705.134364:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317705.709474:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940075520:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317705.709547:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317705.710067:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940075520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317705.710396:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317706.732976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317707.760305:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317708.781057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317709.296989:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317709.297000:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317709.297003:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317709.297007:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317709.297012:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317709.297020:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2954
00000100:00080000:1.0:1767317709.297024:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317709.297031:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317709.297087:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940075648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317709.297124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317709.297128:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317709.297129:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317709.297133:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2954
00000100:00080000:1.0:1767317709.297135:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317709.297138:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317709.297163:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940075776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317709.297227:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317709.297231:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317709.297232:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317709.297236:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2954
00000100:00080000:1.0:1767317709.297238:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317709.297242:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317709.297251:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433f100 x1853163940076288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317709.297266:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317709.297269:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317709.297271:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317709.297274:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2954
00000100:00080000:1.0:1767317709.297276:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317709.297279:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317709.297296:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213100 x1853163940076544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317709.297324:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940076160:0@lo:400:kworker.0
00000100:00100000:1.0:1767317709.297398:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317709.297461:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317709.297467:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940076416:0@lo:400:kworker.0
00000100:00100000:1.0:1767317709.297491:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317709.297528:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940076160
00000100:00100000:1.0:1767317709.297537:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940076160
00000100:00100000:1.0:1767317709.297590:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940076416
00000100:00100000:1.0:1767317709.297593:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940076416
00000100:00100000:1.0:1767317709.297616:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447
00000100:00100000:1.0:1767317709.297625:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940076160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317709.298405:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940075904:0@lo:400:kworker.0
00000100:00100000:1.0:1767317709.303816:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940076160:12345-0@lo:400:kworker.0 Request processed in 6189us (6415us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317709.303825:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447
00000100:00080000:1.0:1767317709.314546:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317709.314552:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317709.314556:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940075776:0@lo:38:kworker.0
00000100:00100000:0.0:1767317709.315475:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317709.319567:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940075904:0@lo:400:kworker.0
00000100:00100000:0.0:1767317709.804956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317709.805426:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940076672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317709.805491:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317709.805613:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940076672
00000100:00100000:1.0:1767317709.805621:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940076672
00000100:00100000:1.0:1767317709.805684:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792
00000100:00100000:1.0:1767317709.805693:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940076672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317709.805721:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317709.805769:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940076672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317709.805815:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792
00000100:00100000:1.0:1767317709.805863:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940076672:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317709.902803:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00010000:00010000:0.0:1767317710.253040:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317710.829453:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317710.829943:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940076800
00000100:00100000:0.0:1767317710.829952:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940076800
00000100:00100000:0.0:1767317710.830006:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793
00000100:00100000:0.0:1767317710.830014:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940076800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317710.830046:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317710.830101:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940076800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317710.830122:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793
00000100:00100000:0.0:1767317711.852901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317712.877408:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317713.900917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317714.416240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317714.416249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317714.416253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317714.416257:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317714.416261:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317714.416270:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2959
00000100:00080000:0.0:1767317714.416275:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317714.416283:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317714.416322:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1880 x1853163940076928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317714.416353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317714.416356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317714.416358:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317714.416362:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2959
00000100:00080000:0.0:1767317714.416364:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317714.416367:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317714.416380:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1f80 x1853163940077056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317714.416452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317714.416455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317714.416473:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317714.416477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2959
00000100:00080000:0.0:1767317714.416479:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317714.416483:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317714.416497:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a680 x1853163940077568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317714.416515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317714.416519:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317714.416520:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317714.416525:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2959
00000100:00080000:0.0:1767317714.416528:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317714.416534:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317714.416549:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a300 x1853163940077824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317714.416790:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077312
00000100:00100000:0.0:1767317714.416798:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077312
00000100:00100000:0.0:1767317714.416853:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077184
00000100:00100000:0.0:1767317714.416857:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077184
00000100:00100000:0.0:1767317714.416877:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289
00000100:00100000:0.0:1767317714.416886:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940077312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317714.416937:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940077312:12345-0@lo:400:kworker.0 Request processed in 52us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317714.416944:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289
00000100:00100000:0.0:1767317714.416959:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290
00000100:00100000:0.0:1767317714.416964:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940077184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317714.416989:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940077184:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317714.417004:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290
00000100:00100000:1.0:1767317714.417606:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940077440:0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.417653:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317714.417705:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317714.417711:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940077696:0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.417732:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317714.417755:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077440
00000100:00100000:0.0:1767317714.417762:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077440
00000100:00100000:1.0:1767317714.417767:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077696
00000100:00100000:1.0:1767317714.417806:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077696
00000100:00100000:0.0:1767317714.417831:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450
00000100:00100000:0.0:1767317714.417842:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940077440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.417846:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451
00000100:00100000:1.0:1767317714.417857:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940077696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317714.417904:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940077440:12345-0@lo:400:kworker.0 Request processed in 65us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317714.417907:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940077696:12345-0@lo:400:kworker.0 Request processed in 51us (172us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317714.417916:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450
00000100:00100000:0.0:1767317714.418291:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940076928
00000100:00100000:0.0:1767317714.418295:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940076928
00000100:00100000:1.0:1767317714.423260:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451
00000100:00100000:1.0:1767317714.423312:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077824
00000100:00100000:1.0:1767317714.423323:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077824
00000100:00100000:1.0:1767317714.423355:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15676
00000100:00100000:1.0:1767317714.423362:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940077824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317714.423387:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317714.423470:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940077824:12345-0@lo:38:kworker.0 Request processed in 106us (5235us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317714.423477:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15676
00000100:00100000:1.0:1767317714.423533:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940077696:0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.423548:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940077440:0@lo:400:kworker.0
00000100:00080000:1.0:1767317714.423629:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317714.423635:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317714.423639:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317714.423663:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940077184:0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.427504:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940077312:0@lo:400:kworker.0
00000100:00100000:1.0:1767317714.427599:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940077056
00000100:00100000:1.0:1767317714.427606:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940077056
00000100:00100000:1.0:1767317714.427652:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802
00000100:00100000:1.0:1767317714.427660:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940077056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317714.428371:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317714.428449:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940077056:12345-0@lo:38:kworker.0 Request processed in 788us (10329us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317714.428459:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802
00000100:00100000:0.0:1767317714.432188:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15677
00000100:00100000:0.0:1767317714.432199:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940076928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317714.432224:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317714.432312:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940076928:12345-0@lo:38:kworker.0 Request processed in 112us (14242us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317714.432319:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15677
00000100:00080000:0.0:1767317714.432365:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317714.432369:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317714.432373:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940076928:0@lo:38:kworker.0
00000100:00080000:0.0:1767317714.433451:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317714.433456:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317714.433459:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940077568:0@lo:38:kworker.0
00000100:00100000:1.0:1767317714.939427:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794
00000100:00100000:1.0:1767317714.939456:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940077952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317714.939509:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317714.940427:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940077952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 982us (11356us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317714.940439:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794
00000100:00100000:1.0:1767317715.014962:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317715.015055:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767317715.015810:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767317715.377025:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317715.952558:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940078080:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317715.952631:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317715.955681:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940078080:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317719.534208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317719.534217:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317719.534220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317719.534225:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317719.534229:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317719.534249:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2964
00000100:00080000:0.0:1767317719.534254:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317719.534260:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317719.534297:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a300 x1853163940078208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317719.534314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317719.534318:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317719.534319:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317719.534323:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2964
00000100:00080000:0.0:1767317719.534325:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317719.534328:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317719.534339:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978a80 x1853163940078336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317719.534409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317719.534412:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317719.534414:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317719.534417:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2964
00000100:00080000:0.0:1767317719.534419:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317719.534436:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317719.534449:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940078848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317719.534464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317719.534468:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317719.534470:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317719.534473:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2964
00000100:00080000:0.0:1767317719.534475:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317719.534478:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317719.534486:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011c00 x1853163940079104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317719.534519:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940078592:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.534591:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317719.534669:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317719.534676:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940078464:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.534698:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317719.534725:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940078720:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.534761:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317719.534797:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317719.534802:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940078976:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.534834:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317719.534875:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940078592
00000100:00100000:0.0:1767317719.534882:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940078592
00000100:00100000:0.0:1767317719.534928:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940078464
00000100:00100000:0.0:1767317719.534932:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940078464
00000100:00100000:0.0:1767317719.534951:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767317719.534964:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940078592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535009:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940078592:12345-0@lo:400:kworker.0 Request processed in 46us (418us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317719.535015:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767317719.535029:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292
00000100:00100000:0.0:1767317719.535034:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940078464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535071:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940078464:12345-0@lo:400:kworker.0 Request processed in 36us (372us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317719.535077:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292
00000100:00100000:0.0:1767317719.535095:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940078720
00000100:00100000:0.0:1767317719.535098:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940078720
00000100:00100000:0.0:1767317719.535121:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940078976
00000100:00100000:0.0:1767317719.535124:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940078976
00000100:00100000:0.0:1767317719.535139:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453
00000100:00100000:0.0:1767317719.535145:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940078720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535177:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940078720:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317719.535182:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453
00000100:00100000:0.0:1767317719.535192:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454
00000100:00100000:0.0:1767317719.535196:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940078976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535220:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940078976:12345-0@lo:400:kworker.0 Request processed in 23us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317719.535225:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454
00000100:00080000:0.0:1767317719.535241:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767317719.535246:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317719.535248:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317719.535285:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940078976:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535303:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940078720:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535331:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940078464:0@lo:400:kworker.0
00000100:00100000:0.0:1767317719.535339:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940078592:0@lo:400:kworker.0
00000100:00100000:1.0:1767317719.538419:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940078848
00000100:00100000:1.0:1767317719.538424:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940078848
00000100:00100000:1.0:1767317719.538451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15681
00000100:00100000:1.0:1767317719.538456:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940078848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317719.538483:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317719.538512:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940078848:12345-0@lo:38:kworker.0 Request processed in 55us (321us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317719.538519:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15681
00000100:00100000:1.0:1767317719.539176:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940079104
00000100:00100000:1.0:1767317719.539181:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940079104
00000100:00100000:1.0:1767317719.539210:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15682
00000100:00100000:1.0:1767317719.539214:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940079104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317719.539225:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317719.539273:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940079104:12345-0@lo:38:kworker.0 Request processed in 57us (1038us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317719.539280:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15682
00000100:00100000:0.0:1767317720.045090:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317720.045116:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940079232:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317720.045195:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317720.045319:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940079232
00000100:00100000:1.0:1767317720.045328:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940079232
00000100:00100000:1.0:1767317720.045378:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796
00000100:00100000:1.0:1767317720.045398:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940079232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317720.045428:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317720.045484:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940079232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317720.045491:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796
00000100:00100000:0.0:1767317720.045691:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940079232:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317720.048177:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317720.136997:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767317720.137396:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317720.138914:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00010000:00010000:0.0:1767317720.493011:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317721.070666:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317721.071006:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317721.071027:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940079360:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317721.071118:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317721.071900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317721.071953:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940079360:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317722.092898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317723.120274:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317724.140945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317724.237761:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317724.237833:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15684
00000100:00100000:1.0:1767317724.237843:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894221824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317724.237867:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317724.238042:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894221824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 197us (2037us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317724.238050:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15684
00000100:00080000:0.0:1767317724.652910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317724.652921:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317724.652925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317724.652929:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317724.652933:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317724.652941:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2969
00000100:00080000:0.0:1767317724.652945:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317724.652952:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317724.653002:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470fd880 x1853163940079488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317724.653063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317724.653067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317724.653069:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317724.653073:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2969
00000100:00080000:0.0:1767317724.653076:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317724.653079:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317724.653097:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38e00 x1853163940079616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317724.653172:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317724.653181:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317724.653183:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317724.653187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2969
00000100:00080000:0.0:1767317724.653189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317724.653192:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317724.653203:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940080128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317724.653218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317724.653220:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317724.653222:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317724.653225:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2969
00000100:00080000:0.0:1767317724.653227:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317724.653231:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317724.653244:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940080384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317724.653276:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940079872:0@lo:400:kworker.0
00000100:00100000:0.0:1767317724.653692:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317724.653737:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317724.653748:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940079744:0@lo:400:kworker.0
00000100:00100000:1.0:1767317724.653959:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940080000:0@lo:400:kworker.0
00000100:00100000:0.0:1767317724.655905:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317724.655993:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940079872
00000100:00100000:0.0:1767317724.656002:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940079872
00000100:00100000:0.0:1767317724.656911:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940079744
00000100:00100000:0.0:1767317724.656919:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940079744
00000100:00100000:0.0:1767317724.656954:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293
00000100:00100000:0.0:1767317724.656966:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940079872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317724.657373:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940079872:12345-0@lo:400:kworker.0 Request processed in 408us (3681us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317724.657383:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293
00000100:00100000:1.0:1767317724.657562:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317724.657623:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940080000
00000100:00100000:1.0:1767317724.657628:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940080000
00000100:00100000:1.0:1767317724.657663:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457
00000100:00100000:1.0:1767317724.657670:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940080000:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317724.657719:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940080000:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317724.657725:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457
00000100:00080000:1.0:1767317724.657743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317724.657762:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940080000:0@lo:400:kworker.0
00000100:00080000:1.0:1767317724.660480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317724.660510:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940079744:0@lo:400:kworker.0
00000100:00100000:0.0:1767317724.660528:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940079872:0@lo:400:kworker.0
00000100:00100000:0.0:1767317725.166633:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317725.167144:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940080512
00000100:00100000:1.0:1767317725.167153:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940080512
00000100:00100000:1.0:1767317725.167207:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798
00000100:00100000:1.0:1767317725.167217:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940080512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317725.167251:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317725.167323:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940080512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (354us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317725.167330:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798
00010000:00010000:0.0:1767317725.617188:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317726.188988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317726.197378:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317727.215433:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317728.237012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317729.262858:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317729.358011:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894222208
00000100:00100000:0.0:1767317729.358028:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894222208
00000100:00100000:0.0:1767317729.358117:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894222080
00000100:00100000:0.0:1767317729.358121:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894222080
00000100:00100000:0.0:1767317729.358151:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3459
00000100:00100000:0.0:1767317729.358176:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894222208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317729.358252:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894222208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (7542us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317729.358259:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3459
00000100:00100000:0.0:1767317729.358276:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15688
00000100:00100000:0.0:1767317729.358280:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894222080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317729.358300:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317729.358331:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894222080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (5188us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317729.358337:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15688
00000100:00100000:0.0:1767317729.773070:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317704/real 1767317704]  req@ffff93cf51ea5500 x1853163940074240/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317729.773104:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51ea5500 x1853163940074240/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767317729.773125:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317729.773134:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767317729.773138:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940074240:0@lo:250:kworker.0
00000100:00100000:1.0:1767317729.774438:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081280
00000100:00100000:1.0:1767317729.774443:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081280
00000100:00100000:1.0:1767317729.774487:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081152
00000100:00100000:1.0:1767317729.774491:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081152
00000100:00100000:1.0:1767317729.774510:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295
00000100:00100000:1.0:1767317729.774517:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317729.774558:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081280:12345-0@lo:400:kworker.0 Request processed in 42us (859us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317729.774564:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295
00000100:00100000:1.0:1767317729.774578:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296
00000100:00100000:1.0:1767317729.774584:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317729.774611:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081152:12345-0@lo:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317729.774617:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296
00000100:00100000:1.0:1767317729.774645:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940081152:0@lo:400:kworker.0
00000100:00100000:1.0:1767317729.774654:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940081280:0@lo:400:kworker.0
00000100:00100000:0.0:1767317729.774754:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940080768:0@lo:250:kworker.0
00000400:00000100:0.0:1767317729.774810:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940080768 offset 0 length 520: 4
00000100:00100000:0.0:1767317729.774834:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940080896:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.774859:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317729.774888:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940081024:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.774927:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317729.774952:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081024
00000100:00100000:0.0:1767317729.774956:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081024
00000100:00100000:0.0:1767317729.774992:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805
00000100:00100000:0.0:1767317729.774997:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940081024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317729.775017:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317729.775046:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940081024:12345-0@lo:38:kworker.0 Request processed in 48us (119us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317729.775053:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805
00000100:00080000:0.0:1767317729.775078:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317729.775082:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317729.775086:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940081024:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.775092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940081536:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.775112:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317729.775131:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940080896
00000100:00100000:0.0:1767317729.775134:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940080896
00000100:00100000:0.0:1767317729.775159:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081536
00000100:00100000:0.0:1767317729.775162:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081536
00000100:00100000:0.0:1767317729.775175:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15689
00000100:00100000:0.0:1767317729.775179:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940080896:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317729.775190:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317729.775218:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940080896:12345-0@lo:38:kworker.0 Request processed in 37us (358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317729.775224:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15689
00000100:00100000:0.0:1767317729.775236:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15690
00000100:00100000:0.0:1767317729.775239:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940081536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317729.775257:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317729.775279:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940081536:12345-0@lo:38:kworker.0 Request processed in 38us (166us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317729.775284:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15690
00000100:00080000:0.0:1767317729.775303:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317729.775307:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317729.775310:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940081536:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.775316:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940081792:0@lo:38:kworker.0
00000100:00100000:0.0:1767317729.775336:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317729.775353:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081792
00000100:00100000:0.0:1767317729.775356:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081792
00000100:00100000:0.0:1767317729.775373:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15691
00000100:00100000:0.0:1767317729.775377:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940081792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317729.775386:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317729.775409:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940081792:12345-0@lo:38:kworker.0 Request processed in 30us (72us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317729.775414:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15691
00000100:00080000:0.0:1767317729.775435:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317729.775439:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317729.775442:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940081792:0@lo:38:kworker.0
00000100:00080000:0.0:1767317729.775463:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317729.775466:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317729.775469:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940080896:0@lo:38:kworker.0
00000100:00100000:0.0:1767317730.286079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317730.290570:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317730.290596:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940081920:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317730.290683:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317730.291090:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940081920
00000100:00100000:1.0:1767317730.291101:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940081920
00000100:00100000:1.0:1767317730.291160:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800
00000100:00100000:1.0:1767317730.291171:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317730.291201:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317730.291258:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940081920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (575us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317730.291281:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800
00010000:00010000:0.0:1767317730.732998:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317731.309155:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317731.316456:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317731.316489:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940082048:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317731.316562:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317731.316765:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940082048
00000100:00100000:0.0:1767317731.316807:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940082048
00000100:00100000:0.0:1767317731.316875:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801
00000100:00100000:0.0:1767317731.316884:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940082048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317731.316916:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317731.317346:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940082048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 463us (784us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317731.317354:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801
00000100:00100000:1.0:1767317731.317444:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940082048:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317732.333240:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317733.357007:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317734.473576:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317734.473584:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767317734.893093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317734.893105:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317734.893109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317734.893113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317734.893119:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317734.893128:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2979
00000100:00080000:0.0:1767317734.893142:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317734.893150:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317734.893197:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0a80 x1853163940082176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317734.893215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317734.893245:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317734.893247:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317734.893251:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2979
00000100:00080000:0.0:1767317734.893253:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317734.893258:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317734.893273:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2680 x1853163940082304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317734.893346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317734.893350:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317734.893352:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317734.893355:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2979
00000100:00080000:0.0:1767317734.893358:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317734.893363:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317734.893374:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5880 x1853163940082816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317734.893392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317734.893395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317734.893397:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317734.893400:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2979
00000100:00080000:0.0:1767317734.893403:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317734.893406:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317734.893416:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf100 x1853163940083072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317734.895232:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464
00000100:00100000:1.0:1767317734.895242:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940082688:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767317734.895408:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767317734.895422:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767317734.895424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317734.901257:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940082688:12345-0@lo:400:kworker.0 Request processed in 6008us (6341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317734.901269:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464
00000100:00100000:0.0:1767317735.405244:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083200
00000100:00100000:0.0:1767317735.405253:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083200
00000100:00100000:0.0:1767317735.405315:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802
00000100:00100000:0.0:1767317735.405325:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940083200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317735.405361:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317735.405943:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940083200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 617us (777us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317735.405952:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802
00010000:00010000:0.0:1767317735.852967:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317736.429071:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317736.429098:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940083328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317736.429178:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317736.429325:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083328
00000100:00100000:1.0:1767317736.429334:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083328
00000100:00100000:1.0:1767317736.429420:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803
00000100:00100000:1.0:1767317736.429430:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940083328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317736.429462:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317736.429515:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940083328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317736.429523:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803
00000100:00100000:1.0:1767317736.429572:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940083328:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317736.429655:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317736.430726:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317737.456033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317738.476973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317739.500958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317739.598539:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317739.598792:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317739.599274:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15696
00000100:00100000:1.0:1767317739.599281:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894222592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317739.599304:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317739.599330:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894222592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (807us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767317739.599384:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317739.616503:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15696
00000100:00080000:0.0:1767317740.012976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317740.012989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317740.012993:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317740.012997:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317740.013003:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317740.013013:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2984
00000100:00080000:0.0:1767317740.013039:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317740.013048:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317740.013097:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705aa00 x1853163940083456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317740.013127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317740.013131:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317740.013133:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317740.013136:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2984
00000100:00080000:0.0:1767317740.013138:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317740.013142:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317740.013156:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940083584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317740.013236:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940083712:0@lo:400:kworker.0
00000100:00080000:0.0:1767317740.013238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317740.013244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317740.013247:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317740.013252:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2984
00000100:00080000:0.0:1767317740.013254:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317740.013259:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317740.013273:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940084096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317740.013292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317740.013296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317740.013298:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317740.013302:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2984
00000100:00080000:0.0:1767317740.013316:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317740.013321:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317740.013329:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317740.013338:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940084352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317740.013370:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940084224:0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013411:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317740.013418:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317740.013422:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940083840:0@lo:400:kworker.0
00000100:00100000:0.0:1767317740.013454:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317740.013461:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940083968:0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013468:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317740.013498:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317740.013511:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083712
00000100:00100000:1.0:1767317740.013519:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083712
00000100:00100000:0.0:1767317740.013550:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084224
00000100:00100000:0.0:1767317740.013556:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084224
00000100:00100000:1.0:1767317740.013579:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083840
00000100:00100000:1.0:1767317740.013584:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083840
00000100:00100000:0.0:1767317740.013599:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083968
00000100:00100000:0.0:1767317740.013603:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083968
00000100:00100000:1.0:1767317740.013619:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299
00000100:00100000:1.0:1767317740.013630:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940083712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317740.013635:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466
00000100:00100000:0.0:1767317740.013645:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940084224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013683:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940083712:12345-0@lo:400:kworker.0 Request processed in 56us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317740.013692:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299
00000100:00100000:0.0:1767317740.013698:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940084224:12345-0@lo:400:kworker.0 Request processed in 54us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317740.013705:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466
00000100:00100000:1.0:1767317740.013716:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300
00000100:00100000:0.0:1767317740.013728:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467
00000100:00100000:1.0:1767317740.013729:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940083840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317740.013741:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940083968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013770:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940083840:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317740.013807:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940083968:12345-0@lo:400:kworker.0 Request processed in 69us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317740.013807:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300
00000100:00100000:0.0:1767317740.013818:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467
00000100:00080000:1.0:1767317740.013839:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317740.013844:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317740.013846:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317740.013881:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940083968:0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013892:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940083840:0@lo:400:kworker.0
00000100:00100000:0.0:1767317740.013898:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940084224:0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.013906:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940083712:0@lo:400:kworker.0
00000100:00100000:1.0:1767317740.014306:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940083584
00000100:00100000:1.0:1767317740.014318:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940083584
00000100:00100000:1.0:1767317740.014348:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807
00000100:00100000:1.0:1767317740.014358:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940083584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317740.014382:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317740.014445:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940083584:12345-0@lo:38:kworker.0 Request processed in 88us (188us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317740.014727:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807
00000100:00100000:1.0:1767317740.525354:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084480
00000100:00100000:1.0:1767317740.525362:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084480
00000100:00100000:1.0:1767317740.525411:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804
00000100:00100000:1.0:1767317740.525421:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940084480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317740.525450:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317740.525504:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940084480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317740.525512:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804
00010000:00010000:0.0:1767317740.973670:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317741.549807:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317741.549829:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940084608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317741.549909:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317741.550026:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084608
00000100:00100000:0.0:1767317741.550034:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084608
00000100:00100000:0.0:1767317741.550085:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805
00000100:00100000:0.0:1767317741.550094:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940084608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317741.550125:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317741.550172:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940084608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (262us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317741.550179:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805
00000100:00100000:1.0:1767317741.550266:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940084608:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317744.712356:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894222976
00000100:00100000:0.0:1767317744.712367:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894222976
00000100:00100000:0.0:1767317744.712457:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3468
00000100:00100000:0.0:1767317744.712468:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894222976:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767317744.712481:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317744.712556:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894222976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317744.712564:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3468
00000100:00100000:0.0:1767317744.714674:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317745.135437:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940084992:0@lo:400:kworker.0
00000100:00100000:0.0:1767317745.135548:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940084736:0@lo:38:kworker.0
00000100:00100000:1.0:1767317745.148236:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317745.148569:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940085504:0@lo:400:kworker.0
00000100:00100000:1.0:1767317745.148585:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940085248:0@lo:400:kworker.0
00000100:00080000:1.0:1767317745.148621:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317745.148675:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084992
00000100:00100000:1.0:1767317745.148681:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084992
00000100:00100000:1.0:1767317745.148734:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301
00000100:00100000:1.0:1767317745.148742:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940084992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317745.148841:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940084992:12345-0@lo:400:kworker.0 Request processed in 98us (613us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317745.148848:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301
00000100:00080000:1.0:1767317745.148870:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317745.148887:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940084992:0@lo:400:kworker.0
00000100:00100000:0.0:1767317745.152620:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317745.152681:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940084864:0@lo:38:kworker.0
00000100:00100000:0.0:1767317745.152724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317745.152748:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940085376:0@lo:38:kworker.0
00000100:00100000:0.0:1767317745.152769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317745.152806:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940085632:0@lo:38:kworker.0
00000100:00100000:0.0:1767317745.152841:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317745.152910:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084864
00000100:00100000:0.0:1767317745.152918:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084864
00000100:00100000:0.0:1767317745.152955:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808
00000100:00100000:0.0:1767317745.152963:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940084864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317745.152985:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317745.153030:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940084864:12345-0@lo:38:kworker.0 Request processed in 66us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317745.153037:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808
00000100:00100000:0.0:1767317745.153062:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940084736
00000100:00100000:0.0:1767317745.153066:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940084736
00000100:00100000:0.0:1767317745.153084:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940085376
00000100:00100000:0.0:1767317745.153087:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940085376
00000100:00100000:0.0:1767317745.153098:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940085632
00000100:00100000:0.0:1767317745.153100:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940085632
00000100:00100000:0.0:1767317745.153109:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15701
00000100:00100000:0.0:1767317745.153113:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940084736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317745.153123:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317745.153149:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940084736:12345-0@lo:38:kworker.0 Request processed in 33us (536us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317745.153155:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15701
00000100:00100000:0.0:1767317745.153166:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15702
00000100:00100000:0.0:1767317745.153169:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940085376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317745.153178:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317745.153201:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940085376:12345-0@lo:38:kworker.0 Request processed in 30us (430us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317745.153206:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15702
00000100:00100000:0.0:1767317745.153216:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15703
00000100:00100000:0.0:1767317745.153228:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940085632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317745.153238:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317745.153263:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940085632:12345-0@lo:38:kworker.0 Request processed in 35us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317745.153269:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15703
00000100:00080000:0.0:1767317745.153316:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317745.153321:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317745.153325:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940084736:0@lo:38:kworker.0
00000100:00080000:0.0:1767317745.153334:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317745.153337:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317745.153339:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940084864:0@lo:38:kworker.0
00000100:00080000:0.0:1767317745.153346:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317745.153349:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317745.153351:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940085376:0@lo:38:kworker.0
00000100:00080000:0.0:1767317745.153357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317745.153360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317745.153362:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940085632:0@lo:38:kworker.0
00000100:00100000:1.0:1767317745.154135:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940085120
00000100:00100000:1.0:1767317745.154140:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940085120
00000100:00100000:1.0:1767317745.154246:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302
00000100:00100000:1.0:1767317745.154254:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317745.154310:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085120:12345-0@lo:400:kworker.0 Request processed in 57us (391us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317745.154316:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302
00000100:00100000:0.0:1767317745.154357:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940085120:0@lo:400:kworker.0
00000100:00100000:0.0:1767317745.648737:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317745.650833:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940085760:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317745.650921:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317745.651413:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940085760
00000100:00100000:1.0:1767317745.651433:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940085760
00000100:00100000:1.0:1767317745.651491:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806
00000100:00100000:1.0:1767317745.651501:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317745.651537:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317745.651593:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (672us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317745.651600:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806
00010000:00010000:0.0:1767317746.093161:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317746.669711:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940085888:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317746.669799:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317746.670276:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940085888
00000100:00100000:0.0:1767317746.670287:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940085888
00000100:00100000:0.0:1767317746.670357:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807
00000100:00100000:0.0:1767317746.670366:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317746.670401:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317746.670465:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940085888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (665us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317746.670472:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807
00000100:00100000:0.0:1767317748.718500:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317749.741082:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317749.831724:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894223360
00000100:00100000:1.0:1767317749.831749:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894223360
00000100:00100000:1.0:1767317749.831881:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894223232
00000100:00100000:1.0:1767317749.831885:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894223232
00000100:00100000:1.0:1767317749.831906:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3471
00000100:00100000:1.0:1767317749.831916:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894223360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317749.831992:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894223360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (427us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317749.831999:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3471
00000100:00100000:1.0:1767317749.832018:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15704
00000100:00100000:1.0:1767317749.832023:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894223232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317749.832045:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317749.832071:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894223232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (431us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317749.832077:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15704
00000100:00100000:0.0:1767317750.256973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940086016:0@lo:38:kworker.0
00000100:00100000:0.0:1767317750.257004:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317750.257026:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940086144:0@lo:38:kworker.0
00000100:00100000:0.0:1767317750.257051:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317750.257068:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940086656:0@lo:38:kworker.0
00000100:00100000:0.0:1767317750.257086:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317750.257099:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940086912:0@lo:38:kworker.0
00000100:00100000:0.0:1767317750.257117:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317750.257148:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940086144
00000100:00100000:0.0:1767317750.257152:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940086144
00000100:00100000:0.0:1767317750.257175:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809
00000100:00100000:0.0:1767317750.257179:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940086144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317750.257197:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317750.257229:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940086144:12345-0@lo:38:kworker.0 Request processed in 48us (177us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317750.257234:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809
00000100:00080000:0.0:1767317750.257263:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317750.257267:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317750.257279:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940086144:0@lo:38:kworker.0
00000100:00100000:1.0:1767317750.257920:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940086016
00000100:00100000:1.0:1767317750.257925:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940086016
00000100:00100000:1.0:1767317750.257943:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940086656
00000100:00100000:1.0:1767317750.257946:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940086656
00000100:00100000:1.0:1767317750.257955:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940086912
00000100:00100000:1.0:1767317750.257957:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940086912
00000100:00100000:1.0:1767317750.257966:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15705
00000100:00100000:1.0:1767317750.257971:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317750.257982:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317750.258013:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086016:12345-0@lo:38:kworker.0 Request processed in 41us (1008us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317750.258018:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15705
00000100:00100000:1.0:1767317750.258030:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15706
00000100:00100000:1.0:1767317750.258041:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317750.258050:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317750.258073:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086656:12345-0@lo:38:kworker.0 Request processed in 32us (986us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317750.258078:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15706
00000100:00100000:1.0:1767317750.258091:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15707
00000100:00100000:1.0:1767317750.258094:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317750.258103:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317750.258124:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940086912:12345-0@lo:38:kworker.0 Request processed in 28us (1006us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317750.258129:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15707
00000100:00080000:0.0:1767317750.258499:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317750.258503:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317750.258506:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940086016:0@lo:38:kworker.0
00000100:00080000:0.0:1767317750.258514:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317750.258517:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317750.258520:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940086656:0@lo:38:kworker.0
00000100:00080000:0.0:1767317750.258528:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317750.258531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317750.258534:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940086912:0@lo:38:kworker.0
00000100:00100000:0.0:1767317750.764915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317750.767862:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940087040
00000100:00100000:1.0:1767317750.767872:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940087040
00000100:00100000:1.0:1767317750.767932:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808
00000100:00100000:1.0:1767317750.767941:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940087040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317750.767972:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317750.768042:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940087040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (1433us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317750.768049:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808
00010000:00010000:0.0:1767317751.215071:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317751.789190:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940087168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317751.789265:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317751.789957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317752.812928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317753.837156:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317754.349243:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317754.349249:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767317754.349253:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317754.349258:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 2979
00000100:00080000:0.0:1767317754.349262:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317754.349268:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317754.349315:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219e300 x1853163940087296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317754.349478:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317754.349482:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317754.349499:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317754.349503:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3000
00000100:00080000:0.0:1767317754.349505:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317754.349509:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317754.349524:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d180 x1853163940087424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317754.350149:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317754.350154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317754.350157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940087424:0@lo:38:kworker.0
00000100:00080000:0.0:1767317754.350359:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317754.350363:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317754.350365:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317754.350368:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3000
00000100:00080000:0.0:1767317754.350371:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317754.350375:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317754.350390:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d500 x1853163940087552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317754.350440:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317754.350443:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317754.350445:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317754.350449:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3000
00000100:00080000:0.0:1767317754.350451:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317754.350455:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317754.350466:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af800 x1853163940088064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317754.350481:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317754.350484:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317754.350491:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317754.350495:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3000
00000100:00080000:0.0:1767317754.350497:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317754.350500:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317754.350511:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940088320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317754.350536:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940087808:0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.350567:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317754.350591:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317754.350597:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940087680:0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.350616:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317754.350644:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940087808
00000100:00100000:0.0:1767317754.350648:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940087808
00000100:00100000:0.0:1767317754.350697:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940087680
00000100:00100000:0.0:1767317754.350701:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940087680
00000100:00100000:0.0:1767317754.350831:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305
00000100:00100000:0.0:1767317754.350851:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940087808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.350895:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940087808:12345-0@lo:400:kworker.0 Request processed in 57us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317754.350902:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305
00000100:00100000:0.0:1767317754.350916:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306
00000100:00100000:0.0:1767317754.350935:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940087680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.350964:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940087680:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317754.350970:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306
00000100:00100000:0.0:1767317754.351007:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940087680:0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.351025:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940087808:0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.351044:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940087936:0@lo:400:kworker.0
00000100:00100000:0.0:1767317754.351069:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317754.351114:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940087552:0@lo:38:kworker.0
00000100:00100000:1.0:1767317754.351147:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317754.351170:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940088064:0@lo:38:kworker.0
00000100:00100000:1.0:1767317754.351197:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940087552
00000100:00100000:1.0:1767317754.351201:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940087552
00000100:00100000:1.0:1767317754.351224:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810
00000100:00100000:1.0:1767317754.351228:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940087552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317754.351242:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317754.351271:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940087552:12345-0@lo:38:kworker.0 Request processed in 42us (124us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317754.351277:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810
00000100:00100000:1.0:1767317754.351316:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940088192:0@lo:400:kworker.0
00000100:00080000:1.0:1767317754.351350:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317754.351354:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317754.352122:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317754.352851:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940088064
00000100:00100000:1.0:1767317754.352855:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940088064
00000100:00100000:1.0:1767317754.352879:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15709
00000100:00100000:1.0:1767317754.352884:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940088064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317754.352900:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317754.353135:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940088064:12345-0@lo:38:kworker.0 Request processed in 250us (457us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317754.353143:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15709
00000100:00080000:1.0:1767317754.353170:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317754.353368:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940088320
00000100:00100000:1.0:1767317754.353372:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940088320
00000100:00100000:1.0:1767317754.353400:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15710
00000100:00100000:1.0:1767317754.353404:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940088320:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317754.353422:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317754.353451:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940088320:12345-0@lo:38:kworker.0 Request processed in 45us (193us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317754.353457:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15710
00000100:00100000:0.0:1767317754.354146:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940088192:0@lo:400:kworker.0
00000100:00100000:1.0:1767317754.860952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317754.951319:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317754.951406:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767317754.952159:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317755.885882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317756.336351:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317756.911406:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317757.933042:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317758.957150:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317759.470536:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940089088:0@lo:400:kworker.0
00000100:00100000:1.0:1767317759.470574:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317759.470711:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940088704:0@lo:38:kworker.0
00000100:00100000:0.0:1767317759.470741:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317759.470770:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940088832:0@lo:38:kworker.0
00000100:00100000:0.0:1767317759.470821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317759.470838:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940089344:0@lo:38:kworker.0
00000100:00100000:0.0:1767317759.470857:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317759.470874:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940089600:0@lo:38:kworker.0
00000100:00100000:0.0:1767317759.470893:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317759.470921:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940089088
00000100:00100000:0.0:1767317759.470925:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940089088
00000100:00100000:0.0:1767317759.470963:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940088960
00000100:00100000:0.0:1767317759.470966:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940088960
00000100:00100000:0.0:1767317759.470987:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307
00000100:00100000:0.0:1767317759.470993:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940089088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317759.471023:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940089088:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317759.471035:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307
00000100:00100000:0.0:1767317759.471046:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308
00000100:00100000:0.0:1767317759.471051:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940088960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317759.471082:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940088960:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317759.471087:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308
00000100:00100000:0.0:1767317759.471111:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940088704
00000100:00100000:0.0:1767317759.471114:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940088704
00000100:00100000:0.0:1767317759.471132:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940089344
00000100:00100000:0.0:1767317759.471134:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940089344
00000100:00100000:0.0:1767317759.471144:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940089600
00000100:00100000:0.0:1767317759.471146:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940089600
00000100:00100000:0.0:1767317759.471159:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15712
00000100:00100000:0.0:1767317759.471163:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940088704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317759.471181:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317759.471212:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940088704:12345-0@lo:38:kworker.0 Request processed in 48us (470us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317759.471219:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15712
00000100:00100000:0.0:1767317759.471229:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15713
00000100:00100000:0.0:1767317759.471233:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940089344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317759.471242:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317759.471261:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940089344:12345-0@lo:38:kworker.0 Request processed in 27us (403us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317759.471266:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15713
00000100:00100000:0.0:1767317759.471275:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15714
00000100:00100000:0.0:1767317759.471278:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940089600:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317759.471293:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317759.471313:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940089600:12345-0@lo:38:kworker.0 Request processed in 33us (419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317759.471319:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15714
00000100:00080000:0.0:1767317759.471338:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317759.471340:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767317759.471357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317759.471362:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317759.471365:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940088704:0@lo:38:kworker.0
00000100:00080000:0.0:1767317759.471372:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317759.471374:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317759.471376:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940089344:0@lo:38:kworker.0
00000100:00080000:0.0:1767317759.471382:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317759.471385:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317759.471387:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940089600:0@lo:38:kworker.0
00000100:00100000:1.0:1767317759.473291:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940089088:0@lo:400:kworker.0
00000100:00100000:0.0:1767317759.980992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317760.070582:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894223872
00000100:00100000:1.0:1767317760.070591:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894223872
00000100:00100000:1.0:1767317760.070649:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894223744
00000100:00100000:1.0:1767317760.070651:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894223744
00000100:00100000:1.0:1767317760.070664:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3479
00000100:00100000:1.0:1767317760.070671:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894223872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317760.070759:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894223872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317760.070765:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3479
00000100:00100000:1.0:1767317760.070804:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15715
00000100:00100000:1.0:1767317760.070815:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894223744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317760.070836:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317760.070860:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894223744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (333us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317760.070884:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15715
00000100:00080000:0.0:1767317760.071812:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317761.005234:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317761.005882:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940089728
00000100:00100000:0.0:1767317761.005891:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940089728
00000100:00100000:0.0:1767317761.005959:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812
00000100:00100000:0.0:1767317761.005968:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940089728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317761.006005:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317761.006062:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940089728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (261us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317761.006085:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812
00000100:00080000:1.0:1767317761.006229:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317761.454321:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317762.028915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317762.029151:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317762.029170:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940089856:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317762.029251:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317762.029729:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940089856:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317762.029767:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317763.053260:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317764.076928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317764.590001:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317764.590019:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940090368:0@lo:400:kworker.0
00000100:00100000:1.0:1767317764.590052:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317764.590086:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317764.590091:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940090240:0@lo:400:kworker.0
00000100:00100000:1.0:1767317764.590111:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317764.590136:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940090368
00000100:00100000:1.0:1767317764.590140:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940090368
00000100:00100000:1.0:1767317764.590172:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940090240
00000100:00100000:1.0:1767317764.590175:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940090240
00000100:00100000:1.0:1767317764.590196:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309
00000100:00100000:1.0:1767317764.590203:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940090368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317764.590235:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940090368:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317764.590241:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309
00000100:00100000:1.0:1767317764.590253:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310
00000100:00100000:1.0:1767317764.590258:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940090240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317764.590281:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940090240:12345-0@lo:400:kworker.0 Request processed in 23us (169us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317764.590286:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310
00000100:00080000:1.0:1767317764.590320:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317764.590323:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317764.590345:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940090240:0@lo:400:kworker.0
00000100:00100000:1.0:1767317764.590354:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940090368:0@lo:400:kworker.0
00000100:00100000:0.0:1767317764.590680:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940089984:0@lo:38:kworker.0
00000100:00100000:0.0:1767317764.590712:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317764.590738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940090112:0@lo:38:kworker.0
00000100:00100000:0.0:1767317764.590761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317764.590810:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940090624:0@lo:38:kworker.0
00000100:00100000:0.0:1767317764.590833:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317764.590850:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940090880:0@lo:38:kworker.0
00000100:00100000:0.0:1767317764.590868:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317764.590899:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940089984
00000100:00100000:0.0:1767317764.590903:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940089984
00000100:00100000:0.0:1767317764.590924:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940090624
00000100:00100000:0.0:1767317764.590927:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940090624
00000100:00100000:0.0:1767317764.590938:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940090880
00000100:00100000:0.0:1767317764.590940:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940090880
00000100:00100000:0.0:1767317764.590952:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15716
00000100:00100000:0.0:1767317764.590957:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940089984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317764.590974:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317764.591005:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940089984:12345-0@lo:38:kworker.0 Request processed in 47us (292us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317764.591018:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15716
00000100:00100000:0.0:1767317764.591031:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15717
00000100:00100000:0.0:1767317764.591034:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940090624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317764.591044:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317764.591067:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940090624:12345-0@lo:38:kworker.0 Request processed in 31us (233us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317764.591072:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15717
00000100:00100000:0.0:1767317764.591083:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15718
00000100:00100000:0.0:1767317764.591086:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940090880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317764.591095:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317764.591115:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940090880:12345-0@lo:38:kworker.0 Request processed in 28us (247us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317764.591120:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15718
00000100:00080000:0.0:1767317764.591151:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317764.591156:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317764.591159:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940089984:0@lo:38:kworker.0
00000100:00080000:0.0:1767317764.591167:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317764.591170:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317764.591173:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940090624:0@lo:38:kworker.0
00000100:00080000:0.0:1767317764.591180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317764.591183:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317764.591186:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940090880:0@lo:38:kworker.0
00000100:00100000:1.0:1767317765.100895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317765.190314:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894224128
00000100:00100000:0.0:1767317765.190341:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894224128
00000100:00100000:0.0:1767317765.190419:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894224000
00000100:00100000:0.0:1767317765.190423:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894224000
00000100:00100000:0.0:1767317765.190444:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3482
00000100:00100000:0.0:1767317765.190453:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894224128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317765.190534:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894224128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (423us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317765.190541:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3482
00000100:00100000:0.0:1767317765.190560:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15719
00000100:00100000:0.0:1767317765.190564:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894224000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317765.190583:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317765.190607:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894224000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (443us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317765.190613:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15719
00000100:00100000:1.0:1767317766.125020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317766.126093:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940091008
00000100:00100000:0.0:1767317766.126102:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940091008
00000100:00100000:0.0:1767317766.126172:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814
00000100:00100000:0.0:1767317766.126181:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940091008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317766.126212:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317766.126275:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940091008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1090us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317766.126283:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814
00010000:00010000:0.0:1767317766.573710:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317767.148920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317768.172909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317769.196898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317769.709168:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940091520:0@lo:400:kworker.0
00000100:00100000:0.0:1767317769.709248:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317769.713542:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940091520:0@lo:400:kworker.0
00000100:00100000:1.0:1767317770.220914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317770.311397:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317770.311479:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767317770.312350:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317771.244933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317771.245076:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940092288:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317771.245162:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317771.245650:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317771.245679:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940092288:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317771.694741:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317772.269191:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317772.269361:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317772.272482:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940092416:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317772.272598:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317772.279293:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940092416:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317772.280317:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317773.293726:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317774.317383:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317774.408269:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894224640
00000100:00100000:1.0:1767317774.408276:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894224640
00000100:00100000:1.0:1767317774.408310:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15724
00000100:00100000:1.0:1767317774.408318:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894224640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317774.408345:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317774.408949:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894224640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 631us (879us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317774.408957:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15724
00000100:00080000:0.0:1767317774.411694:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317774.832186:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940092800:0@lo:400:kworker.0
00000100:00100000:0.0:1767317774.832220:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317774.832276:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940092928:0@lo:400:kworker.0
00000100:00080000:1.0:1767317774.832317:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317774.852137:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940093056:0@lo:400:kworker.0
00000100:00100000:1.0:1767317774.852158:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940093312:0@lo:400:kworker.0
00000100:00100000:1.0:1767317774.852233:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317774.852321:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940092800
00000100:00100000:1.0:1767317774.852329:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940092800
00000100:00100000:1.0:1767317774.852380:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940092928
00000100:00100000:1.0:1767317774.852384:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940092928
00000100:00100000:1.0:1767317774.852406:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313
00000100:00100000:1.0:1767317774.852413:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940092800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317774.852485:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940092800:12345-0@lo:400:kworker.0 Request processed in 73us (20264us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317774.852493:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313
00000100:00100000:1.0:1767317774.852510:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314
00000100:00100000:1.0:1767317774.852516:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940092928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317774.853471:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940092928:12345-0@lo:400:kworker.0 Request processed in 954us (1237us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317774.853478:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314
00000100:00100000:0.0:1767317774.884919:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940092544
00000100:00100000:0.0:1767317774.884936:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940092544
00000100:00100000:0.0:1767317774.885001:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940093184
00000100:00100000:0.0:1767317774.885006:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940093184
00000100:00100000:0.0:1767317774.885029:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15725
00000100:00100000:0.0:1767317774.885036:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940092544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317774.885060:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317774.885136:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940092544:12345-0@lo:38:kworker.0 Request processed in 99us (52723us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317774.885144:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15725
00000100:00100000:0.0:1767317774.885159:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15726
00000100:00100000:0.0:1767317774.885164:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940093184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317774.885173:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317774.885214:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940093184:12345-0@lo:38:kworker.0 Request processed in 49us (17551us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317774.885220:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15726
00000100:00100000:1.0:1767317774.890679:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940093440
00000100:00100000:1.0:1767317774.890688:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940093440
00000100:00100000:1.0:1767317774.890732:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15727
00000100:00100000:1.0:1767317774.890740:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940093440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317774.890763:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317774.890844:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940093440:12345-0@lo:38:kworker.0 Request processed in 103us (9714us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317774.890851:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15727
00000100:00100000:0.0:1767317775.340962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317776.365014:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317776.365437:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940093568:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317776.365658:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:3.0:1767317776.366166:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317776.366238:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940093568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317776.366247:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818
00010000:00010000:0.0:1767317776.813950:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317777.390149:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317777.390667:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940093696
00000100:00100000:0.0:1767317777.390677:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940093696
00000100:00100000:0.0:1767317777.390746:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819
00000100:00100000:0.0:1767317777.390756:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940093696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317777.390813:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317777.390870:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940093696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (602us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317777.390926:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940093696:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317777.391064:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819
00000100:00100000:1.0:1767317778.412907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317779.436907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317779.532623:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894225024
00000100:00100000:3.0:1767317779.532635:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894225024
00000100:00100000:3.0:1767317779.532729:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3489
00000100:00100000:3.0:1767317779.532744:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894225024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317779.532861:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894225024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 122us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317779.532871:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3489
00000100:00100000:0.0:1767317779.536331:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894224896
00000100:00100000:0.0:1767317779.536350:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894224896
00000100:00100000:0.0:1767317779.536395:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15728
00000100:00100000:0.0:1767317779.536402:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894224896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317779.536426:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317779.536494:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894224896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 90us (283us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317779.536502:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15728
00000100:00100000:3.0:1767317779.949967:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940093824:0@lo:38:kworker.0
00000100:00100000:3.0:1767317779.950035:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940094592
00000100:00100000:3.0:1767317779.950043:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940094592
00000100:00100000:3.0:1767317779.950105:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490
00000100:00100000:3.0:1767317779.950116:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940094592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317779.950181:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940094592:12345-0@lo:400:kworker.0 Request processed in 66us (185us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317779.950191:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490
00000100:00100000:3.0:1767317779.950486:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940094592:0@lo:400:kworker.0
00000100:00100000:3.0:1767317779.950528:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940094336:0@lo:400:kworker.0
00000100:00100000:3.0:1767317779.950565:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940093824
00000100:00100000:3.0:1767317779.950570:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940093824
00000100:00100000:3.0:1767317779.950602:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940094464
00000100:00100000:3.0:1767317779.950607:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940094464
00000100:00100000:3.0:1767317779.950770:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15731
00000100:00100000:3.0:1767317779.950867:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940094720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317779.950884:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317779.950913:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940094720:12345-0@lo:38:kworker.0 Request processed in 46us (498us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317779.950986:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940094080:0@lo:400:kworker.0
00000100:00100000:0.0:1767317779.951017:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317779.951051:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317779.951057:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940094208:0@lo:400:kworker.0
00000100:00100000:0.0:1767317779.951078:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317779.951122:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940094080
00000100:00100000:0.0:1767317779.951126:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940094080
00000100:00100000:0.0:1767317779.951159:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940094208
00000100:00100000:0.0:1767317779.951162:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940094208
00000100:00100000:0.0:1767317779.951184:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315
00000100:00100000:0.0:1767317779.951190:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940094080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317779.951239:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940094080:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317779.951246:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315
00000100:00100000:0.0:1767317779.951267:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316
00000100:00100000:0.0:1767317779.951275:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940094208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317779.951302:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940094208:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317779.951308:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316
00000100:00080000:1.0:1767317779.951694:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317779.951698:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317779.951721:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940094208:0@lo:400:kworker.0
00000100:00100000:1.0:1767317779.951731:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0458bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940094080:0@lo:400:kworker.0
00000100:00100000:3.0:1767317779.957007:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15731
00000100:00100000:1.0:1767317780.461113:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317780.975233:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317780.975239:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767317780.975242:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317780.975247:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3004
00000100:00080000:0.0:1767317780.975386:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317780.975393:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317780.975713:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50aded80 x1853163940094848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317780.975921:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317780.975925:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317780.975943:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317780.975947:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3029
00000100:00080000:0.0:1767317780.975949:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317780.975953:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317780.975970:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940094976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317780.976158:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940094976
00000100:00100000:3.0:1767317780.976165:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940094976
00000100:00100000:3.0:1767317780.976205:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15732
00000100:00100000:3.0:1767317780.976212:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940094976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317780.976231:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317780.976839:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940094976:12345-0@lo:38:kworker.0 Request processed in 624us (768us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317780.976847:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15732
00000100:00080000:1.0:1767317780.976924:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317780.976930:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317780.976933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940094976:0@lo:38:kworker.0
00000100:00080000:0.0:1767317780.977046:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317780.977051:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317780.977052:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317780.977056:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3029
00000100:00080000:0.0:1767317780.977059:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317780.977063:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317780.977082:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940095104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317780.977128:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940095104:0@lo:38:kworker.0
00000100:00100000:1.0:1767317780.977161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317780.977873:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317780.977877:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317780.977879:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317780.977883:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3029
00000100:00080000:0.0:1767317780.977886:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317780.977891:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317780.977908:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adc000 x1853163940095616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317780.977955:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940095232:0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.977989:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317780.978014:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317780.978019:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940095360:0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978038:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317780.978085:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940095232
00000100:00100000:3.0:1767317780.978089:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940095232
00000100:00100000:3.0:1767317780.978122:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940095360
00000100:00100000:3.0:1767317780.978125:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940095360
00000100:00100000:3.0:1767317780.978146:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317
00000100:00100000:3.0:1767317780.978152:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940095232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978197:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940095232:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317780.978204:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317
00000100:00100000:3.0:1767317780.978234:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318
00000100:00100000:3.0:1767317780.978240:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940095360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978283:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940095360:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317780.978289:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318
00000100:00100000:3.0:1767317780.978337:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940095360:0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978346:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940095232:0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978370:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767317780.978378:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940095488:0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978415:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317780.978443:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940095488
00000100:00100000:3.0:1767317780.978446:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940095488
00000100:00100000:3.0:1767317780.978470:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492
00000100:00100000:3.0:1767317780.978883:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940095488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317780.978922:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940095488:12345-0@lo:400:kworker.0 Request processed in 447us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317780.978928:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492
00000100:00100000:3.0:1767317780.978955:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940095488:0@lo:400:kworker.0
00000100:00100000:1.0:1767317780.979573:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940095616:0@lo:38:kworker.0
00000100:00100000:1.0:1767317780.979747:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317780.979830:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940095616
00000100:00100000:3.0:1767317780.979835:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940095616
00000100:00100000:3.0:1767317780.979863:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15733
00000100:00100000:3.0:1767317780.979868:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940095616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317780.979887:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317780.979918:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940095616:12345-0@lo:38:kworker.0 Request processed in 49us (171us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317780.979938:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15733
00000100:00080000:0.0:1767317780.980153:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317780.980157:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317780.980166:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317780.980170:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3029
00000100:00080000:0.0:1767317780.980173:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317780.980177:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317780.980196:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058a80 x1853163940095872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317780.980571:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940095744
00000100:00100000:0.0:1767317780.980575:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940095744
00000100:00100000:0.0:1767317780.980629:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493
00000100:00100000:0.0:1767317780.980635:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940095744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317780.980673:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940095744:12345-0@lo:400:kworker.0 Request processed in 38us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317780.980678:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493
00000100:00080000:1.0:1767317780.981104:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317780.981109:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317780.981113:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940095104:0@lo:38:kworker.0
00000100:00100000:1.0:1767317780.981130:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940095872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317780.981158:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317780.981177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317780.981180:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317780.981183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940095616:0@lo:38:kworker.0
00000100:00080000:1.0:1767317780.981722:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317780.981726:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317780.981729:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940095872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317781.485105:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317781.485675:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317781.485694:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940096000:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317781.485769:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317781.486150:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940096000
00000100:00100000:0.0:1767317781.486159:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940096000
00000100:00100000:0.0:1767317781.486239:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820
00000100:00100000:0.0:1767317781.486259:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940096000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317781.486291:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317781.486353:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940096000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (583us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317781.486360:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820
00000100:00080000:1.0:1767317781.486554:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317781.487103:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0458bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940096000:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317781.932985:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317782.508989:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317782.512741:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317782.517309:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940096128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317782.517403:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317782.517999:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0458bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940096128:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317782.518254:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317783.534277:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317784.559511:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317784.646965:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317784.647276:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767317784.648056:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317785.581095:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317786.092960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317786.092970:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317786.092973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317786.092977:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317786.092981:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317786.092991:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3031
00000100:00080000:0.0:1767317786.093009:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317786.093017:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317786.093061:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940096256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317786.093083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317786.093087:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317786.093088:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317786.093092:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3031
00000100:00080000:0.0:1767317786.093094:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317786.093098:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317786.093111:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058a80 x1853163940096384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317786.093165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317786.093168:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317786.093170:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317786.093174:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3031
00000100:00080000:0.0:1767317786.093176:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317786.093180:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317786.093212:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38700 x1853163940096896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317786.093228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317786.093231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317786.093233:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317786.093236:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3031
00000100:00080000:0.0:1767317786.093239:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317786.093242:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317786.094249:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09c00 x1853163940097152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317786.094688:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940096512
00000100:00100000:3.0:1767317786.094694:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940096512
00000100:00100000:3.0:1767317786.094724:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940096640
00000100:00100000:3.0:1767317786.094728:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940096640
00000100:00100000:3.0:1767317786.094749:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319
00000100:00100000:3.0:1767317786.094756:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0458be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940096512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317786.094812:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0458be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940096512:12345-0@lo:400:kworker.0 Request processed in 57us (1334us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317786.094819:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319
00000100:00100000:3.0:1767317786.094834:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320
00000100:00100000:3.0:1767317786.094841:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0458bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940096640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317786.094866:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0458bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940096640:12345-0@lo:400:kworker.0 Request processed in 27us (1302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317786.094872:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320
00000100:00100000:1.0:1767317786.097691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940096256:0@lo:38:kworker.0
00000100:00100000:1.0:1767317786.097762:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317786.097812:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940096384:0@lo:38:kworker.0
00000100:00100000:1.0:1767317786.097838:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317786.097856:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940096896:0@lo:38:kworker.0
00000100:00100000:1.0:1767317786.097879:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317786.097896:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940097152:0@lo:38:kworker.0
00000100:00100000:1.0:1767317786.097917:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317786.097947:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317786.097952:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317786.097955:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317786.097970:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940096256
00000100:00100000:1.0:1767317786.097976:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940096256
00000100:00100000:1.0:1767317786.098014:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940096896
00000100:00100000:1.0:1767317786.098017:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940096896
00000100:00100000:1.0:1767317786.098044:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097152
00000100:00100000:1.0:1767317786.098047:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097152
00000100:00100000:1.0:1767317786.098059:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15736
00000100:00100000:1.0:1767317786.098066:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940096256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317786.098086:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317786.098127:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940096256:12345-0@lo:38:kworker.0 Request processed in 59us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317786.098133:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15736
00000100:00100000:1.0:1767317786.098149:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15737
00000100:00100000:1.0:1767317786.098153:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940096896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317786.098163:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317786.098185:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940096896:12345-0@lo:38:kworker.0 Request processed in 30us (305us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317786.098190:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15737
00000100:00100000:1.0:1767317786.098200:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15738
00000100:00100000:1.0:1767317786.098204:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940097152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317786.098213:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317786.098235:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940097152:12345-0@lo:38:kworker.0 Request processed in 30us (318us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317786.098241:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15738
00000100:00080000:0.0:1767317786.098852:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317786.098859:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317786.098863:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940096256:0@lo:38:kworker.0
00000100:00080000:0.0:1767317786.098872:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317786.098876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317786.098878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940096896:0@lo:38:kworker.0
00000100:00080000:0.0:1767317786.098885:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317786.098888:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317786.098891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940097152:0@lo:38:kworker.0
00000100:00100000:1.0:1767317786.605178:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317786.605741:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940097280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317786.605827:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317786.606761:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940097280:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317787.054829:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317787.628861:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317787.629175:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317787.629203:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940097408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317787.629297:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317787.629348:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097408
00000100:00100000:0.0:1767317787.629356:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097408
00000100:00100000:0.0:1767317787.629409:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823
00000100:00100000:0.0:1767317787.629418:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940097408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317787.629458:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317787.629978:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940097408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 560us (679us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317787.629988:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823
00000100:00100000:1.0:1767317787.635530:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940097408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317788.654043:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317789.676875:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317789.767021:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894225536
00000100:00100000:0.0:1767317789.767032:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894225536
00000100:00100000:0.0:1767317789.767120:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3497
00000100:00100000:0.0:1767317789.767131:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894225536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317789.767220:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894225536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (270us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317789.767227:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3497
00000100:00080000:1.0:1767317789.767318:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317789.769275:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894225408
00000100:00100000:0.0:1767317789.769284:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894225408
00000100:00100000:0.0:1767317789.769433:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15739
00000100:00100000:0.0:1767317789.769443:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894225408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317789.769472:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317789.769551:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894225408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 107us (1378us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317789.769558:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15739
00000100:00100000:1.0:1767317790.701363:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317791.215858:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940097792:0@lo:400:kworker.0
00000100:00100000:1.0:1767317791.215929:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317791.216147:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940097920:0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.216185:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317791.216189:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097792
00000100:00100000:0.0:1767317791.216198:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097792
00000100:00100000:3.0:1767317791.216231:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097920
00000100:00100000:3.0:1767317791.216237:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097920
00000100:00100000:0.0:1767317791.216266:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321
00000100:00100000:0.0:1767317791.216279:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940097792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.216281:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322
00000100:00100000:3.0:1767317791.216294:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940097920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.216353:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940097920:12345-0@lo:400:kworker.0 Request processed in 61us (168us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317791.216360:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322
00000100:00100000:3.0:1767317791.216425:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940097920:0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.221767:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940097536:0@lo:38:kworker.0
00000100:00100000:3.0:1767317791.221883:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317791.221927:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940097664:0@lo:38:kworker.0
00000100:00100000:3.0:1767317791.221957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317791.222011:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097536
00000100:00100000:3.0:1767317791.222020:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097536
00000100:00100000:3.0:1767317791.222059:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15740
00000100:00100000:3.0:1767317791.222066:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940097536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317791.222088:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317791.222133:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940097536:12345-0@lo:38:kworker.0 Request processed in 65us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317791.222140:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15740
00000100:00080000:3.0:1767317791.222191:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317791.222196:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317791.222200:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940097536:0@lo:38:kworker.0
00000100:00100000:3.0:1767317791.222235:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940097664
00000100:00100000:3.0:1767317791.222239:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940097664
00000100:00100000:3.0:1767317791.222262:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818
00000100:00100000:3.0:1767317791.222267:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940097664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317791.222277:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317791.222307:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940097664:12345-0@lo:38:kworker.0 Request processed in 39us (349us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317791.222326:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818
00000100:00080000:3.0:1767317791.222526:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317791.222548:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317791.222552:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940097664:0@lo:38:kworker.0
00000100:00080000:3.0:1767317791.222584:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767317791.222590:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317791.229336:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940098048:0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.229427:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317791.229487:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317791.229494:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940098304:0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.229516:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317791.229556:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098048
00000100:00100000:3.0:1767317791.229564:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098048
00000100:00100000:3.0:1767317791.229622:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098304
00000100:00100000:3.0:1767317791.229626:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098304
00000100:00100000:3.0:1767317791.229653:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498
00000100:00100000:3.0:1767317791.229661:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940098048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.229712:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940098048:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317791.229719:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498
00000100:00100000:3.0:1767317791.229738:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499
00000100:00100000:3.0:1767317791.229745:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940098304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.229812:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940098304:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317791.229819:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499
00000100:00100000:0.0:1767317791.231320:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940097792:12345-0@lo:400:kworker.0 Request processed in 15036us (15382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317791.231348:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321
00000100:00100000:1.0:1767317791.231637:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940097792:0@lo:400:kworker.0
00000100:00100000:3.0:1767317791.235568:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098176
00000100:00100000:3.0:1767317791.235576:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098176
00000100:00100000:3.0:1767317791.235604:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098432
00000100:00100000:3.0:1767317791.235606:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098432
00000100:00100000:3.0:1767317791.235642:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15741
00000100:00100000:3.0:1767317791.235650:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940098176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317791.235671:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317791.235715:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940098176:12345-0@lo:38:kworker.0 Request processed in 66us (661us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317791.235723:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15741
00000100:00100000:3.0:1767317791.235742:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15742
00000100:00100000:3.0:1767317791.235745:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940098432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317791.235753:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317791.235789:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940098432:12345-0@lo:38:kworker.0 Request processed in 26us (646us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317791.235795:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15742
00000100:00080000:3.0:1767317791.235821:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317791.235826:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317791.235829:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940098176:0@lo:38:kworker.0
00000100:00080000:3.0:1767317791.235837:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317791.235840:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317791.235842:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940098432:0@lo:38:kworker.0
00000100:00100000:1.0:1767317791.725663:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317791.725688:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940098560:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317791.725756:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317791.725887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317791.725908:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098560
00000100:00100000:0.0:1767317791.725916:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098560
00000100:00100000:0.0:1767317791.725981:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824
00000100:00100000:0.0:1767317791.725989:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940098560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317791.726020:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317791.726063:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940098560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317791.726070:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824
00000100:00100000:1.0:1767317791.726237:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940098560:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317792.173082:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317792.748914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317792.749303:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317792.749323:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940098688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317792.749404:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317792.750155:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940098688:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317793.772923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317794.796896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317794.887177:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317794.887308:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894225792
00000100:00100000:1.0:1767317794.887326:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894225792
00000100:00100000:1.0:1767317794.887443:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3500
00000100:00100000:1.0:1767317794.887456:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894225792:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317794.887541:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894225792:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (372us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317794.887549:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3500
00000100:00100000:3.0:1767317794.887968:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894225664
00000100:00100000:3.0:1767317794.887986:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894225664
00000100:00100000:3.0:1767317794.888016:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15743
00000100:00100000:3.0:1767317794.888023:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894225664:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317794.888043:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317794.888088:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894225664:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 64us (372us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317794.888096:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15743
00000100:00100000:0.0:1767317795.820959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317796.335101:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317796.335112:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317796.335114:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317796.335118:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317796.335123:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317796.335131:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3041
00000100:00080000:0.0:1767317796.335136:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317796.335143:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317796.335186:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0bb80 x1853163940098816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317796.335216:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317796.335239:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317796.335241:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317796.335245:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3041
00000100:00080000:0.0:1767317796.335248:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317796.335252:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317796.335267:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08000 x1853163940098944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317796.335336:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317796.335339:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317796.335341:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317796.335345:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3041
00000100:00080000:0.0:1767317796.335347:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317796.335351:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317796.335390:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940099456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317796.335407:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317796.335410:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317796.335412:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317796.335415:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3041
00000100:00080000:0.0:1767317796.335417:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317796.335420:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317796.335434:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940099712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317796.335591:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099200:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.335662:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317796.335736:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317796.335741:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099072:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.335761:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317796.335812:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940099584:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.335858:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317796.335876:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317796.335881:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940099328:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.335902:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317796.335928:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099200
00000100:00100000:1.0:1767317796.335936:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099200
00000100:00100000:1.0:1767317796.335984:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099072
00000100:00100000:1.0:1767317796.335987:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099072
00000100:00100000:1.0:1767317796.336005:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323
00000100:00100000:1.0:1767317796.336012:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336061:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099200:12345-0@lo:400:kworker.0 Request processed in 48us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317796.336068:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323
00000100:00100000:1.0:1767317796.336083:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324
00000100:00100000:1.0:1767317796.336088:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336113:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099072:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317796.336119:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324
00000100:00100000:1.0:1767317796.336138:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099584
00000100:00100000:1.0:1767317796.336142:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099584
00000100:00100000:1.0:1767317796.336166:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099328
00000100:00100000:1.0:1767317796.336169:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099328
00000100:00100000:1.0:1767317796.336186:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501
00000100:00100000:1.0:1767317796.336192:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940099584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336224:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940099584:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317796.336230:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501
00000100:00100000:1.0:1767317796.336250:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502
00000100:00100000:1.0:1767317796.336256:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940099328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336282:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940099328:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317796.336287:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502
00000100:00100000:1.0:1767317796.336324:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940099328:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336336:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940099584:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336377:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099072:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.336387:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099200:0@lo:400:kworker.0
00000100:00100000:1.0:1767317796.338060:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940098944
00000100:00100000:1.0:1767317796.338066:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940098944
00000100:00100000:1.0:1767317796.338099:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819
00000100:00100000:1.0:1767317796.338104:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940098944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317796.338116:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317796.338162:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940098944:12345-0@lo:38:kworker.0 Request processed in 56us (1076us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317796.338168:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819
00000100:00080000:0.0:1767317796.338239:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317796.338253:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317796.338257:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940098944:0@lo:38:kworker.0
00000100:00100000:0.0:1767317796.845719:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317796.847293:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317796.847316:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0458bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099840:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317796.847422:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317796.847480:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099840
00000100:00100000:0.0:1767317796.847489:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099840
00000100:00100000:0.0:1767317796.847550:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826
00000100:00100000:0.0:1767317796.847560:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317796.847605:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317796.847664:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (241us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317796.847672:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826
00000100:00100000:3.0:1767317796.847812:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0458bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099840:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317797.293304:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317797.869369:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317797.870741:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099968:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317797.870835:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317797.871066:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940099968
00000100:00100000:1.0:1767317797.871075:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940099968
00000100:00100000:1.0:1767317797.871127:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827
00000100:00100000:1.0:1767317797.871135:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0458bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317797.871183:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317797.871245:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0458bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940099968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317797.871252:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827
00000100:00100000:3.0:1767317797.872444:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940099968:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317798.893077:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317798.982934:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317798.983129:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226176
00000100:00100000:1.0:1767317798.983269:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226176
00000100:00100000:1.0:1767317798.983442:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3503
00000100:00100000:1.0:1767317798.983453:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894226176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317798.983681:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894226176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 229us (756us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317798.983690:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3503
00000400:00000100:3.0:1767317798.984497:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894225920 offset 0 length 520: 4
00000100:00100000:3.0:1767317798.985111:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317798.985935:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226048
00000100:00100000:1.0:1767317798.985954:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226048
00000100:00100000:1.0:1767317798.986002:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15747
00000100:00100000:1.0:1767317798.986009:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894226048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317798.986032:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317798.986108:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894226048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 97us (998us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317798.986115:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15747
00000100:00100000:1.0:1767317799.916963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317800.941425:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317801.453391:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317801.453405:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317801.453409:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317801.453414:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317801.453420:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317801.453431:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3046
00000100:00080000:0.0:1767317801.453439:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317801.453448:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317801.453506:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b100 x1853163940100096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317801.453527:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317801.453550:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317801.453552:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317801.453556:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3046
00000100:00080000:0.0:1767317801.453559:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317801.453563:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317801.453580:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940100224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317801.453661:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317801.453665:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317801.453667:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317801.453671:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3046
00000100:00080000:0.0:1767317801.453673:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317801.453678:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317801.453689:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399fb80 x1853163940100736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317801.453705:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317801.453709:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317801.453710:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317801.453714:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3046
00000100:00080000:0.0:1767317801.453717:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317801.453721:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317801.453731:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3b80 x1853163940100992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317801.453792:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940100608:0@lo:400:kworker.0
00000100:00100000:0.0:1767317801.454177:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317801.454253:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317801.454260:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940100864:0@lo:400:kworker.0
00000100:00100000:0.0:1767317801.454284:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317801.454328:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940100608
00000100:00100000:0.0:1767317801.454337:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940100608
00000100:00100000:0.0:1767317801.454397:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940100864
00000100:00100000:0.0:1767317801.454400:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940100864
00000100:00100000:0.0:1767317801.454425:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504
00000100:00100000:0.0:1767317801.454433:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940100608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317801.454488:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940100608:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317801.454495:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504
00000100:00100000:0.0:1767317801.454512:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505
00000100:00100000:0.0:1767317801.454517:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940100864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317801.454540:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940100864:12345-0@lo:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317801.454545:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505
00000100:00100000:0.0:1767317801.454587:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940100864:0@lo:400:kworker.0
00000100:00100000:0.0:1767317801.454597:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940100608:0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456407:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940100352:0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456454:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317801.456493:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317801.456499:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940100480:0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456520:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317801.456571:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940100352
00000100:00100000:3.0:1767317801.456575:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940100352
00000100:00100000:3.0:1767317801.456622:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940100480
00000100:00100000:3.0:1767317801.456624:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940100480
00000100:00100000:3.0:1767317801.456644:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325
00000100:00100000:3.0:1767317801.456652:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940100352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456693:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940100352:12345-0@lo:400:kworker.0 Request processed in 44us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317801.456708:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325
00000100:00100000:3.0:1767317801.456725:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326
00000100:00100000:3.0:1767317801.456731:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940100480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456757:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940100480:12345-0@lo:400:kworker.0 Request processed in 27us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317801.456763:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326
00000100:00100000:3.0:1767317801.456803:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940100480:0@lo:400:kworker.0
00000100:00100000:3.0:1767317801.456814:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940100352:0@lo:400:kworker.0
00000100:00100000:1.0:1767317801.964897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317801.964994:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940101120:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317801.965068:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317801.966258:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940101120:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317802.415857:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317802.988865:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317802.991131:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940101248:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317802.991211:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317802.992242:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940101248:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317804.012908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317804.101879:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317804.101968:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317804.102061:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226432
00000100:00100000:1.0:1767317804.102072:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226432
00000100:00100000:1.0:1767317804.102163:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226304
00000100:00100000:1.0:1767317804.102168:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226304
00000100:00100000:1.0:1767317804.102188:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3506
00000100:00100000:1.0:1767317804.102198:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894226432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317804.102318:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894226432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (423us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317804.102326:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3506
00000100:00100000:0.0:1767317804.102342:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15751
00000100:00100000:0.0:1767317804.102366:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894226304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317804.102496:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317804.102543:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894226304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 176us (574us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317804.109596:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15751
00000100:00100000:1.0:1767317805.036908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:0.0:1767317805.549618:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317805.549624:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767317805.549627:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317805.549631:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3031
00000100:00080000:0.0:1767317805.549635:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317805.549642:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317805.549673:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940101376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317805.549945:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317805.549949:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317805.549951:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317805.549954:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3051
00000100:00080000:0.0:1767317805.549957:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317805.549960:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317805.549977:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3b80 x1853163940101504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317805.550161:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940101504
00000100:00100000:1.0:1767317805.550169:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940101504
00000100:00100000:1.0:1767317805.550212:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15752
00000100:00100000:1.0:1767317805.550227:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940101504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317805.550257:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317805.550313:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940101504:12345-0@lo:38:kworker.0 Request processed in 86us (265us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317805.550334:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15752
00000100:00080000:3.0:1767317805.550595:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317805.550601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317805.550605:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940101504:0@lo:38:kworker.0
00000100:00080000:0.0:1767317805.551052:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317805.551057:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317805.551059:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317805.551074:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3051
00000100:00080000:0.0:1767317805.551608:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317805.551613:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317805.551637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2a00 x1853163940101632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317805.551684:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940101632:0@lo:38:kworker.0
00000100:00100000:3.0:1767317805.551732:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317805.551913:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317805.551916:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317805.551918:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317805.551922:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3051
00000100:00080000:0.0:1767317805.551925:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317805.551929:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317805.551941:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0000 x1853163940102144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317805.551971:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940101632
00000100:00100000:1.0:1767317805.551977:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940101632
00000100:00100000:1.0:1767317805.552008:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821
00000100:00100000:1.0:1767317805.552014:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940101632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317805.552031:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317805.553956:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940102144:0@lo:38:kworker.0
00000100:00100000:3.0:1767317805.554003:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317805.560809:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317805.560817:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317805.560821:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317805.560830:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3051
00000100:00080000:0.0:1767317805.560835:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317805.560843:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317805.560865:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3100 x1853163940102400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317805.560910:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940102272:0@lo:400:kworker.0
00000100:00100000:0.0:1767317805.560978:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317805.561041:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102272
00000100:00100000:0.0:1767317805.561061:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102272
00000100:00100000:0.0:1767317805.561816:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508
00000100:00100000:0.0:1767317805.561826:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940102272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317805.561888:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940102272:12345-0@lo:400:kworker.0 Request processed in 63us (909us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317805.561895:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508
00000100:00080000:0.0:1767317805.561919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317805.561955:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940102272:0@lo:400:kworker.0
00000100:00100000:1.0:1767317805.563921:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940101632:12345-0@lo:38:kworker.0 Request processed in 11894us (12176us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317805.563937:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821
00000100:00080000:3.0:1767317805.564832:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317805.564840:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317805.564845:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940101632:0@lo:38:kworker.0
00000100:00100000:3.0:1767317805.564881:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940102400:0@lo:38:kworker.0
00000100:00100000:3.0:1767317805.564959:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767317805.565065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317805.565070:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317805.565073:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940102144:0@lo:38:kworker.0
00000100:00100000:0.0:1767317805.565914:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102400
00000100:00100000:0.0:1767317805.565927:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102400
00000100:00100000:0.0:1767317805.565981:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15754
00000100:00100000:0.0:1767317805.565988:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940102400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317805.566012:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317805.566746:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940102400:12345-0@lo:38:kworker.0 Request processed in 754us (1783us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317805.566756:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15754
00000100:00080000:3.0:1767317805.570378:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317805.570391:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317805.570403:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940102400:0@lo:38:kworker.0
00000100:00100000:1.0:1767317806.061381:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317807.085117:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317807.085501:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102528
00000100:00100000:1.0:1767317807.085509:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102528
00000100:00100000:1.0:1767317807.085575:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830
00000100:00100000:1.0:1767317807.085583:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940102528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317807.085613:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317807.085669:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940102528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317807.085676:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830
00000100:00100000:3.0:1767317807.085765:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940102528:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767317807.085793:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317807.533446:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317808.109049:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940102656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317808.109121:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317808.109600:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102656
00000100:00100000:3.0:1767317808.109609:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102656
00000100:00100000:3.0:1767317808.109682:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831
00000100:00100000:3.0:1767317808.109694:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940102656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317808.109728:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317808.109800:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940102656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (678us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317808.109807:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831
00000100:00080000:0.0:1767317808.110116:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317808.110166:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940102656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317808.110229:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317809.132912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317809.223547:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317809.223591:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317809.223669:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226560
00000100:00100000:1.0:1767317809.223680:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226560
00000100:00100000:1.0:1767317809.223725:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226688
00000100:00100000:1.0:1767317809.223729:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226688
00000100:00100000:1.0:1767317809.223807:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3509
00000100:00100000:3.0:1767317809.223817:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15755
00000100:00100000:3.0:1767317809.223825:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894226560:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767317809.223841:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894226688:12345-192.168.202.21@tcp:400:kworker.0
00010000:00020000:3.0:1767317809.223851:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317809.223908:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894226560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 83us (371us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317809.223930:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15755
00000100:00100000:1.0:1767317809.224132:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894226688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 315us (538us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317809.224140:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3509
00000100:00100000:3.0:1767317810.156865:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:2.0:1767317810.669284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317810.669294:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317810.669296:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317810.669299:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3055
00000100:00080000:2.0:1767317810.669302:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317810.669306:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317810.669322:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940103680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317810.669480:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940102784:0@lo:38:kworker.0
00000100:00100000:3.0:1767317810.669553:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.669605:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940102912:0@lo:38:kworker.0
00000100:00100000:3.0:1767317810.669627:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.669640:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940103424:0@lo:38:kworker.0
00000100:00100000:3.0:1767317810.669659:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.669675:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940103680:0@lo:38:kworker.0
00000100:00100000:3.0:1767317810.669696:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.669736:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102784
00000100:00100000:3.0:1767317810.669744:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102784
00000100:00100000:3.0:1767317810.669795:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103424
00000100:00100000:3.0:1767317810.669798:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103424
00000100:00100000:3.0:1767317810.669813:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103680
00000100:00100000:3.0:1767317810.669815:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103680
00000100:00100000:3.0:1767317810.669832:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15756
00000100:00100000:3.0:1767317810.669838:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940102784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317810.669859:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317810.669904:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940102784:12345-0@lo:38:kworker.0 Request processed in 63us (348us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317810.669911:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15756
00000100:00100000:3.0:1767317810.669931:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15757
00000100:00100000:3.0:1767317810.669935:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940103424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317810.669944:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317810.669977:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940103424:12345-0@lo:38:kworker.0 Request processed in 39us (316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317810.669983:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15757
00000100:00100000:3.0:1767317810.669996:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15758
00000100:00100000:3.0:1767317810.670000:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940103680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317810.670010:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317810.670030:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940103680:12345-0@lo:38:kworker.0 Request processed in 29us (334us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317810.670035:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15758
00000100:00080000:3.0:1767317810.670078:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317810.670083:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317810.670087:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940102784:0@lo:38:kworker.0
00000100:00080000:3.0:1767317810.670096:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317810.670099:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317810.670101:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103168:0@lo:400:kworker.0
00000100:00100000:3.0:1767317810.670102:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940103424:0@lo:38:kworker.0
00000100:00080000:3.0:1767317810.670108:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317810.670111:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317810.670113:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940103680:0@lo:38:kworker.0
00000100:00100000:1.0:1767317810.670140:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317810.670165:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767317810.670168:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940103296:0@lo:400:kworker.0
00000100:00100000:1.0:1767317810.670171:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103040:0@lo:400:kworker.0
00000100:00100000:1.0:1767317810.670189:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.670190:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.670205:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317810.670212:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940102912
00000100:00100000:1.0:1767317810.670215:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940102912
00000100:00100000:1.0:1767317810.670251:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822
00000100:00100000:1.0:1767317810.670255:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940102912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317810.670272:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317810.670288:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103296
00000100:00100000:2.0:1767317810.670293:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103296
00000100:00100000:1.0:1767317810.670300:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940102912:12345-0@lo:38:kworker.0 Request processed in 43us (672us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317810.670305:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822
00000100:00100000:2.0:1767317810.670329:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510
00000100:00100000:2.0:1767317810.670336:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940103296:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767317810.670345:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317810.670356:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103168
00000100:00100000:1.0:1767317810.670359:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103168
00000100:00100000:2.0:1767317810.670375:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940103296:12345-0@lo:400:kworker.0 Request processed in 40us (184us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317810.670381:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510
00000100:00100000:1.0:1767317810.670386:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103040
00000100:00100000:1.0:1767317810.670388:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103040
00000100:00100000:2.0:1767317810.670399:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329
00000100:00100000:2.0:1767317810.670405:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317810.670406:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330
00000100:00100000:1.0:1767317810.670410:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103040:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767317810.670497:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317810.670514:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767317810.670558:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103168:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317810.670566:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329
00000100:00080000:2.0:1767317810.670604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317810.670608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317810.670611:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940102912:0@lo:38:kworker.0
00000100:00100000:3.0:1767317810.671033:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940103552:0@lo:400:kworker.0
00000100:00100000:3.0:1767317810.671068:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317810.671143:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940103296:0@lo:400:kworker.0
00000100:00100000:1.0:1767317810.671150:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103040:12345-0@lo:400:kworker.0 Request processed in 738us (959us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317810.671157:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330
00000100:00100000:2.0:1767317810.674659:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103552
00000100:00100000:2.0:1767317810.674673:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103552
00000100:00100000:2.0:1767317810.674755:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511
00000100:00080000:1.0:1767317810.674758:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317810.674764:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940103552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317810.674891:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940103552:12345-0@lo:400:kworker.0 Request processed in 127us (3821us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317810.674899:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511
00000100:00100000:1.0:1767317810.674929:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940103552:0@lo:400:kworker.0
00000100:00100000:0.0:1767317810.675017:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103040:0@lo:400:kworker.0
00000100:00100000:0.0:1767317810.675026:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103168:0@lo:400:kworker.0
00000100:00100000:3.0:1767317811.181114:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317811.629044:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317812.205178:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317812.205272:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317812.205289:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317812.205355:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317812.205525:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103808
00000100:00100000:1.0:1767317812.205532:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103808
00000100:00100000:1.0:1767317812.205586:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832
00000100:00100000:1.0:1767317812.205592:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317812.205616:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317812.205651:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940103808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317812.205656:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832
00000100:00100000:1.0:1767317812.205689:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940103808:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317812.206567:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317812.653800:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317813.228910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317813.229745:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317813.229766:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940103936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317813.229875:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317813.230162:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940103936
00000100:00100000:3.0:1767317813.230171:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940103936
00000100:00100000:3.0:1767317813.230243:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833
00000100:00100000:3.0:1767317813.230265:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940103936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317813.230294:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317813.230953:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940103936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 510us (895us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317813.230963:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833
00000100:00100000:3.0:1767317813.231022:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940103936:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317813.231204:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767317813.676988:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317814.255755:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317814.342378:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317814.342432:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317814.342606:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226816
00000100:00100000:0.0:1767317814.342617:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226816
00000100:00100000:0.0:1767317814.342660:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894226944
00000100:00100000:0.0:1767317814.342663:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894226944
00000100:00100000:0.0:1767317814.342709:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3512
00000100:00100000:0.0:1767317814.342719:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894226944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317814.342824:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894226944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 106us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317814.342832:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3512
00000100:00100000:0.0:1767317814.342851:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15759
00000100:00100000:0.0:1767317814.342855:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894226816:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317814.342877:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317814.342902:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894226816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (544us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317814.342907:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15759
00000100:00080000:0.0:1767317814.342922:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317814.702279:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317815.276909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317815.725303:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317815.789249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317815.789260:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317815.789263:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317815.789267:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317815.789289:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317815.789297:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3060
00000100:00080000:0.0:1767317815.789302:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317815.789309:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317815.789358:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940104064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317815.789382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317815.789386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317815.789387:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317815.789391:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3060
00000100:00080000:0.0:1767317815.789393:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317815.789397:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317815.789411:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3100 x1853163940104192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317815.789476:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317815.789479:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317815.789481:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317815.789485:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3060
00000100:00080000:0.0:1767317815.789487:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317815.789491:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317815.789503:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ea680 x1853163940104704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317815.789504:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940104064:0@lo:38:kworker.0
00000100:00080000:0.0:1767317815.789519:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317815.789532:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317815.789539:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317815.789542:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3060
00000100:00080000:0.0:1767317815.789544:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317815.789547:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317815.789563:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71500 x1853163940104960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317815.789577:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317815.789610:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940104576:0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.789632:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940104192:0@lo:38:kworker.0
00000100:00100000:0.0:1767317815.789636:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317815.789654:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317815.789657:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317815.789662:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940104832:0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.789669:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940104704:0@lo:38:kworker.0
00000100:00100000:0.0:1767317815.789682:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317815.789696:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104064
00000100:00100000:3.0:1767317815.789703:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104064
00000100:00100000:0.0:1767317815.789713:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104576
00000100:00100000:0.0:1767317815.789716:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104576
00000100:00100000:3.0:1767317815.789732:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104832
00000100:00100000:3.0:1767317815.789735:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104832
00000100:00100000:0.0:1767317815.789752:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513
00000100:00100000:0.0:1767317815.789759:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940104576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317815.789804:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940104320:0@lo:400:kworker.0
00000100:00100000:1.0:1767317815.789837:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317815.789863:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317815.789869:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940104448:0@lo:400:kworker.0
00000100:00100000:1.0:1767317815.789890:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317815.789924:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104192
00000100:00100000:1.0:1767317815.789927:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104192
00000100:00100000:1.0:1767317815.789948:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823
00000100:00100000:1.0:1767317815.789953:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940104192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317815.789974:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317815.790008:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940104192:12345-0@lo:38:kworker.0 Request processed in 54us (352us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317815.790015:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823
00000100:00100000:0.0:1767317815.790208:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940104576:12345-0@lo:400:kworker.0 Request processed in 448us (570us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317815.791380:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514
00000100:00100000:3.0:1767317815.791397:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940104832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.791451:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940104832:12345-0@lo:400:kworker.0 Request processed in 62us (1767us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317815.791458:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514
00000100:00100000:3.0:1767317815.791495:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15760
00000100:00100000:3.0:1767317815.791499:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317815.791514:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317815.791543:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104064:12345-0@lo:38:kworker.0 Request processed in 43us (1965us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317815.791549:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15760
00000100:00100000:3.0:1767317815.791672:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317815.791700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940104960:0@lo:38:kworker.0
00000100:00100000:3.0:1767317815.791728:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767317815.791759:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317815.791763:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317815.791767:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940104064:0@lo:38:kworker.0
00000100:00080000:3.0:1767317815.791846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317815.791850:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317815.791853:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940104192:0@lo:38:kworker.0
00000100:00100000:3.0:1767317815.791897:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104704
00000100:00100000:3.0:1767317815.791903:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104704
00000100:00100000:3.0:1767317815.791921:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104960
00000100:00100000:3.0:1767317815.791924:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104960
00000100:00100000:3.0:1767317815.791934:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15761
00000100:00100000:3.0:1767317815.791938:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317815.791949:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317815.791978:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104704:12345-0@lo:38:kworker.0 Request processed in 39us (306us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317815.791984:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15761
00000100:00100000:3.0:1767317815.791995:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15762
00000100:00100000:3.0:1767317815.792007:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317815.792016:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317815.792038:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940104960:12345-0@lo:38:kworker.0 Request processed in 30us (309us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317815.792043:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15762
00000100:00080000:3.0:1767317815.792066:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317815.792070:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317815.792073:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940104704:0@lo:38:kworker.0
00000100:00080000:3.0:1767317815.792081:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317815.792084:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317815.792087:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940104960:0@lo:38:kworker.0
00000100:00080000:3.0:1767317815.792123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317815.792143:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940104832:0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.792153:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940104576:0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.792197:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104320
00000100:00100000:3.0:1767317815.792201:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104320
00000100:00100000:3.0:1767317815.792232:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940104448
00000100:00100000:3.0:1767317815.792236:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940104448
00000100:00100000:3.0:1767317815.792256:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331
00000100:00100000:3.0:1767317815.792263:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940104320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.792299:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940104320:12345-0@lo:400:kworker.0 Request processed in 37us (2461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317815.792305:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331
00000100:00100000:3.0:1767317815.792318:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332
00000100:00100000:3.0:1767317815.792323:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940104448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.792357:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940104448:12345-0@lo:400:kworker.0 Request processed in 33us (2466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317815.792362:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332
00000100:00080000:3.0:1767317815.792380:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767317815.792382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317815.792428:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940104448:0@lo:400:kworker.0
00000100:00100000:3.0:1767317815.792438:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940104320:0@lo:400:kworker.0
00000100:00100000:0.0:1767317815.807386:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513
00000100:00100000:1.0:1767317816.301104:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317816.750547:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317817.324921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317817.325131:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317817.325152:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940105088:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317817.325246:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317817.325422:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105088
00000100:00100000:3.0:1767317817.325431:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105088
00000100:00100000:3.0:1767317817.325575:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834
00000100:00100000:3.0:1767317817.325585:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940105088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317817.325617:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317817.325675:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940105088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (429us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317817.325682:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834
00000100:00100000:1.0:1767317817.325822:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940105088:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317817.326270:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317817.774489:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317818.349025:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317818.349156:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940105216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317818.349256:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317818.349376:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105216
00000100:00100000:0.0:1767317818.349384:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105216
00000100:00100000:0.0:1767317818.349449:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835
00000100:00100000:0.0:1767317818.349458:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940105216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317818.349487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317818.349535:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940105216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317818.349559:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835
00000100:00100000:0.0:1767317818.349614:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940105216:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767317818.349749:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767317818.797123:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317819.375379:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317819.462062:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317819.462113:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317819.462216:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227072
00000100:00100000:0.0:1767317819.462227:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227072
00000100:00100000:0.0:1767317819.462275:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227200
00000100:00100000:0.0:1767317819.462279:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227200
00000100:00080000:3.0:1767317819.462326:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317819.462333:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3515
00000100:00100000:3.0:1767317819.462345:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15763
00000100:00100000:0.0:1767317819.462347:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894227200:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317819.462354:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894227072:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317819.462374:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317819.462420:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894227072:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 69us (369us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317819.462425:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894227200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (308us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317819.462431:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15763
00000100:00100000:0.0:1767317819.464654:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3515
00010000:00010000:2.0:1767317819.824455:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317820.399382:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317820.845066:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317820.910836:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317820.910847:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317820.910850:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317820.910870:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317820.910874:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317820.910882:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3065
00000100:00080000:1.0:1767317820.910886:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317820.910892:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317820.910933:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060c75f80 x1853163940105344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317820.911013:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940105344:0@lo:38:kworker.0
00000100:00100000:3.0:1767317820.911079:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.911201:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105344
00000100:00100000:0.0:1767317820.911209:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105344
00000100:00100000:0.0:1767317820.911255:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15764
00000100:00100000:0.0:1767317820.911262:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940105344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317820.911283:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767317820.911393:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317820.911397:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317820.911399:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317820.911403:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3065
00000100:00080000:1.0:1767317820.911405:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317820.911409:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317820.911427:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060c75880 x1853163940105472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317820.916818:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940105472:0@lo:38:kworker.0
00000100:00100000:3.0:1767317820.916902:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317820.917005:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105472
00000100:00100000:2.0:1767317820.917014:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105472
00000100:00100000:2.0:1767317820.917060:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824
00000100:00100000:2.0:1767317820.917067:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940105472:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317820.917090:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317820.917134:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940105472:12345-0@lo:38:kworker.0 Request processed in 66us (231us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317820.917152:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824
00000100:00100000:0.0:1767317820.917302:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940105344:12345-0@lo:38:kworker.0 Request processed in 6038us (6220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317820.917311:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15764
00000100:00100000:2.0:1767317820.917528:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317820.917580:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317820.917590:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940105728:0@lo:400:kworker.0
00000100:00100000:0.0:1767317820.917634:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.917680:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105728
00000100:00100000:0.0:1767317820.917684:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105728
00000100:00100000:0.0:1767317820.917738:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333
00000100:00100000:0.0:1767317820.917745:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940105728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317820.917817:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940105728:12345-0@lo:400:kworker.0 Request processed in 72us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317820.917824:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333
00000100:00080000:0.0:1767317820.917846:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317820.917877:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940105728:0@lo:400:kworker.0
00000100:00100000:2.0:1767317820.921320:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940105600:0@lo:400:kworker.0
00000100:00100000:2.0:1767317820.921395:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.921680:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105600
00000100:00100000:0.0:1767317820.921689:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105600
00000100:00100000:0.0:1767317820.921793:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334
00000100:00100000:0.0:1767317820.921804:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940105600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317820.921862:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940105600:12345-0@lo:400:kworker.0 Request processed in 60us (466us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317820.921869:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334
00000100:00080000:2.0:1767317820.921996:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767317820.922029:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940105600:0@lo:400:kworker.0
00000100:00080000:3.0:1767317820.922315:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317820.922321:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317820.922324:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940105344:0@lo:38:kworker.0
00000100:00080000:3.0:1767317820.922348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317820.922351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317820.922353:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940105472:0@lo:38:kworker.0
00000100:00100000:2.0:1767317820.922568:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940105856:0@lo:400:kworker.0
00000100:00100000:2.0:1767317820.922606:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317820.922754:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105856
00000100:00100000:3.0:1767317820.922761:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105856
00000100:00100000:3.0:1767317820.922821:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516
00000100:00100000:3.0:1767317820.922830:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940105856:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767317820.922892:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317820.923013:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317820.923018:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317820.923021:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317820.923026:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3065
00000100:00080000:1.0:1767317820.923030:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317820.923035:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317820.923056:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060c75f80 x1853163940105984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317820.923133:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940106112:0@lo:400:kworker.0
00000100:00100000:0.0:1767317820.923192:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.923230:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106112
00000100:00100000:0.0:1767317820.923234:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106112
00000100:00100000:0.0:1767317820.923265:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517
00000100:00100000:0.0:1767317820.923271:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940106112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317820.923303:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940106112:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317820.923310:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517
00000100:00080000:0.0:1767317820.923326:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317820.923346:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940106112:0@lo:400:kworker.0
00000100:00100000:3.0:1767317820.926377:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940105856:12345-0@lo:400:kworker.0 Request processed in 3538us (3759us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317820.926392:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516
00000100:00100000:3.0:1767317820.926449:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940105984:0@lo:38:kworker.0
00000100:00100000:3.0:1767317820.926508:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.927819:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940105984
00000100:00100000:0.0:1767317820.927831:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940105984
00000100:00100000:0.0:1767317820.927891:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15765
00000100:00100000:0.0:1767317820.927899:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940105984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317820.927924:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317820.927988:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940105984:12345-0@lo:38:kworker.0 Request processed in 89us (1480us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317820.927995:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15765
00000100:00080000:3.0:1767317820.928165:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317820.928170:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317820.928174:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940105984:0@lo:38:kworker.0
00000100:00100000:2.0:1767317820.930296:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940105856:0@lo:400:kworker.0
00000100:00080000:1.0:1767317820.931992:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317820.932018:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317820.932021:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317820.932029:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3065
00000100:00080000:1.0:1767317820.932034:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317820.932040:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317820.932076:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060c76300 x1853163940106240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317820.932176:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940106240:0@lo:38:kworker.0
00000100:00100000:3.0:1767317820.932244:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317820.932338:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106240
00000100:00100000:0.0:1767317820.932346:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106240
00000100:00100000:0.0:1767317820.932391:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15766
00000100:00100000:0.0:1767317820.932398:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940106240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317820.932422:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317820.934129:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940106240:12345-0@lo:38:kworker.0 Request processed in 1721us (1876us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317820.934154:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15766
00000100:00080000:3.0:1767317820.937014:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317820.937027:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317820.937032:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940106240:0@lo:38:kworker.0
00000100:00100000:2.0:1767317821.420864:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317821.869073:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317822.444890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317822.445587:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940106368:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317822.445675:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317822.445792:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106368
00000100:00100000:1.0:1767317822.445800:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106368
00000100:00100000:1.0:1767317822.445864:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836
00000100:00100000:1.0:1767317822.445873:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940106368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317822.445903:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767317822.445994:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317822.446913:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940106368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1037us (1234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317822.447209:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836
00000100:00100000:0.0:1767317822.447301:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940106368:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317822.900412:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317823.469593:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317823.469628:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940106496:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317823.469730:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317823.470124:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317823.474088:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106496
00000100:00100000:1.0:1767317823.474106:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106496
00000100:00100000:1.0:1767317823.474222:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837
00000100:00100000:1.0:1767317823.474233:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940106496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317823.474268:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317823.474371:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940106496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (4653us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317823.474379:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837
00000100:00080000:2.0:1767317823.474480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317823.474580:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940106496:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767317823.917887:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317824.494253:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317824.583425:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317824.583709:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227456
00000100:00100000:0.0:1767317824.583720:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227456
00000100:00100000:0.0:1767317824.583893:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3518
00000100:00100000:0.0:1767317824.583905:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894227456:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317824.583993:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894227456:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (581us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317824.584017:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3518
00000100:00080000:2.0:1767317824.584519:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317824.589715:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317824.590175:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227328
00000100:00100000:1.0:1767317824.590186:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227328
00000100:00100000:1.0:1767317824.590243:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15767
00000100:00100000:1.0:1767317824.590253:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894227328:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317824.590305:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317824.590383:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894227328:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 129us (680us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317824.590391:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15767
00000400:00000100:3.0:1767317824.592468:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894227584 offset 0 length 520: 4
00010000:00010000:2.0:1767317824.941090:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317825.516906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317825.965132:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317826.029232:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317826.029242:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317826.029245:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317826.029249:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317826.029254:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317826.029261:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3070
00000100:00080000:0.0:1767317826.029266:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317826.029272:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317826.029316:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940106624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317826.029345:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317826.029348:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317826.029350:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317826.029354:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3070
00000100:00080000:0.0:1767317826.029356:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317826.029359:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317826.029374:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964700 x1853163940106752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317826.029448:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767317826.029570:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940106624:0@lo:38:kworker.0
00000100:00100000:3.0:1767317826.029636:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317826.029709:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940106752:0@lo:38:kworker.0
00000100:00100000:3.0:1767317826.029733:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317826.030223:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106752
00000100:00100000:2.0:1767317826.030233:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106752
00000100:00100000:2.0:1767317826.030279:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825
00000100:00100000:2.0:1767317826.030287:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940106752:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317826.030309:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317826.030365:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940106752:12345-0@lo:38:kworker.0 Request processed in 76us (629us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317826.030373:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825
00000100:00080000:3.0:1767317826.030384:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317826.030392:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317826.030396:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940106752:0@lo:38:kworker.0
00000100:00100000:2.0:1767317826.030403:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106624
00000100:00100000:2.0:1767317826.030409:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106624
00000100:00100000:2.0:1767317826.030435:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15768
00000100:00100000:2.0:1767317826.030456:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940106624:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317826.030468:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317826.030519:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940106624:12345-0@lo:38:kworker.0 Request processed in 62us (882us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317826.030525:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15768
00000100:00080000:3.0:1767317826.030599:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317826.030604:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317826.030608:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940106624:0@lo:38:kworker.0
00000100:00100000:1.0:1767317826.030620:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940107008:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.030657:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317826.030697:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940106880:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.030718:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317826.030800:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107008
00000100:00100000:3.0:1767317826.030805:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107008
00000100:00100000:2.0:1767317826.030810:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940106880
00000100:00100000:2.0:1767317826.030816:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940106880
00000100:00080000:1.0:1767317826.030895:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317826.030899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317826.030936:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335
00000100:00100000:3.0:1767317826.030946:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940107008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317826.030997:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940107008:12345-0@lo:400:kworker.0 Request processed in 55us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317826.031010:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335
00000100:00100000:3.0:1767317826.031037:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336
00000100:00100000:3.0:1767317826.031044:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940106880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317826.031073:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940106880:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317826.031079:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336
00000100:00100000:1.0:1767317826.031141:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940107008:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.031151:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940106880:0@lo:400:kworker.0
00000100:00080000:1.0:1767317826.031931:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317826.031936:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317826.031940:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317826.031945:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3070
00000100:00080000:1.0:1767317826.031949:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317826.031954:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317826.031977:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d060c77100 x1853163940107264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317826.032007:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317826.032010:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317826.032012:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317826.032025:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3070
00000100:00080000:1.0:1767317826.032028:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317826.032032:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317826.032046:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940107520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317826.032081:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940107392:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032159:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317826.032189:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317826.032195:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940107136:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032215:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317826.032260:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107392
00000100:00100000:1.0:1767317826.032267:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107392
00000100:00100000:1.0:1767317826.032315:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107136
00000100:00100000:1.0:1767317826.032319:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107136
00000100:00100000:1.0:1767317826.032343:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519
00000100:00100000:1.0:1767317826.032349:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940107392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032389:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940107392:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317826.032395:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519
00000100:00100000:1.0:1767317826.032410:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520
00000100:00100000:1.0:1767317826.032415:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940107136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032441:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940107136:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317826.032447:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520
00000100:00080000:1.0:1767317826.032464:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317826.032492:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940107136:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032514:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940107392:0@lo:400:kworker.0
00000100:00100000:1.0:1767317826.032552:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940107264:0@lo:38:kworker.0
00000100:00100000:1.0:1767317826.032578:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317826.032595:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940107520:0@lo:38:kworker.0
00000100:00100000:1.0:1767317826.032615:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317826.032642:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107264
00000100:00100000:1.0:1767317826.032646:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107264
00000100:00100000:1.0:1767317826.032660:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107520
00000100:00100000:1.0:1767317826.032662:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107520
00000100:00100000:1.0:1767317826.032671:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15769
00000100:00100000:1.0:1767317826.032676:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940107264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317826.032692:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317826.032722:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940107264:12345-0@lo:38:kworker.0 Request processed in 46us (143us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317826.032728:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15769
00000100:00100000:1.0:1767317826.032740:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15770
00000100:00100000:1.0:1767317826.032744:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940107520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317826.032753:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317826.032803:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940107520:12345-0@lo:38:kworker.0 Request processed in 57us (187us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317826.032809:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15770
00000100:00080000:1.0:1767317826.032833:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317826.032837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317826.032840:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d060c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940107264:0@lo:38:kworker.0
00000100:00080000:1.0:1767317826.032848:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317826.032858:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317826.032860:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940107520:0@lo:38:kworker.0
00000100:00100000:3.0:1767317826.540893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317826.988953:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317827.564905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317827.568145:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940107648:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317827.568229:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317827.570464:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107648
00000100:00100000:0.0:1767317827.570482:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107648
00000100:00100000:0.0:1767317827.570544:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838
00000100:00100000:0.0:1767317827.570553:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940107648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317827.570585:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317827.570682:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940107648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (2451us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317827.570689:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838
00000100:00100000:0.0:1767317827.570746:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940107648:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317828.013059:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317828.589001:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317828.589082:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940107776:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317828.589163:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317828.589392:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940107776
00000100:00100000:2.0:1767317828.589402:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940107776
00000100:00080000:1.0:1767317828.589513:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767317828.589559:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839
00000100:00100000:2.0:1767317828.589569:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940107776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317828.589601:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317828.589648:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940107776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317828.589653:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839
00000100:00100000:1.0:1767317828.589715:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940107776:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767317829.037407:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317829.618301:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317829.706173:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317829.706285:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317829.706451:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227840
00000100:00100000:3.0:1767317829.706463:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227840
00000100:00100000:1.0:1767317829.706529:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227712
00000100:00100000:1.0:1767317829.706535:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227712
00000100:00100000:3.0:1767317829.706559:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3521
00000100:00100000:1.0:1767317829.706577:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15771
00000100:00100000:3.0:1767317829.706579:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894227840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317829.706589:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894227712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317829.706616:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317829.706673:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894227712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 87us (388us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317829.706681:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15771
00000100:00080000:2.0:1767317829.706894:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317829.707145:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894227840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 574us (984us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317829.707153:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3521
00010000:00010000:2.0:1767317830.064510:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317830.125318:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317805/real 1767317805]  req@ffff93cf4399df80 x1853163940101376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317830 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317830.125357:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4399df80 x1853163940101376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317830 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767317830.125380:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317830.125402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767317830.125406:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940101376:0@lo:250:kworker.0
00000100:00080000:3.0:1767317830.125480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317830.125487:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767317830.125490:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317830.125495:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3055
00000100:00080000:3.0:1767317830.125499:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317830.125505:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317830.125538:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964700 x1853163940107904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317830.125563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317830.125567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317830.125584:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317830.125588:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3076
00000100:00080000:3.0:1767317830.125590:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317830.125594:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317830.125609:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940108032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317830.125618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317830.125622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317830.125623:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317830.125626:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3076
00000100:00080000:3.0:1767317830.125628:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317830.125632:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317830.125642:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940108160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317830.125704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317830.125708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317830.125710:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317830.125713:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3076
00000100:00080000:3.0:1767317830.125715:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317830.125719:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317830.125745:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d5880 x1853163940108672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317830.125764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317830.125767:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767317830.125794:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940108416:0@lo:400:kworker.0
00000100:00080000:3.0:1767317830.125795:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317830.125800:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3076
00000100:00080000:3.0:1767317830.125802:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317830.125810:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317830.125826:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6300 x1853163940108928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317830.125854:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940108544:0@lo:400:kworker.0
00000100:00100000:1.0:1767317830.125877:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317830.125942:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940108288:0@lo:400:kworker.0
00000100:00100000:0.0:1767317830.128682:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108416
00000100:00100000:0.0:1767317830.128700:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108416
00000100:00100000:0.0:1767317830.128823:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337
00000100:00100000:0.0:1767317830.128833:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d060c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940108416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317830.135568:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.135668:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317830.135683:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940108800:0@lo:400:kworker.0
00000100:00100000:3.0:1767317830.135749:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.135825:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108544
00000100:00100000:3.0:1767317830.135835:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108544
00000100:00100000:3.0:1767317830.135904:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108800
00000100:00100000:3.0:1767317830.135907:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108800
00000100:00100000:3.0:1767317830.135937:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522
00000100:00100000:3.0:1767317830.135947:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940108544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317830.136026:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940108544:12345-0@lo:400:kworker.0 Request processed in 80us (467us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317830.136034:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522
00000100:00100000:3.0:1767317830.136089:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523
00000100:00100000:3.0:1767317830.136096:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940108800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317830.136125:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940108800:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317830.139489:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523
00000100:00100000:3.0:1767317830.139606:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940108800:0@lo:400:kworker.0
00000100:00100000:3.0:1767317830.139647:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940108544:0@lo:400:kworker.0
00000100:00080000:3.0:1767317830.139706:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767317830.139713:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317830.139749:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940107904:0@lo:250:kworker.0
00000400:00000100:3.0:1767317830.139813:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940107904 offset 0 length 520: 4
00000100:00100000:3.0:1767317830.139846:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940108032:0@lo:38:kworker.0
00000100:00100000:3.0:1767317830.139877:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.139900:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940108160:0@lo:38:kworker.0
00000100:00100000:3.0:1767317830.139923:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.139950:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940108672:0@lo:38:kworker.0
00000100:00100000:3.0:1767317830.139971:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.139987:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940108928:0@lo:38:kworker.0
00000100:00100000:3.0:1767317830.140010:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317830.140040:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108032
00000100:00100000:3.0:1767317830.140046:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108032
00000100:00100000:3.0:1767317830.140088:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108672
00000100:00100000:3.0:1767317830.140092:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108672
00000100:00100000:3.0:1767317830.140104:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108928
00000100:00100000:3.0:1767317830.140107:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108928
00000100:00100000:3.0:1767317830.140117:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15772
00000100:00100000:3.0:1767317830.140124:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940108032:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767317830.140363:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15773
00000100:00100000:1.0:1767317830.140370:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940108672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317830.140389:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317830.140439:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940108672:12345-0@lo:38:kworker.0 Request processed in 68us (466us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317830.140445:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15773
00000100:00100000:1.0:1767317830.140466:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15774
00000100:00100000:1.0:1767317830.140470:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940108928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317830.140479:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317830.140503:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940108928:12345-0@lo:38:kworker.0 Request processed in 31us (491us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317830.140509:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15774
00000100:00080000:1.0:1767317830.140541:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317830.140546:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317830.140550:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940108672:0@lo:38:kworker.0
00000100:00080000:1.0:1767317830.140558:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317830.140561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317830.140563:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940108928:0@lo:38:kworker.0
00000100:00100000:1.0:1767317830.140670:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108160
00000100:00100000:1.0:1767317830.140675:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108160
00000100:00100000:1.0:1767317830.140697:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826
00000100:00100000:1.0:1767317830.140701:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940108160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317830.140711:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317830.140751:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940108160:12345-0@lo:38:kworker.0 Request processed in 48us (827us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317830.140758:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826
00000100:00080000:1.0:1767317830.140800:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317830.140804:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317830.140807:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940108160:0@lo:38:kworker.0
00010000:00020000:3.0:1767317830.141916:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317830.141978:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940108032:12345-0@lo:38:kworker.0 Request processed in 1851us (2098us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317830.141988:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15772
00000100:00080000:1.0:1767317830.142540:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317830.142548:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317830.142553:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940108032:0@lo:38:kworker.0
00000100:00100000:2.0:1767317830.147580:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317830.150713:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d060c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940108416:12345-0@lo:400:kworker.0 Request processed in 21870us (24826us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317830.150730:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337
00000100:00100000:0.0:1767317830.150767:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940108288
00000100:00100000:0.0:1767317830.150792:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940108288
00000100:00100000:0.0:1767317830.150873:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338
00000100:00100000:0.0:1767317830.150882:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940108288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317830.150941:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940108288:12345-0@lo:400:kworker.0 Request processed in 60us (3377us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317830.150947:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338
00000100:00100000:1.0:1767317830.151452:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940108416:0@lo:400:kworker.0
00000100:00080000:2.0:1767317830.153182:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767317830.153260:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940108288:0@lo:400:kworker.0
00000100:00100000:2.0:1767317830.641819:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317831.088828:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317831.661134:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317832.109848:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317832.684899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317832.686423:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317832.686446:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940109056:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317832.686516:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317832.687350:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109056
00000100:00100000:3.0:1767317832.687360:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109056
00000100:00100000:3.0:1767317832.687441:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840
00000100:00100000:3.0:1767317832.687454:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940109056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317832.687488:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317832.687559:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940109056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (1041us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317832.687566:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840
00000100:00100000:1.0:1767317832.687728:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940109056:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317832.687875:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317833.133086:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317833.710166:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317833.710324:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767317833.710344:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940109184:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317833.710429:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317833.710632:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109184
00000100:00100000:0.0:1767317833.710640:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109184
00000100:00100000:0.0:1767317833.710716:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841
00000100:00100000:0.0:1767317833.710726:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940109184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317833.710757:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317833.710860:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940109184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (430us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317833.710868:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841
00000100:00100000:3.0:1767317833.710900:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940109184:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767317833.713092:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767317834.157125:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317834.732958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317834.825307:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317834.825359:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317834.825478:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228096
00000100:00100000:1.0:1767317834.825488:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228096
00000100:00100000:1.0:1767317834.825585:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894227968
00000100:00100000:1.0:1767317834.825589:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894227968
00000100:00100000:1.0:1767317834.825617:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3524
00000100:00100000:3.0:1767317834.825627:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15775
00000100:00100000:1.0:1767317834.825631:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894228096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317834.825639:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894227968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317834.825666:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767317834.825760:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317834.826004:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894228096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 377us (707us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317834.826023:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3524
00000100:00100000:3.0:1767317834.835187:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894227968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 9535us (9812us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317834.835205:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15775
00010000:00010000:2.0:1767317835.180991:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317835.251428:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317835.251439:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317835.251442:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317835.251446:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317835.251450:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317835.251458:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3080
00000100:00080000:2.0:1767317835.251463:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317835.251490:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317835.251611:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a300 x1853163940109312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317835.251675:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317835.251679:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317835.251688:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317835.251691:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3080
00000100:00080000:2.0:1767317835.251700:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317835.251704:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317835.251726:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988a80 x1853163940109440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317835.251839:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317835.251841:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317835.251843:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317835.251846:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3080
00000100:00080000:2.0:1767317835.251848:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317835.251851:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317835.251870:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988380 x1853163940109952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317835.251881:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317835.251883:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317835.251885:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317835.251888:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3080
00000100:00080000:2.0:1767317835.251890:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317835.251899:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317835.251909:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698b480 x1853163940110208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317835.251968:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940110080:0@lo:400:kworker.0
00000100:00100000:2.0:1767317835.252334:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252415:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317835.252422:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940109824:0@lo:400:kworker.0
00000100:00100000:2.0:1767317835.252459:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252501:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940109312:0@lo:38:kworker.0
00000100:00100000:2.0:1767317835.252526:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252543:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940109440:0@lo:38:kworker.0
00000100:00100000:2.0:1767317835.252578:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252606:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940109952:0@lo:38:kworker.0
00000100:00100000:2.0:1767317835.252630:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252643:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940110208:0@lo:38:kworker.0
00000100:00100000:2.0:1767317835.252670:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317835.252713:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109440
00000100:00100000:2.0:1767317835.252730:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109440
00000100:00100000:2.0:1767317835.252806:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827
00000100:00100000:2.0:1767317835.252821:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940109440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317835.252846:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317835.252903:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940109440:12345-0@lo:38:kworker.0 Request processed in 72us (315us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317835.252909:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827
00000100:00100000:2.0:1767317835.252974:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110080
00000100:00100000:3.0:1767317835.253392:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109824
00000100:00100000:3.0:1767317835.253397:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109824
00000100:00100000:3.0:1767317835.253441:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109312
00000100:00100000:3.0:1767317835.253444:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109312
00000100:00100000:3.0:1767317835.253488:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109952
00000100:00100000:3.0:1767317835.253491:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109952
00000100:00100000:3.0:1767317835.253515:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110208
00000100:00100000:3.0:1767317835.253531:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110208
00000100:00100000:3.0:1767317835.253557:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525
00000100:00100000:3.0:1767317835.253583:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b830c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940109824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.253651:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b830c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940109824:12345-0@lo:400:kworker.0 Request processed in 89us (1192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317835.253665:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525
00000100:00100000:3.0:1767317835.253690:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15776
00000100:00100000:3.0:1767317835.253693:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940109312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317835.253712:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317835.253747:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940109312:12345-0@lo:38:kworker.0 Request processed in 52us (1221us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317835.253753:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15776
00000100:00100000:3.0:1767317835.253807:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15777
00000100:00100000:3.0:1767317835.253811:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940109952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317835.253821:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317835.253857:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940109952:12345-0@lo:38:kworker.0 Request processed in 44us (1235us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317835.253871:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15777
00000100:00100000:3.0:1767317835.253882:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15778
00000100:00100000:3.0:1767317835.253894:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940110208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317835.253909:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317835.253944:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940110208:12345-0@lo:38:kworker.0 Request processed in 45us (1260us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317835.253949:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15778
00000100:00100000:3.0:1767317835.254451:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940109568:0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.254494:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317835.254549:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317835.254566:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940109696:0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.254597:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317835.254671:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109568
00000100:00100000:3.0:1767317835.254682:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109568
00000100:00100000:3.0:1767317835.254720:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940109696
00000100:00100000:3.0:1767317835.254723:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940109696
00000100:00100000:3.0:1767317835.254758:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339
00000100:00100000:3.0:1767317835.254808:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940109568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.254861:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940109568:12345-0@lo:400:kworker.0 Request processed in 88us (359us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317835.254865:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339
00000100:00100000:3.0:1767317835.254876:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340
00000100:00100000:3.0:1767317835.254882:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940109696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.254912:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940109696:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317835.254949:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340
00000100:00100000:2.0:1767317835.255335:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110080
00000100:00100000:2.0:1767317835.255411:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526
00000100:00100000:2.0:1767317835.255418:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940110080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317835.255476:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940110080:12345-0@lo:400:kworker.0 Request processed in 59us (3142us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317835.255482:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526
00000100:00100000:3.0:1767317835.256283:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940109696:0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.256313:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940109568:0@lo:400:kworker.0
00000100:00080000:3.0:1767317835.256395:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767317835.256401:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767317835.256404:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767317835.256441:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317835.256448:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317835.256451:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940109312:0@lo:38:kworker.0
00000100:00080000:3.0:1767317835.256461:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317835.256465:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317835.256467:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940109440:0@lo:38:kworker.0
00000100:00080000:3.0:1767317835.256476:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317835.256506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317835.256509:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940109952:0@lo:38:kworker.0
00000100:00080000:3.0:1767317835.256532:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317835.256536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317835.256539:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940110208:0@lo:38:kworker.0
00000100:00100000:3.0:1767317835.256601:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940109824:0@lo:400:kworker.0
00000100:00100000:3.0:1767317835.256621:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940110080:0@lo:400:kworker.0
00000100:00100000:2.0:1767317835.760166:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317836.205582:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317836.781149:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317837.229053:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317837.805469:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317837.805797:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940110336:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317837.805880:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317837.806075:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110336
00000100:00100000:3.0:1767317837.806084:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110336
00000100:00100000:3.0:1767317837.806155:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842
00000100:00100000:3.0:1767317837.806165:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940110336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317837.806198:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317837.806264:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940110336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (384us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317837.806272:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842
00000100:00100000:1.0:1767317837.806418:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940110336:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317837.806513:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317838.253388:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317838.828925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317838.829827:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940110464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317838.829909:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317838.830124:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110464
00000100:00100000:3.0:1767317838.830132:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110464
00000100:00100000:3.0:1767317838.830209:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843
00000100:00100000:3.0:1767317838.830412:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940110464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317838.830446:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317838.830571:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940110464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 353us (662us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317838.830579:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843
00000100:00080000:2.0:1767317838.830834:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317838.830927:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940110464:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767317839.277348:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317839.853809:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317839.942449:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317839.942582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317839.942854:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228224
00000100:00100000:2.0:1767317839.942875:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228224
00000100:00100000:2.0:1767317839.942914:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228352
00000100:00100000:2.0:1767317839.942917:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228352
00000100:00100000:0.0:1767317839.943060:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15779
00000100:00100000:0.0:1767317839.943071:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894228224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317839.943099:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317839.943160:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894228224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 90us (723us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317839.943167:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15779
00000100:00100000:2.0:1767317839.943677:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3527
00000100:00100000:2.0:1767317839.943686:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894228352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317839.943738:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894228352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 54us (1156us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317839.943744:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3527
00000100:00080000:1.0:1767317839.944615:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317840.304080:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317840.369165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317840.369173:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317840.369175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317840.369178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317840.369181:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317840.369187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3085
00000100:00080000:0.0:1767317840.369208:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317840.369213:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317840.369245:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d880 x1853163940110592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317840.373077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940110592:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.373151:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317840.373300:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110592
00000100:00100000:3.0:1767317840.373310:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110592
00000100:00100000:3.0:1767317840.373371:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15780
00000100:00100000:3.0:1767317840.373377:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940110592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317840.373396:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767317840.377065:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317840.377074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317840.377078:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317840.377084:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3085
00000100:00080000:0.0:1767317840.377088:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317840.377094:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317840.377130:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219fb80 x1853163940110720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317840.377395:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940110720:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.377451:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317840.377562:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940110592:12345-0@lo:38:kworker.0 Request processed in 4183us (4408us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317840.377571:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15780
00000100:00080000:0.0:1767317840.377684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317840.377687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317840.377689:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317840.377692:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3085
00000100:00080000:0.0:1767317840.377693:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317840.377696:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317840.377705:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219e300 x1853163940111232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317840.377715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317840.377717:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317840.377719:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317840.377721:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3085
00000100:00080000:0.0:1767317840.377734:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317840.377737:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317840.377746:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95f80 x1853163940111488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317840.377765:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940111104:0@lo:400:kworker.0
00000100:00100000:0.0:1767317840.377801:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317840.377819:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317840.377823:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940111360:0@lo:400:kworker.0
00000100:00100000:0.0:1767317840.377835:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317840.377860:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111104
00000100:00100000:0.0:1767317840.377866:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111104
00000100:00100000:0.0:1767317840.377901:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111360
00000100:00100000:0.0:1767317840.377902:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111360
00000100:00100000:0.0:1767317840.377917:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528
00000100:00100000:0.0:1767317840.377922:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940111104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317840.381144:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940111104:12345-0@lo:400:kworker.0 Request processed in 3213us (3333us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317840.381156:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528
00000100:00100000:0.0:1767317840.381185:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529
00000100:00100000:0.0:1767317840.381207:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940111360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317840.381257:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940111360:12345-0@lo:400:kworker.0 Request processed in 67us (3421us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317840.381261:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529
00000100:00100000:0.0:1767317840.381307:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940111360:0@lo:400:kworker.0
00000100:00100000:0.0:1767317840.381320:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940111104:0@lo:400:kworker.0
00000100:00080000:0.0:1767317840.381379:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317840.381494:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940110976:0@lo:400:kworker.0
00000100:00100000:3.0:1767317840.381533:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317840.381572:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767317840.381576:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940110848:0@lo:400:kworker.0
00000100:00100000:3.0:1767317840.381592:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317840.381612:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110976
00000100:00100000:3.0:1767317840.381617:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110976
00000100:00100000:3.0:1767317840.381646:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110848
00000100:00100000:3.0:1767317840.381648:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110848
00000100:00100000:3.0:1767317840.381659:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341
00000100:00100000:3.0:1767317840.381663:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940110976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317840.381684:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940110976:12345-0@lo:400:kworker.0 Request processed in 21us (151us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317840.381688:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341
00000100:00100000:3.0:1767317840.381697:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342
00000100:00100000:3.0:1767317840.381701:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940110848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317840.381714:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940110848:12345-0@lo:400:kworker.0 Request processed in 13us (121us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317840.381717:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342
00000100:00100000:3.0:1767317840.381739:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940110848:0@lo:400:kworker.0
00000100:00100000:3.0:1767317840.381752:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940110976:0@lo:400:kworker.0
00000100:00080000:0.0:1767317840.381831:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317840.381833:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317840.399340:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940110720
00000100:00100000:1.0:1767317840.399358:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940110720
00000100:00100000:1.0:1767317840.401090:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828
00000100:00100000:1.0:1767317840.401099:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940110720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317840.401120:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317840.401186:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940110720:12345-0@lo:38:kworker.0 Request processed in 88us (23735us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317840.401191:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828
00000100:00080000:2.0:1767317840.403318:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317840.403328:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317840.403333:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940110592:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.403362:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940111232:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.403424:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317840.403451:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940111488:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.403463:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317840.403482:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111232
00000100:00100000:2.0:1767317840.403487:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111232
00000100:00100000:2.0:1767317840.403507:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111488
00000100:00100000:2.0:1767317840.403508:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111488
00000100:00100000:2.0:1767317840.403517:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15781
00000100:00100000:2.0:1767317840.403521:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940111232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317840.403536:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317840.403556:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940111232:12345-0@lo:38:kworker.0 Request processed in 34us (131us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317840.403560:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15781
00000100:00100000:2.0:1767317840.403569:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15782
00000100:00100000:2.0:1767317840.403572:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940111488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317840.403577:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317840.403588:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940111488:12345-0@lo:38:kworker.0 Request processed in 15us (124us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317840.403591:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15782
00000100:00080000:2.0:1767317840.403607:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317840.403610:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317840.403612:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940111488:0@lo:38:kworker.0
00000100:00080000:2.0:1767317840.403619:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317840.403622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317840.403623:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940110720:0@lo:38:kworker.0
00000100:00080000:2.0:1767317840.403642:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317840.403644:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317840.403645:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940111232:0@lo:38:kworker.0
00000100:00100000:2.0:1767317840.880082:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317841.326551:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317841.901071:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317842.349216:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317842.924920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317842.925139:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940111616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317842.925219:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317842.925539:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111616
00000100:00100000:3.0:1767317842.925550:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111616
00000100:00100000:3.0:1767317842.925632:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844
00000100:00100000:3.0:1767317842.925641:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940111616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317842.925672:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317842.925732:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940111616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (512us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317842.925739:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844
00000100:00100000:3.0:1767317842.925814:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940111616:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767317842.926152:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317843.374295:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317843.949260:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317843.949285:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940111744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317843.949358:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317843.949547:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111744
00000100:00100000:3.0:1767317843.949556:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111744
00000100:00100000:3.0:1767317843.949617:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845
00000100:00100000:3.0:1767317843.949626:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940111744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317843.949657:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317843.949703:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940111744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317843.949711:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845
00000100:00100000:3.0:1767317843.949758:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940111744:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317843.949844:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317843.952845:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317844.403380:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317844.978394:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317845.063463:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317845.063517:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317845.063710:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228608
00000100:00100000:3.0:1767317845.063722:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228608
00000100:00100000:3.0:1767317845.063840:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228480
00000100:00100000:3.0:1767317845.063844:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228480
00000100:00100000:3.0:1767317845.063862:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3530
00000100:00100000:3.0:1767317845.063891:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894228608:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317845.063995:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894228608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (542us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317845.064003:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3530
00000100:00100000:3.0:1767317845.064027:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15783
00000100:00100000:3.0:1767317845.064032:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894228480:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317845.064053:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317845.064080:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894228480:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (562us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317845.064086:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15783
00000100:00080000:0.0:1767317845.068824:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317845.421090:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317845.485690:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317845.485701:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317845.485704:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317845.485708:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317845.485712:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317845.485721:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3090
00000100:00080000:2.0:1767317845.485726:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317845.485733:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317845.485793:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989880 x1853163940111872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317845.485824:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317845.485828:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317845.485830:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317845.485834:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3090
00000100:00080000:2.0:1767317845.485836:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317845.485859:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317845.485876:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698b100 x1853163940112000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317845.485965:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317845.485968:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317845.485970:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317845.485974:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3090
00000100:00080000:2.0:1767317845.485976:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317845.485981:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317845.485991:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988380 x1853163940112512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317845.486085:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940112256:0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486177:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317845.486253:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317845.486258:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940112128:0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486293:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317845.486319:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317845.486327:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940112384:0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486354:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317845.486385:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112256
00000100:00100000:1.0:1767317845.486392:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112256
00000100:00100000:1.0:1767317845.486445:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112128
00000100:00100000:1.0:1767317845.486448:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112128
00000100:00100000:1.0:1767317845.486471:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343
00000100:00100000:1.0:1767317845.486479:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940112256:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317845.486482:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940111872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317845.486531:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940112256:12345-0@lo:400:kworker.0 Request processed in 52us (353us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317845.486531:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317845.486539:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343
00000100:00100000:3.0:1767317845.486550:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940112000:0@lo:38:kworker.0
00000100:00100000:1.0:1767317845.486558:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1767317845.486573:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940112128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317845.486573:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317845.486614:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112384
00000100:00100000:1.0:1767317845.486615:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940112128:12345-0@lo:400:kworker.0 Request processed in 44us (320us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317845.486618:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112384
00000100:00100000:1.0:1767317845.486621:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344
00000100:00100000:3.0:1767317845.486647:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940111872
00000100:00100000:3.0:1767317845.486649:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940111872
00000100:00100000:1.0:1767317845.486661:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940112128:0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486673:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940112256:0@lo:400:kworker.0
00000100:00100000:3.0:1767317845.486675:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531
00000100:00100000:3.0:1767317845.486681:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940112384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486722:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15784
00000100:00100000:3.0:1767317845.486722:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940112384:12345-0@lo:400:kworker.0 Request processed in 41us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317845.486727:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940111872:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317845.486728:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531
00010000:00020000:1.0:1767317845.486747:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317845.486755:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940112384:0@lo:400:kworker.0
00000100:00100000:1.0:1767317845.486799:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940111872:12345-0@lo:38:kworker.0 Request processed in 70us (276us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767317845.486802:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767317845.486806:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15784
00000100:00080000:3.0:1767317845.486811:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317845.486814:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940111872:0@lo:38:kworker.0
00000100:00100000:1.0:1767317845.486824:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112000
00000100:00100000:1.0:1767317845.486828:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112000
00000100:00100000:1.0:1767317845.486850:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829
00000100:00100000:1.0:1767317845.486855:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940112000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317845.486865:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317845.486893:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940112000:12345-0@lo:38:kworker.0 Request processed in 37us (319us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317845.486899:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829
00000100:00080000:3.0:1767317845.486905:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317845.486909:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317845.486912:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940112000:0@lo:38:kworker.0
00000100:00080000:2.0:1767317845.487365:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317845.487369:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317845.487372:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317845.487376:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3090
00000100:00080000:2.0:1767317845.487380:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317845.487384:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317845.487400:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a300 x1853163940112768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317845.488445:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767317845.488454:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317845.488457:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317845.489866:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940112512:0@lo:38:kworker.0
00000100:00100000:3.0:1767317845.489951:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317845.490011:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940112768:0@lo:38:kworker.0
00000100:00100000:3.0:1767317845.490035:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317845.490404:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112512
00000100:00100000:0.0:1767317845.490415:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112512
00000100:00100000:0.0:1767317845.490459:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112768
00000100:00100000:0.0:1767317845.490462:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112768
00000100:00100000:0.0:1767317845.490486:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15785
00000100:00100000:0.0:1767317845.490493:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940112512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317845.490518:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317845.490568:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940112512:12345-0@lo:38:kworker.0 Request processed in 73us (616us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317845.490575:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15785
00000100:00100000:0.0:1767317845.490592:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15786
00000100:00100000:0.0:1767317845.490609:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940112768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317845.490641:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317845.490667:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940112768:12345-0@lo:38:kworker.0 Request processed in 70us (631us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317845.490673:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15786
00000100:00100000:1.0:1767317845.490697:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940112640:0@lo:400:kworker.0
00000100:00080000:0.0:1767317845.490712:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317845.490717:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317845.490720:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940112512:0@lo:38:kworker.0
00000100:00100000:1.0:1767317845.490726:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317845.490729:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317845.490732:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317845.490735:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940112768:0@lo:38:kworker.0
00000100:00100000:0.0:1767317845.490756:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112640
00000100:00100000:0.0:1767317845.490759:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112640
00000100:00100000:0.0:1767317845.490840:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532
00000100:00100000:0.0:1767317845.490847:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940112640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317845.490892:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940112640:12345-0@lo:400:kworker.0 Request processed in 46us (165us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317845.490898:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532
00000100:00100000:0.0:1767317845.490938:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940112640:0@lo:400:kworker.0
00000100:00080000:1.0:1767317845.490940:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317845.996924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317846.445616:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317847.020951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317847.469270:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317848.049011:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317848.052064:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940112896:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317848.052152:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317848.055171:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940112896
00000100:00100000:3.0:1767317848.055189:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940112896
00000100:00100000:3.0:1767317848.055288:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846
00000100:00100000:3.0:1767317848.055301:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940112896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317848.055335:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317848.055426:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940112896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (3272us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317848.055434:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846
00000100:00100000:0.0:1767317848.055720:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940112896:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767317848.055920:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317848.493077:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317849.069020:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317849.069043:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940113024:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317849.069123:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317849.069999:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113024
00000100:00100000:2.0:1767317849.070008:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113024
00000100:00100000:2.0:1767317849.070059:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847
00000100:00100000:2.0:1767317849.070067:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940113024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317849.070100:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317849.070146:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940113024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (1022us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317849.070153:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847
00000100:00100000:3.0:1767317849.070212:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767317849.070246:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317849.072945:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940113024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317849.158770:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317849.159167:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228992
00000100:00100000:3.0:1767317849.159179:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228992
00000100:00100000:3.0:1767317849.159258:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3533
00000100:00100000:3.0:1767317849.159270:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894228992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317849.159353:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894228992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (592us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317849.159375:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3533
00000400:00000100:3.0:1767317849.161567:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894228736 offset 0 length 520: 4
00000100:00100000:3.0:1767317849.161628:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317849.161943:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894228864
00000100:00100000:0.0:1767317849.161953:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894228864
00000100:00100000:0.0:1767317849.162011:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15787
00000100:00100000:0.0:1767317849.162020:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894228864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317849.162045:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317849.162112:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894228864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (482us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317849.162118:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15787
00000100:00080000:1.0:1767317849.162753:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317849.517128:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317850.092965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317850.541822:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317850.605283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317850.605293:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317850.605296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317850.605300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317850.605304:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317850.605312:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3095
00000100:00080000:1.0:1767317850.605317:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317850.605323:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317850.605363:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940113152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317850.605388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317850.605391:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317850.605393:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317850.605396:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3095
00000100:00080000:1.0:1767317850.605398:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317850.605401:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317850.605414:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940113280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317850.605475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317850.605479:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317850.605481:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317850.605484:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3095
00000100:00080000:1.0:1767317850.605487:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317850.605491:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317850.605520:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac380 x1853163940113792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317850.605536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317850.605539:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317850.605541:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317850.605543:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3095
00000100:00080000:1.0:1767317850.605546:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317850.605549:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317850.605558:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac000 x1853163940114048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317850.605594:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940113920:0@lo:400:kworker.0
00000100:00100000:1.0:1767317850.605668:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317850.605731:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317850.605737:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940113664:0@lo:400:kworker.0
00000100:00100000:1.0:1767317850.605759:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317850.605817:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113920
00000100:00100000:1.0:1767317850.605824:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113920
00000100:00100000:1.0:1767317850.605884:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113664
00000100:00100000:1.0:1767317850.605888:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113664
00000100:00100000:1.0:1767317850.605913:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534
00000100:00100000:1.0:1767317850.605921:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940113920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317850.605977:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940113920:12345-0@lo:400:kworker.0 Request processed in 56us (308us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317850.605984:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534
00000100:00100000:1.0:1767317850.606002:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535
00000100:00100000:1.0:1767317850.606008:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940113664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317850.606043:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940113664:12345-0@lo:400:kworker.0 Request processed in 35us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317850.606048:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535
00000100:00080000:1.0:1767317850.606065:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317850.606096:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940113664:0@lo:400:kworker.0
00000100:00100000:1.0:1767317850.606106:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940113920:0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606217:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940113536:0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606248:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606273:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317850.606278:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940113408:0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606296:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606326:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113536
00000100:00100000:0.0:1767317850.606329:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113536
00000100:00100000:0.0:1767317850.606354:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113408
00000100:00100000:0.0:1767317850.606357:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113408
00000100:00100000:0.0:1767317850.606383:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345
00000100:00100000:0.0:1767317850.606389:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940113536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606422:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940113536:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317850.606429:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345
00000100:00100000:0.0:1767317850.606440:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346
00000100:00100000:0.0:1767317850.606445:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940113408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606478:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940113408:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317850.606485:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346
00000100:00080000:0.0:1767317850.606500:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317850.606515:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940113408:0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606523:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940113536:0@lo:400:kworker.0
00000100:00100000:0.0:1767317850.606542:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940113152:0@lo:38:kworker.0
00000100:00100000:0.0:1767317850.606566:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606582:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940113280:0@lo:38:kworker.0
00000100:00100000:0.0:1767317850.606605:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606622:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940113792:0@lo:38:kworker.0
00000100:00100000:0.0:1767317850.606640:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606656:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940114048:0@lo:38:kworker.0
00000100:00100000:0.0:1767317850.606673:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317850.606701:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113280
00000100:00100000:0.0:1767317850.606704:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113280
00000100:00100000:0.0:1767317850.606722:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830
00000100:00100000:0.0:1767317850.606727:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940113280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317850.606744:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317850.606792:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940113280:12345-0@lo:38:kworker.0 Request processed in 45us (167us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317850.606798:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830
00000100:00100000:0.0:1767317850.606814:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113152
00000100:00100000:0.0:1767317850.606817:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113152
00000100:00100000:0.0:1767317850.606839:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940113792
00000100:00100000:0.0:1767317850.606842:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940113792
00000100:00100000:0.0:1767317850.606848:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114048
00000100:00100000:0.0:1767317850.606850:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114048
00000100:00100000:0.0:1767317850.606859:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15788
00000100:00100000:0.0:1767317850.606863:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940113152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317850.606883:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317850.606908:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940113152:12345-0@lo:38:kworker.0 Request processed in 43us (341us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317850.606914:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15788
00000100:00100000:0.0:1767317850.606925:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15789
00000100:00100000:0.0:1767317850.606929:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940113792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317850.606937:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317850.606957:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940113792:12345-0@lo:38:kworker.0 Request processed in 27us (316us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317850.606963:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15789
00000100:00100000:0.0:1767317850.606972:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15790
00000100:00100000:0.0:1767317850.606976:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940114048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317850.606985:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317850.607005:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940114048:12345-0@lo:38:kworker.0 Request processed in 27us (330us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317850.607010:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15790
00000100:00080000:0.0:1767317850.607031:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317850.607035:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317850.607038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940113152:0@lo:38:kworker.0
00000100:00080000:0.0:1767317850.607045:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317850.607053:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317850.607056:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940113280:0@lo:38:kworker.0
00000100:00080000:0.0:1767317850.607065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317850.607068:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317850.607070:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940113792:0@lo:38:kworker.0
00000100:00080000:0.0:1767317850.607076:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317850.607079:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317850.607081:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940114048:0@lo:38:kworker.0
00000100:00100000:3.0:1767317851.118478:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317851.564973:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317852.141860:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317852.589147:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317853.166324:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317853.166333:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940114176:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317853.166408:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317853.166494:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114176
00000100:00100000:0.0:1767317853.166505:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114176
00000100:00100000:0.0:1767317853.166576:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848
00000100:00100000:0.0:1767317853.166586:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940114176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317853.166627:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317853.166684:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940114176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317853.166691:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848
00000100:00100000:3.0:1767317853.166755:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940114176:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767317853.166852:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317853.615395:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317854.188942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317854.190364:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317854.190393:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940114304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317854.190489:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317854.190812:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114304
00000100:00100000:2.0:1767317854.190822:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114304
00000100:00100000:2.0:1767317854.190921:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849
00000100:00100000:2.0:1767317854.190931:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940114304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317854.190972:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317854.191037:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940114304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (548us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317854.191045:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849
00000100:00080000:1.0:1767317854.191340:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317854.191386:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940114304:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317854.279058:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317854.279247:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229248
00000100:00100000:3.0:1767317854.279259:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229248
00000100:00100000:3.0:1767317854.279349:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3536
00000100:00100000:3.0:1767317854.279358:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894229248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767317854.279486:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317854.285540:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894229248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 6166us (6605us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317854.285560:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3536
00000100:00100000:0.0:1767317854.288316:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317854.288407:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229120
00000100:00100000:3.0:1767317854.288420:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229120
00000100:00100000:3.0:1767317854.288532:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15791
00000100:00100000:3.0:1767317854.288542:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317854.288565:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317854.288646:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 104us (339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317854.288703:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15791
00010000:00010000:2.0:1767317854.637148:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317855.213093:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317855.662644:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317855.724974:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317830/real 1767317830]  req@ffff93cf47964700 x1853163940107904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317855 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767317855.725001:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47964700 x1853163940107904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767317855.725016:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317855.725022:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767317855.725026:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940107904:0@lo:250:kworker.0
00000100:00080000:2.0:1767317855.726839:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317855.726850:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767317855.726854:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317855.726862:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3080
00000100:00080000:2.0:1767317855.726867:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317855.726874:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317855.726929:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989c00 x1853163940114432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317855.726960:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317855.726964:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317855.726966:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317855.726969:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3100
00000100:00080000:2.0:1767317855.726971:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317855.726975:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317855.726992:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988a80 x1853163940114560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317855.727003:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940114432:0@lo:250:kworker.0
00000100:00080000:2.0:1767317855.727003:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317855.727009:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317855.727012:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317855.727017:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3100
00000100:00080000:2.0:1767317855.727019:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317855.727023:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317855.727037:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a300 x1853163940114688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:1.0:1767317855.727066:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940114432 offset 0 length 520: 4
00000100:00080000:2.0:1767317855.727106:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317855.727110:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317855.727113:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317855.727117:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3100
00000100:00080000:2.0:1767317855.727121:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767317855.727122:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940114816:0@lo:400:kworker.0
00000100:00080000:2.0:1767317855.727125:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317855.727145:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698b480 x1853163940115200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317855.727154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940114560:0@lo:38:kworker.0
00000100:00080000:2.0:1767317855.727163:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317855.727167:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317855.727169:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767317855.727171:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317855.727173:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3100
00000100:00080000:2.0:1767317855.727175:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317855.727180:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317855.727189:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317855.727193:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a680 x1853163940115456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317855.727202:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317855.727209:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940114944:0@lo:400:kworker.0
00000100:00100000:2.0:1767317855.727221:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940115072:0@lo:400:kworker.0
00000100:00100000:1.0:1767317855.727227:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940114688:0@lo:38:kworker.0
00000100:00100000:0.0:1767317855.727235:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317855.727250:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317855.727270:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317855.727271:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114816
00000100:00100000:2.0:1767317855.727272:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767317855.727279:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940115328:0@lo:400:kworker.0
00000100:00100000:0.0:1767317855.727284:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114816
00000100:00100000:1.0:1767317855.727299:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940115200:0@lo:38:kworker.0
00000100:00100000:2.0:1767317855.727318:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317855.727342:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114944
00000100:00100000:0.0:1767317855.727345:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114944
00000100:00080000:1.0:1767317855.727359:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317855.727374:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347
00000100:00100000:1.0:1767317855.727384:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348
00000100:00100000:0.0:1767317855.727386:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940114816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317855.727397:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114560
00000100:00100000:1.0:1767317855.727399:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940114944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317855.727401:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114560
00000100:00100000:3.0:1767317855.727427:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115072
00000100:00100000:3.0:1767317855.727437:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115072
00000100:00100000:3.0:1767317855.727475:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115328
00000100:00100000:3.0:1767317855.727478:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115328
00000100:00100000:3.0:1767317855.727507:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537
00000100:00100000:3.0:1767317855.727514:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940115072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317855.729135:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538
00000100:00100000:1.0:1767317855.729138:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940114944:12345-0@lo:400:kworker.0 Request processed in 1741us (1901us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317855.729151:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348
00000100:00100000:2.0:1767317855.729154:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940115328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317855.729215:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940115328:12345-0@lo:400:kworker.0 Request processed in 70us (1910us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317855.729222:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538
00000100:00100000:2.0:1767317855.729243:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15792
00000100:00100000:2.0:1767317855.729248:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940114560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317855.729267:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317855.729293:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940114560:12345-0@lo:38:kworker.0 Request processed in 44us (2105us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317855.729447:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15792
00000100:00100000:2.0:1767317855.729497:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940115328:0@lo:400:kworker.0
00000100:00100000:2.0:1767317855.729523:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317855.729530:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940114944:0@lo:400:kworker.0
00000100:00100000:2.0:1767317855.729553:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940115456:0@lo:38:kworker.0
00000100:00100000:1.0:1767317855.729574:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115200
00000100:00100000:1.0:1767317855.729580:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115200
00000100:00100000:2.0:1767317855.729588:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317855.729611:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115456
00000100:00100000:1.0:1767317855.729615:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115456
00000100:00080000:2.0:1767317855.729615:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317855.729634:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317855.729638:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940114560:0@lo:38:kworker.0
00000100:00100000:1.0:1767317855.729653:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15793
00000100:00100000:1.0:1767317855.729659:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940115200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317855.729671:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317855.729673:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15794
00000100:00100000:2.0:1767317855.729680:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940115456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317855.729691:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317855.729709:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940115200:12345-0@lo:38:kworker.0 Request processed in 48us (185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317855.729718:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15793
00000100:00100000:2.0:1767317855.729724:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940115456:12345-0@lo:38:kworker.0 Request processed in 42us (135us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317855.729731:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15794
00000100:00100000:1.0:1767317855.729745:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940114688
00000100:00100000:1.0:1767317855.729750:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940114688
00000100:00080000:2.0:1767317855.729766:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317855.729791:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317855.729795:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940115200:0@lo:38:kworker.0
00000100:00100000:1.0:1767317855.729799:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831
00000100:00100000:1.0:1767317855.729806:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940114688:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767317855.729808:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317855.729813:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317855.729817:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940115456:0@lo:38:kworker.0
00010000:00020000:1.0:1767317855.729841:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767317855.729856:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317855.729896:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940114688:12345-0@lo:38:kworker.0 Request processed in 88us (2626us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317855.729903:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831
00000100:00080000:2.0:1767317855.729918:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317855.729924:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317855.729939:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940114688:0@lo:38:kworker.0
00000100:00100000:0.0:1767317855.730258:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940114816:12345-0@lo:400:kworker.0 Request processed in 2874us (3085us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317855.730267:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347
00000100:00100000:1.0:1767317855.731135:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940114816:0@lo:400:kworker.0
00000100:00100000:3.0:1767317855.736544:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940115072:12345-0@lo:400:kworker.0 Request processed in 9015us (9278us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317855.736565:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537
00000100:00100000:2.0:1767317855.737538:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940115072:0@lo:400:kworker.0
00000100:00100000:0.0:1767317856.237841:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317856.685930:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317857.260905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317857.710539:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317858.285371:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940115584:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317858.285444:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317858.288470:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115584
00000100:00100000:0.0:1767317858.289371:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115584
00000100:00100000:0.0:1767317858.289445:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850
00000100:00100000:0.0:1767317858.289454:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940115584:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317858.289524:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317858.290137:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00002000:00000024:0.0:1767317858.290230:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317858.293811:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940115584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4311us (8320us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317858.293829:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850
00000100:00100000:1.0:1767317858.298527:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940115584:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317858.738807:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317859.309219:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317859.310275:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317859.310303:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940115712:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317859.310393:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317859.310981:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115712
00000100:00100000:0.0:1767317859.310991:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115712
00000100:00100000:0.0:1767317859.311088:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851
00000100:00100000:0.0:1767317859.311099:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940115712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317859.311137:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317859.311208:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940115712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (816us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317859.311217:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851
00000100:00080000:2.0:1767317859.311425:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317859.311508:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940115712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317859.399556:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317859.399712:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229376
00000100:00100000:3.0:1767317859.399726:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229376
00000100:00100000:3.0:1767317859.399823:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15795
00000100:00100000:3.0:1767317859.399832:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317859.399858:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317859.400044:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 211us (500us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317859.400053:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15795
00000100:00100000:0.0:1767317859.408564:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317859.411460:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229504
00000100:00100000:2.0:1767317859.411473:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229504
00000100:00100000:2.0:1767317859.411570:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3539
00000100:00100000:2.0:1767317859.411578:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894229504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317859.411664:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894229504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (3112us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317859.411672:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3539
00000100:00080000:3.0:1767317859.417229:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317859.757343:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317860.332959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317860.781317:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317860.847415:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317860.847429:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317860.847432:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317860.847447:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317860.847452:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317860.847495:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3105
00000100:00080000:3.0:1767317860.847501:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317860.847508:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317860.847553:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7100 x1853163940115840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317860.847591:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317860.847595:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317860.847596:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317860.847600:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3105
00000100:00080000:3.0:1767317860.847602:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317860.847605:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317860.847620:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6680 x1853163940115968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317860.847690:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317860.847694:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317860.847696:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317860.847699:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3105
00000100:00080000:3.0:1767317860.847701:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317860.847705:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317860.847717:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4e00 x1853163940116480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317860.847733:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317860.847737:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317860.847738:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317860.847760:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3105
00000100:00080000:3.0:1767317860.847763:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317860.847767:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317860.847819:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4700 x1853163940116736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317860.847867:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940116352:0@lo:400:kworker.0
00000100:00100000:3.0:1767317860.847950:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317860.848016:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317860.848023:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940116608:0@lo:400:kworker.0
00000100:00100000:3.0:1767317860.848047:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317860.848153:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116096:0@lo:400:kworker.0
00000100:00100000:1.0:1767317860.848191:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317860.848227:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317860.848232:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116224:0@lo:400:kworker.0
00000100:00100000:1.0:1767317860.848253:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317860.848289:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116096
00000100:00100000:1.0:1767317860.848296:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116096
00000100:00100000:1.0:1767317860.848349:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116224
00000100:00100000:1.0:1767317860.848351:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116224
00000100:00100000:1.0:1767317860.848370:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349
00000100:00100000:1.0:1767317860.848378:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317860.848425:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116096:12345-0@lo:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317860.848433:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349
00000100:00100000:1.0:1767317860.848458:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350
00000100:00100000:1.0:1767317860.848464:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317860.848493:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116224:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317860.848499:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350
00000100:00080000:1.0:1767317860.848518:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317860.848555:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116224:0@lo:400:kworker.0
00000100:00100000:1.0:1767317860.848566:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116096:0@lo:400:kworker.0
00000100:00100000:2.0:1767317860.850444:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116352
00000100:00100000:2.0:1767317860.850456:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116352
00000100:00100000:2.0:1767317860.850538:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116608
00000100:00100000:2.0:1767317860.850541:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116608
00000100:00100000:2.0:1767317860.850586:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540
00000100:00100000:2.0:1767317860.850597:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940116352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317860.850693:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940116352:12345-0@lo:400:kworker.0 Request processed in 98us (2742us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317860.850701:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540
00000100:00100000:2.0:1767317860.850719:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541
00000100:00100000:2.0:1767317860.850725:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940116608:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767317860.851227:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317860.851292:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940116608:12345-0@lo:400:kworker.0 Request processed in 567us (3243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317860.851299:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541
00000100:00100000:0.0:1767317860.851425:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940115840:0@lo:38:kworker.0
00000100:00100000:0.0:1767317860.851480:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317860.851510:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940115968:0@lo:38:kworker.0
00000100:00100000:0.0:1767317860.851540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317860.851562:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940116480:0@lo:38:kworker.0
00000100:00100000:0.0:1767317860.851588:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317860.856517:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940116608:0@lo:400:kworker.0
00000100:00100000:2.0:1767317860.856537:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940116352:0@lo:400:kworker.0
00000100:00100000:2.0:1767317860.856685:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115968
00000100:00100000:2.0:1767317860.856693:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115968
00000100:00100000:2.0:1767317860.856735:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832
00000100:00100000:2.0:1767317860.856742:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940115968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317860.856806:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317860.856901:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940115968:12345-0@lo:38:kworker.0 Request processed in 157us (5359us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317860.856917:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832
00000100:00100000:1.0:1767317860.857832:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940115840
00000100:00100000:1.0:1767317860.857840:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940115840
00000100:00100000:1.0:1767317860.857876:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116480
00000100:00100000:1.0:1767317860.857879:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116480
00000100:00100000:1.0:1767317860.857901:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15796
00000100:00100000:1.0:1767317860.857907:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940115840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317860.857925:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317860.857971:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940115840:12345-0@lo:38:kworker.0 Request processed in 63us (6491us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317860.857978:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15796
00000100:00100000:1.0:1767317860.857991:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15797
00000100:00100000:1.0:1767317860.857993:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940116480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317860.858000:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317860.858017:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940116480:12345-0@lo:38:kworker.0 Request processed in 23us (6429us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317860.858021:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15797
00000100:00100000:0.0:1767317860.860564:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940116736:0@lo:38:kworker.0
00000100:00100000:0.0:1767317860.860652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317860.860727:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317860.860733:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317860.860737:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940115840:0@lo:38:kworker.0
00000100:00080000:0.0:1767317860.860758:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317860.860762:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317860.860765:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940115968:0@lo:38:kworker.0
00000100:00080000:0.0:1767317860.860797:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317860.860801:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317860.860804:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940116480:0@lo:38:kworker.0
00000100:00100000:1.0:1767317860.860894:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116736
00000100:00100000:1.0:1767317860.860916:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116736
00000100:00100000:1.0:1767317860.860963:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15798
00000100:00100000:1.0:1767317860.860970:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940116736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317860.860989:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317860.861031:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940116736:12345-0@lo:38:kworker.0 Request processed in 60us (378us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317860.861038:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15798
00000100:00080000:0.0:1767317860.861422:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317860.861427:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317860.861430:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940116736:0@lo:38:kworker.0
00000100:00100000:3.0:1767317861.357143:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317861.805250:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317862.380938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317862.831347:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317863.405023:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317863.405030:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317863.405053:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940116864:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767317863.405143:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317863.405701:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116864
00000100:00100000:1.0:1767317863.405711:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116864
00000100:00080000:3.0:1767317863.406035:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317863.406083:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852
00000100:00100000:1.0:1767317863.406095:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940116864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767317863.406127:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767317863.406195:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940116864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1052us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317863.406203:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852
00000100:00100000:3.0:1767317863.406258:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940116864:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767317863.853225:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317864.429468:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317864.429495:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116992:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317864.429564:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317864.429796:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317864.429903:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940116992
00000100:00100000:3.0:1767317864.429911:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940116992
00000100:00100000:3.0:1767317864.429983:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853
00000100:00100000:3.0:1767317864.429994:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317864.430028:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317864.430087:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940116992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (522us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317864.430094:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853
00000100:00100000:2.0:1767317864.430237:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940116992:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317864.430333:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317864.529157:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317864.529203:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317864.529348:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229632
00000100:00100000:2.0:1767317864.529360:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229632
00000100:00100000:2.0:1767317864.529413:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229760
00000100:00100000:2.0:1767317864.529417:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229760
00000100:00100000:2.0:1767317864.529472:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3542
00000100:00100000:2.0:1767317864.529483:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894229760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317864.529554:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894229760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (350us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317864.529563:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3542
00000100:00100000:2.0:1767317864.529597:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15799
00000100:00100000:2.0:1767317864.529602:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317864.529623:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317864.529649:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (503us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317864.529655:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15799
00000100:00080000:1.0:1767317864.530667:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317864.876996:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317865.452913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317865.902582:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317865.965816:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317865.965827:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317865.965830:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317865.965833:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317865.965836:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317865.965844:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3110
00000100:00080000:2.0:1767317865.965848:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317865.965854:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317865.965896:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046addc00 x1853163940117120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317865.965920:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317865.965924:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317865.965926:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317865.965930:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3110
00000100:00080000:2.0:1767317865.965932:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317865.965935:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317865.965948:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adce00 x1853163940117248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317865.966026:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317865.966029:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317865.966031:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317865.966034:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3110
00000100:00080000:2.0:1767317865.966037:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317865.966041:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317865.966053:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adea00 x1853163940117760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317865.966067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317865.966070:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317865.966071:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317865.966075:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3110
00000100:00080000:2.0:1767317865.966077:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317865.966081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317865.966089:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adc700 x1853163940118016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317865.966118:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940117504:0@lo:400:kworker.0
00000100:00100000:2.0:1767317865.966184:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317865.966241:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317865.966247:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940117376:0@lo:400:kworker.0
00000100:00100000:2.0:1767317865.966267:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317865.966292:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940117632:0@lo:400:kworker.0
00000100:00100000:2.0:1767317865.966317:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317865.966342:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767317865.966347:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940117888:0@lo:400:kworker.0
00000100:00100000:2.0:1767317865.966368:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317865.966535:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117504
00000100:00100000:1.0:1767317865.966543:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117504
00000100:00100000:1.0:1767317865.966592:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117376
00000100:00100000:1.0:1767317865.966596:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117376
00000100:00100000:1.0:1767317865.966637:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767317865.966646:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940117504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.966701:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940117504:12345-0@lo:400:kworker.0 Request processed in 56us (517us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317865.966708:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767317865.966724:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352
00000100:00100000:1.0:1767317865.966742:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940117376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.966769:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940117376:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317865.966796:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352
00000100:00100000:1.0:1767317865.966816:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117632
00000100:00100000:1.0:1767317865.966819:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117632
00000100:00100000:1.0:1767317865.966843:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117888
00000100:00100000:1.0:1767317865.966847:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117888
00000100:00100000:1.0:1767317865.966868:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543
00000100:00100000:1.0:1767317865.966874:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940117632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.966909:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940117632:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317865.966915:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543
00000100:00100000:1.0:1767317865.966927:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544
00000100:00100000:1.0:1767317865.966932:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940117888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.966956:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940117888:12345-0@lo:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317865.966961:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544
00000100:00080000:1.0:1767317865.966978:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767317865.966982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317865.967015:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940117376:0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.967035:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940117504:0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.967062:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940117888:0@lo:400:kworker.0
00000100:00100000:1.0:1767317865.967070:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940117632:0@lo:400:kworker.0
00000100:00100000:0.0:1767317865.967396:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940117120:0@lo:38:kworker.0
00000100:00100000:0.0:1767317865.967442:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317865.967468:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940117248:0@lo:38:kworker.0
00000100:00100000:0.0:1767317865.967489:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317865.967504:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940117760:0@lo:38:kworker.0
00000100:00100000:0.0:1767317865.967522:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317865.967536:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940118016:0@lo:38:kworker.0
00000100:00100000:0.0:1767317865.967553:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317865.967720:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117120
00000100:00100000:3.0:1767317865.967740:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117120
00000100:00100000:3.0:1767317865.967771:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117760
00000100:00100000:3.0:1767317865.967791:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117760
00000100:00100000:3.0:1767317865.967806:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118016
00000100:00100000:3.0:1767317865.967808:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118016
00000100:00100000:3.0:1767317865.967823:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15800
00000100:00100000:3.0:1767317865.967828:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940117120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317865.967846:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317865.967883:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940117120:12345-0@lo:38:kworker.0 Request processed in 53us (440us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317865.967889:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15800
00000100:00100000:3.0:1767317865.967904:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15801
00000100:00100000:3.0:1767317865.967908:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940117760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317865.967917:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317865.967946:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940117760:12345-0@lo:38:kworker.0 Request processed in 37us (423us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317865.967951:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15801
00000100:00100000:3.0:1767317865.967963:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15802
00000100:00100000:3.0:1767317865.967966:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940118016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317865.967975:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317865.967995:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940118016:12345-0@lo:38:kworker.0 Request processed in 28us (441us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317865.968000:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15802
00000100:00080000:3.0:1767317865.968032:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317865.968036:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317865.968039:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940117120:0@lo:38:kworker.0
00000100:00080000:3.0:1767317865.968063:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317865.968066:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317865.968069:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940117760:0@lo:38:kworker.0
00000100:00080000:3.0:1767317865.968074:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317865.968077:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317865.968080:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940118016:0@lo:38:kworker.0
00000100:00100000:1.0:1767317865.968655:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940117248
00000100:00100000:1.0:1767317865.968661:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940117248
00000100:00100000:1.0:1767317865.968696:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833
00000100:00100000:1.0:1767317865.968700:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940117248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317865.968712:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317865.968767:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940117248:12345-0@lo:38:kworker.0 Request processed in 65us (1277us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317865.968794:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833
00000100:00080000:0.0:1767317865.968878:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317865.968883:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317865.968886:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940117248:0@lo:38:kworker.0
00000100:00100000:0.0:1767317866.476964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317866.925906:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317867.502628:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317867.949025:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317868.524930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317868.525034:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317868.525056:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940118144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317868.525128:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317868.525173:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118144
00000100:00100000:0.0:1767317868.525180:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118144
00000100:00100000:0.0:1767317868.525241:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854
00000100:00100000:0.0:1767317868.525250:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940118144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317868.525281:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317868.525335:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940118144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (207us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317868.525342:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854
00000100:00100000:2.0:1767317868.525435:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940118144:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767317868.525540:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767317868.973070:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317869.549083:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317869.549119:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940118272:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317869.549205:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317869.549501:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118272
00000100:00100000:0.0:1767317869.549509:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118272
00000100:00100000:0.0:1767317869.549579:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855
00000100:00100000:0.0:1767317869.549598:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940118272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317869.549647:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317869.549734:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940118272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (529us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317869.549741:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855
00000100:00080000:2.0:1767317869.549964:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317869.550018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317869.550062:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940118272:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317869.639346:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317869.639393:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317869.639556:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230016
00000100:00100000:1.0:1767317869.639568:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230016
00000100:00100000:1.0:1767317869.639641:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894229888
00000100:00100000:1.0:1767317869.639645:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894229888
00000100:00100000:1.0:1767317869.639664:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3545
00000100:00100000:1.0:1767317869.639674:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894230016:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317869.639758:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894230016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (422us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317869.639804:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3545
00000100:00100000:1.0:1767317869.639824:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15803
00000100:00100000:1.0:1767317869.639828:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229888:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317869.639849:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317869.639878:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894229888:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (484us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317869.639884:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15803
00000100:00080000:2.0:1767317869.640073:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767317869.997221:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317870.573680:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317871.021082:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317871.085766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317871.085791:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317871.085794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317871.085799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317871.085803:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317871.085811:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3115
00000100:00080000:3.0:1767317871.085816:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317871.085822:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317871.085864:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d880 x1853163940118400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317871.085891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317871.085895:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317871.085897:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317871.085900:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3115
00000100:00080000:3.0:1767317871.085903:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317871.085906:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317871.085922:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7f480 x1853163940118528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317871.085989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317871.085992:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317871.085994:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317871.085998:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3115
00000100:00080000:3.0:1767317871.086000:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317871.086004:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317871.086013:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940119040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317871.086028:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317871.086030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317871.086032:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317871.086035:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3115
00000100:00080000:3.0:1767317871.086037:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317871.086040:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317871.086050:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7e680 x1853163940119296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317871.086175:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940118400:0@lo:38:kworker.0
00000100:00100000:0.0:1767317871.086242:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317871.086299:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940118528:0@lo:38:kworker.0
00000100:00100000:0.0:1767317871.086320:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317871.086333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940119040:0@lo:38:kworker.0
00000100:00100000:0.0:1767317871.086350:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317871.086362:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940119296:0@lo:38:kworker.0
00000100:00100000:0.0:1767317871.086380:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317871.086415:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118400
00000100:00100000:0.0:1767317871.086423:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118400
00000100:00100000:0.0:1767317871.086450:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119040
00000100:00100000:0.0:1767317871.086453:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119040
00000100:00100000:0.0:1767317871.086464:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119296
00000100:00100000:0.0:1767317871.086467:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119296
00000100:00100000:0.0:1767317871.086482:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15804
00000100:00100000:0.0:1767317871.086490:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940118400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317871.086510:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317871.086549:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940118400:12345-0@lo:38:kworker.0 Request processed in 59us (307us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317871.086556:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15804
00000100:00100000:0.0:1767317871.086572:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15805
00000100:00100000:0.0:1767317871.086583:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940119040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317871.086593:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317871.086617:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940119040:12345-0@lo:38:kworker.0 Request processed in 34us (266us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317871.086622:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15805
00000100:00100000:0.0:1767317871.086634:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15806
00000100:00100000:0.0:1767317871.086637:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940119296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317871.086646:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317871.086666:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940119296:12345-0@lo:38:kworker.0 Request processed in 27us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317871.086671:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15806
00000100:00080000:0.0:1767317871.086708:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317871.086712:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317871.086716:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940118400:0@lo:38:kworker.0
00000100:00080000:0.0:1767317871.086725:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317871.086728:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317871.086730:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940119040:0@lo:38:kworker.0
00000100:00080000:0.0:1767317871.086737:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317871.086740:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317871.086743:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940119296:0@lo:38:kworker.0
00000100:00100000:2.0:1767317871.086842:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940118784:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.086872:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317871.086908:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317871.086914:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940118656:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.086933:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317871.086956:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940119168:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.086976:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317871.086991:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317871.086996:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940118912:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.087013:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317871.087033:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119168
00000100:00100000:2.0:1767317871.087036:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119168
00000100:00100000:2.0:1767317871.087074:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118912
00000100:00100000:2.0:1767317871.087077:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118912
00000100:00100000:2.0:1767317871.087093:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3546
00000100:00100000:2.0:1767317871.087105:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940119168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.087145:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940119168:12345-0@lo:400:kworker.0 Request processed in 40us (168us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317871.087151:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3546
00000100:00100000:2.0:1767317871.087162:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547
00000100:00100000:2.0:1767317871.087167:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940118912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.087189:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940118912:12345-0@lo:400:kworker.0 Request processed in 22us (175us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317871.087194:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547
00000100:00080000:2.0:1767317871.087207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317871.087227:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940118912:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.087235:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940119168:0@lo:400:kworker.0
00000100:00100000:0.0:1767317871.087666:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118784
00000100:00100000:0.0:1767317871.087670:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118784
00000100:00100000:0.0:1767317871.087728:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118656
00000100:00100000:0.0:1767317871.087731:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118656
00000100:00100000:0.0:1767317871.087749:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353
00000100:00100000:0.0:1767317871.087763:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940118784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317871.087818:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940118784:12345-0@lo:400:kworker.0 Request processed in 56us (945us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317871.087824:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353
00000100:00100000:0.0:1767317871.087836:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354
00000100:00100000:0.0:1767317871.087842:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940118656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317871.087865:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940118656:12345-0@lo:400:kworker.0 Request processed in 24us (932us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317871.087869:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354
00000100:00080000:1.0:1767317871.087919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317871.087921:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317871.089379:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940118528
00000100:00100000:3.0:1767317871.089389:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940118528
00000100:00100000:3.0:1767317871.089435:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834
00000100:00100000:3.0:1767317871.089442:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940118528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317871.089462:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317871.089532:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940118528:12345-0@lo:38:kworker.0 Request processed in 88us (3209us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317871.089539:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834
00000100:00100000:2.0:1767317871.089876:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940118656:0@lo:400:kworker.0
00000100:00100000:2.0:1767317871.089889:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940118784:0@lo:400:kworker.0
00000100:00080000:0.0:1767317871.090017:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317871.090023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317871.090027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940118528:0@lo:38:kworker.0
00000100:00100000:1.0:1767317871.597037:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317872.049238:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317872.621331:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317873.069018:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317873.645583:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317873.646587:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317873.646609:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940119424:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317873.646691:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317873.646890:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119424
00000100:00100000:3.0:1767317873.646900:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119424
00000100:00100000:3.0:1767317873.646975:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856
00000100:00100000:3.0:1767317873.646990:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940119424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317873.647028:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317873.647092:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940119424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317873.647100:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856
00000100:00100000:1.0:1767317873.647128:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940119424:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317873.648943:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317874.093865:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317874.668987:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317874.669454:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767317874.669480:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940119552:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317874.669576:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317874.669637:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119552
00000100:00100000:0.0:1767317874.669646:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119552
00000100:00100000:0.0:1767317874.669721:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857
00000100:00100000:0.0:1767317874.669730:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940119552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317874.669762:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767317874.669837:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317874.669838:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940119552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (271us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317874.669845:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857
00000100:00100000:1.0:1767317874.669929:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940119552:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317874.759582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317874.759687:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230400
00000100:00100000:3.0:1767317874.759698:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230400
00000100:00100000:3.0:1767317874.759809:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3548
00000100:00100000:3.0:1767317874.759822:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894230400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767317874.759979:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317874.760366:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894230400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 546us (790us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317874.760376:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3548
00000400:00000100:2.0:1767317874.760503:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894230144 offset 0 length 520: 4
00000100:00100000:2.0:1767317874.760586:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317874.760687:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230272
00000100:00100000:3.0:1767317874.760692:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230272
00000100:00100000:3.0:1767317874.760726:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15807
00000100:00100000:3.0:1767317874.760731:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230272:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317874.760752:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317874.760816:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 82us (229us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317874.760823:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15807
00010000:00010000:0.0:1767317875.124053:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317875.693590:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317876.141299:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317876.205504:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317876.205513:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317876.205516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317876.205520:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317876.205524:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317876.205533:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3121
00000100:00080000:2.0:1767317876.205537:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317876.205545:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317876.205593:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988380 x1853163940119680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317876.205609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317876.205612:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317876.205614:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317876.205617:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3121
00000100:00080000:2.0:1767317876.205619:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317876.205622:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317876.205644:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a300 x1853163940119808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317876.205702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317876.205705:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317876.205707:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317876.205710:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3121
00000100:00080000:2.0:1767317876.205727:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317876.205731:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317876.205744:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698b100 x1853163940120320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317876.205758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317876.205761:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317876.205763:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317876.205765:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3121
00000100:00080000:2.0:1767317876.205767:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317876.205770:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317876.205798:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d500 x1853163940120576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317876.205829:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940120448:0@lo:400:kworker.0
00000100:00100000:2.0:1767317876.205890:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317876.205948:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317876.205954:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940120192:0@lo:400:kworker.0
00000100:00100000:2.0:1767317876.205973:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317876.206159:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940120064:0@lo:400:kworker.0
00000100:00100000:3.0:1767317876.206193:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317876.206226:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767317876.206239:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940119936:0@lo:400:kworker.0
00000100:00100000:3.0:1767317876.206269:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317876.206297:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120448
00000100:00100000:3.0:1767317876.206305:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120448
00000100:00100000:3.0:1767317876.206364:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120192
00000100:00100000:3.0:1767317876.206367:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120192
00000100:00100000:3.0:1767317876.206393:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549
00000100:00100000:3.0:1767317876.206400:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940120448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317876.206447:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940120448:12345-0@lo:400:kworker.0 Request processed in 47us (556us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317876.206453:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549
00000100:00100000:3.0:1767317876.206470:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550
00000100:00100000:3.0:1767317876.206476:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940120192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317876.206499:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940120192:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317876.206504:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550
00000100:00080000:3.0:1767317876.206520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317876.206568:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940120192:0@lo:400:kworker.0
00000100:00100000:3.0:1767317876.206581:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940120448:0@lo:400:kworker.0
00000100:00100000:1.0:1767317876.206863:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120064
00000100:00100000:1.0:1767317876.206868:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120064
00000100:00100000:1.0:1767317876.206902:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119936
00000100:00100000:1.0:1767317876.206905:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119936
00000100:00100000:1.0:1767317876.206924:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355
00000100:00100000:1.0:1767317876.206931:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940120064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317876.206980:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940120064:12345-0@lo:400:kworker.0 Request processed in 50us (786us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317876.206987:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355
00000100:00100000:1.0:1767317876.207000:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356
00000100:00100000:1.0:1767317876.207006:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940119936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317876.207042:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940119936:12345-0@lo:400:kworker.0 Request processed in 36us (772us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317876.207047:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356
00000100:00100000:1.0:1767317876.207173:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940119936:0@lo:400:kworker.0
00000100:00100000:1.0:1767317876.207183:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940120064:0@lo:400:kworker.0
00000100:00080000:1.0:1767317876.207198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317876.207201:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317876.207882:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940119680:0@lo:38:kworker.0
00000100:00100000:0.0:1767317876.207925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317876.207961:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940119808:0@lo:38:kworker.0
00000100:00100000:0.0:1767317876.207986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317876.208029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940120320:0@lo:38:kworker.0
00000100:00100000:0.0:1767317876.208053:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317876.208072:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940120576:0@lo:38:kworker.0
00000100:00100000:0.0:1767317876.208095:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317876.208137:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119680
00000100:00100000:0.0:1767317876.208143:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119680
00000100:00100000:0.0:1767317876.208168:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120320
00000100:00100000:0.0:1767317876.208171:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120320
00000100:00100000:0.0:1767317876.208181:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120576
00000100:00100000:0.0:1767317876.208183:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120576
00000100:00100000:0.0:1767317876.208196:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15808
00000100:00100000:0.0:1767317876.208201:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940119680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317876.208220:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317876.208254:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940119680:12345-0@lo:38:kworker.0 Request processed in 51us (329us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317876.208260:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15808
00000100:00100000:0.0:1767317876.208273:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15809
00000100:00100000:0.0:1767317876.208276:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940120320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317876.208285:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317876.208308:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940120320:12345-0@lo:38:kworker.0 Request processed in 30us (255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317876.208314:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15809
00000100:00100000:0.0:1767317876.208324:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15810
00000100:00100000:0.0:1767317876.208328:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940120576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317876.208337:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317876.208375:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940120576:12345-0@lo:38:kworker.0 Request processed in 45us (279us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317876.208388:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15810
00000100:00080000:0.0:1767317876.208436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317876.208441:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317876.208445:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940119680:0@lo:38:kworker.0
00000100:00080000:0.0:1767317876.208453:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317876.208457:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317876.208459:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940120320:0@lo:38:kworker.0
00000100:00080000:0.0:1767317876.208467:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317876.208470:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317876.208473:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940120576:0@lo:38:kworker.0
00000100:00100000:2.0:1767317876.208914:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940119808
00000100:00100000:2.0:1767317876.208919:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940119808
00000100:00100000:2.0:1767317876.208952:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835
00000100:00100000:2.0:1767317876.208957:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940119808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317876.208968:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317876.209011:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940119808:12345-0@lo:38:kworker.0 Request processed in 53us (1023us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317876.209024:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835
00000100:00080000:0.0:1767317876.211946:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317876.211958:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317876.211964:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940119808:0@lo:38:kworker.0
00000100:00100000:1.0:1767317876.717213:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317877.165921:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317877.741814:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317878.191029:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317878.765751:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317878.767815:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940120704:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317878.767898:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317878.768046:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120704
00000100:00100000:2.0:1767317878.768057:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120704
00000100:00100000:2.0:1767317878.768126:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858
00000100:00100000:2.0:1767317878.768135:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940120704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317878.768172:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767317878.768316:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767317878.790386:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940120704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 22240us (22476us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317878.790412:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858
00000100:00100000:1.0:1767317878.793870:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940120704:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317879.213043:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317879.789293:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317879.799226:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317879.799265:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940120832:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317879.799614:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317879.808014:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940120832
00000100:00100000:2.0:1767317879.808030:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940120832
00000100:00100000:2.0:1767317879.808098:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859
00000100:00100000:2.0:1767317879.808107:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940120832:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767317879.808344:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:2.0:1767317879.808534:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317879.808656:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940120832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 549us (9041us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317879.808664:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859
00000100:00100000:1.0:1767317879.810017:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940120832:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317879.881077:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317879.881128:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317879.881214:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230656
00000100:00100000:1.0:1767317879.881225:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230656
00000100:00100000:1.0:1767317879.881303:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230528
00000100:00100000:1.0:1767317879.881307:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230528
00000100:00100000:1.0:1767317879.881348:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3551
00000100:00080000:0.0:1767317879.881458:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317879.881477:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15811
00000100:00100000:0.0:1767317879.881484:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317879.881510:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317879.881572:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 87us (443us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317879.881589:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15811
00000100:00100000:1.0:1767317879.881941:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894230656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317879.882000:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894230656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 644us (933us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317879.882007:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3551
00010000:00010000:0.0:1767317880.238345:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317880.300883:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317855/real 1767317855]  req@ffff93d046989c00 x1853163940114432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317880 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317880.300920:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d046989c00 x1853163940114432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317880 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767317880.300944:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317880.300968:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767317880.300973:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940114432:0@lo:250:kworker.0
00000100:00080000:1.0:1767317880.301092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317880.301100:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767317880.301103:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317880.301109:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3105
00000100:00080000:1.0:1767317880.301113:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317880.301120:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317880.301156:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7100 x1853163940120960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317880.301180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317880.301183:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317880.301185:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317880.301188:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3126
00000100:00080000:1.0:1767317880.301190:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317880.301194:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317880.301209:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4380 x1853163940121088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317880.301218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317880.301221:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317880.301223:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317880.301226:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3126
00000100:00080000:1.0:1767317880.301252:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317880.301257:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317880.301271:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4a80 x1853163940121216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317880.301330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317880.301334:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317880.301336:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317880.301339:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3126
00000100:00080000:1.0:1767317880.301341:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317880.301345:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317880.301357:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399ea00 x1853163940121728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317880.301358:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940121344:0@lo:400:kworker.0
00000100:00080000:1.0:1767317880.301372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317880.301374:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317880.301376:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317880.301379:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3126
00000100:00080000:1.0:1767317880.301380:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317880.301383:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317880.301391:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399c700 x1853163940121984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317880.301430:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317880.301484:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317880.301491:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940121472:0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301513:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317880.301545:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940121856:0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301561:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121344
00000100:00100000:3.0:1767317880.301568:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121344
00000100:00100000:0.0:1767317880.301575:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317880.301593:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317880.301609:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940121600:0@lo:400:kworker.0
00000100:00100000:0.0:1767317880.301628:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317880.301632:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121472
00000100:00100000:3.0:1767317880.301636:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121472
00000100:00080000:0.0:1767317880.301650:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317880.301659:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357
00000100:00100000:0.0:1767317880.301662:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121856
00000100:00100000:0.0:1767317880.301664:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121856
00000100:00100000:3.0:1767317880.301667:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940121344:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317880.301693:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121600
00000100:00100000:0.0:1767317880.301696:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121600
00000100:00100000:0.0:1767317880.301713:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552
00000100:00100000:3.0:1767317880.301714:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940121344:12345-0@lo:400:kworker.0 Request processed in 47us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317880.301718:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940121856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301720:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357
00000100:00100000:0.0:1767317880.301748:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940121856:12345-0@lo:400:kworker.0 Request processed in 30us (172us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317880.301750:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358
00000100:00100000:0.0:1767317880.301754:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552
00000100:00100000:3.0:1767317880.301757:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940121472:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317880.301766:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553
00000100:00100000:0.0:1767317880.301794:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940121600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301799:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940121472:12345-0@lo:400:kworker.0 Request processed in 43us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317880.301804:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358
00000100:00100000:0.0:1767317880.301818:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940121600:12345-0@lo:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317880.301824:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553
00000100:00080000:0.0:1767317880.301839:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317880.301842:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940121472:0@lo:400:kworker.0
00000100:00100000:0.0:1767317880.301851:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940121600:0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301851:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940121344:0@lo:400:kworker.0
00000100:00100000:0.0:1767317880.301859:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940121856:0@lo:400:kworker.0
00000100:00100000:3.0:1767317880.301876:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940120960:0@lo:250:kworker.0
00000400:00000100:3.0:1767317880.301896:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940120960 offset 0 length 520: 4
00000100:00100000:3.0:1767317880.301923:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940121088:0@lo:38:kworker.0
00000100:00100000:3.0:1767317880.301944:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317880.301956:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940121216:0@lo:38:kworker.0
00000100:00100000:1.0:1767317880.301961:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121088
00000100:00100000:1.0:1767317880.301965:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121088
00000100:00100000:3.0:1767317880.301978:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317880.301986:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15812
00000100:00100000:1.0:1767317880.301990:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121088:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317880.301992:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940121728:0@lo:38:kworker.0
00010000:00020000:1.0:1767317880.302009:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317880.302009:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317880.302024:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940121984:0@lo:38:kworker.0
00000100:00100000:3.0:1767317880.302040:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317880.302045:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121088:12345-0@lo:38:kworker.0 Request processed in 54us (101us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317880.302051:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15812
00000100:00100000:1.0:1767317880.302064:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121728
00000100:00080000:3.0:1767317880.302064:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767317880.302066:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121728
00000100:00080000:3.0:1767317880.302068:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317880.302070:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940121088:0@lo:38:kworker.0
00000100:00100000:1.0:1767317880.302074:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121984
00000100:00100000:1.0:1767317880.302076:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121984
00000100:00100000:1.0:1767317880.302084:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15813
00000100:00100000:1.0:1767317880.302088:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121728:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317880.302091:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940121216
00000100:00100000:3.0:1767317880.302093:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940121216
00010000:00020000:1.0:1767317880.302097:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317880.302110:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836
00000100:00100000:3.0:1767317880.302114:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940121216:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767317880.302121:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121728:12345-0@lo:38:kworker.0 Request processed in 32us (111us total) trans 0 rc -19/-19
00010000:00020000:3.0:1767317880.302124:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317880.302126:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15813
00000100:00100000:1.0:1767317880.302137:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15814
00000100:00100000:1.0:1767317880.302140:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121984:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317880.302145:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940121216:12345-0@lo:38:kworker.0 Request processed in 30us (167us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767317880.302148:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317880.302150:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836
00000100:00100000:1.0:1767317880.302166:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940121984:12345-0@lo:38:kworker.0 Request processed in 25us (125us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317880.302171:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15814
00000100:00080000:3.0:1767317880.302182:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317880.302186:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317880.302189:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940121984:0@lo:38:kworker.0
00000100:00080000:3.0:1767317880.302197:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317880.302200:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317880.302203:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940121216:0@lo:38:kworker.0
00000100:00080000:3.0:1767317880.302210:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317880.302212:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317880.302215:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940121728:0@lo:38:kworker.0
00000100:00100000:0.0:1767317880.813187:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317881.264047:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317881.841353:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317882.286939:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317882.860995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317883.310451:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317883.884995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317883.888881:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940122112:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317883.888956:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317883.889101:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122112
00000100:00100000:2.0:1767317883.889110:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122112
00000100:00100000:2.0:1767317883.889173:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860
00000100:00100000:2.0:1767317883.889183:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940122112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317883.889213:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767317883.889257:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940122112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317883.889277:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860
00000100:00100000:1.0:1767317883.889449:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940122112:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767317883.889482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317884.334474:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317884.908918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317884.911494:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317884.911521:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940122240:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317884.911616:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317884.912537:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122240
00000100:00100000:3.0:1767317884.912547:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122240
00000100:00100000:3.0:1767317884.912640:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861
00000100:00080000:1.0:1767317884.912707:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317884.912830:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940122240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317884.912920:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317884.913098:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940122240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 447us (1478us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317884.913108:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861
00000100:00100000:0.0:1767317884.913464:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940122240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317884.998597:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317884.998767:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230912
00000100:00100000:0.0:1767317884.998802:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230912
00000100:00100000:0.0:1767317884.998901:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3554
00000100:00100000:0.0:1767317884.998911:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894230912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317884.998992:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894230912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (413us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317884.998999:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3554
00000100:00080000:1.0:1767317884.999081:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317884.999698:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317884.999807:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894230784
00000100:00100000:2.0:1767317884.999813:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894230784
00000100:00100000:2.0:1767317884.999881:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15815
00000100:00100000:2.0:1767317884.999901:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317884.999936:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317885.000004:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894230784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (309us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317885.000012:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15815
00010000:00010000:0.0:1767317885.357445:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317885.427661:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317885.427690:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317885.427693:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317885.427697:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317885.427702:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317885.427710:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3130
00000100:00080000:0.0:1767317885.427714:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317885.427721:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317885.427761:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b800 x1853163940122368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317885.427844:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317885.427848:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317885.427850:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317885.427854:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3130
00000100:00080000:0.0:1767317885.427856:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317885.427860:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317885.427879:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0e00 x1853163940122496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317885.427947:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317885.427950:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317885.427952:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317885.427956:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3130
00000100:00080000:0.0:1767317885.427959:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317885.427962:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317885.427975:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0a80 x1853163940123008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317885.428014:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317885.428017:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317885.428019:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317885.428023:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3130
00000100:00080000:0.0:1767317885.428025:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317885.428028:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317885.428039:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2680 x1853163940123264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317885.428091:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940122880:0@lo:400:kworker.0
00000100:00100000:0.0:1767317885.428202:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317885.428284:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317885.428291:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940123136:0@lo:400:kworker.0
00000100:00100000:0.0:1767317885.428328:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317885.428379:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122880
00000100:00100000:0.0:1767317885.428385:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122880
00000100:00100000:0.0:1767317885.428435:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123136
00000100:00100000:0.0:1767317885.428438:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123136
00000100:00100000:0.0:1767317885.428475:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555
00000100:00100000:0.0:1767317885.428482:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940122880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317885.428527:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940122880:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317885.428534:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555
00000100:00100000:0.0:1767317885.428562:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556
00000100:00100000:0.0:1767317885.428569:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940123136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317885.428612:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940123136:12345-0@lo:400:kworker.0 Request processed in 43us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317885.428624:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556
00000100:00100000:0.0:1767317885.428671:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940123136:0@lo:400:kworker.0
00000100:00100000:0.0:1767317885.428681:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940122880:0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429197:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940122752:0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429258:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317885.429305:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317885.429312:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940122624:0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429334:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317885.429379:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122752
00000100:00100000:2.0:1767317885.429384:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122752
00000100:00100000:2.0:1767317885.429413:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122624
00000100:00100000:2.0:1767317885.429417:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122624
00000100:00100000:2.0:1767317885.429438:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359
00000100:00100000:2.0:1767317885.429445:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940122752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429480:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940122752:12345-0@lo:400:kworker.0 Request processed in 35us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317885.429486:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359
00000100:00100000:2.0:1767317885.429498:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360
00000100:00100000:2.0:1767317885.429504:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940122624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429542:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940122624:12345-0@lo:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317885.429549:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360
00000100:00100000:2.0:1767317885.429621:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940122624:0@lo:400:kworker.0
00000100:00100000:2.0:1767317885.429632:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940122752:0@lo:400:kworker.0
00000100:00100000:3.0:1767317885.429715:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940122368:0@lo:38:kworker.0
00000100:00100000:3.0:1767317885.429761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317885.429810:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940122496:0@lo:38:kworker.0
00000100:00100000:3.0:1767317885.429834:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317885.429850:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940123008:0@lo:38:kworker.0
00000100:00100000:3.0:1767317885.429869:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317885.429886:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940123264:0@lo:38:kworker.0
00000100:00100000:3.0:1767317885.429906:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317885.429934:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122368
00000100:00100000:3.0:1767317885.429938:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122368
00000100:00100000:3.0:1767317885.429959:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123008
00000100:00100000:3.0:1767317885.429962:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123008
00000100:00100000:3.0:1767317885.429973:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123264
00000100:00100000:3.0:1767317885.429975:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123264
00000100:00100000:3.0:1767317885.429986:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15816
00000100:00100000:3.0:1767317885.429990:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940122368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317885.430008:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317885.430040:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940122368:12345-0@lo:38:kworker.0 Request processed in 48us (279us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317885.430046:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15816
00000100:00100000:3.0:1767317885.430061:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15817
00000100:00100000:3.0:1767317885.430076:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940123008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317885.430085:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317885.430121:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940123008:12345-0@lo:38:kworker.0 Request processed in 54us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317885.430127:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15817
00000100:00100000:3.0:1767317885.430140:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15818
00000100:00100000:3.0:1767317885.430144:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940123264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317885.430154:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317885.430176:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940123264:12345-0@lo:38:kworker.0 Request processed in 30us (268us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317885.430181:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15818
00000100:00080000:3.0:1767317885.430211:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317885.430216:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317885.430219:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940122368:0@lo:38:kworker.0
00000100:00080000:3.0:1767317885.430227:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317885.430230:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317885.430233:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940123008:0@lo:38:kworker.0
00000100:00080000:3.0:1767317885.430240:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317885.430243:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317885.430245:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940123264:0@lo:38:kworker.0
00000100:00080000:1.0:1767317885.430614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317885.430619:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317885.431076:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940122496
00000100:00100000:2.0:1767317885.431081:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940122496
00000100:00100000:2.0:1767317885.431113:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837
00000100:00100000:2.0:1767317885.431119:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940122496:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317885.431131:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317885.431180:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940122496:12345-0@lo:38:kworker.0 Request processed in 60us (1345us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317885.431187:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837
00000100:00080000:0.0:1767317885.432820:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317885.432831:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317885.432837:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940122496:0@lo:38:kworker.0
00000100:00100000:1.0:1767317885.935822:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317886.383836:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317886.956926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317887.405656:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317887.980961:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317888.429127:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317889.004900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317889.005400:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317889.005452:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940123392:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317889.005555:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317889.006384:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123392
00000100:00100000:3.0:1767317889.006392:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123392
00000100:00100000:3.0:1767317889.006597:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862
00000100:00100000:3.0:1767317889.006610:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940123392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317889.006654:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317889.006713:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940123392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1158us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317889.006734:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862
00000100:00100000:1.0:1767317889.007166:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940123392:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317889.017562:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317889.453202:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317890.028986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317890.033033:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940123520:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317890.033149:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317890.033253:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123520
00000100:00100000:0.0:1767317890.033262:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123520
00000100:00100000:0.0:1767317890.033357:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863
00000100:00100000:0.0:1767317890.033366:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940123520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317890.033408:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317890.033486:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940123520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317890.033493:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863
00000100:00080000:2.0:1767317890.033723:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317890.033830:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940123520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317890.118632:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317890.118950:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317890.134385:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231040
00000100:00100000:2.0:1767317890.134403:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231040
00000100:00100000:2.0:1767317890.134486:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231168
00000100:00100000:2.0:1767317890.134490:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231168
00000100:00100000:2.0:1767317890.134574:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3557
00000100:00100000:2.0:1767317890.134586:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894231168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767317890.134649:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317890.134734:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894231168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 150us (15784us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317890.134742:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3557
00000100:00100000:2.0:1767317890.134761:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15819
00000100:00100000:2.0:1767317890.134766:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894231040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317890.134814:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317890.134844:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894231040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 76us (16225us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317890.134850:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15819
00010000:00010000:0.0:1767317890.477744:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317890.542986:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317890.542998:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317890.543001:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317890.543005:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317890.543011:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317890.543019:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3135
00000100:00080000:0.0:1767317890.543024:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317890.543032:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317890.543087:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0e00 x1853163940123648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317890.543112:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317890.543116:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317890.543118:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317890.543150:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3135
00000100:00080000:0.0:1767317890.543153:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317890.543171:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317890.543194:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940123776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317890.543240:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317890.543243:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317890.543245:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317890.543249:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3135
00000100:00080000:0.0:1767317890.543252:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317890.543255:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317890.543267:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3480 x1853163940124160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317890.543293:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317890.543296:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317890.543297:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317890.543301:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3135
00000100:00080000:0.0:1767317890.543304:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317890.543307:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317890.543327:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2a00 x1853163940124416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317890.543366:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940124288:0@lo:400:kworker.0
00000100:00100000:0.0:1767317890.543432:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.543587:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940124032:0@lo:400:kworker.0
00000100:00100000:1.0:1767317890.543617:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.543655:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317890.543661:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940123904:0@lo:400:kworker.0
00000100:00100000:1.0:1767317890.543682:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.543720:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124288
00000100:00100000:1.0:1767317890.543727:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124288
00000100:00100000:1.0:1767317890.543790:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124032
00000100:00100000:1.0:1767317890.543793:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124032
00000100:00100000:1.0:1767317890.543812:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558
00000100:00100000:1.0:1767317890.543819:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940124288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317890.543864:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940124288:12345-0@lo:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317890.543871:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558
00000100:00100000:1.0:1767317890.543894:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559
00000100:00100000:1.0:1767317890.543900:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940124032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317890.543931:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940124032:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317890.543932:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123904
00000100:00100000:0.0:1767317890.543940:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123904
00000100:00100000:1.0:1767317890.543940:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559
00000100:00100000:0.0:1767317890.543979:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361
00000100:00100000:1.0:1767317890.543983:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940124032:0@lo:400:kworker.0
00000100:00100000:0.0:1767317890.543989:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940123904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317890.544010:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940124288:0@lo:400:kworker.0
00000100:00080000:1.0:1767317890.544035:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317890.544041:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940123904:12345-0@lo:400:kworker.0 Request processed in 53us (356us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317890.544049:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361
00000100:00100000:1.0:1767317890.544052:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940123904:0@lo:400:kworker.0
00000100:00100000:3.0:1767317890.544467:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940123648:0@lo:38:kworker.0
00000100:00100000:3.0:1767317890.544528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317890.544555:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940123776:0@lo:38:kworker.0
00000100:00100000:3.0:1767317890.544579:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.544592:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123648
00000100:00100000:1.0:1767317890.544598:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123648
00000100:00100000:3.0:1767317890.544607:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940124160:0@lo:38:kworker.0
00000100:00100000:1.0:1767317890.544629:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15820
00000100:00100000:3.0:1767317890.544633:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.544642:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940123648:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317890.544657:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940124416:0@lo:38:kworker.0
00010000:00020000:1.0:1767317890.544665:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317890.544684:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317890.544709:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940123648:12345-0@lo:38:kworker.0 Request processed in 66us (178us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317890.544716:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15820
00000100:00080000:3.0:1767317890.544722:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317890.544729:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317890.544730:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124160
00000100:00100000:3.0:1767317890.544734:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940123648:0@lo:38:kworker.0
00000100:00100000:1.0:1767317890.544736:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124160
00000100:00100000:1.0:1767317890.544749:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124416
00000100:00100000:1.0:1767317890.544752:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124416
00000100:00100000:1.0:1767317890.544763:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15821
00000100:00100000:1.0:1767317890.544768:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940124160:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317890.544794:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15822
00010000:00020000:1.0:1767317890.544797:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317890.544827:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940124160:12345-0@lo:38:kworker.0 Request processed in 58us (195us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317890.544873:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940124416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317890.544884:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317890.544911:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940124416:12345-0@lo:38:kworker.0 Request processed in 38us (228us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317890.547167:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940123776
00000100:00100000:0.0:1767317890.547184:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940123776
00000100:00100000:0.0:1767317890.547251:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838
00000100:00100000:0.0:1767317890.547259:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940123776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317890.547283:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317890.547359:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940123776:12345-0@lo:38:kworker.0 Request processed in 100us (2778us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317890.547366:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838
00000100:00080000:0.0:1767317890.547464:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317890.547470:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317890.547474:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940123776:0@lo:38:kworker.0
00000100:00080000:0.0:1767317890.547485:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317890.547488:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317890.547491:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940124160:0@lo:38:kworker.0
00000100:00080000:0.0:1767317890.547537:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317890.547541:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317890.547544:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940124416:0@lo:38:kworker.0
00000100:00100000:1.0:1767317890.555651:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15821
00000100:00100000:3.0:1767317890.555974:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15822
00000100:00100000:1.0:1767317891.052915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317891.501955:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317892.076933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317892.528233:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317893.100909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317893.549106:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317894.126561:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317894.126974:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940124544:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317894.127043:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317894.127206:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124544
00000100:00100000:3.0:1767317894.127215:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124544
00000100:00100000:3.0:1767317894.127293:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864
00000100:00100000:3.0:1767317894.127301:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940124544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317894.127347:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317894.127394:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940124544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (350us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317894.127403:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864
00000100:00080000:1.0:1767317894.127689:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317894.127740:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940124544:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317894.573025:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317895.148928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317895.149133:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317895.149152:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940124672:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317895.149218:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317895.149353:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124672
00000100:00100000:2.0:1767317895.149360:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124672
00000100:00100000:2.0:1767317895.149410:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865
00000100:00100000:2.0:1767317895.149417:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940124672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317895.149449:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317895.149504:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940124672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317895.149511:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865
00000100:00080000:1.0:1767317895.149715:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317895.149750:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940124672:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317895.240943:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317895.240992:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317895.241154:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231296
00000100:00100000:1.0:1767317895.241164:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231296
00000100:00100000:1.0:1767317895.241215:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231424
00000100:00100000:1.0:1767317895.241218:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231424
00000100:00100000:1.0:1767317895.241265:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3560
00000100:00100000:1.0:1767317895.241275:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894231424:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317895.241347:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894231424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (354us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317895.241354:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3560
00000100:00100000:1.0:1767317895.241371:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15823
00000100:00100000:1.0:1767317895.241388:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894231296:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317895.241408:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317895.241429:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894231296:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 41us (504us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317895.241435:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15823
00000100:00080000:3.0:1767317895.241763:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767317895.597093:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317895.661272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317895.661283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317895.661286:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317895.661290:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317895.661293:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317895.661300:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3140
00000100:00080000:3.0:1767317895.661305:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317895.661312:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317895.661353:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940124800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317895.661412:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940124800:0@lo:38:kworker.0
00000100:00100000:0.0:1767317895.661514:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317895.661664:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124800
00000100:00100000:2.0:1767317895.661674:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124800
00000100:00100000:2.0:1767317895.661726:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15824
00000100:00100000:2.0:1767317895.661734:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940124800:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317895.661756:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767317895.663378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317895.663386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317895.663389:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317895.663394:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3140
00000100:00080000:3.0:1767317895.663399:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317895.663405:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317895.663436:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940124928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317895.663798:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940124800:12345-0@lo:38:kworker.0 Request processed in 2061us (2280us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317895.663815:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15824
00000100:00100000:0.0:1767317895.663936:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940124928:0@lo:38:kworker.0
00000100:00100000:0.0:1767317895.663991:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317895.664071:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317895.664077:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317895.664081:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940124800:0@lo:38:kworker.0
00000100:00100000:2.0:1767317895.664275:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940124928
00000100:00100000:2.0:1767317895.664281:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940124928
00000100:00100000:2.0:1767317895.664317:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839
00000100:00100000:2.0:1767317895.664323:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940124928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317895.664342:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317895.664436:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940124928:12345-0@lo:38:kworker.0 Request processed in 111us (443us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317895.664443:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839
00000100:00100000:0.0:1767317895.665010:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940125056:0@lo:400:kworker.0
00000100:00100000:0.0:1767317895.665058:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317895.665136:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125056
00000100:00100000:2.0:1767317895.665141:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125056
00000100:00100000:2.0:1767317895.665194:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362
00000100:00100000:2.0:1767317895.665202:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940125056:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767317895.665403:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317895.665408:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317895.665412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940124928:0@lo:38:kworker.0
00000100:00080000:3.0:1767317895.665889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317895.665894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317895.665896:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317895.665900:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3140
00000100:00080000:3.0:1767317895.665904:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317895.665909:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317895.665930:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb97480 x1853163940125312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317895.665952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317895.665956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317895.665957:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317895.665961:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3140
00000100:00080000:3.0:1767317895.665964:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317895.665968:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317895.665981:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7c700 x1853163940125568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317895.666158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940125440:0@lo:400:kworker.0
00000100:00100000:1.0:1767317895.666213:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317895.666255:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317895.666262:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940125184:0@lo:400:kworker.0
00000100:00100000:1.0:1767317895.666284:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317895.666314:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125440
00000100:00100000:1.0:1767317895.666320:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125440
00000100:00100000:1.0:1767317895.666387:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125184
00000100:00100000:1.0:1767317895.666390:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125184
00000100:00100000:1.0:1767317895.666415:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561
00000100:00100000:1.0:1767317895.666422:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940125440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317895.666474:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940125440:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317895.666481:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561
00000100:00100000:1.0:1767317895.666500:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562
00000100:00100000:1.0:1767317895.666506:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940125184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317895.666534:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940125184:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317895.666553:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562
00000100:00080000:1.0:1767317895.666575:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317895.666590:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940125312:0@lo:38:kworker.0
00000100:00100000:1.0:1767317895.666613:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317895.666627:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940125568:0@lo:38:kworker.0
00000100:00100000:3.0:1767317895.666805:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125312
00000100:00100000:3.0:1767317895.666810:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125312
00000100:00100000:3.0:1767317895.666834:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15825
00000100:00100000:3.0:1767317895.666838:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940125312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317895.666857:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317895.666889:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940125312:12345-0@lo:38:kworker.0 Request processed in 49us (274us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317895.666895:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15825
00000100:00100000:3.0:1767317895.666957:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940125184:0@lo:400:kworker.0
00000100:00100000:3.0:1767317895.666967:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940125440:0@lo:400:kworker.0
00000100:00100000:1.0:1767317895.667170:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317895.667286:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317895.667291:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317895.667295:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940125312:0@lo:38:kworker.0
00000100:00100000:3.0:1767317895.667355:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125568
00000100:00100000:3.0:1767317895.667358:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125568
00000100:00100000:3.0:1767317895.667377:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15826
00000100:00100000:3.0:1767317895.667382:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940125568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317895.667392:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317895.667421:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940125568:12345-0@lo:38:kworker.0 Request processed in 38us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317895.667427:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15826
00000100:00080000:1.0:1767317895.667539:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317895.667544:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317895.667547:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940125568:0@lo:38:kworker.0
00000100:00100000:2.0:1767317895.667648:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940125056:12345-0@lo:400:kworker.0 Request processed in 2436us (2577us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317895.667657:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362
00000100:00100000:0.0:1767317895.667809:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940125056:0@lo:400:kworker.0
00000100:00100000:0.0:1767317896.174181:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317896.620958:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317897.196901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317897.644936:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317898.220914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317898.668976:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317899.245152:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940125696:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317899.245240:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317899.246459:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125696
00000100:00100000:0.0:1767317899.246468:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125696
00000100:00100000:0.0:1767317899.246530:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866
00000100:00100000:0.0:1767317899.246539:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940125696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317899.246574:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767317899.246878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317899.250108:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940125696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3560us (4857us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317899.250122:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866
00000100:00080000:0.0:1767317899.250228:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317899.250495:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940125696:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317899.334827:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767317899.334861:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894231552 offset 0 length 520: 4
00000100:00100000:0.0:1767317899.334887:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317899.335195:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231808
00000100:00100000:1.0:1767317899.335205:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231808
00000100:00100000:1.0:1767317899.335289:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231680
00000100:00100000:1.0:1767317899.335293:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231680
00000100:00100000:1.0:1767317899.335313:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3563
00000100:00100000:1.0:1767317899.335321:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894231808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317899.335390:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894231808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (637us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317899.335413:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3563
00000100:00100000:1.0:1767317899.335453:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15827
00000100:00100000:1.0:1767317899.335458:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894231680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317899.335480:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317899.335508:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894231680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (619us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317899.335514:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15827
00000100:00080000:0.0:1767317899.335576:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767317899.693493:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317900.268892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317900.269146:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940125824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317900.269228:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317900.269384:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125824
00000100:00100000:0.0:1767317900.269393:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125824
00000100:00100000:0.0:1767317900.269488:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867
00000100:00100000:0.0:1767317900.269499:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940125824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317900.269538:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317900.269580:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940125824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (353us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317900.269585:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867
00000100:00080000:1.0:1767317900.272010:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767317900.274126:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940125824:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317900.717121:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317900.781085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317900.781097:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317900.781100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317900.781103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317900.781109:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317900.781117:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3145
00000100:00080000:3.0:1767317900.781122:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317900.781129:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317900.781173:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7c700 x1853163940125952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317900.781209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317900.781212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317900.781214:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317900.781217:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3145
00000100:00080000:3.0:1767317900.781233:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317900.781237:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317900.781251:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94380 x1853163940126080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317900.781339:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940126208:0@lo:400:kworker.0
00000100:00100000:1.0:1767317900.781400:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317900.781511:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126208
00000100:00100000:0.0:1767317900.781518:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126208
00000100:00100000:0.0:1767317900.781574:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363
00000100:00100000:0.0:1767317900.781584:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940126208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317900.781700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940125952:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.781734:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.781760:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940126080:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.781793:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.781830:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940125952
00000100:00100000:2.0:1767317900.781834:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940125952
00000100:00100000:2.0:1767317900.781863:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15828
00000100:00100000:2.0:1767317900.781869:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940125952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317900.781894:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317900.781928:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940125952:12345-0@lo:38:kworker.0 Request processed in 56us (191us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317900.781935:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15828
00000100:00100000:2.0:1767317900.781958:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126080
00000100:00100000:2.0:1767317900.781962:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126080
00000100:00100000:2.0:1767317900.781978:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840
00000100:00100000:2.0:1767317900.781982:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940126080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317900.781991:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317900.782012:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940126080:12345-0@lo:38:kworker.0 Request processed in 29us (218us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317900.782018:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840
00000100:00080000:2.0:1767317900.782045:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317900.782049:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317900.782052:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940125952:0@lo:38:kworker.0
00000100:00080000:2.0:1767317900.782059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317900.782061:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317900.782064:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940126080:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.782100:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940126336:0@lo:400:kworker.0
00000100:00100000:2.0:1767317900.782132:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.782158:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126336
00000100:00100000:2.0:1767317900.782162:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126336
00000100:00100000:2.0:1767317900.782194:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564
00000100:00100000:2.0:1767317900.782200:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940126336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317900.782231:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940126336:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317900.782237:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564
00000100:00100000:2.0:1767317900.782262:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940126336:0@lo:400:kworker.0
00000100:00080000:2.0:1767317900.782994:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317900.783047:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940126208:12345-0@lo:400:kworker.0 Request processed in 1463us (1644us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317900.783055:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363
00000100:00080000:3.0:1767317900.787519:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317900.787530:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317900.787534:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317900.787542:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3145
00000100:00080000:3.0:1767317900.787547:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317900.787553:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317900.787593:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb97b80 x1853163940126464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317900.787656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317900.787659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317900.787661:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317900.787664:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3145
00000100:00080000:3.0:1767317900.787667:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317900.787670:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317900.787681:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94380 x1853163940126720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317900.787721:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767317900.787739:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940126592:0@lo:400:kworker.0
00000100:00100000:3.0:1767317900.787834:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.787935:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126592
00000100:00100000:2.0:1767317900.787947:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126592
00000100:00100000:2.0:1767317900.788093:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565
00000100:00100000:2.0:1767317900.788103:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940126592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317900.788176:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940126592:12345-0@lo:400:kworker.0 Request processed in 75us (342us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317900.788184:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565
00000100:00100000:2.0:1767317900.788212:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940126464:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.788237:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.788253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940126720:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.788271:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317900.788297:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126464
00000100:00100000:2.0:1767317900.788301:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126464
00000100:00100000:2.0:1767317900.788323:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126720
00000100:00100000:2.0:1767317900.788326:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126720
00000100:00100000:2.0:1767317900.788341:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15829
00000100:00100000:2.0:1767317900.788346:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940126464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317900.788385:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317900.788434:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940126464:12345-0@lo:38:kworker.0 Request processed in 87us (196us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317900.788441:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15829
00000100:00100000:2.0:1767317900.788454:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15830
00000100:00100000:2.0:1767317900.788459:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940126720:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767317900.789479:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940126208:0@lo:400:kworker.0
00010000:00020000:2.0:1767317900.789576:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317900.789621:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940126720:12345-0@lo:38:kworker.0 Request processed in 1159us (1347us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317900.789628:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15830
00000100:00080000:2.0:1767317900.789664:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317900.789669:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317900.789672:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940126464:0@lo:38:kworker.0
00000100:00080000:2.0:1767317900.789681:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317900.789684:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317900.789686:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940126720:0@lo:38:kworker.0
00000100:00100000:2.0:1767317900.789733:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940126592:0@lo:400:kworker.0
00000100:00080000:3.0:1767317900.790746:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317901.293178:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317901.741061:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317902.316977:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317902.774281:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317903.341083:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317903.789092:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317904.364905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317904.368657:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940126848:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317904.368735:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317904.369022:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126848
00000100:00100000:0.0:1767317904.369030:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126848
00000100:00080000:3.0:1767317904.369128:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317904.369189:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868
00000100:00100000:0.0:1767317904.369197:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940126848:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317904.369221:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317904.369267:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940126848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (530us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317904.369280:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868
00000100:00100000:2.0:1767317904.369360:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940126848:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317904.467712:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317904.467826:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317904.467936:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232064
00000100:00100000:2.0:1767317904.467961:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232064
00000100:00100000:2.0:1767317904.468038:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894231936
00000100:00100000:2.0:1767317904.468042:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894231936
00000100:00100000:2.0:1767317904.468063:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3566
00000100:00100000:2.0:1767317904.468072:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894232064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317904.468167:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894232064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (467us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317904.468177:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3566
00000100:00100000:2.0:1767317904.468199:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15831
00000100:00100000:2.0:1767317904.468204:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894231936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317904.468229:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317904.468255:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894231936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317904.468262:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15831
00000100:00080000:3.0:1767317904.468586:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767317904.818827:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317905.388952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317905.389108:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940126976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317905.389186:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317905.389259:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940126976
00000100:00100000:0.0:1767317905.389274:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940126976
00000100:00100000:0.0:1767317905.389833:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869
00000100:00100000:0.0:1767317905.389846:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940126976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317905.389885:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767317905.391472:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317905.396235:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940126976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6376us (7033us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317905.396255:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869
00000100:00100000:1.0:1767317905.397798:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940126976:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317905.839130:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317905.902144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.902158:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317905.902161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.902165:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317905.902171:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317905.902179:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3150
00000100:00080000:3.0:1767317905.902186:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317905.902195:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317905.902240:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf480 x1853163940127104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317905.902265:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.902268:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317905.902270:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317905.902274:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3150
00000100:00080000:3.0:1767317905.902276:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317905.902280:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317905.902293:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae680 x1853163940127232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317905.902349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.902352:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317905.902354:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317905.902356:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3150
00000100:00080000:3.0:1767317905.902358:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317905.902362:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317905.902396:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeadf80 x1853163940127616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317905.902411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.902414:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317905.902416:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317905.902419:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3150
00000100:00080000:3.0:1767317905.902421:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317905.902424:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317905.902433:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046ade680 x1853163940127872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317905.902539:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940127360:0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.902609:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317905.902701:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940127488:0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.902730:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317905.902751:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317905.902757:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940127744:0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.902811:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317905.902843:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127488
00000100:00100000:1.0:1767317905.902851:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127488
00000100:00100000:1.0:1767317905.902898:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127744
00000100:00100000:1.0:1767317905.902902:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127744
00000100:00100000:1.0:1767317905.902925:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567
00000100:00100000:1.0:1767317905.902933:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940127488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.902991:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940127488:12345-0@lo:400:kworker.0 Request processed in 59us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317905.903000:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567
00000100:00100000:1.0:1767317905.903017:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568
00000100:00100000:1.0:1767317905.903024:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940127744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.903051:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940127744:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317905.903056:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568
00000100:00100000:1.0:1767317905.903093:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940127744:0@lo:400:kworker.0
00000100:00100000:1.0:1767317905.903101:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940127488:0@lo:400:kworker.0
00000100:00100000:0.0:1767317905.903288:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317880/real 1767317880]  req@ffff93d06d3d7100 x1853163940120960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317905.903305:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d3d7100 x1853163940120960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317905.903317:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940127104:0@lo:38:kworker.0
00000100:00100000:0.0:1767317905.903343:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317905.903362:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940127232:0@lo:38:kworker.0
00000100:00100000:0.0:1767317905.903397:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317905.903412:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940127616:0@lo:38:kworker.0
00000100:00100000:0.0:1767317905.903430:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317905.903444:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940127872:0@lo:38:kworker.0
00000100:00100000:0.0:1767317905.903460:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317905.903482:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317905.903492:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767317905.903496:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940120960:0@lo:250:kworker.0
00000100:00100000:0.0:1767317905.903522:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127104
00000100:00100000:0.0:1767317905.903525:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127104
00000100:00100000:0.0:1767317905.903540:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127616
00000100:00100000:0.0:1767317905.903542:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127616
00000100:00100000:0.0:1767317905.903549:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127872
00000100:00100000:0.0:1767317905.903551:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127872
00000100:00100000:0.0:1767317905.903560:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15832
00000100:00100000:0.0:1767317905.903571:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317905.903591:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317905.903624:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127104:12345-0@lo:38:kworker.0 Request processed in 58us (280us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317905.903631:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15832
00000100:00100000:0.0:1767317905.903644:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15833
00000100:00100000:0.0:1767317905.903647:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317905.903656:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317905.903677:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127616:12345-0@lo:38:kworker.0 Request processed in 28us (246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317905.903682:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15833
00000100:00100000:0.0:1767317905.903692:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15834
00000100:00100000:0.0:1767317905.903696:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317905.903703:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317905.903723:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940127872:12345-0@lo:38:kworker.0 Request processed in 26us (261us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317905.903738:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15834
00000100:00100000:3.0:1767317905.903945:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127360
00000100:00100000:3.0:1767317905.903950:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127360
00000100:00100000:3.0:1767317905.903999:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364
00000100:00100000:3.0:1767317905.904006:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940127360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317905.904049:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940127360:12345-0@lo:400:kworker.0 Request processed in 44us (1440us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317905.904056:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364
00000100:00100000:3.0:1767317905.904091:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940127360:0@lo:400:kworker.0
00000100:00080000:3.0:1767317905.904142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317905.904147:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767317905.904149:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317905.904153:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3130
00000100:00080000:3.0:1767317905.904158:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317905.904162:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317905.904181:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adf100 x1853163940128000/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317905.904224:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940128000:0@lo:250:kworker.0
00000400:00000100:3.0:1767317905.904246:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940128000 offset 0 length 520: 4
00000100:00080000:3.0:1767317905.904274:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317905.904278:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317905.904281:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940127104:0@lo:38:kworker.0
00000100:00080000:3.0:1767317905.904289:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317905.904292:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317905.904295:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940127616:0@lo:38:kworker.0
00000100:00080000:3.0:1767317905.904301:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317905.904304:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317905.904306:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940127872:0@lo:38:kworker.0
00000100:00100000:2.0:1767317905.904661:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940127232
00000100:00100000:2.0:1767317905.904667:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940127232
00000100:00100000:2.0:1767317905.904703:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841
00000100:00100000:2.0:1767317905.904708:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940127232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317905.904720:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317905.904761:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940127232:12345-0@lo:38:kworker.0 Request processed in 52us (1362us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317905.904822:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841
00000100:00080000:2.0:1767317905.904848:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767317905.904879:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317905.904883:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317905.904887:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940127232:0@lo:38:kworker.0
00000100:00100000:0.0:1767317906.413456:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317906.861032:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317907.437168:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317907.885017:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317908.461478:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317908.910436:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317909.485676:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940128128:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317909.485826:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317909.486387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317909.487109:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128128
00000100:00100000:3.0:1767317909.487120:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128128
00000100:00080000:2.0:1767317909.487446:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317909.488473:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870
00000100:00100000:3.0:1767317909.488497:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940128128:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317909.488550:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317909.488660:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940128128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (2834us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317909.488668:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870
00000100:00100000:2.0:1767317909.489872:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940128128:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317909.575685:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317909.575826:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317909.575911:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232192
00000100:00100000:1.0:1767317909.575921:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232192
00000100:00100000:1.0:1767317909.575977:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232320
00000100:00100000:1.0:1767317909.575981:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232320
00000100:00100000:1.0:1767317909.576044:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3569
00000100:00100000:1.0:1767317909.576056:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317909.576164:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317909.576184:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3569
00000100:00080000:0.0:1767317909.576190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317909.576208:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15835
00000100:00100000:1.0:1767317909.576213:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894232192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317909.576234:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317909.576263:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894232192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (589us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317909.576270:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15835
00010000:00010000:1.0:1767317909.935048:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317910.508910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317910.509984:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940128256:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317910.510072:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317910.510162:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128256
00000100:00100000:1.0:1767317910.510171:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128256
00000100:00080000:0.0:1767317910.510213:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317910.510240:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871
00000100:00100000:1.0:1767317910.510252:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940128256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317910.510286:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317910.510354:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940128256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317910.510363:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871
00000100:00100000:0.0:1767317910.510579:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940128256:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317910.964142:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317911.025447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317911.025459:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317911.025462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317911.025466:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317911.025471:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317911.025479:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3155
00000100:00080000:0.0:1767317911.025484:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317911.025491:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317911.025540:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0380 x1853163940128384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317911.025581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317911.025585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317911.025587:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317911.025606:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3155
00000100:00080000:0.0:1767317911.025608:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317911.025612:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317911.025626:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1880 x1853163940128512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317911.025708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317911.025712:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317911.025714:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317911.025718:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3155
00000100:00080000:0.0:1767317911.025721:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317911.025726:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317911.025737:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940128768:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.025740:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3480 x1853163940129024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317911.025759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317911.025762:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317911.025764:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317911.025767:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3155
00000100:00080000:0.0:1767317911.025769:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317911.025814:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317911.025827:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0e00 x1853163940129280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317911.025837:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317911.025866:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940129152:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.025908:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317911.025943:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767317911.025956:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940128896:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.025980:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317911.026023:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128768
00000100:00100000:0.0:1767317911.026031:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128768
00000100:00100000:0.0:1767317911.026083:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365
00000100:00100000:0.0:1767317911.026093:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940128768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317911.026113:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767317911.026122:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940128640:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.026148:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940128768:12345-0@lo:400:kworker.0 Request processed in 55us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317911.026159:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365
00000100:00100000:3.0:1767317911.026180:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317911.026202:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129152
00000100:00100000:0.0:1767317911.026206:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129152
00000100:00100000:0.0:1767317911.026243:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128896
00000100:00100000:3.0:1767317911.026245:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940128768:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.026248:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128896
00000100:00100000:0.0:1767317911.026275:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570
00000100:00100000:3.0:1767317911.026278:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128640
00000100:00100000:3.0:1767317911.026282:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128640
00000100:00100000:0.0:1767317911.026283:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940129152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317911.026328:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366
00000100:00100000:0.0:1767317911.026340:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940129152:12345-0@lo:400:kworker.0 Request processed in 57us (430us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317911.026341:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940128640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.026355:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570
00000100:00100000:0.0:1767317911.026370:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571
00000100:00100000:0.0:1767317911.026379:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940128896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317911.026393:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940128640:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317911.026399:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366
00000100:00100000:0.0:1767317911.026416:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940128896:12345-0@lo:400:kworker.0 Request processed in 39us (434us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317911.026424:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571
00000100:00100000:3.0:1767317911.026428:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940128640:0@lo:400:kworker.0
00000100:00080000:0.0:1767317911.026448:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317911.026454:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317911.026480:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940128896:0@lo:400:kworker.0
00000100:00100000:0.0:1767317911.026489:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940129152:0@lo:400:kworker.0
00000100:00100000:2.0:1767317911.026878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940128384:0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.026912:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317911.026942:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940128512:0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.026967:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317911.026995:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940129024:0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.027014:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317911.027037:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940129280:0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.027055:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317911.027090:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128384
00000100:00100000:2.0:1767317911.027095:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128384
00000100:00100000:3.0:1767317911.027118:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940128512
00000100:00100000:2.0:1767317911.027121:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129024
00000100:00100000:3.0:1767317911.027125:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940128512
00000100:00100000:2.0:1767317911.027127:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129024
00000100:00100000:2.0:1767317911.027145:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129280
00000100:00100000:2.0:1767317911.027148:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129280
00000100:00100000:3.0:1767317911.027171:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842
00000100:00100000:2.0:1767317911.027175:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15836
00000100:00100000:3.0:1767317911.027179:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940128512:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.027193:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940128384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317911.027203:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767317911.027207:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317911.027250:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940128512:12345-0@lo:38:kworker.0 Request processed in 71us (281us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317911.027254:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842
00000100:00100000:3.0:1767317911.027279:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15837
00000100:00100000:3.0:1767317911.027282:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940129024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317911.027290:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317911.027296:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15838
00000100:00100000:0.0:1767317911.027304:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940129280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317911.027449:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317911.027682:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940128384:12345-0@lo:38:kworker.0 Request processed in 489us (768us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317911.027690:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15836
00000100:00080000:2.0:1767317911.027725:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317911.027730:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317911.027733:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940128384:0@lo:38:kworker.0
00000100:00080000:2.0:1767317911.027743:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317911.027746:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317911.027749:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940128512:0@lo:38:kworker.0
00000100:00100000:3.0:1767317911.030836:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940129024:12345-0@lo:38:kworker.0 Request processed in 3539us (3808us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317911.030854:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15837
00000100:00080000:2.0:1767317911.033965:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317911.033981:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317911.033987:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940129024:0@lo:38:kworker.0
00000100:00100000:0.0:1767317911.034082:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940129280:12345-0@lo:38:kworker.0 Request processed in 6774us (7022us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317911.034094:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15838
00000100:00080000:2.0:1767317911.034983:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317911.034991:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317911.034994:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940129280:0@lo:38:kworker.0
00000100:00100000:2.0:1767317911.533713:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317911.984368:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317912.557258:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317913.004966:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317913.581731:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317914.029067:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317914.605418:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317914.605722:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940129408:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317914.605818:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317914.606009:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129408
00000100:00100000:3.0:1767317914.606032:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129408
00000100:00100000:3.0:1767317914.606101:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872
00000100:00100000:3.0:1767317914.606108:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940129408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317914.606136:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317914.606179:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940129408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317914.606186:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872
00000100:00080000:1.0:1767317914.607446:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317914.607517:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940129408:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317914.698677:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317914.698950:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317914.713208:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232576
00000100:00100000:2.0:1767317914.713227:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232576
00000100:00100000:2.0:1767317914.713497:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232448
00000100:00100000:2.0:1767317914.713519:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232448
00000100:00100000:2.0:1767317914.713554:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3572
00000100:00100000:2.0:1767317914.713565:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317914.713661:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (14999us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317914.713670:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3572
00000100:00100000:2.0:1767317914.713703:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15839
00000100:00100000:2.0:1767317914.713709:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894232448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317914.713734:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317914.713762:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894232448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (14812us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317914.713769:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15839
00000100:00080000:1.0:1767317914.718382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767317915.053767:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317915.629842:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317915.630879:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317915.630900:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940129536:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317915.630971:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317915.631107:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129536
00000100:00100000:2.0:1767317915.631115:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129536
00000100:00100000:2.0:1767317915.631182:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873
00000100:00100000:2.0:1767317915.631192:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940129536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317915.631223:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317915.631269:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940129536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (297us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317915.631306:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873
00000100:00080000:1.0:1767317915.631482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317915.631517:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940129536:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317916.079345:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317916.142309:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317916.142322:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317916.142325:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317916.142329:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317916.142353:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317916.142362:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3161
00000100:00080000:2.0:1767317916.142367:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317916.142374:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317916.142413:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173b80 x1853163940129664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317916.142450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317916.142454:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317916.142456:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317916.142467:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3161
00000100:00080000:2.0:1767317916.142469:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317916.142473:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317916.142490:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173480 x1853163940129792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317916.142563:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317916.142566:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317916.142568:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767317916.142606:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940130048:0@lo:400:kworker.0
00000100:00100000:1.0:1767317916.142675:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317916.143042:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317916.143051:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940129920:0@lo:400:kworker.0
00000100:00100000:0.0:1767317916.143072:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940129664:0@lo:38:kworker.0
00000100:00100000:0.0:1767317916.143104:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317916.143127:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940129792:0@lo:38:kworker.0
00000100:00100000:0.0:1767317916.143149:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317916.143188:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129792
00000100:00100000:0.0:1767317916.143195:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129792
00000100:00100000:0.0:1767317916.143228:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843
00000100:00100000:0.0:1767317916.143235:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940129792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317916.143256:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317916.143314:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940129792:12345-0@lo:38:kworker.0 Request processed in 77us (163us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317916.143320:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843
00000100:00100000:0.0:1767317916.143343:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129664
00000100:00100000:0.0:1767317916.143347:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129664
00000100:00100000:0.0:1767317916.143368:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15840
00000100:00100000:0.0:1767317916.143372:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940129664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317916.143400:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317916.143425:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940129664:12345-0@lo:38:kworker.0 Request processed in 52us (321us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317916.143431:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15840
00000100:00080000:0.0:1767317916.143478:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317916.143483:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317916.143486:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940129664:0@lo:38:kworker.0
00000100:00100000:1.0:1767317916.143491:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317916.143497:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317916.143500:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317916.143503:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940129792:0@lo:38:kworker.0
00000100:00100000:1.0:1767317916.143520:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130048
00000100:00100000:1.0:1767317916.143524:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130048
00000100:00100000:0.0:1767317916.143539:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940129920
00000100:00100000:0.0:1767317916.143542:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940129920
00000100:00100000:0.0:1767317916.143592:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367
00000100:00100000:0.0:1767317916.143598:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940130048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317916.143609:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368
00000100:00100000:1.0:1767317916.143614:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940129920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317916.143639:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940130048:12345-0@lo:400:kworker.0 Request processed in 41us (964us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317916.143639:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940129920:12345-0@lo:400:kworker.0 Request processed in 26us (149us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317916.143645:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367
00000100:00080000:2.0:1767317916.143691:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3161
00000100:00080000:2.0:1767317916.143695:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317916.143699:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317916.143720:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171c00 x1853163940130304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317916.143726:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317916.143753:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940130176:0@lo:400:kworker.0
00000100:00080000:2.0:1767317916.143756:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317916.143759:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317916.143766:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317916.143770:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3161
00000100:00100000:3.0:1767317916.143802:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317916.143823:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317916.143828:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940130432:0@lo:400:kworker.0
00000100:00100000:3.0:1767317916.143864:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317916.144152:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317916.144159:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317916.144174:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170e00 x1853163940130560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317916.144210:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130176
00000100:00100000:2.0:1767317916.144214:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130176
00000100:00100000:2.0:1767317916.144252:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130432
00000100:00100000:2.0:1767317916.144255:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130432
00000100:00100000:2.0:1767317916.144290:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573
00000100:00100000:2.0:1767317916.144297:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940130176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317916.144335:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940130176:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317916.144341:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573
00000100:00100000:2.0:1767317916.144355:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574
00000100:00100000:2.0:1767317916.144360:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940130432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317916.144385:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940130432:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317916.144390:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574
00000100:00100000:2.0:1767317916.144414:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940130304:0@lo:38:kworker.0
00000100:00100000:2.0:1767317916.144438:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317916.144453:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940130560:0@lo:38:kworker.0
00000100:00100000:2.0:1767317916.144474:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317916.144499:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130304
00000100:00100000:2.0:1767317916.144503:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130304
00000100:00080000:3.0:1767317916.144509:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317916.144519:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130560
00000100:00100000:3.0:1767317916.144522:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130560
00000100:00100000:2.0:1767317916.144531:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15841
00000100:00100000:2.0:1767317916.144534:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940130304:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317916.144545:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15842
00010000:00020000:2.0:1767317916.144549:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317916.144549:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940130560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317916.144557:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317916.145315:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940129920:0@lo:400:kworker.0
00000100:00100000:0.0:1767317916.145331:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940130048:0@lo:400:kworker.0
00000100:00100000:2.0:1767317916.146331:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940130304:12345-0@lo:38:kworker.0 Request processed in 1790us (1887us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317916.146341:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15841
00000100:00100000:1.0:1767317916.146603:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368
00000100:00100000:1.0:1767317916.146675:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940130432:0@lo:400:kworker.0
00000100:00100000:1.0:1767317916.146688:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940130176:0@lo:400:kworker.0
00000100:00100000:3.0:1767317916.147551:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940130560:12345-0@lo:38:kworker.0 Request processed in 2995us (3070us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317916.147562:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15842
00000100:00080000:2.0:1767317916.150806:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317916.150823:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317916.150838:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940130304:0@lo:38:kworker.0
00000100:00080000:2.0:1767317916.150869:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317916.150873:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317916.150876:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940130560:0@lo:38:kworker.0
00000100:00100000:2.0:1767317916.655903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317917.101020:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317917.679674:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317918.128466:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317918.701095:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317919.149907:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317919.725587:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317919.725790:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940130688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317919.725976:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317919.727813:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130688
00000100:00100000:3.0:1767317919.727828:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130688
00000100:00080000:1.0:1767317919.728194:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317919.728255:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874
00000100:00100000:3.0:1767317919.728269:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940130688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317919.728315:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317919.728443:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940130688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (2466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317919.728452:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874
00000100:00100000:0.0:1767317919.728563:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940130688:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317919.829191:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317919.829256:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317919.829445:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232832
00000100:00100000:1.0:1767317919.829469:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232832
00000100:00100000:1.0:1767317919.829550:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894232704
00000100:00100000:1.0:1767317919.829553:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894232704
00000100:00100000:1.0:1767317919.829573:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3575
00000100:00100000:1.0:1767317919.829582:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232832:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317919.829679:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894232832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 98us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317919.829688:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3575
00000100:00100000:1.0:1767317919.829709:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15843
00000100:00100000:1.0:1767317919.829714:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894232704:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317919.829739:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317919.829767:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894232704:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (510us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317919.829803:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15843
00000100:00080000:0.0:1767317919.830148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767317920.173746:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317920.749003:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317920.749018:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940130816:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317920.749097:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317920.749252:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130816
00000100:00100000:0.0:1767317920.749262:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130816
00000100:00100000:0.0:1767317920.749335:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875
00000100:00100000:0.0:1767317920.749344:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940130816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317920.749380:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317920.749430:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940130816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317920.749437:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875
00000100:00080000:1.0:1767317920.749624:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317920.749665:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940130816:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317921.197153:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317921.265335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317921.265348:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317921.265352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317921.265356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317921.265361:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317921.265371:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3166
00000100:00080000:0.0:1767317921.265376:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317921.265384:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317921.265428:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0e00 x1853163940130944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317921.265501:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940130944:0@lo:38:kworker.0
00000100:00100000:1.0:1767317921.265577:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317921.265725:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940130944
00000100:00100000:3.0:1767317921.265735:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940130944
00000100:00100000:3.0:1767317921.265813:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15844
00000100:00100000:3.0:1767317921.265822:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940130944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317921.265853:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767317921.267012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317921.267020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317921.267023:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317921.267029:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3166
00000100:00080000:0.0:1767317921.267034:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317921.267097:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317921.267157:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3480 x1853163940131072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317921.267654:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940131072:0@lo:38:kworker.0
00000100:00100000:1.0:1767317921.267725:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317921.267831:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131072
00000100:00100000:2.0:1767317921.267840:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131072
00000100:00100000:2.0:1767317921.267881:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844
00000100:00100000:2.0:1767317921.267888:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940131072:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317921.267909:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317921.267952:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940131072:12345-0@lo:38:kworker.0 Request processed in 63us (226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317921.267968:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844
00000100:00100000:3.0:1767317921.268659:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940130944:12345-0@lo:38:kworker.0 Request processed in 2833us (3077us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317921.268672:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15844
00000100:00100000:3.0:1767317921.268710:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940131328:0@lo:400:kworker.0
00000100:00080000:0.0:1767317921.268716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317921.268723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317921.268727:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317921.268732:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3166
00000100:00080000:0.0:1767317921.268736:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317921.268742:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317921.268749:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317921.268764:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2d80 x1853163940131584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317921.268811:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:0.0:1767317921.268818:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767317921.268822:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940131200:0@lo:400:kworker.0
00000100:00080000:0.0:1767317921.268823:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317921.268827:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317921.268831:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3166
00000100:00080000:0.0:1767317921.268834:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317921.268838:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317921.268852:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3a680 x1853163940131840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317921.268878:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940131456:0@lo:400:kworker.0
00000100:00100000:0.0:1767317921.268909:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317921.268929:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317921.268935:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940131712:0@lo:400:kworker.0
00000100:00100000:0.0:1767317921.268955:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317921.269006:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131328
00000100:00100000:2.0:1767317921.269219:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131456
00000100:00100000:2.0:1767317921.269234:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131456
00000100:00100000:2.0:1767317921.269292:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576
00000100:00100000:2.0:1767317921.269300:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940131456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317921.269349:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940131456:12345-0@lo:400:kworker.0 Request processed in 50us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317921.269356:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576
00000100:00100000:2.0:1767317921.269368:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131712
00000100:00100000:2.0:1767317921.269371:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131712
00000100:00100000:2.0:1767317921.269392:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577
00000100:00100000:2.0:1767317921.269398:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940131712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317921.269426:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940131712:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317921.269432:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577
00000100:00080000:2.0:1767317921.269447:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317921.269631:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131328
00000100:00100000:0.0:1767317921.269674:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369
00000100:00100000:0.0:1767317921.269681:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940131328:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317921.269716:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940131328:12345-0@lo:400:kworker.0 Request processed in 36us (968us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317921.269721:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369
00000100:00100000:0.0:1767317921.269762:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940131712:0@lo:400:kworker.0
00000100:00100000:0.0:1767317921.269799:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940131456:0@lo:400:kworker.0
00000100:00100000:3.0:1767317921.270093:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317921.270129:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940131328:0@lo:400:kworker.0
00000100:00100000:2.0:1767317921.270203:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131200
00000100:00100000:2.0:1767317921.270208:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131200
00000100:00100000:2.0:1767317921.270270:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370
00000100:00100000:2.0:1767317921.270277:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940131200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317921.270316:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940131200:12345-0@lo:400:kworker.0 Request processed in 39us (222us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317921.270322:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370
00000100:00080000:3.0:1767317921.270465:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317921.270488:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940131200:0@lo:400:kworker.0
00000100:00080000:1.0:1767317921.270678:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317921.270685:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317921.271203:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940130944:0@lo:38:kworker.0
00000100:00100000:1.0:1767317921.271239:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940131584:0@lo:38:kworker.0
00000100:00100000:1.0:1767317921.271307:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317921.271365:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940131840:0@lo:38:kworker.0
00000100:00100000:1.0:1767317921.271389:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317921.271506:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317921.271511:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317921.271514:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940131072:0@lo:38:kworker.0
00000100:00100000:2.0:1767317921.274886:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131584
00000100:00100000:2.0:1767317921.274902:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131584
00000100:00100000:2.0:1767317921.274969:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131840
00000100:00100000:2.0:1767317921.274973:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131840
00000100:00100000:2.0:1767317921.275018:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15845
00000100:00100000:2.0:1767317921.275409:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940131584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317921.275448:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317921.275567:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940131584:12345-0@lo:38:kworker.0 Request processed in 160us (4257us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317921.277588:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15846
00000100:00100000:1.0:1767317921.277612:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940131840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317921.277653:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317921.277815:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940131840:12345-0@lo:38:kworker.0 Request processed in 208us (6422us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317921.277825:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15846
00000100:00080000:1.0:1767317921.277923:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317921.277929:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317921.277934:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940131584:0@lo:38:kworker.0
00000100:00080000:1.0:1767317921.277947:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317921.277950:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317921.277953:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940131840:0@lo:38:kworker.0
00000100:00100000:2.0:1767317921.278638:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15845
00000100:00100000:3.0:1767317921.772946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317922.221137:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317922.796997:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317923.246862:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317923.821534:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317923.916439:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767317923.916483:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894232960 offset 0 length 520: 4
00000100:00100000:2.0:1767317923.916508:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317923.916604:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233216
00000100:00100000:0.0:1767317923.916616:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233216
00000100:00100000:0.0:1767317923.916700:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233088
00000100:00100000:0.0:1767317923.916704:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233088
00000100:00100000:0.0:1767317923.916724:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3578
00000100:00100000:0.0:1767317923.916734:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894233216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317923.916871:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894233216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 138us (443us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317923.916879:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3578
00000100:00100000:0.0:1767317923.916897:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15847
00000100:00100000:0.0:1767317923.916902:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894233088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317923.916923:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317923.916950:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894233088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (440us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317923.916955:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15847
00000100:00080000:2.0:1767317923.917508:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317924.273250:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317924.847802:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940131968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317924.847887:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317924.848030:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940131968
00000100:00100000:3.0:1767317924.848039:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940131968
00000100:00100000:3.0:1767317924.848104:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876
00000100:00100000:3.0:1767317924.848117:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940131968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317924.848176:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317924.848263:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940131968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (376us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317924.848270:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876
00000100:00100000:1.0:1767317924.848543:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940131968:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317924.848608:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317924.850169:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317925.293070:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317925.869730:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317925.870119:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940132096:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317925.870239:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317925.870535:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132096
00000100:00100000:0.0:1767317925.870543:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132096
00000100:00100000:0.0:1767317925.870616:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877
00000100:00100000:0.0:1767317925.870625:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940132096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317925.870653:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317925.870712:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940132096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (473us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317925.870721:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877
00000100:00080000:2.0:1767317925.870792:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317925.870802:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940132096:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317926.317220:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767317926.382947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317926.382959:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767317926.382980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317926.382985:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317926.382989:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317926.382998:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3171
00000100:00080000:1.0:1767317926.383003:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317926.383011:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317926.383056:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09f80 x1853163940132224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317926.383075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317926.383078:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317926.383080:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317926.383084:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3171
00000100:00080000:1.0:1767317926.383087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317926.383091:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317926.383103:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0a680 x1853163940132352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767317926.383174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317926.383189:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317926.383191:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317926.383195:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3171
00000100:00080000:1.0:1767317926.383197:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317926.383203:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317926.383214:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08a80 x1853163940132864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317926.383220:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940132224:0@lo:38:kworker.0
00000100:00080000:1.0:1767317926.383243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767317926.383246:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767317926.383247:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767317926.383251:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3171
00000100:00080000:1.0:1767317926.383253:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767317926.383256:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317926.383267:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70e00 x1853163940133120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317926.383293:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940132736:0@lo:400:kworker.0
00000100:00100000:2.0:1767317926.383300:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317926.383378:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940132480:0@lo:400:kworker.0
00000100:00100000:3.0:1767317926.383433:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940132608:0@lo:400:kworker.0
00000100:00100000:1.0:1767317926.390584:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317926.390681:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317926.390696:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940132992:0@lo:400:kworker.0
00000100:00100000:1.0:1767317926.390744:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317926.390809:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132224
00000100:00100000:1.0:1767317926.390819:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132224
00000100:00100000:1.0:1767317926.390862:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132736
00000100:00100000:1.0:1767317926.390865:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132736
00000100:00100000:1.0:1767317926.390912:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132992
00000100:00100000:1.0:1767317926.390915:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132992
00000100:00100000:1.0:1767317926.390941:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579
00000100:00100000:1.0:1767317926.390950:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940132736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317926.391005:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940132736:12345-0@lo:400:kworker.0 Request processed in 56us (430us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317926.391013:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579
00000100:00100000:1.0:1767317926.391033:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580
00000100:00100000:1.0:1767317926.391039:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940132992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317926.391083:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940132992:12345-0@lo:400:kworker.0 Request processed in 44us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317926.391089:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580
00000100:00100000:1.0:1767317926.391104:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15848
00000100:00100000:1.0:1767317926.391107:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940132224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317926.391128:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317926.391159:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940132224:12345-0@lo:38:kworker.0 Request processed in 49us (7858us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317926.391164:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15848
00000100:00100000:1.0:1767317926.391235:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940132992:0@lo:400:kworker.0
00000100:00100000:1.0:1767317926.391248:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940132736:0@lo:400:kworker.0
00000100:00080000:1.0:1767317926.391310:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767317926.391623:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317926.391629:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317926.391632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940132224:0@lo:38:kworker.0
00000100:00100000:2.0:1767317926.391641:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940132352:0@lo:38:kworker.0
00000100:00100000:2.0:1767317926.391683:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317926.391722:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940132864:0@lo:38:kworker.0
00000100:00100000:2.0:1767317926.391745:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317926.391767:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940133120:0@lo:38:kworker.0
00000100:00100000:1.0:1767317926.392858:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132352
00000100:00100000:1.0:1767317926.392870:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132352
00000100:00100000:1.0:1767317926.392924:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845
00000100:00100000:1.0:1767317926.392931:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940132352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317926.392954:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317926.400624:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317926.400717:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132480
00000100:00100000:0.0:1767317926.400729:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132480
00000100:00100000:0.0:1767317926.400826:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371
00000100:00100000:0.0:1767317926.400851:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940132480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317926.400919:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940132480:12345-0@lo:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317926.400927:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371
00000100:00080000:0.0:1767317926.401148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317926.401207:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940132480:0@lo:400:kworker.0
00000100:00100000:0.0:1767317926.401262:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132864
00000100:00100000:0.0:1767317926.401266:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132864
00000100:00100000:0.0:1767317926.401300:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15849
00000100:00100000:0.0:1767317926.401305:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940132864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317926.401328:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317926.401378:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940132864:12345-0@lo:38:kworker.0 Request processed in 71us (9631us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317926.401401:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15849
00000100:00100000:2.0:1767317926.404536:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317926.404639:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317926.404656:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317926.404661:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940132864:0@lo:38:kworker.0
00000100:00100000:0.0:1767317926.407284:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133120
00000100:00100000:0.0:1767317926.407303:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133120
00000100:00100000:0.0:1767317926.407379:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15850
00000100:00100000:0.0:1767317926.407388:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940133120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317926.407414:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317926.407532:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940133120:12345-0@lo:38:kworker.0 Request processed in 144us (3003us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317926.407539:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15850
00000100:00080000:2.0:1767317926.408717:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317926.408730:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317926.408735:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940133120:0@lo:38:kworker.0
00000100:00100000:1.0:1767317926.410736:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940132352:12345-0@lo:38:kworker.0 Request processed in 17792us (19040us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317926.410753:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845
00000100:00100000:3.0:1767317926.411289:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317926.411448:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317926.411458:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317926.411462:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940132352:0@lo:38:kworker.0
00000100:00100000:0.0:1767317926.411543:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940132608
00000100:00100000:0.0:1767317926.411550:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940132608
00000100:00100000:0.0:1767317926.411614:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372
00000100:00100000:0.0:1767317926.411625:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940132608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317926.411768:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940132608:12345-0@lo:400:kworker.0 Request processed in 144us (479us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317926.411807:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372
00000100:00100000:3.0:1767317926.412101:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940132608:0@lo:400:kworker.0
00000100:00100000:0.0:1767317926.892919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317927.342528:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317927.920248:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317928.365189:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317928.940916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317929.033680:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317929.033819:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317929.033964:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233344
00000100:00100000:2.0:1767317929.033973:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233472
00000100:00100000:0.0:1767317929.033975:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233344
00000100:00100000:2.0:1767317929.033980:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233472
00000100:00100000:0.0:1767317929.034041:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3581
00000100:00100000:2.0:1767317929.034051:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15851
00000100:00100000:0.0:1767317929.034057:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894233472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767317929.034063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317929.034065:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894233344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317929.034091:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317929.034222:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894233472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 170us (401us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317929.034232:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3581
00000100:00100000:2.0:1767317929.038087:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894233344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4008us (4402us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317929.038105:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15851
00010000:00010000:2.0:1767317929.389461:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317929.964909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317929.965610:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940133248:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767317929.965695:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317929.966529:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133248
00000100:00100000:2.0:1767317929.966539:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133248
00000100:00100000:2.0:1767317929.966625:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878
00000100:00100000:2.0:1767317929.966634:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940133248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317929.966675:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767317929.966788:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767317929.974704:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940133248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8061us (8997us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317929.974723:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878
00000100:00100000:0.0:1767317929.986217:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940133248:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317930.413085:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317930.477122:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317905/real 1767317905]  req@ffff93d046adf100 x1853163940128000/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317930 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767317930.477170:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d046adf100 x1853163940128000/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317930 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767317930.477192:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317930.477216:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767317930.477219:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940128000:0@lo:250:kworker.0
00000100:00080000:3.0:1767317930.477328:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317930.477333:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767317930.477336:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317930.477341:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3155
00000100:00080000:3.0:1767317930.477345:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317930.477351:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317930.477385:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b800 x1853163940133376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317930.477410:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317930.477413:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317930.477415:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317930.477438:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3176
00000100:00080000:3.0:1767317930.477441:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317930.477445:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317930.477486:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989c00 x1853163940133504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317930.477496:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317930.477499:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317930.477501:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317930.477504:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3176
00000100:00080000:3.0:1767317930.477506:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317930.477509:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317930.477520:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a300 x1853163940133632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317930.477574:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317930.477577:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317930.477579:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317930.477583:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3176
00000100:00080000:3.0:1767317930.477585:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317930.477589:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317930.477600:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04698a680 x1853163940134144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317930.477615:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317930.477618:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317930.477620:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317930.477629:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3176
00000100:00080000:3.0:1767317930.477631:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317930.477636:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317930.477651:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046988a80 x1853163940134400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317930.477732:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940133888:0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.477846:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317930.477903:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317930.477909:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940134016:0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.477935:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317930.477984:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134016
00000100:00100000:1.0:1767317930.477994:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134016
00000100:00100000:1.0:1767317930.478047:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582
00000100:00100000:1.0:1767317930.478056:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940134016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.478103:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940134016:12345-0@lo:400:kworker.0 Request processed in 48us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317930.478111:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582
00000100:00100000:1.0:1767317930.478133:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940133760:0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.478169:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317930.478185:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767317930.478189:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940134272:0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.478207:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317930.478227:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317930.478235:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134272
00000100:00100000:1.0:1767317930.478239:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134272
00000100:00100000:1.0:1767317930.478263:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583
00000100:00100000:1.0:1767317930.478268:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940134272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.478299:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940134272:12345-0@lo:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317930.478305:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583
00000100:00080000:1.0:1767317930.478319:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317930.478344:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940134272:0@lo:400:kworker.0
00000100:00100000:1.0:1767317930.478377:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940134016:0@lo:400:kworker.0
00000100:00100000:2.0:1767317930.478556:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133888
00000100:00100000:2.0:1767317930.478561:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133888
00000100:00100000:2.0:1767317930.478603:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133760
00000100:00100000:2.0:1767317930.478606:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133760
00000100:00100000:2.0:1767317930.478626:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373
00000100:00100000:2.0:1767317930.478633:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940133888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317930.478678:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940133888:12345-0@lo:400:kworker.0 Request processed in 45us (831us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317930.478684:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373
00000100:00100000:2.0:1767317930.478696:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374
00000100:00100000:2.0:1767317930.478702:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940133760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317930.478731:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940133760:12345-0@lo:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317930.478736:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374
00000100:00100000:2.0:1767317930.478803:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940133888:0@lo:400:kworker.0
00000100:00100000:0.0:1767317930.479066:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940133376:0@lo:250:kworker.0
00000400:00000100:0.0:1767317930.479094:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940133376 offset 0 length 520: 4
00000100:00100000:0.0:1767317930.479115:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940133504:0@lo:38:kworker.0
00000100:00100000:0.0:1767317930.479138:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317930.479163:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940133632:0@lo:38:kworker.0
00000100:00100000:0.0:1767317930.479183:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317930.479207:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940134144:0@lo:38:kworker.0
00000100:00100000:0.0:1767317930.479223:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317930.479235:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940134400:0@lo:38:kworker.0
00000100:00100000:0.0:1767317930.479251:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317930.479269:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133504
00000100:00100000:0.0:1767317930.479273:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133504
00000100:00100000:0.0:1767317930.479292:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134144
00000100:00100000:0.0:1767317930.479294:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134144
00000100:00100000:0.0:1767317930.479304:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134400
00000100:00100000:0.0:1767317930.479306:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134400
00000100:00100000:0.0:1767317930.479318:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15852
00000100:00100000:0.0:1767317930.479322:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940133504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317930.479339:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317930.479362:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940133504:12345-0@lo:38:kworker.0 Request processed in 40us (225us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317930.479368:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15852
00000100:00100000:0.0:1767317930.479378:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15853
00000100:00100000:0.0:1767317930.479389:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940134144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317930.479398:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317930.479417:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940134144:12345-0@lo:38:kworker.0 Request processed in 27us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317930.479422:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15853
00000100:00100000:0.0:1767317930.479431:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15854
00000100:00100000:0.0:1767317930.479435:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940134400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317930.479442:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317930.479457:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940134400:12345-0@lo:38:kworker.0 Request processed in 21us (205us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317930.479462:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15854
00000100:00080000:0.0:1767317930.479490:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317930.479494:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317930.479497:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940134400:0@lo:38:kworker.0
00000100:00080000:0.0:1767317930.479512:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317930.479515:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317930.479517:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940133504:0@lo:38:kworker.0
00000100:00080000:0.0:1767317930.479523:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317930.479526:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317930.479528:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940134144:0@lo:38:kworker.0
00000100:00100000:3.0:1767317930.479591:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940133632
00000100:00100000:3.0:1767317930.479595:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940133632
00000100:00100000:3.0:1767317930.479621:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846
00000100:00100000:3.0:1767317930.479625:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940133632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317930.479635:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317930.479664:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940133632:12345-0@lo:38:kworker.0 Request processed in 38us (479us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317930.479669:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846
00000100:00080000:3.0:1767317930.479694:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317930.479697:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317930.479701:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940133632:0@lo:38:kworker.0
00000100:00080000:1.0:1767317930.481411:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317930.481487:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940133760:0@lo:400:kworker.0
00000100:00100000:3.0:1767317930.988905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317930.989276:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940134528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317930.989395:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317930.989499:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134528
00000100:00100000:3.0:1767317930.989507:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134528
00000100:00100000:3.0:1767317930.989560:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879
00000100:00100000:3.0:1767317930.989568:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940134528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317930.989597:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317930.989645:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940134528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (251us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317930.989651:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879
00000100:00100000:2.0:1767317930.990152:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940134528:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317931.437059:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317932.012921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317932.461754:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317933.036910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317933.486500:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317934.061282:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317934.155742:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317934.155830:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317934.155974:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233728
00000100:00100000:3.0:1767317934.155986:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233728
00000100:00100000:3.0:1767317934.156064:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233600
00000100:00100000:3.0:1767317934.156068:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233600
00000100:00100000:3.0:1767317934.156095:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3584
00000100:00100000:3.0:1767317934.156140:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894233728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317934.156236:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894233728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 120us (491us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317934.156245:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3584
00000100:00100000:3.0:1767317934.156267:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15855
00000100:00100000:3.0:1767317934.156271:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894233600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317934.156292:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317934.156328:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894233600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (496us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317934.156334:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15855
00000100:00080000:1.0:1767317934.156664:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317934.519326:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317935.086900:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940134656:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317935.086973:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317935.087046:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134656
00000100:00100000:3.0:1767317935.087054:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134656
00000100:00100000:3.0:1767317935.087139:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880
00000100:00100000:3.0:1767317935.087151:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940134656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317935.087184:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767317935.087400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317935.087463:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317935.087639:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940134656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 491us (664us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317935.087647:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880
00000100:00100000:2.0:1767317935.087691:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940134656:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317935.533138:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317935.597050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317935.597063:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317935.597066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317935.597074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317935.597078:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317935.597086:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767317935.597090:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317935.597107:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317935.597157:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6a00 x1853163940134784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317935.597406:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940134784:0@lo:38:kworker.0
00000100:00100000:3.0:1767317935.597511:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767317935.597575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317935.597581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317935.597583:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317935.597587:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767317935.597591:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317935.597596:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317935.597612:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7800 x1853163940134912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317935.597672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317935.597675:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317935.597677:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317935.597680:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767317935.597694:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317935.597705:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317935.597728:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95f80 x1853163940135296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317935.597744:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317935.597747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317935.597749:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317935.597752:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767317935.597754:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317935.597758:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317935.597768:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966d80 x1853163940135552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317935.597830:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940135168:0@lo:400:kworker.0
00000100:00100000:0.0:1767317935.597864:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940135424:0@lo:400:kworker.0
00000100:00100000:0.0:1767317935.597900:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317935.597909:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940135040:0@lo:400:kworker.0
00000100:00100000:0.0:1767317935.597935:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317935.598012:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135040
00000100:00100000:0.0:1767317935.598020:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135040
00000100:00080000:1.0:1767317935.598057:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317935.598077:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375
00000100:00100000:0.0:1767317935.598086:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940135040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317935.598161:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940135040:12345-0@lo:400:kworker.0 Request processed in 75us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317935.598168:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375
00000100:00100000:1.0:1767317935.598291:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940135040:0@lo:400:kworker.0
00000100:00100000:3.0:1767317935.598470:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940134912:0@lo:38:kworker.0
00000100:00100000:3.0:1767317935.598500:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317935.598525:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134912
00000100:00100000:1.0:1767317935.598526:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317935.598529:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134912
00000100:00100000:3.0:1767317935.598610:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847
00000100:00100000:3.0:1767317935.598615:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940134912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317935.598633:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317935.598664:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940134912:12345-0@lo:38:kworker.0 Request processed in 47us (163us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317935.598670:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847
00000100:00080000:3.0:1767317935.598709:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317935.598714:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317935.598716:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940134912:0@lo:38:kworker.0
00000100:00100000:3.0:1767317935.598723:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940135296:0@lo:38:kworker.0
00000100:00100000:1.0:1767317935.601240:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317935.604644:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940134784
00000100:00100000:2.0:1767317935.604659:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940134784
00000100:00100000:2.0:1767317935.604805:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135168
00000100:00100000:2.0:1767317935.604809:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135168
00000100:00100000:2.0:1767317935.604854:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585
00000100:00100000:2.0:1767317935.604865:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940135168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317935.604950:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940135168:12345-0@lo:400:kworker.0 Request processed in 89us (6424us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317935.604957:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585
00000100:00100000:2.0:1767317935.604974:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15856
00000100:00100000:2.0:1767317935.604978:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940134784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317935.604997:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317935.605024:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940134784:12345-0@lo:38:kworker.0 Request processed in 45us (7514us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317935.605030:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15856
00000100:00080000:2.0:1767317935.605054:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317935.605378:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940135168:0@lo:400:kworker.0
00000100:00100000:0.0:1767317935.607370:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135424
00000100:00100000:0.0:1767317935.607383:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135424
00000100:00100000:2.0:1767317935.607436:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767317935.607477:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317935.607556:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135296
00000100:00100000:2.0:1767317935.607563:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940135552:0@lo:38:kworker.0
00000100:00100000:0.0:1767317935.607572:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135296
00000100:00100000:2.0:1767317935.607616:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317935.609506:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135552
00000100:00100000:3.0:1767317935.609519:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135552
00000100:00080000:2.0:1767317935.609548:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317935.609555:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317935.609558:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586
00000100:00100000:2.0:1767317935.609560:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940134784:0@lo:38:kworker.0
00000100:00100000:3.0:1767317935.609573:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940135424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317935.609631:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15857
00000100:00100000:2.0:1767317935.609637:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940135296:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767317935.609650:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940135424:12345-0@lo:400:kworker.0 Request processed in 85us (8418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317935.609657:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586
00010000:00020000:2.0:1767317935.609661:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317935.609674:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15858
00000100:00100000:3.0:1767317935.609678:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940135552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317935.609687:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317935.609692:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940135296:12345-0@lo:38:kworker.0 Request processed in 55us (2259us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317935.609698:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15857
00000100:00100000:3.0:1767317935.609724:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940135552:12345-0@lo:38:kworker.0 Request processed in 44us (2107us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317935.609729:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15858
00000100:00080000:3.0:1767317935.609792:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317935.609798:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317935.609801:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940135296:0@lo:38:kworker.0
00000100:00080000:3.0:1767317935.609811:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317935.609815:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317935.609818:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940135552:0@lo:38:kworker.0
00000100:00100000:0.0:1767317935.609971:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940135424:0@lo:400:kworker.0
00000100:00100000:1.0:1767317936.109395:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317936.112950:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940135680:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317936.113035:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317936.113699:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135680
00000100:00100000:3.0:1767317936.113709:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135680
00000100:00100000:3.0:1767317936.113806:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881
00000100:00100000:3.0:1767317936.113817:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940135680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767317936.113856:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767317936.113945:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940135680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (909us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317936.113953:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881
00000100:00100000:1.0:1767317936.114129:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940135680:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317936.558968:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317937.132893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317937.584862:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317938.156910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317938.605124:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317939.180904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317939.272085:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317939.272191:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317939.273671:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233856
00000100:00100000:1.0:1767317939.273686:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233856
00000100:00100000:1.0:1767317939.273738:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894233984
00000100:00100000:1.0:1767317939.273743:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894233984
00000100:00100000:1.0:1767317939.273825:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3587
00000100:00100000:1.0:1767317939.273836:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894233984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317939.273926:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894233984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (1734us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317939.273933:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3587
00000100:00100000:1.0:1767317939.273970:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15859
00000100:00100000:1.0:1767317939.273974:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894233856:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:3.0:1767317939.275918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767317939.276674:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317939.276793:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894233856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 2795us (4707us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317939.276809:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15859
00010000:00010000:2.0:1767317939.630901:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767317940.204890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317940.207174:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940135808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317940.207265:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317940.209748:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135808
00000100:00100000:0.0:1767317940.209768:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135808
00000100:00100000:0.0:1767317940.209908:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882
00000100:00100000:0.0:1767317940.209917:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940135808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317940.209955:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317940.210076:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940135808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (2810us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317940.210085:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882
00000100:00080000:3.0:1767317940.210102:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767317940.210241:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940135808:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317940.654270:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317940.717545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317940.717555:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317940.717558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317940.717562:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317940.717566:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317940.717575:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3185
00000100:00080000:2.0:1767317940.717579:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317940.717603:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317940.717653:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940135936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317940.717880:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940135936:0@lo:38:kworker.0
00000100:00080000:2.0:1767317940.717945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317940.717951:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767317940.717955:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317940.717956:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317940.717963:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3185
00000100:00080000:2.0:1767317940.717966:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317940.717970:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317940.717989:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940136064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317940.718035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767317940.718038:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940136064:0@lo:38:kworker.0
00000100:00080000:2.0:1767317940.718040:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317940.718045:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317940.718061:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3185
00000100:00080000:2.0:1767317940.718064:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317940.718067:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317940.718083:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940136448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317940.718103:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317940.718111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317940.718115:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317940.718117:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317940.718121:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3185
00000100:00080000:2.0:1767317940.718126:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317940.718137:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317940.718151:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1c00 x1853163940136704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317940.718157:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136064
00000100:00100000:3.0:1767317940.718164:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136064
00000100:00100000:2.0:1767317940.718173:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317940.718183:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940136576:0@lo:400:kworker.0
00000100:00100000:3.0:1767317940.718201:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848
00000100:00100000:3.0:1767317940.718209:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940136064:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767317940.718218:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767317940.718230:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317940.718266:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940136448:0@lo:38:kworker.0
00000100:00100000:3.0:1767317940.718273:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940136064:12345-0@lo:38:kworker.0 Request processed in 63us (169us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317940.718282:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848
00000100:00100000:2.0:1767317940.718295:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317940.718317:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940136704:0@lo:38:kworker.0
00000100:00100000:2.0:1767317940.718337:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317940.718385:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317940.718390:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317940.718393:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940136064:0@lo:38:kworker.0
00000100:00100000:0.0:1767317940.718474:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940136192:0@lo:400:kworker.0
00000100:00100000:0.0:1767317940.718508:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317940.718536:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317940.718542:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940136320:0@lo:400:kworker.0
00000100:00100000:0.0:1767317940.718563:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317940.718594:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940135936
00000100:00100000:0.0:1767317940.718599:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136576
00000100:00100000:1.0:1767317940.718600:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940135936
00000100:00100000:0.0:1767317940.718605:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136576
00000100:00100000:1.0:1767317940.718625:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136448
00000100:00100000:1.0:1767317940.718630:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136448
00000100:00100000:0.0:1767317940.718644:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136704
00000100:00100000:1.0:1767317940.718646:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136320
00000100:00100000:0.0:1767317940.718650:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136704
00000100:00100000:1.0:1767317940.718651:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136320
00000100:00100000:0.0:1767317940.718672:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588
00000100:00100000:0.0:1767317940.718681:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940136576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317940.718739:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940136576:12345-0@lo:400:kworker.0 Request processed in 60us (521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317940.718814:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940136576:0@lo:400:kworker.0
00000100:00100000:1.0:1767317940.722794:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589
00000100:00100000:1.0:1767317940.722821:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940136320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317940.722924:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940136320:12345-0@lo:400:kworker.0 Request processed in 116us (4359us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317940.722932:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589
00000100:00100000:1.0:1767317940.722955:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15860
00000100:00100000:1.0:1767317940.722960:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940135936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317940.722981:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317940.723019:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940135936:12345-0@lo:38:kworker.0 Request processed in 57us (5067us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317940.723025:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15860
00000100:00100000:1.0:1767317940.723038:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15861
00000100:00100000:1.0:1767317940.723042:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940136448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317940.723164:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317940.723193:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940136448:12345-0@lo:38:kworker.0 Request processed in 148us (4899us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317940.723199:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15861
00000100:00100000:1.0:1767317940.723214:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15862
00000100:00100000:1.0:1767317940.723217:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940136704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317940.723227:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317940.723249:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940136704:12345-0@lo:38:kworker.0 Request processed in 30us (4911us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317940.723254:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15862
00000100:00100000:1.0:1767317940.723328:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940136320:0@lo:400:kworker.0
00000100:00100000:1.0:1767317940.723370:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136192
00000100:00100000:1.0:1767317940.723376:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136192
00000100:00100000:1.0:1767317940.723664:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376
00000100:00100000:1.0:1767317940.723673:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940136192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317940.723726:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940136192:12345-0@lo:400:kworker.0 Request processed in 54us (5216us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317940.723734:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376
00000100:00100000:1.0:1767317940.723767:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940136192:0@lo:400:kworker.0
00000100:00080000:1.0:1767317940.723826:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317940.723832:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317940.723835:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940136448:0@lo:38:kworker.0
00000100:00080000:1.0:1767317940.723844:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317940.723847:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317940.723858:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940136704:0@lo:38:kworker.0
00000100:00080000:1.0:1767317940.723871:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317940.723875:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317940.723878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940135936:0@lo:38:kworker.0
00000100:00080000:1.0:1767317940.723909:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317940.723914:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317940.728582:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588
00000100:00100000:0.0:1767317941.231259:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767317941.231283:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940136832:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317941.231354:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317941.231732:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136832
00000100:00100000:1.0:1767317941.231742:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136832
00000100:00100000:1.0:1767317941.231830:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883
00000100:00100000:1.0:1767317941.231839:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940136832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317941.231873:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317941.231935:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940136832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (580us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317941.231942:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883
00000100:00100000:1.0:1767317941.231995:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940136832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317941.232360:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317941.677057:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317942.257297:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317942.704649:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317943.277010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317943.725890:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317944.301199:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317944.403306:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317944.403421:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317944.406494:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234112
00000100:00100000:3.0:1767317944.406511:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234112
00000100:00100000:3.0:1767317944.406624:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234240
00000100:00100000:3.0:1767317944.406629:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234240
00000100:00080000:2.0:1767317944.406705:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317944.406757:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3590
00000100:00100000:0.0:1767317944.406770:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894234240:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317944.406899:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894234240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 131us (3476us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317944.406908:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3590
00000100:00100000:0.0:1767317944.406932:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15863
00000100:00100000:0.0:1767317944.406937:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894234112:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317944.406960:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317944.406989:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894234112:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (3792us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317944.406996:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15863
00010000:00010000:2.0:1767317944.749942:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317945.324927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317945.325083:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940136960:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317945.325162:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317945.325367:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940136960
00000100:00100000:0.0:1767317945.325376:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940136960
00000100:00100000:0.0:1767317945.325436:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884
00000100:00100000:0.0:1767317945.325445:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940136960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317945.325477:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317945.325542:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940136960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (379us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317945.325549:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884
00000100:00100000:3.0:1767317945.325672:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940136960:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767317945.325874:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767317945.776062:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317945.839502:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317945.839516:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317945.839519:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317945.839523:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317945.839529:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317945.839537:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3190
00000100:00080000:0.0:1767317945.839541:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317945.839549:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317945.839593:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966d80 x1853163940137088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317945.839624:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317945.839627:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317945.839629:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317945.839632:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3190
00000100:00080000:0.0:1767317945.839635:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317945.839638:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317945.839654:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219e300 x1853163940137216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317945.839725:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317945.839729:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317945.839731:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317945.839734:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3190
00000100:00080000:0.0:1767317945.839753:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317945.839757:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317945.839770:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ea00 x1853163940137600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317945.839808:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317945.839811:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317945.839812:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317945.839815:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3190
00000100:00080000:0.0:1767317945.839818:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317945.839821:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317945.839834:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a03800 x1853163940137856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317945.839927:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317945.839946:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940137344:0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840034:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317945.840137:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940137728:0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840169:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317945.840193:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767317945.840198:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940137472:0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840221:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317945.840254:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137728
00000100:00100000:3.0:1767317945.840263:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137728
00000100:00100000:3.0:1767317945.840325:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137472
00000100:00100000:3.0:1767317945.840328:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137472
00000100:00100000:3.0:1767317945.840356:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591
00000100:00100000:3.0:1767317945.840364:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940137728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840430:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940137728:12345-0@lo:400:kworker.0 Request processed in 65us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317945.840438:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591
00000100:00100000:3.0:1767317945.840459:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592
00000100:00100000:3.0:1767317945.840466:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940137472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840490:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940137472:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317945.840496:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592
00000100:00100000:3.0:1767317945.840539:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940137472:0@lo:400:kworker.0
00000100:00100000:3.0:1767317945.840549:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940137728:0@lo:400:kworker.0
00000100:00100000:1.0:1767317945.840674:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137344
00000100:00100000:1.0:1767317945.840678:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137344
00000100:00100000:1.0:1767317945.840723:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377
00000100:00100000:1.0:1767317945.840731:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940137344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317945.840794:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940137344:12345-0@lo:400:kworker.0 Request processed in 44us (740us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317945.840801:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377
00000100:00100000:1.0:1767317945.840855:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940137088:0@lo:38:kworker.0
00000100:00100000:1.0:1767317945.840884:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317945.840902:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940137216:0@lo:38:kworker.0
00000100:00100000:1.0:1767317945.840925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317945.840944:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940137600:0@lo:38:kworker.0
00000100:00100000:1.0:1767317945.840964:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317945.840991:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137216
00000100:00100000:1.0:1767317945.840995:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137216
00000100:00100000:1.0:1767317945.841029:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849
00000100:00100000:1.0:1767317945.841034:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940137216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317945.841053:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317945.841085:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940137216:12345-0@lo:38:kworker.0 Request processed in 50us (159us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317945.841091:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849
00000100:00100000:1.0:1767317945.841111:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137088
00000100:00100000:1.0:1767317945.841114:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137088
00000100:00100000:1.0:1767317945.841130:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137600
00000100:00100000:1.0:1767317945.841133:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137600
00000100:00100000:1.0:1767317945.841147:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15864
00000100:00100000:1.0:1767317945.841151:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940137088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317945.841160:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317945.841184:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940137088:12345-0@lo:38:kworker.0 Request processed in 31us (299us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317945.841189:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15864
00000100:00100000:1.0:1767317945.841200:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15865
00000100:00100000:1.0:1767317945.841204:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940137600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317945.841220:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317945.841243:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940137600:12345-0@lo:38:kworker.0 Request processed in 38us (279us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317945.841249:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15865
00000100:00080000:1.0:1767317945.841278:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317945.841283:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317945.841285:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940137088:0@lo:38:kworker.0
00000100:00080000:1.0:1767317945.841294:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317945.841297:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317945.841300:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940137216:0@lo:38:kworker.0
00000100:00080000:1.0:1767317945.841307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317945.841310:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317945.841313:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940137600:0@lo:38:kworker.0
00000100:00100000:1.0:1767317945.841347:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940137344:0@lo:400:kworker.0
00000100:00080000:2.0:1767317945.841922:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767317945.841928:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317945.841962:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940137856:0@lo:38:kworker.0
00000100:00100000:1.0:1767317945.841996:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317945.842196:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137856
00000100:00100000:0.0:1767317945.842201:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137856
00000100:00100000:0.0:1767317945.842237:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15866
00000100:00100000:0.0:1767317945.842243:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940137856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317945.842256:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317945.842301:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940137856:12345-0@lo:38:kworker.0 Request processed in 57us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317945.842307:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15866
00000100:00080000:2.0:1767317945.842376:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317945.842381:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317945.842384:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940137856:0@lo:38:kworker.0
00000100:00100000:2.0:1767317946.349140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317946.350467:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940137984:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317946.350553:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317946.351108:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940137984
00000100:00100000:1.0:1767317946.351119:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940137984
00000100:00100000:1.0:1767317946.351174:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885
00000100:00100000:1.0:1767317946.351184:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940137984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317946.351225:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317946.351289:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940137984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (735us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317946.351296:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885
00000100:00100000:3.0:1767317946.352092:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940137984:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317946.799123:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317947.374869:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317947.822092:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317948.397221:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317948.845216:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317949.421069:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317949.511083:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767317949.511126:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894234368 offset 0 length 520: 4
00000100:00100000:3.0:1767317949.511150:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317949.511255:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234624
00000100:00100000:0.0:1767317949.511267:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234624
00000100:00100000:0.0:1767317949.511374:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234496
00000100:00100000:0.0:1767317949.511378:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234496
00000100:00100000:0.0:1767317949.511435:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3593
00000100:00100000:0.0:1767317949.511446:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894234624:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317949.511541:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894234624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (469us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317949.511550:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3593
00000100:00100000:0.0:1767317949.511571:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15867
00000100:00100000:0.0:1767317949.511576:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894234496:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767317949.511600:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317949.511628:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894234496:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (477us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317949.511634:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15867
00000100:00080000:2.0:1767317949.511798:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317949.869270:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317950.444931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317950.446060:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940138112:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317950.446128:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317950.446471:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138112
00000100:00100000:0.0:1767317950.446479:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138112
00000100:00080000:2.0:1767317950.446575:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767317950.447038:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886
00000100:00100000:0.0:1767317950.447050:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940138112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317950.447084:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317950.447164:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940138112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (1034us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317950.447172:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886
00000100:00100000:2.0:1767317950.447268:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940138112:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317950.893421:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317950.959701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317950.959713:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317950.959716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317950.959721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317950.959726:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317950.959734:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3195
00000100:00080000:2.0:1767317950.959740:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317950.959746:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317950.959807:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940138240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317950.959834:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317950.959838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317950.959840:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317950.959843:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3195
00000100:00080000:2.0:1767317950.959846:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317950.959850:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317950.959864:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1c00 x1853163940138368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317950.959938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317950.959941:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317950.959943:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317950.959946:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3195
00000100:00080000:2.0:1767317950.959949:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317950.959954:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317950.959976:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2d80 x1853163940138752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317950.960007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317950.960010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317950.960011:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317950.960015:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3195
00000100:00080000:2.0:1767317950.960017:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317950.960021:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317950.960031:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940139008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317950.960063:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317950.960081:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940138880:0@lo:400:kworker.0
00000100:00100000:2.0:1767317950.960169:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317950.960602:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940138240:0@lo:38:kworker.0
00000100:00100000:1.0:1767317950.960635:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317950.960669:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940138368:0@lo:38:kworker.0
00000100:00100000:1.0:1767317950.960693:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317950.960715:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940138752:0@lo:38:kworker.0
00000100:00100000:1.0:1767317950.960736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317950.960750:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940139008:0@lo:38:kworker.0
00000100:00100000:1.0:1767317950.960769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317950.960827:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138880
00000100:00100000:1.0:1767317950.960834:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138880
00000100:00100000:1.0:1767317950.960885:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138240
00000100:00100000:1.0:1767317950.960889:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138240
00000100:00100000:1.0:1767317950.960900:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138752
00000100:00100000:1.0:1767317950.960903:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138752
00000100:00100000:1.0:1767317950.960910:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139008
00000100:00100000:1.0:1767317950.960913:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139008
00000100:00100000:1.0:1767317950.960923:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594
00000100:00100000:1.0:1767317950.960932:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940138880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317950.960996:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940138880:12345-0@lo:400:kworker.0 Request processed in 64us (825us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317950.961003:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594
00000100:00100000:1.0:1767317950.961022:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15868
00000100:00100000:1.0:1767317950.961026:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940138240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317950.961045:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317950.961077:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940138240:12345-0@lo:38:kworker.0 Request processed in 49us (441us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317950.961093:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15868
00000100:00100000:1.0:1767317950.961106:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15869
00000100:00100000:1.0:1767317950.961110:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940138752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317950.961119:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317950.961143:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940138752:12345-0@lo:38:kworker.0 Request processed in 32us (406us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317950.961148:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15869
00000100:00100000:1.0:1767317950.961158:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15870
00000100:00100000:1.0:1767317950.961161:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940139008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317950.961169:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317950.961189:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940139008:12345-0@lo:38:kworker.0 Request processed in 27us (420us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317950.961195:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15870
00000100:00080000:1.0:1767317950.961211:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317950.961250:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940138880:0@lo:400:kworker.0
00000100:00080000:1.0:1767317950.961280:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317950.961285:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317950.961287:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940138240:0@lo:38:kworker.0
00000100:00080000:1.0:1767317950.961295:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317950.961298:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317950.961301:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940138752:0@lo:38:kworker.0
00000100:00080000:1.0:1767317950.961307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317950.961309:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317950.961317:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940139008:0@lo:38:kworker.0
00000100:00100000:3.0:1767317950.961620:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940138496:0@lo:400:kworker.0
00000100:00100000:3.0:1767317950.961660:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317950.961706:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317950.961712:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940138624:0@lo:400:kworker.0
00000100:00100000:3.0:1767317950.961735:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317950.961799:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138624
00000100:00100000:3.0:1767317950.961810:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138624
00000100:00100000:3.0:1767317950.961865:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595
00000100:00100000:3.0:1767317950.961871:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940138624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317950.961909:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940138624:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317950.961915:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595
00000100:00080000:3.0:1767317950.961936:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317950.961966:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940138624:0@lo:400:kworker.0
00000100:00100000:2.0:1767317950.962138:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138368
00000100:00100000:2.0:1767317950.962144:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138368
00000100:00100000:2.0:1767317950.962177:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850
00000100:00100000:2.0:1767317950.962182:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940138368:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317950.962196:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317950.962244:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940138368:12345-0@lo:38:kworker.0 Request processed in 60us (1550us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317950.962250:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850
00000100:00080000:0.0:1767317950.962320:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317950.962325:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317950.962328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940138368:0@lo:38:kworker.0
00000100:00100000:1.0:1767317950.962424:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940138496
00000100:00100000:1.0:1767317950.962428:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940138496
00000100:00080000:3.0:1767317950.965609:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767317950.965745:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378
00000100:00100000:1.0:1767317950.965791:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940138496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317950.965911:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940138496:12345-0@lo:400:kworker.0 Request processed in 154us (4250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317950.965919:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378
00000100:00100000:3.0:1767317950.966022:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940138496:0@lo:400:kworker.0
00000100:00100000:0.0:1767317951.469445:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317951.469576:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317951.469631:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940139136:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317951.469703:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317951.469869:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139136
00000100:00100000:1.0:1767317951.469877:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139136
00000100:00100000:1.0:1767317951.469926:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887
00000100:00100000:1.0:1767317951.469936:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940139136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317951.469975:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317951.470017:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940139136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (315us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317951.470025:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887
00000100:00100000:0.0:1767317951.478075:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940139136:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317951.917397:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317952.494597:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317952.941138:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317953.523698:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317953.967894:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317954.540959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317954.631868:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317954.631949:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317954.632060:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234880
00000100:00100000:0.0:1767317954.632071:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234880
00000100:00100000:0.0:1767317954.632165:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894234752
00000100:00100000:0.0:1767317954.632169:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894234752
00000100:00100000:0.0:1767317954.632195:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3596
00000100:00100000:0.0:1767317954.632205:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894234880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317954.632281:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894234880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (424us total) trans 0 rc 0/0
00000100:00080000:3.0:1767317954.632463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317954.632498:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15871
00000100:00100000:3.0:1767317954.632505:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894234752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317954.632527:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317954.632557:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894234752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (636us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317954.632565:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15871
00000100:00100000:0.0:1767317954.632622:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3596
00010000:00010000:2.0:1767317954.989552:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317955.055207:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317930/real 1767317930]  req@ffff93d04401b800 x1853163940133376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317955 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317955.055244:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04401b800 x1853163940133376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317955 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767317955.055262:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317955.055301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767317955.055305:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940133376:0@lo:250:kworker.0
00000100:00080000:2.0:1767317955.055595:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317955.055602:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767317955.055606:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317955.055611:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3180
00000100:00080000:2.0:1767317955.055615:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317955.055622:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317955.055654:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940139264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317955.055680:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317955.055683:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317955.055685:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317955.055688:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3200
00000100:00080000:2.0:1767317955.055691:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317955.055694:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317955.055708:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059500 x1853163940139392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317955.055717:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317955.055720:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317955.055722:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317955.055738:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3200
00000100:00080000:2.0:1767317955.055740:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317955.055743:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317955.055758:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a300 x1853163940139520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317955.055844:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317955.055848:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317955.055849:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317955.055854:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3200
00000100:00080000:2.0:1767317955.055856:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317955.055860:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317955.055872:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940140032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317955.055887:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317955.055890:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317955.055891:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317955.055894:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3200
00000100:00080000:2.0:1767317955.055897:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317955.055900:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317955.055911:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0700 x1853163940140288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317955.055949:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940140160:0@lo:400:kworker.0
00000100:00100000:2.0:1767317955.056006:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317955.056065:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317955.056077:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940139904:0@lo:400:kworker.0
00000100:00100000:2.0:1767317955.056102:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317955.056130:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140160
00000100:00100000:2.0:1767317955.056137:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140160
00000100:00100000:2.0:1767317955.056186:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139904
00000100:00100000:2.0:1767317955.056189:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139904
00000100:00100000:2.0:1767317955.056212:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597
00000100:00100000:2.0:1767317955.056219:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940140160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317955.056268:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940140160:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317955.056275:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597
00000100:00100000:2.0:1767317955.056310:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598
00000100:00100000:2.0:1767317955.056316:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940139904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317955.056343:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940139904:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317955.056348:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598
00000100:00100000:2.0:1767317955.056387:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940139904:0@lo:400:kworker.0
00000100:00100000:2.0:1767317955.056397:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940140160:0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056560:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940139776:0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056598:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317955.056635:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317955.056641:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940139648:0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056662:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317955.056690:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139776
00000100:00100000:1.0:1767317955.056695:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139776
00000100:00100000:1.0:1767317955.056720:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139648
00000100:00100000:1.0:1767317955.056723:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139648
00000100:00100000:1.0:1767317955.056746:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379
00000100:00100000:1.0:1767317955.056767:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940139776:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056823:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940139776:12345-0@lo:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317955.056829:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379
00000100:00100000:1.0:1767317955.056843:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380
00000100:00100000:1.0:1767317955.056849:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940139648:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056874:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940139648:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317955.056879:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380
00000100:00100000:1.0:1767317955.056913:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940139648:0@lo:400:kworker.0
00000100:00100000:1.0:1767317955.056933:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940139776:0@lo:400:kworker.0
00000100:00080000:3.0:1767317955.057014:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767317955.057018:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767317955.057020:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317955.057086:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940139264:0@lo:250:kworker.0
00000400:00000100:0.0:1767317955.057111:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940139264 offset 0 length 520: 4
00000100:00100000:0.0:1767317955.057130:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940139392:0@lo:38:kworker.0
00000100:00100000:0.0:1767317955.057155:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317955.057181:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940139520:0@lo:38:kworker.0
00000100:00100000:0.0:1767317955.057205:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317955.057242:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940140032:0@lo:38:kworker.0
00000100:00100000:0.0:1767317955.057266:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317955.057293:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940140288:0@lo:38:kworker.0
00000100:00100000:0.0:1767317955.057314:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317955.057344:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139392
00000100:00100000:0.0:1767317955.057348:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139392
00000100:00100000:0.0:1767317955.057369:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140032
00000100:00100000:0.0:1767317955.057371:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140032
00000100:00100000:0.0:1767317955.057386:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140288
00000100:00100000:0.0:1767317955.057388:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140288
00000100:00100000:0.0:1767317955.057399:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15872
00000100:00100000:0.0:1767317955.057404:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940139392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317955.057422:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317955.057455:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940139392:12345-0@lo:38:kworker.0 Request processed in 49us (298us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317955.057461:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15872
00000100:00100000:0.0:1767317955.057473:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15873
00000100:00100000:0.0:1767317955.057477:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940140032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317955.057486:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317955.057507:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940140032:12345-0@lo:38:kworker.0 Request processed in 28us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317955.057512:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15873
00000100:00100000:0.0:1767317955.057521:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15874
00000100:00100000:0.0:1767317955.057523:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940140288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317955.057531:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317955.057550:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940140288:12345-0@lo:38:kworker.0 Request processed in 25us (235us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317955.057564:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15874
00000100:00080000:0.0:1767317955.057594:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317955.057599:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317955.057602:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940139392:0@lo:38:kworker.0
00000100:00080000:0.0:1767317955.057610:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317955.057613:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317955.057616:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940140032:0@lo:38:kworker.0
00000100:00080000:0.0:1767317955.057622:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317955.057625:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317955.057627:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940140288:0@lo:38:kworker.0
00000100:00100000:1.0:1767317955.057837:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940139520
00000100:00100000:1.0:1767317955.057842:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940139520
00000100:00100000:1.0:1767317955.057872:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851
00000100:00100000:1.0:1767317955.057877:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940139520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317955.057888:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317955.057935:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940139520:12345-0@lo:38:kworker.0 Request processed in 56us (729us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317955.057940:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851
00000100:00080000:0.0:1767317955.058410:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317955.058416:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317955.058419:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940139520:0@lo:38:kworker.0
00000100:00100000:3.0:1767317955.564843:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317955.567808:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940140416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767317955.567888:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317955.570420:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140416
00000100:00100000:2.0:1767317955.570437:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140416
00000100:00100000:2.0:1767317955.570876:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888
00000100:00100000:2.0:1767317955.570888:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940140416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317955.570936:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767317955.571024:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940140416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (3135us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317955.571031:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888
00000100:00100000:3.0:1767317955.571203:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940140416:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317956.013899:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317956.589341:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940140544:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317956.589412:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317956.589594:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140544
00000100:00100000:1.0:1767317956.589602:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140544
00000100:00100000:1.0:1767317956.589656:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889
00000100:00100000:1.0:1767317956.589665:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940140544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317956.589696:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317956.589754:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940140544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317956.589762:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889
00000100:00100000:0.0:1767317956.590878:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940140544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317956.591153:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317957.040267:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317957.612887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317958.061467:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317958.641986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317959.090164:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317959.661088:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317959.752417:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317959.752479:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317959.752915:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235136
00000100:00100000:3.0:1767317959.752927:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235136
00000100:00100000:3.0:1767317959.753007:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235008
00000100:00100000:3.0:1767317959.753011:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235008
00000100:00100000:3.0:1767317959.753032:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3599
00000100:00100000:3.0:1767317959.753043:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894235136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317959.753113:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894235136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (706us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317959.753120:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3599
00000100:00100000:2.0:1767317959.753317:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15875
00000100:00100000:2.0:1767317959.753324:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894235008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317959.753345:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317959.753374:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894235008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (895us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317959.753379:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15875
00000100:00080000:0.0:1767317959.753424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317960.114317:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767317960.175122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317960.175133:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767317960.175152:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317960.175157:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317960.175161:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317960.175169:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3205
00000100:00080000:0.0:1767317960.175174:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317960.175180:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317960.175216:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046add880 x1853163940140672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317960.175251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317960.175255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317960.175256:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317960.175260:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3205
00000100:00080000:0.0:1767317960.175263:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317960.175267:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317960.175280:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046addf80 x1853163940140800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317960.175369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317960.175373:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317960.175375:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317960.175378:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3205
00000100:00080000:0.0:1767317960.175381:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317960.175385:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317960.175397:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046ade680 x1853163940141312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767317960.175430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767317960.175433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767317960.175435:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767317960.175439:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3205
00000100:00080000:0.0:1767317960.175441:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767317960.175445:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767317960.175456:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf100 x1853163940141568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767317960.175498:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940141184:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.175666:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940140928:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.175730:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317960.175811:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317960.175818:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141056:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.175840:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317960.175885:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140928
00000100:00100000:1.0:1767317960.175900:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140928
00000100:00100000:1.0:1767317960.175962:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141056
00000100:00100000:1.0:1767317960.175966:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141056
00000100:00100000:1.0:1767317960.175989:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381
00000100:00100000:1.0:1767317960.175996:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940140928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.176048:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940140928:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317960.176057:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381
00000100:00100000:1.0:1767317960.176074:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382
00000100:00100000:1.0:1767317960.176080:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.176107:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141056:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317960.176113:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382
00000100:00080000:1.0:1767317960.176133:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317960.176137:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767317960.176173:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141056:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.176182:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940140928:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.176230:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940141440:0@lo:400:kworker.0
00000100:00100000:1.0:1767317960.176259:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317960.176867:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.177150:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940140672:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.177185:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.177211:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940140800:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.177233:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.177259:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940141312:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.177280:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.177293:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940141568:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.177313:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.177344:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141440
00000100:00100000:2.0:1767317960.177349:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141440
00000100:00100000:2.0:1767317960.177398:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141184
00000100:00100000:2.0:1767317960.177402:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141184
00000100:00100000:2.0:1767317960.177415:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140672
00000100:00100000:2.0:1767317960.177418:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140672
00000100:00100000:2.0:1767317960.177426:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141312
00000100:00100000:2.0:1767317960.177428:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141312
00000100:00100000:2.0:1767317960.177449:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141568
00000100:00100000:2.0:1767317960.177452:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141568
00000100:00100000:2.0:1767317960.177462:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600
00000100:00100000:2.0:1767317960.177479:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940141440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317960.177520:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940141440:12345-0@lo:400:kworker.0 Request processed in 51us (1260us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317960.177526:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600
00000100:00100000:2.0:1767317960.177753:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601
00000100:00100000:2.0:1767317960.177761:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940141184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767317960.177827:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940141184:12345-0@lo:400:kworker.0 Request processed in 67us (960us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317960.177832:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601
00000100:00100000:2.0:1767317960.177843:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15876
00000100:00100000:2.0:1767317960.177847:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940140672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317960.177864:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317960.178133:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15877
00000100:00100000:3.0:1767317960.178139:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940141312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317960.178150:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317960.178187:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940141312:12345-0@lo:38:kworker.0 Request processed in 46us (905us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317960.178193:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15877
00000100:00100000:3.0:1767317960.178208:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15878
00000100:00100000:3.0:1767317960.178211:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940141568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317960.178220:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317960.178243:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940141568:12345-0@lo:38:kworker.0 Request processed in 30us (929us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317960.178248:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15878
00000100:00080000:3.0:1767317960.178276:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767317960.178311:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317960.178317:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317960.178320:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940141312:0@lo:38:kworker.0
00000100:00080000:3.0:1767317960.178341:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317960.178344:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317960.178347:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940141568:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.178912:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940140672:12345-0@lo:38:kworker.0 Request processed in 1061us (1724us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317960.178919:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15876
00000100:00100000:1.0:1767317960.179165:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940141440:0@lo:400:kworker.0
00000100:00100000:0.0:1767317960.179248:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940140800
00000100:00100000:0.0:1767317960.179254:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940140800
00000100:00100000:0.0:1767317960.179291:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852
00000100:00100000:0.0:1767317960.179296:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940140800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317960.179308:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317960.179344:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940140800:12345-0@lo:38:kworker.0 Request processed in 47us (2109us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317960.179349:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852
00000100:00100000:0.0:1767317960.179399:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940141184:0@lo:400:kworker.0
00000100:00080000:3.0:1767317960.179668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317960.179684:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317960.179687:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940140672:0@lo:38:kworker.0
00000100:00080000:3.0:1767317960.179697:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317960.179700:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317960.179702:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940140800:0@lo:38:kworker.0
00000100:00100000:2.0:1767317960.684952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317960.685248:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141696:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317960.685337:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317960.685467:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141696
00000100:00100000:2.0:1767317960.685475:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141696
00000100:00100000:2.0:1767317960.685530:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890
00000100:00100000:2.0:1767317960.685539:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317960.685578:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767317960.685629:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317960.685654:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890
00000100:00100000:0.0:1767317960.686041:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141696:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317961.133837:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317961.708933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317961.709327:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767317961.709348:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317961.709414:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317961.709702:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141824
00000100:00100000:1.0:1767317961.709710:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141824
00000100:00100000:1.0:1767317961.709761:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891
00000100:00100000:1.0:1767317961.709787:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317961.709818:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317961.709878:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940141824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (464us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317961.709885:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891
00000100:00100000:3.0:1767317961.710006:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940141824:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317962.159158:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767317962.732926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317963.189170:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317963.758055:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317964.205057:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317964.781089:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317964.872020:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317964.872074:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767317964.872187:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235392
00000100:00100000:1.0:1767317964.872197:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235392
00000100:00100000:1.0:1767317964.872273:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235264
00000100:00100000:1.0:1767317964.872277:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235264
00000100:00100000:1.0:1767317964.872297:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3602
00000100:00100000:1.0:1767317964.872308:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894235392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317964.872382:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894235392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (371us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317964.872390:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3602
00000100:00100000:1.0:1767317964.872428:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15879
00000100:00100000:1.0:1767317964.872433:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894235264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767317964.872469:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317964.872500:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894235264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 65us (426us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317964.872507:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15879
00000100:00080000:2.0:1767317964.873083:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317965.229947:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317965.293321:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317965.293332:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317965.293334:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317965.293338:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317965.293343:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317965.293351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3210
00000100:00080000:2.0:1767317965.293356:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317965.293364:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317965.293419:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940141952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317965.293445:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317965.293448:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317965.293451:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317965.293454:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3210
00000100:00080000:2.0:1767317965.293456:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317965.293460:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317965.293474:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940142080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317965.293564:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317965.293567:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317965.293569:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317965.293573:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3210
00000100:00080000:2.0:1767317965.293585:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317965.293590:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317965.293603:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a300 x1853163940142592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317965.293617:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317965.293620:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317965.293622:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767317965.293802:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142208:0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.293879:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317965.293951:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767317965.293958:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142336:0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.293979:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317965.294021:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142208
00000100:00100000:1.0:1767317965.294029:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142208
00000100:00100000:1.0:1767317965.294080:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142336
00000100:00100000:1.0:1767317965.294084:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142336
00000100:00100000:1.0:1767317965.294107:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767317965.294116:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142208:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.294164:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142208:12345-0@lo:400:kworker.0 Request processed in 49us (285us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317965.294171:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767317965.294338:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384
00000100:00100000:1.0:1767317965.294346:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.294376:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142336:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317965.294381:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384
00000100:00100000:1.0:1767317965.294516:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142336:0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.294528:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142208:0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.294578:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940142720:0@lo:400:kworker.0
00000100:00100000:1.0:1767317965.294606:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317965.294741:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3210
00000100:00080000:2.0:1767317965.294744:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317965.294748:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317965.294767:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059500 x1853163940142848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317965.294804:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767317965.294809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317965.294893:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940142464:0@lo:400:kworker.0
00000100:00100000:3.0:1767317965.294934:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317965.294974:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142720
00000100:00100000:3.0:1767317965.294979:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142720
00000100:00100000:3.0:1767317965.295017:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142464
00000100:00100000:3.0:1767317965.295020:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142464
00000100:00100000:3.0:1767317965.295046:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603
00000100:00100000:3.0:1767317965.295052:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940142720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317965.295083:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940142720:12345-0@lo:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317965.295090:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603
00000100:00100000:3.0:1767317965.295105:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604
00000100:00100000:3.0:1767317965.295110:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940142464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317965.295149:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940142464:12345-0@lo:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317965.295155:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604
00000100:00080000:3.0:1767317965.295172:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317965.295337:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940141952:0@lo:38:kworker.0
00000100:00100000:3.0:1767317965.295365:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317965.295381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940142080:0@lo:38:kworker.0
00000100:00100000:2.0:1767317965.295510:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940141952
00000100:00100000:2.0:1767317965.295515:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940141952
00000100:00100000:2.0:1767317965.295536:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15880
00000100:00100000:2.0:1767317965.295541:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940141952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317965.295558:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317965.295755:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940141952:12345-0@lo:38:kworker.0 Request processed in 212us (389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317965.295768:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15880
00000100:00100000:2.0:1767317965.295821:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940142464:0@lo:400:kworker.0
00000100:00100000:3.0:1767317965.307816:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317965.307883:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940142592:0@lo:38:kworker.0
00000100:00100000:3.0:1767317965.307948:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317965.307977:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940142848:0@lo:38:kworker.0
00000100:00100000:3.0:1767317965.307999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767317965.308054:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317965.308059:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317965.308063:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940141952:0@lo:38:kworker.0
00000100:00100000:3.0:1767317965.308104:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142592
00000100:00100000:3.0:1767317965.308110:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142592
00000100:00100000:3.0:1767317965.308143:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142848
00000100:00100000:3.0:1767317965.308147:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142848
00000100:00100000:3.0:1767317965.308163:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15881
00000100:00100000:3.0:1767317965.308169:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940142592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317965.308207:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317965.308246:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940142592:12345-0@lo:38:kworker.0 Request processed in 76us (298us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317965.308252:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15881
00000100:00100000:3.0:1767317965.308280:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15882
00000100:00100000:3.0:1767317965.308284:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940142848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317965.308293:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317965.308315:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940142848:12345-0@lo:38:kworker.0 Request processed in 30us (315us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317965.308320:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15882
00000100:00080000:3.0:1767317965.308342:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317965.308345:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317965.308348:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940142592:0@lo:38:kworker.0
00000100:00080000:3.0:1767317965.308355:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317965.308358:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317965.308360:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940142848:0@lo:38:kworker.0
00000100:00100000:0.0:1767317965.308940:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142080
00000100:00100000:0.0:1767317965.308947:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142080
00000100:00100000:0.0:1767317965.308985:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853
00000100:00100000:0.0:1767317965.308990:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940142080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317965.309002:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317965.309056:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940142080:12345-0@lo:38:kworker.0 Request processed in 64us (1247us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317965.309061:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853
00000100:00080000:2.0:1767317965.309206:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767317965.309210:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767317965.309213:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940142080:0@lo:38:kworker.0
00000100:00100000:1.0:1767317965.313239:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940142720:0@lo:400:kworker.0
00000100:00100000:0.0:1767317965.808725:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317965.808866:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142976:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317965.808961:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317965.812960:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940142976
00000100:00100000:3.0:1767317965.812977:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940142976
00000100:00100000:3.0:1767317965.813056:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892
00000100:00100000:3.0:1767317965.813066:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767317965.813100:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767317965.813191:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940142976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (4230us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317965.813198:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892
00000100:00100000:2.0:1767317965.813330:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940142976:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317966.255526:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317966.828915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317966.829166:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317966.829185:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940143104:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317966.829269:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317966.829966:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143104
00000100:00100000:0.0:1767317966.829976:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143104
00000100:00100000:0.0:1767317966.830027:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893
00000100:00100000:0.0:1767317966.830036:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940143104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317966.830069:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317966.830387:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940143104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 352us (1117us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317966.830393:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940143104:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317966.830466:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893
00010000:00010000:0.0:1767317967.277032:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317967.853037:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317968.302558:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317968.877066:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767317969.325412:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317969.900915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317969.990557:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317969.990615:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317969.990728:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235648
00000100:00100000:2.0:1767317969.990739:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235648
00000100:00100000:2.0:1767317969.990854:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235520
00000100:00100000:2.0:1767317969.990858:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235520
00000100:00100000:2.0:1767317969.990887:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3605
00000100:00100000:2.0:1767317969.990898:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894235648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767317969.990981:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15883
00000100:00100000:2.0:1767317969.990982:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894235648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317969.990994:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894235520:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:2.0:1767317969.990995:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3605
00010000:00020000:1.0:1767317969.991020:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317969.991054:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894235520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 61us (437us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317969.991061:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15883
00000100:00080000:0.0:1767317969.991162:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767317970.353519:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767317970.413037:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317970.413064:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767317970.413067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317970.413071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317970.413075:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317970.413083:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3215
00000100:00080000:3.0:1767317970.413089:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317970.413096:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317970.413133:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92d80 x1853163940143232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317970.413166:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317970.413170:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317970.413172:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317970.413176:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3215
00000100:00080000:3.0:1767317970.413178:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317970.413182:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317970.413195:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92300 x1853163940143360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317970.413250:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317970.413254:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317970.413255:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317970.413259:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3215
00000100:00080000:3.0:1767317970.413262:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317970.413265:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317970.413277:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91880 x1853163940143872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317970.413294:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940143488:0@lo:400:kworker.0
00000100:00080000:3.0:1767317970.413302:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317970.413305:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317970.413307:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317970.413311:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3215
00000100:00080000:3.0:1767317970.413313:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317970.413316:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317970.413325:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940144128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317970.413343:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940144000:0@lo:400:kworker.0
00000100:00100000:2.0:1767317970.413360:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317970.413369:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.413429:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940143232:0@lo:38:kworker.0
00000100:00100000:0.0:1767317970.413465:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.413508:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144000
00000100:00100000:0.0:1767317970.413515:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144000
00000100:00100000:0.0:1767317970.413562:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143232
00000100:00100000:0.0:1767317970.413566:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143232
00000100:00100000:0.0:1767317970.413584:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606
00000100:00100000:0.0:1767317970.413593:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940144000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317970.413636:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940144000:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317970.413642:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606
00000100:00100000:0.0:1767317970.413658:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15884
00000100:00100000:0.0:1767317970.413662:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940143232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317970.413680:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317970.413710:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940143232:12345-0@lo:38:kworker.0 Request processed in 46us (244us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317970.413715:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15884
00000100:00080000:0.0:1767317970.413736:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317970.413749:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940143744:0@lo:400:kworker.0
00000100:00100000:0.0:1767317970.413798:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.413819:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143744
00000100:00100000:0.0:1767317970.413822:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143744
00000100:00100000:0.0:1767317970.413850:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607
00000100:00100000:0.0:1767317970.413856:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940143744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317970.413887:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940143744:12345-0@lo:400:kworker.0 Request processed in 31us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317970.413892:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607
00000100:00100000:3.0:1767317970.414316:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940144000:0@lo:400:kworker.0
00000100:00080000:3.0:1767317970.414370:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767317970.414473:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317970.414479:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317970.414483:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940143232:0@lo:38:kworker.0
00000100:00100000:0.0:1767317970.414492:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940143360:0@lo:38:kworker.0
00000100:00100000:1.0:1767317970.414496:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940143616:0@lo:400:kworker.0
00000100:00100000:0.0:1767317970.414523:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317970.414547:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.414549:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940143872:0@lo:38:kworker.0
00000100:00100000:0.0:1767317970.414578:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.414600:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940144128:0@lo:38:kworker.0
00000100:00100000:1.0:1767317970.414613:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143488
00000100:00100000:1.0:1767317970.414619:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143488
00000100:00100000:0.0:1767317970.414623:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317970.414665:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143616
00000100:00100000:0.0:1767317970.414668:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143360
00000100:00100000:1.0:1767317970.414670:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143616
00000100:00100000:0.0:1767317970.414674:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143360
00000100:00100000:0.0:1767317970.414696:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854
00000100:00100000:0.0:1767317970.414701:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940143360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317970.414714:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317970.414744:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940143360:12345-0@lo:38:kworker.0 Request processed in 42us (221us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317970.414750:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854
00000100:00100000:0.0:1767317970.414767:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940143872
00000100:00100000:0.0:1767317970.414770:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940143872
00000100:00100000:0.0:1767317970.414812:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144128
00000100:00100000:0.0:1767317970.414815:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144128
00000100:00100000:0.0:1767317970.414833:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15885
00000100:00100000:0.0:1767317970.414838:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940143872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317970.414849:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317970.414877:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385
00000100:00100000:0.0:1767317970.414880:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940143872:12345-0@lo:38:kworker.0 Request processed in 40us (299us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317970.414887:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940143488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317970.414928:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940143488:12345-0@lo:400:kworker.0 Request processed in 44us (1568us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317970.414934:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385
00000100:00100000:1.0:1767317970.414948:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386
00000100:00100000:1.0:1767317970.414962:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940143616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317970.414995:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940143616:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317970.415002:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386
00000100:00100000:1.0:1767317970.415023:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15886
00000100:00100000:1.0:1767317970.415027:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940144128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317970.415038:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317970.415064:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940144128:12345-0@lo:38:kworker.0 Request processed in 35us (442us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317970.415069:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15886
00000100:00080000:1.0:1767317970.415129:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317970.415133:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767317970.415168:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940143744:0@lo:400:kworker.0
00000100:00100000:0.0:1767317970.415304:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15885
00000100:00100000:1.0:1767317970.415385:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940143616:0@lo:400:kworker.0
00000100:00100000:2.0:1767317970.415641:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940143488:0@lo:400:kworker.0
00000100:00080000:0.0:1767317970.415841:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317970.415847:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317970.415850:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940143360:0@lo:38:kworker.0
00000100:00080000:0.0:1767317970.415858:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317970.415861:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317970.415864:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940143872:0@lo:38:kworker.0
00000100:00080000:0.0:1767317970.415872:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317970.415875:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317970.415878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940144128:0@lo:38:kworker.0
00000100:00100000:2.0:1767317970.926361:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940144256:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317970.926440:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317970.926724:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144256
00000100:00100000:0.0:1767317970.926732:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144256
00000100:00100000:0.0:1767317970.926826:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894
00000100:00100000:0.0:1767317970.926836:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940144256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317970.926866:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317970.926911:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940144256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (469us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317970.926919:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894
00000100:00100000:2.0:1767317970.927652:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940144256:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767317970.929449:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317971.373143:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317971.951701:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317971.952211:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767317971.952230:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940144384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317971.952302:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317971.952514:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144384
00000100:00100000:0.0:1767317971.952522:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144384
00000100:00100000:0.0:1767317971.952580:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895
00000100:00100000:0.0:1767317971.952589:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940144384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317971.952618:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317971.952670:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940144384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (367us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317971.952691:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895
00000100:00100000:3.0:1767317971.952984:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940144384:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317972.397077:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317972.972918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317973.421497:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317973.999879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317974.094680:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767317974.094721:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894235776 offset 0 length 520: 4
00000100:00100000:0.0:1767317974.094804:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317974.099165:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236032
00000100:00100000:3.0:1767317974.099180:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236032
00000100:00100000:3.0:1767317974.099268:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894235904
00000100:00100000:3.0:1767317974.099289:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894235904
00000100:00100000:3.0:1767317974.099329:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3608
00000100:00100000:3.0:1767317974.099344:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894236032:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317974.099436:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894236032:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 98us (4764us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317974.099443:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3608
00000100:00100000:3.0:1767317974.099466:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15887
00000100:00100000:3.0:1767317974.099470:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894235904:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317974.099491:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317974.099519:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894235904:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (4773us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317974.099525:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15887
00000100:00080000:2.0:1767317974.100428:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767317974.445005:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317975.020873:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317975.470069:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317975.533358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317975.533370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317975.533373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317975.533377:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317975.533382:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317975.533389:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3220
00000100:00080000:2.0:1767317975.533404:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317975.533411:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317975.533452:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705aa00 x1853163940144512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317975.533479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317975.533483:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317975.533485:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317975.533489:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3220
00000100:00080000:2.0:1767317975.533491:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317975.533495:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317975.533511:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940144640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317975.533572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317975.533576:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317975.533577:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317975.533581:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3220
00000100:00080000:2.0:1767317975.533583:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317975.533587:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317975.533616:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940145152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317975.533631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317975.533634:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317975.533636:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317975.533639:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3220
00000100:00080000:2.0:1767317975.533641:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317975.533645:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317975.533654:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d880 x1853163940145408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317975.533679:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940145280:0@lo:400:kworker.0
00000100:00100000:2.0:1767317975.533795:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317975.533859:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317975.533866:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940145024:0@lo:400:kworker.0
00000100:00100000:2.0:1767317975.533889:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.533974:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940144512:0@lo:38:kworker.0
00000100:00100000:0.0:1767317975.534004:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.534035:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940144640:0@lo:38:kworker.0
00000100:00100000:0.0:1767317975.534059:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.534077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940145152:0@lo:38:kworker.0
00000100:00100000:0.0:1767317975.534097:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.534111:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940145408:0@lo:38:kworker.0
00000100:00100000:0.0:1767317975.534131:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.534166:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144640
00000100:00100000:0.0:1767317975.534174:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144640
00000100:00100000:0.0:1767317975.534207:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855
00000100:00100000:0.0:1767317975.534214:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940144640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317975.534234:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317975.534274:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940144640:12345-0@lo:38:kworker.0 Request processed in 59us (214us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317975.534282:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855
00000100:00100000:0.0:1767317975.534307:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145280
00000100:00100000:0.0:1767317975.534310:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145280
00000100:00100000:0.0:1767317975.534346:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145024
00000100:00100000:0.0:1767317975.534357:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145024
00000100:00100000:0.0:1767317975.534374:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144512
00000100:00100000:0.0:1767317975.534377:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144512
00000100:00100000:0.0:1767317975.534385:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145152
00000100:00100000:0.0:1767317975.534388:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145152
00000100:00100000:0.0:1767317975.534394:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145408
00000100:00100000:0.0:1767317975.534396:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145408
00000100:00100000:0.0:1767317975.534405:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609
00000100:00100000:0.0:1767317975.534411:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940145280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317975.534454:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940145280:12345-0@lo:400:kworker.0 Request processed in 44us (659us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317975.534459:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609
00000100:00100000:0.0:1767317975.534471:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610
00000100:00100000:0.0:1767317975.534476:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940145024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317975.534501:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940145024:12345-0@lo:400:kworker.0 Request processed in 25us (611us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317975.534507:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610
00000100:00100000:0.0:1767317975.534518:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15888
00000100:00100000:0.0:1767317975.534522:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940144512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317975.534532:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317975.534556:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940144512:12345-0@lo:38:kworker.0 Request processed in 32us (551us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317975.534562:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15888
00000100:00100000:0.0:1767317975.534574:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15889
00000100:00100000:0.0:1767317975.534577:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940145152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317975.534586:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317975.534607:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940145152:12345-0@lo:38:kworker.0 Request processed in 28us (509us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317975.534619:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15889
00000100:00100000:0.0:1767317975.534630:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15890
00000100:00100000:0.0:1767317975.534634:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940145408:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317975.534644:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317975.534667:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940145408:12345-0@lo:38:kworker.0 Request processed in 32us (535us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317975.534673:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15890
00000100:00080000:0.0:1767317975.534688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317975.534717:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940145024:0@lo:400:kworker.0
00000100:00100000:0.0:1767317975.534726:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940145280:0@lo:400:kworker.0
00000100:00080000:0.0:1767317975.534766:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317975.534771:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317975.534796:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940144512:0@lo:38:kworker.0
00000100:00080000:0.0:1767317975.534806:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317975.534809:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317975.534812:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940144640:0@lo:38:kworker.0
00000100:00080000:0.0:1767317975.534819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317975.534822:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317975.534825:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940145152:0@lo:38:kworker.0
00000100:00080000:0.0:1767317975.534831:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317975.534834:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317975.534837:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940145408:0@lo:38:kworker.0
00000100:00100000:0.0:1767317975.534877:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940144896:0@lo:400:kworker.0
00000100:00100000:0.0:1767317975.534909:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317975.534945:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317975.534951:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940144768:0@lo:400:kworker.0
00000100:00100000:0.0:1767317975.534970:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317975.535516:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144896
00000100:00100000:1.0:1767317975.535522:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144896
00000100:00100000:1.0:1767317975.535572:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940144768
00000100:00100000:1.0:1767317975.535575:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940144768
00000100:00100000:1.0:1767317975.535594:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387
00000100:00100000:1.0:1767317975.535600:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940144896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317975.535647:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940144896:12345-0@lo:400:kworker.0 Request processed in 48us (738us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317975.535653:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387
00000100:00100000:1.0:1767317975.535665:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388
00000100:00100000:1.0:1767317975.535671:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940144768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317975.535703:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940144768:12345-0@lo:400:kworker.0 Request processed in 33us (732us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317975.535709:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388
00000100:00100000:1.0:1767317975.535757:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940144768:0@lo:400:kworker.0
00000100:00100000:1.0:1767317975.535792:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940144896:0@lo:400:kworker.0
00000100:00080000:0.0:1767317975.538306:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317975.538318:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317976.045073:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317976.046656:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940145536:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767317976.046747:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317976.046863:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145536
00000100:00100000:0.0:1767317976.046874:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145536
00000100:00100000:0.0:1767317976.046945:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896
00000100:00100000:0.0:1767317976.046954:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940145536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317976.046984:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317976.047037:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940145536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317976.047044:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896
00000100:00100000:3.0:1767317976.047748:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940145536:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317976.493014:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317977.068928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317977.069417:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317977.069437:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940145664:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317977.069510:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317977.069596:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145664
00000100:00100000:2.0:1767317977.069605:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145664
00000100:00080000:1.0:1767317977.069676:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767317977.069683:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897
00000100:00100000:2.0:1767317977.069693:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940145664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767317977.069753:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767317977.069827:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940145664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (317us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317977.069835:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897
00000100:00100000:3.0:1767317977.069923:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940145664:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317977.521808:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317978.104620:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317978.541011:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317979.116905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317979.208430:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317979.208537:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236288
00000100:00100000:3.0:1767317979.208548:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236288
00000100:00080000:1.0:1767317979.208582:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317979.208622:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3611
00000100:00100000:3.0:1767317979.208647:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894236288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317979.208850:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894236288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 204us (428us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317979.208859:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3611
00000100:00100000:0.0:1767317979.209330:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317979.209798:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236160
00000100:00100000:3.0:1767317979.209805:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236160
00000100:00100000:3.0:1767317979.209843:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15891
00000100:00100000:3.0:1767317979.209850:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894236160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317979.209873:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317979.209934:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894236160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 82us (603us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317979.209941:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15891
00010000:00010000:0.0:1767317979.565175:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317980.140952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317980.594986:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317980.652878:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317955/real 1767317955]  req@ffff93cf4705a680 x1853163940139264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767317980.652913:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4705a680 x1853163940139264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767317980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767317980.652934:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317980.652960:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767317980.652964:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940139264:0@lo:250:kworker.0
00000100:00080000:3.0:1767317980.653129:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317980.653135:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767317980.653138:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317980.653143:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3205
00000100:00080000:3.0:1767317980.653147:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317980.653153:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317980.653185:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222300 x1853163940145792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317980.653210:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317980.653214:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317980.653216:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317980.653219:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3225
00000100:00080000:3.0:1767317980.653222:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317980.653232:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317980.653249:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220700 x1853163940145920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317980.653257:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317980.653260:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317980.653262:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317980.653265:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3225
00000100:00080000:3.0:1767317980.653268:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317980.653271:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317980.653282:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940146048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317980.653348:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317980.653351:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317980.653353:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317980.653356:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3225
00000100:00080000:3.0:1767317980.653359:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317980.653363:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317980.653374:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940146560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767317980.653389:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767317980.653392:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767317980.653393:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767317980.653396:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3225
00000100:00080000:3.0:1767317980.653398:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767317980.653408:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767317980.653418:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220a80 x1853163940146816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767317980.653445:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940146432:0@lo:400:kworker.0
00000100:00100000:3.0:1767317980.653512:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317980.653571:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317980.653577:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940146688:0@lo:400:kworker.0
00000100:00100000:3.0:1767317980.653616:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317980.653648:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146432
00000100:00100000:3.0:1767317980.653656:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146432
00000100:00100000:3.0:1767317980.653717:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146688
00000100:00100000:3.0:1767317980.653721:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146688
00000100:00100000:3.0:1767317980.653748:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612
00000100:00100000:3.0:1767317980.653756:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940146432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317980.654015:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940146176:0@lo:400:kworker.0
00000100:00100000:1.0:1767317980.654053:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317980.654142:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940146304:0@lo:400:kworker.0
00000100:00100000:0.0:1767317980.654174:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317980.654220:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613
00000100:00100000:0.0:1767317980.654229:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940146688:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317980.654274:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940146688:12345-0@lo:400:kworker.0 Request processed in 47us (657us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317980.654283:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613
00000100:00100000:0.0:1767317980.654312:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146176
00000100:00100000:0.0:1767317980.654317:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146176
00000100:00100000:0.0:1767317980.654347:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146304
00000100:00100000:0.0:1767317980.654350:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146304
00000100:00100000:1.0:1767317980.654369:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389
00000100:00100000:0.0:1767317980.654380:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390
00000100:00100000:1.0:1767317980.654381:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940146176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317980.654393:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940146304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317980.654431:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940146176:12345-0@lo:400:kworker.0 Request processed in 54us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317980.654438:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389
00000100:00100000:0.0:1767317980.654444:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940146304:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317980.654452:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390
00000100:00100000:1.0:1767317980.654481:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940146176:0@lo:400:kworker.0
00000100:00100000:0.0:1767317980.654495:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940146304:0@lo:400:kworker.0
00000100:00100000:1.0:1767317980.654519:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940145792:0@lo:250:kworker.0
00000100:00100000:0.0:1767317980.654529:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940146688:0@lo:400:kworker.0
00000400:00000100:1.0:1767317980.654545:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940145792 offset 0 length 520: 4
00000100:00100000:1.0:1767317980.654567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940145920:0@lo:38:kworker.0
00000100:00080000:0.0:1767317980.654570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767317980.654576:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767317980.654580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317980.654588:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317980.654606:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940146048:0@lo:38:kworker.0
00000100:00100000:1.0:1767317980.654625:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317980.654639:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940146560:0@lo:38:kworker.0
00000100:00100000:1.0:1767317980.654667:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317980.655044:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940146432:12345-0@lo:400:kworker.0 Request processed in 1288us (1531us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317980.655052:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612
00000100:00100000:2.0:1767317980.655369:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940146432:0@lo:400:kworker.0
00000100:00100000:1.0:1767317980.656707:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940146816:0@lo:38:kworker.0
00000100:00100000:1.0:1767317980.656755:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317980.657127:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940145920
00000100:00100000:3.0:1767317980.657136:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940145920
00000100:00100000:3.0:1767317980.657179:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146560
00000100:00100000:3.0:1767317980.657183:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146560
00000100:00100000:3.0:1767317980.657209:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15892
00000100:00100000:3.0:1767317980.657216:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940145920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317980.657239:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317980.657285:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940145920:12345-0@lo:38:kworker.0 Request processed in 68us (2696us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317980.657292:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15892
00000100:00100000:3.0:1767317980.657326:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15893
00000100:00100000:3.0:1767317980.657330:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940146560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317980.657340:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317980.657365:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940146560:12345-0@lo:38:kworker.0 Request processed in 34us (2697us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317980.657371:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15893
00000100:00100000:3.0:1767317980.657412:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146048
00000100:00100000:3.0:1767317980.657416:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146048
00000100:00100000:3.0:1767317980.657436:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856
00000100:00100000:3.0:1767317980.657440:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940146048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317980.657450:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317980.657478:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940146048:12345-0@lo:38:kworker.0 Request processed in 36us (2851us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317980.657484:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856
00000100:00080000:1.0:1767317980.668606:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317980.668619:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317980.668624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940145920:0@lo:38:kworker.0
00000100:00080000:1.0:1767317980.668636:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317980.668639:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317980.668642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940146048:0@lo:38:kworker.0
00000100:00080000:1.0:1767317980.668652:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317980.668656:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317980.668659:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940146560:0@lo:38:kworker.0
00000100:00100000:2.0:1767317980.669285:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146816
00000100:00100000:2.0:1767317980.669295:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146816
00000100:00100000:2.0:1767317980.669394:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15894
00000100:00100000:2.0:1767317980.669402:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940146816:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317980.669423:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317980.669504:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940146816:12345-0@lo:38:kworker.0 Request processed in 101us (12748us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317980.669511:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15894
00000100:00080000:1.0:1767317980.669593:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317980.669605:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317980.669609:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940146816:0@lo:38:kworker.0
00000100:00100000:0.0:1767317981.164926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317981.169380:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940146944:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317981.169457:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317981.172322:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940146944
00000100:00100000:2.0:1767317981.172337:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940146944
00000100:00100000:2.0:1767317981.172404:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898
00000100:00100000:2.0:1767317981.172414:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940146944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767317981.178026:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767317981.178127:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940146944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5711us (8666us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317981.178138:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898
00000100:00100000:1.0:1767317981.178371:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940146944:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317981.613767:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317982.188898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317982.189260:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767317982.189278:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940147072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767317982.189354:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317982.189465:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147072
00000100:00100000:0.0:1767317982.189473:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147072
00000100:00100000:0.0:1767317982.189534:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899
00000100:00100000:0.0:1767317982.189541:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940147072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317982.189582:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317982.189630:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940147072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317982.189638:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899
00000100:00100000:0.0:1767317982.189710:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940147072:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767317982.189842:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767317982.637480:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317983.214153:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317983.661156:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317984.236896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317984.332719:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317984.332829:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236416
00000100:00100000:2.0:1767317984.332839:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236416
00000100:00100000:2.0:1767317984.332894:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15895
00000100:00100000:2.0:1767317984.332902:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894236416:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317984.332938:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317984.333015:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894236416:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 111us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317984.333036:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15895
00000100:00100000:2.0:1767317984.334165:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317984.339503:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236544
00000100:00100000:0.0:1767317984.339519:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236544
00000100:00100000:0.0:1767317984.339620:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3614
00000100:00100000:0.0:1767317984.339631:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894236544:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767317984.339746:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894236544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 117us (5586us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317984.339755:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3614
00000100:00080000:1.0:1767317984.339954:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767317984.685525:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317985.264181:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317985.709003:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317985.773267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317985.773277:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317985.773280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317985.773284:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317985.773288:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317985.773296:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767317985.773301:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317985.773308:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317985.773349:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940147200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317985.773381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317985.773384:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317985.773386:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317985.773390:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767317985.773392:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317985.773395:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317985.773408:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940147328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317985.773471:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317985.773484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317985.773500:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317985.773504:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767317985.773506:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317985.773518:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317985.773533:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ca80 x1853163940147840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317985.773555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317985.773559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317985.773561:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317985.773566:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767317985.773569:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317985.773573:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317985.773583:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012680 x1853163940148096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317985.773612:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940147968:0@lo:400:kworker.0
00000100:00100000:2.0:1767317985.773707:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774125:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940147200:0@lo:38:kworker.0
00000100:00100000:0.0:1767317985.774159:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774186:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940147328:0@lo:38:kworker.0
00000100:00100000:0.0:1767317985.774211:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774229:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940147840:0@lo:38:kworker.0
00000100:00100000:0.0:1767317985.774247:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774262:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940148096:0@lo:38:kworker.0
00000100:00100000:0.0:1767317985.774293:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774330:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940147584:0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.774355:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774380:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767317985.774386:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940147456:0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.774407:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774430:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940147712:0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.774452:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317985.774482:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147968
00000100:00100000:0.0:1767317985.774490:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147968
00000100:00100000:0.0:1767317985.774554:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147200
00000100:00100000:0.0:1767317985.774558:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147200
00000100:00100000:0.0:1767317985.774568:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147840
00000100:00100000:0.0:1767317985.774570:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147840
00000100:00100000:0.0:1767317985.774578:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148096
00000100:00100000:0.0:1767317985.774580:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148096
00000100:00100000:0.0:1767317985.774587:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147712
00000100:00100000:0.0:1767317985.774589:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147712
00000100:00100000:0.0:1767317985.774609:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615
00000100:00100000:0.0:1767317985.774616:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940147968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.774675:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940147968:12345-0@lo:400:kworker.0 Request processed in 58us (967us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317985.774683:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615
00000100:00100000:0.0:1767317985.774700:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616
00000100:00100000:0.0:1767317985.774706:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940147712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.774744:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940147712:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317985.774748:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616
00000100:00100000:0.0:1767317985.774769:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15896
00000100:00100000:0.0:1767317985.774796:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940147200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317985.774818:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317985.774965:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940147200:12345-0@lo:38:kworker.0 Request processed in 167us (804us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317985.774972:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15896
00000100:00100000:3.0:1767317985.775113:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15897
00000100:00100000:3.0:1767317985.775119:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940147840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317985.775130:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317985.775161:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940147840:12345-0@lo:38:kworker.0 Request processed in 40us (912us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317985.775166:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15897
00000100:00100000:3.0:1767317985.775180:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15898
00000100:00100000:3.0:1767317985.775184:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940148096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317985.775194:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317985.775216:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940148096:12345-0@lo:38:kworker.0 Request processed in 30us (922us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317985.775231:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15898
00000100:00100000:3.0:1767317985.775281:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147584
00000100:00100000:3.0:1767317985.775286:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147584
00000100:00100000:3.0:1767317985.775313:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147456
00000100:00100000:3.0:1767317985.775316:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147456
00000100:00100000:3.0:1767317985.775332:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391
00000100:00100000:3.0:1767317985.775339:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940147584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317985.775374:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940147584:12345-0@lo:400:kworker.0 Request processed in 36us (1018us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317985.775380:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391
00000100:00100000:3.0:1767317985.775394:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392
00000100:00100000:3.0:1767317985.775400:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940147456:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317985.775424:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940147456:12345-0@lo:400:kworker.0 Request processed in 25us (1017us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317985.775430:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392
00000100:00100000:3.0:1767317985.775449:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940147328
00000100:00100000:3.0:1767317985.775453:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940147328
00000100:00100000:3.0:1767317985.775470:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857
00000100:00100000:3.0:1767317985.775474:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940147328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767317985.775483:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317985.775508:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940147328:12345-0@lo:38:kworker.0 Request processed in 32us (1295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317985.775513:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857
00000100:00100000:3.0:1767317985.775580:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940147712:0@lo:400:kworker.0
00000100:00080000:3.0:1767317985.775616:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317985.775621:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317985.775632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940147200:0@lo:38:kworker.0
00000100:00080000:3.0:1767317985.775654:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317985.775659:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317985.775662:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940147328:0@lo:38:kworker.0
00000100:00080000:3.0:1767317985.775671:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317985.775674:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317985.775677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940147840:0@lo:38:kworker.0
00000100:00080000:3.0:1767317985.775685:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767317985.775688:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767317985.775691:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940148096:0@lo:38:kworker.0
00000100:00100000:0.0:1767317985.775807:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940147456:0@lo:400:kworker.0
00000100:00100000:0.0:1767317985.775819:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940147584:0@lo:400:kworker.0
00000100:00100000:2.0:1767317985.776169:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940147968:0@lo:400:kworker.0
00000100:00080000:1.0:1767317985.776575:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767317985.776580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767317985.776593:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767317986.285289:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767317986.285315:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940148224:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767317986.285393:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317986.285540:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148224
00000100:00100000:0.0:1767317986.285548:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148224
00000100:00100000:0.0:1767317986.285606:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900
00000100:00100000:0.0:1767317986.285616:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940148224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317986.285660:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317986.285708:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940148224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317986.285714:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900
00000100:00100000:3.0:1767317986.286116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317986.286361:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940148224:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317986.734568:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317987.310034:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317987.310060:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940148352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767317987.310133:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317987.310264:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148352
00000100:00100000:1.0:1767317987.310273:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148352
00000100:00100000:1.0:1767317987.310344:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901
00000100:00100000:1.0:1767317987.310353:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940148352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317987.310383:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317987.310438:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940148352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (304us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317987.310446:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901
00000100:00100000:0.0:1767317987.310587:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:3.0:1767317987.311537:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317987.311591:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940148352:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317987.771740:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317988.333119:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317988.781207:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317989.356909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767317989.447813:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317989.447932:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317989.448174:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236672
00000100:00100000:3.0:1767317989.448174:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236800
00000100:00100000:2.0:1767317989.448184:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236672
00000100:00100000:3.0:1767317989.448186:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236800
00000100:00080000:1.0:1767317989.448271:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767317989.448590:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3617
00000100:00100000:2.0:1767317989.448604:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894236800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317989.448699:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894236800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (766us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317989.448708:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3617
00000100:00100000:2.0:1767317989.448749:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15899
00000100:00100000:2.0:1767317989.448754:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894236672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317989.448802:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317989.448829:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894236672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 73us (1063us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317989.448835:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15899
00010000:00010000:0.0:1767317989.805095:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317990.380909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317990.829101:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317990.893219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317990.893231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317990.893234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317990.893238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317990.893243:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317990.893253:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3235
00000100:00080000:2.0:1767317990.893259:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317990.893268:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317990.893317:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010380 x1853163940148480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317990.893345:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317990.893349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317990.893350:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317990.893354:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3235
00000100:00080000:2.0:1767317990.893356:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317990.893359:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317990.893373:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012300 x1853163940148608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317990.893442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317990.893446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317990.893448:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317990.893452:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3235
00000100:00080000:2.0:1767317990.893454:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317990.893458:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317990.893469:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940149120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317990.893487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317990.893490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317990.893492:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317990.893494:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3235
00000100:00080000:2.0:1767317990.893497:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317990.893500:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317990.893509:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940149376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767317990.893546:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940148864:0@lo:400:kworker.0
00000100:00100000:2.0:1767317990.893623:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317990.893684:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317990.893691:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940148736:0@lo:400:kworker.0
00000100:00100000:2.0:1767317990.893713:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317990.893741:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940149248:0@lo:400:kworker.0
00000100:00100000:2.0:1767317990.893768:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317990.893822:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317990.893828:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940148992:0@lo:400:kworker.0
00000100:00100000:2.0:1767317990.893853:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317990.894035:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148864
00000100:00100000:0.0:1767317990.894046:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148864
00000100:00100000:0.0:1767317990.894128:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148736
00000100:00100000:0.0:1767317990.894142:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148736
00000100:00100000:0.0:1767317990.894170:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393
00000100:00100000:0.0:1767317990.894179:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940148864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317990.894249:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940148864:12345-0@lo:400:kworker.0 Request processed in 70us (624us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317990.894258:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393
00000100:00100000:0.0:1767317990.894277:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394
00000100:00100000:0.0:1767317990.894284:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940148736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317990.894312:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940148736:12345-0@lo:400:kworker.0 Request processed in 29us (598us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317990.894318:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394
00000100:00100000:0.0:1767317990.894364:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940148736:0@lo:400:kworker.0
00000100:00100000:0.0:1767317990.894375:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940148864:0@lo:400:kworker.0
00000100:00100000:1.0:1767317990.894503:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940148480:0@lo:38:kworker.0
00000100:00100000:1.0:1767317990.894537:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317990.894560:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940148608:0@lo:38:kworker.0
00000100:00100000:1.0:1767317990.894585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317990.894618:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940149120:0@lo:38:kworker.0
00000100:00100000:1.0:1767317990.894640:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317990.894654:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940149376:0@lo:38:kworker.0
00000100:00100000:1.0:1767317990.894672:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317990.894701:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149248
00000100:00100000:1.0:1767317990.894705:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149248
00000100:00100000:1.0:1767317990.894807:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148992
00000100:00100000:1.0:1767317990.894811:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148992
00000100:00100000:1.0:1767317990.894824:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148480
00000100:00100000:1.0:1767317990.894827:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148480
00000100:00100000:1.0:1767317990.894834:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149120
00000100:00100000:1.0:1767317990.894836:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149120
00000100:00100000:1.0:1767317990.894842:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149376
00000100:00100000:1.0:1767317990.894844:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149376
00000100:00100000:1.0:1767317990.894852:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618
00000100:00100000:1.0:1767317990.894857:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940149248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317990.894891:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940149248:12345-0@lo:400:kworker.0 Request processed in 34us (1122us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317990.894897:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618
00000100:00100000:1.0:1767317990.894908:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619
00000100:00100000:1.0:1767317990.894914:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940148992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767317990.894938:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940148992:12345-0@lo:400:kworker.0 Request processed in 24us (1084us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317990.894942:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619
00000100:00100000:1.0:1767317990.894952:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15900
00000100:00100000:1.0:1767317990.894956:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940148480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317990.894973:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317990.895000:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940148480:12345-0@lo:38:kworker.0 Request processed in 43us (463us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317990.895006:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15900
00000100:00100000:1.0:1767317990.895019:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15901
00000100:00100000:1.0:1767317990.895023:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940149120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317990.895032:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317990.895061:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940149120:12345-0@lo:38:kworker.0 Request processed in 36us (419us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317990.895066:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15901
00000100:00100000:1.0:1767317990.895078:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15902
00000100:00100000:1.0:1767317990.895081:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940149376:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317990.895090:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317990.895110:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940149376:12345-0@lo:38:kworker.0 Request processed in 27us (437us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317990.895116:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15902
00000100:00100000:1.0:1767317990.895134:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940148608
00000100:00100000:1.0:1767317990.895137:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940148608
00000100:00100000:1.0:1767317990.895154:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858
00000100:00100000:1.0:1767317990.895158:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940148608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767317990.895168:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767317990.895191:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940148608:12345-0@lo:38:kworker.0 Request processed in 32us (605us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767317990.895196:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858
00000100:00100000:1.0:1767317990.895232:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940148992:0@lo:400:kworker.0
00000100:00100000:1.0:1767317990.895244:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940149248:0@lo:400:kworker.0
00000100:00080000:1.0:1767317990.895270:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317990.895275:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317990.895279:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940148480:0@lo:38:kworker.0
00000100:00080000:1.0:1767317990.895287:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317990.895291:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317990.895300:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940148608:0@lo:38:kworker.0
00000100:00080000:1.0:1767317990.895311:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317990.895314:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317990.895316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940149120:0@lo:38:kworker.0
00000100:00080000:1.0:1767317990.895323:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317990.895326:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317990.895328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940149376:0@lo:38:kworker.0
00000100:00080000:2.0:1767317990.896335:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767317990.896344:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767317990.896347:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767317991.404908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317991.405164:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767317991.405198:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940149504:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767317991.405268:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317991.405383:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149504
00000100:00100000:0.0:1767317991.405391:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149504
00000100:00100000:0.0:1767317991.405438:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902
00000100:00100000:0.0:1767317991.405447:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940149504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317991.405478:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317991.405529:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940149504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (261us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317991.405536:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902
00000100:00100000:2.0:1767317991.405836:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940149504:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317991.853256:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317992.429061:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767317992.429215:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767317992.429241:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940149632:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767317992.429319:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317992.429382:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149632
00000100:00100000:0.0:1767317992.429391:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149632
00000100:00100000:0.0:1767317992.429454:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903
00000100:00100000:0.0:1767317992.429465:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940149632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767317992.429518:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767317992.429572:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940149632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317992.429588:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903
00000100:00100000:1.0:1767317992.429659:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940149632:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767317992.429770:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767317992.878152:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317993.453042:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317993.905505:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317994.477244:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767317994.566242:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317994.566338:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237056
00000100:00100000:3.0:1767317994.566349:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237056
00000100:00100000:3.0:1767317994.566425:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3620
00000100:00100000:3.0:1767317994.566436:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894237056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767317994.566666:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894237056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 232us (432us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317994.566686:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3620
00000100:00080000:2.0:1767317994.571235:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317994.579517:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767317994.584177:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894236928
00000100:00100000:3.0:1767317994.584196:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894236928
00000100:00100000:3.0:1767317994.584268:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15903
00000100:00100000:3.0:1767317994.584276:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894236928:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767317994.584300:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767317994.584394:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894236928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 116us (4884us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767317994.584401:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15903
00010000:00010000:0.0:1767317994.925967:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317995.500927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767317995.949817:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767317996.013746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317996.013757:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767317996.013760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317996.013765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317996.013768:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317996.013803:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3240
00000100:00080000:2.0:1767317996.013808:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317996.013816:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317996.013860:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940149760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767317996.013878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317996.013881:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767317996.013897:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940149760:0@lo:38:kworker.0
00000100:00080000:2.0:1767317996.013899:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317996.013908:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3240
00000100:00080000:2.0:1767317996.013911:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317996.013914:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317996.013931:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940149888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317996.013972:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767317996.013989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317996.013993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317996.013995:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317996.013999:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3240
00000100:00080000:2.0:1767317996.014001:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317996.014005:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767317996.014017:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010000 x1853163940150400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317996.014035:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940149888:0@lo:38:kworker.0
00000100:00080000:2.0:1767317996.014036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767317996.014043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767317996.014045:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767317996.014048:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3240
00000100:00080000:2.0:1767317996.014051:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767317996.014055:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767317996.014067:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317996.014070:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011f80 x1853163940150656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767317996.014091:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940150400:0@lo:38:kworker.0
00000100:00100000:1.0:1767317996.014116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317996.014140:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149888
00000100:00100000:1.0:1767317996.014146:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940150656:0@lo:38:kworker.0
00000100:00100000:2.0:1767317996.014149:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149888
00000100:00100000:0.0:1767317996.014150:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940149760
00000100:00100000:0.0:1767317996.014157:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940149760
00000100:00100000:1.0:1767317996.014172:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317996.014211:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859
00000100:00100000:2.0:1767317996.014236:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940149888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767317996.014311:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317996.014352:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940149888:12345-0@lo:38:kworker.0 Request processed in 115us (285us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317996.014359:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859
00000100:00100000:2.0:1767317996.014382:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940150144:0@lo:400:kworker.0
00000100:00100000:2.0:1767317996.014410:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317996.014435:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767317996.014440:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940150016:0@lo:400:kworker.0
00000100:00100000:2.0:1767317996.014461:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767317996.014482:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940150272:0@lo:400:kworker.0
00000100:00080000:1.0:1767317996.016183:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767317996.016194:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767317996.016199:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940149888:0@lo:38:kworker.0
00000100:00100000:1.0:1767317996.016260:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767317996.016720:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940150528:0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.016801:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150144
00000100:00100000:3.0:1767317996.016807:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150144
00000100:00100000:3.0:1767317996.016857:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150016
00000100:00100000:3.0:1767317996.016861:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150016
00000100:00100000:3.0:1767317996.016884:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395
00000100:00100000:3.0:1767317996.016895:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940150144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.016947:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940150144:12345-0@lo:400:kworker.0 Request processed in 54us (2535us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317996.016954:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395
00000100:00100000:3.0:1767317996.016972:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396
00000100:00100000:3.0:1767317996.016978:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940150016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.017019:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940150016:12345-0@lo:400:kworker.0 Request processed in 42us (2557us total) trans 0 rc 0/0
00000100:00100000:3.0:1767317996.017025:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396
00000100:00080000:3.0:1767317996.017055:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767317996.017060:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767317996.017099:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940150016:0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.017111:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940150144:0@lo:400:kworker.0
00000100:00100000:0.0:1767317996.023348:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150400
00000100:00100000:0.0:1767317996.023367:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150400
00000100:00100000:0.0:1767317996.023436:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150656
00000100:00100000:0.0:1767317996.023440:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150656
00000100:00100000:0.0:1767317996.023465:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15904
00000100:00100000:0.0:1767317996.023473:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940149760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317996.023499:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317996.023625:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940149760:12345-0@lo:38:kworker.0 Request processed in 151us (9654us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317996.023633:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15904
00000100:00100000:0.0:1767317996.023650:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15905
00000100:00100000:0.0:1767317996.023655:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940150400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317996.023664:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317996.023690:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940150400:12345-0@lo:38:kworker.0 Request processed in 34us (9573us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317996.023695:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15905
00000100:00100000:0.0:1767317996.023705:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15906
00000100:00100000:0.0:1767317996.023709:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940150656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767317996.023732:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767317996.023759:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940150656:12345-0@lo:38:kworker.0 Request processed in 49us (9589us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767317996.023764:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15906
00000100:00080000:0.0:1767317996.023877:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317996.023883:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317996.023887:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940150656:0@lo:38:kworker.0
00000100:00080000:0.0:1767317996.023897:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317996.023900:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317996.023903:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940150400:0@lo:38:kworker.0
00000100:00080000:0.0:1767317996.023911:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767317996.023915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767317996.023917:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940149760:0@lo:38:kworker.0
00000100:00100000:0.0:1767317996.027111:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150272
00000100:00100000:0.0:1767317996.027127:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150272
00000100:00100000:0.0:1767317996.027201:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621
00000100:00100000:0.0:1767317996.027223:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940150272:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767317996.027742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767317996.027765:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317996.027976:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940150272:12345-0@lo:400:kworker.0 Request processed in 766us (11714us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317996.027985:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621
00000100:00100000:0.0:1767317996.028002:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150528
00000100:00100000:0.0:1767317996.028006:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150528
00000100:00100000:0.0:1767317996.028030:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622
00000100:00100000:0.0:1767317996.028035:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940150528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767317996.028062:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940150528:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317996.028081:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622
00000100:00080000:0.0:1767317996.028093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767317996.039059:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940150272:0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.040495:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940150528:0@lo:400:kworker.0
00000100:00100000:3.0:1767317996.526705:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317996.527993:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940150784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767317996.528076:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767317996.528242:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150784
00000100:00100000:0.0:1767317996.528253:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150784
00000100:00100000:0.0:1767317996.528311:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904
00000100:00100000:0.0:1767317996.528321:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940150784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767317996.528358:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767317996.528415:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940150784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (339us total) trans 0 rc 0/0
00000100:00100000:0.0:1767317996.528421:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904
00000100:00100000:3.0:1767317996.529062:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940150784:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767317996.973036:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767317997.549043:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767317997.549067:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940150912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767317997.549205:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767317997.549281:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767317997.549603:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940150912
00000100:00100000:1.0:1767317997.549611:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940150912
00000100:00100000:1.0:1767317997.551039:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905
00000100:00100000:1.0:1767317997.551055:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940150912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767317997.551086:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767317997.551382:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940150912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 332us (2099us total) trans 0 rc 0/0
00000100:00100000:1.0:1767317997.551404:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905
00000100:00100000:3.0:1767317997.556109:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940150912:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767317997.997588:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317998.572938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767317999.022544:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767317999.596914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000400:00000100:0.0:1767317999.697573:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894237184 offset 0 length 520: 4
00000100:00100000:0.0:1767317999.697638:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767317999.697691:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767317999.699713:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237312
00000100:00100000:2.0:1767317999.699728:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237312
00000100:00100000:2.0:1767317999.699842:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237440
00000100:00100000:2.0:1767317999.699846:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237440
00000100:00100000:2.0:1767317999.699899:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3623
00000100:00100000:2.0:1767317999.699909:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894237440:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767317999.699993:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894237440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (2300us total) trans 0 rc 0/0
00000100:00100000:2.0:1767317999.700001:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3623
00000100:00100000:2.0:1767317999.700021:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15907
00000100:00100000:2.0:1767317999.700026:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894237312:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767317999.700047:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767317999.700073:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894237312:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (2436us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767317999.700094:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15907
00000100:00080000:1.0:1767317999.700170:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318000.045636:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318000.622071:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318001.071050:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318001.132919:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318001.132933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318001.132936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318001.132941:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318001.132945:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318001.132953:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3246
00000100:00080000:2.0:1767318001.132958:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318001.132965:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318001.133008:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940151040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318001.133045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318001.133049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318001.133051:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318001.133055:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3246
00000100:00080000:2.0:1767318001.133058:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318001.133062:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318001.133076:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a300 x1853163940151168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318001.133163:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940151296:0@lo:400:kworker.0
00000100:00100000:3.0:1767318001.133256:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318001.133589:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940151040:0@lo:38:kworker.0
00000100:00100000:1.0:1767318001.133633:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318001.133658:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940151168:0@lo:38:kworker.0
00000100:00100000:1.0:1767318001.133683:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318001.133723:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151040
00000100:00100000:1.0:1767318001.133733:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151040
00000100:00100000:1.0:1767318001.133802:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15908
00000100:00100000:1.0:1767318001.133810:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940151040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318001.133835:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318001.133881:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940151040:12345-0@lo:38:kworker.0 Request processed in 69us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318001.133888:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15908
00000100:00080000:0.0:1767318001.133928:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318001.133930:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151168
00000100:00080000:0.0:1767318001.133937:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318001.133937:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151168
00000100:00100000:0.0:1767318001.133943:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940151040:0@lo:38:kworker.0
00000100:00100000:1.0:1767318001.133964:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860
00000100:00100000:0.0:1767318001.133979:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940151424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318001.133986:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940151168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318001.133998:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318001.134017:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318001.134045:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940151168:12345-0@lo:38:kworker.0 Request processed in 58us (358us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318001.134052:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860
00000100:00080000:1.0:1767318001.134081:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318001.134086:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318001.134089:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151296
00000100:00100000:1.0:1767318001.134091:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940151168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318001.134103:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151296
00000100:00100000:1.0:1767318001.134123:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151424
00000100:00100000:1.0:1767318001.134128:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151424
00000100:00100000:0.0:1767318001.134164:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397
00000100:00100000:0.0:1767318001.134173:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940151296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318001.136575:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398
00000100:00100000:1.0:1767318001.136600:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940151424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318001.136692:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940151424:12345-0@lo:400:kworker.0 Request processed in 105us (2675us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318001.136700:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398
00000100:00080000:1.0:1767318001.136737:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318001.136742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318001.136812:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940151424:0@lo:400:kworker.0
00000100:00080000:2.0:1767318001.137928:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318001.137935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318001.137939:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318001.137945:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3246
00000100:00080000:2.0:1767318001.137965:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318001.137972:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318001.137992:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940151680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318001.138017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318001.138020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318001.138021:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318001.138025:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3246
00000100:00080000:2.0:1767318001.138028:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318001.138031:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318001.138041:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940151936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318001.138078:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940151808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.138135:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318001.138169:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318001.138174:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940151552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.138195:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318001.139702:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151808
00000100:00100000:2.0:1767318001.139717:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151808
00000100:00100000:2.0:1767318001.139798:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151552
00000100:00100000:2.0:1767318001.139802:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151552
00000100:00100000:2.0:1767318001.139827:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624
00000100:00100000:2.0:1767318001.139835:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940151808:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.139903:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940151808:12345-0@lo:400:kworker.0 Request processed in 69us (1767us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318001.139909:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624
00000100:00100000:2.0:1767318001.139939:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625
00000100:00100000:2.0:1767318001.139944:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940151552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.139971:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940151552:12345-0@lo:400:kworker.0 Request processed in 27us (1775us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318001.139976:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625
00000100:00100000:2.0:1767318001.140023:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940151552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.140035:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940151808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.140070:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940151680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318001.140099:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318001.140116:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940151936:0@lo:38:kworker.0
00000100:00100000:2.0:1767318001.140133:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318001.140158:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151680
00000100:00100000:2.0:1767318001.140162:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151680
00000100:00100000:0.0:1767318001.141031:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940151296:12345-0@lo:400:kworker.0 Request processed in 6855us (7770us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318001.141043:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397
00000100:00100000:0.0:1767318001.141182:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940151936
00000100:00100000:0.0:1767318001.141187:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940151936
00000100:00100000:0.0:1767318001.141214:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15909
00000100:00100000:0.0:1767318001.141221:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940151680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318001.141243:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318001.141248:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15910
00000100:00100000:2.0:1767318001.141256:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940151936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318001.141268:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318001.141308:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940151936:12345-0@lo:38:kworker.0 Request processed in 50us (1172us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318001.141314:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15910
00000100:00080000:2.0:1767318001.141350:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318001.141354:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318001.141358:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940151680:0@lo:38:kworker.0
00000100:00080000:2.0:1767318001.141367:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318001.141370:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318001.141382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940151936:0@lo:38:kworker.0
00000100:00080000:1.0:1767318001.141586:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318001.141612:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940151680:12345-0@lo:38:kworker.0 Request processed in 78us (1198us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318001.141622:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15909
00000100:00100000:3.0:1767318001.141957:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940151296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318001.646870:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318001.646897:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940152064:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318001.646981:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318001.648419:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318001.648691:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152064
00000100:00100000:1.0:1767318001.648702:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152064
00000100:00100000:1.0:1767318001.648768:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906
00000100:00100000:1.0:1767318001.648817:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940152064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318001.648850:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318001.648926:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940152064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (1945us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318001.648950:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906
00000100:00100000:2.0:1767318001.650557:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940152064:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318002.099811:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318002.668932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318002.669139:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940152192:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318002.669223:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318002.669484:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152192
00000100:00100000:0.0:1767318002.669502:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152192
00000100:00100000:0.0:1767318002.669563:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907
00000100:00100000:0.0:1767318002.669572:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940152192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318002.669605:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318002.669667:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940152192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (443us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318002.669675:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907
00000100:00100000:2.0:1767318002.669827:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940152192:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318003.120034:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318003.693499:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318004.141013:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318004.717167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318004.815671:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318004.815728:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318004.815893:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237696
00000100:00100000:1.0:1767318004.815905:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237696
00000100:00100000:1.0:1767318004.815974:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237568
00000100:00100000:1.0:1767318004.815978:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237568
00000100:00100000:1.0:1767318004.815999:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3626
00000100:00100000:1.0:1767318004.816009:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894237696:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318004.816088:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894237696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318004.816096:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3626
00000100:00100000:1.0:1767318004.816116:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15911
00000100:00100000:1.0:1767318004.816121:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894237568:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318004.816142:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318004.816166:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894237568:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (437us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318004.816172:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15911
00000100:00080000:2.0:1767318004.816557:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318005.165042:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318005.229506:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317980/real 1767317980]  req@ffff93cf45222300 x1853163940145792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318005.229542:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45222300 x1853163940145792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318005.229563:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318005.229593:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318005.229597:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940145792:0@lo:250:kworker.0
00000100:00080000:0.0:1767318005.229681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318005.229687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318005.229691:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318005.229713:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3230
00000100:00080000:0.0:1767318005.229717:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318005.229723:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318005.229754:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940152320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318005.229795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318005.229799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318005.229801:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318005.229804:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3251
00000100:00080000:0.0:1767318005.229806:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318005.229809:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318005.229827:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409180 x1853163940152448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318005.229835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318005.229838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318005.229840:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318005.229843:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3251
00000100:00080000:0.0:1767318005.229845:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318005.229848:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318005.229859:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45408a80 x1853163940152576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318005.229924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318005.229927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318005.229929:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318005.229932:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3251
00000100:00080000:0.0:1767318005.229940:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318005.229945:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318005.229957:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac700 x1853163940153088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318005.229973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318005.229976:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318005.229978:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318005.229982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3251
00000100:00080000:0.0:1767318005.229984:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318005.229987:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318005.229997:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940153344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318005.230078:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940152832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318005.230146:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318005.230215:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318005.230229:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940152704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318005.230270:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230404:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940153216:0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230437:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230477:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318005.230483:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940152960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230504:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230534:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153216
00000100:00100000:2.0:1767318005.230546:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153216
00000100:00100000:2.0:1767318005.230593:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152960
00000100:00100000:2.0:1767318005.230597:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152960
00000100:00100000:2.0:1767318005.230618:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627
00000100:00100000:2.0:1767318005.230626:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940153216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230677:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940153216:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318005.230684:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627
00000100:00100000:2.0:1767318005.230704:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628
00000100:00100000:2.0:1767318005.230710:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940152960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230736:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940152960:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318005.230742:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628
00000100:00080000:2.0:1767318005.230758:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318005.230806:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940152960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230817:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940153216:0@lo:400:kworker.0
00000100:00100000:2.0:1767318005.230834:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940152320:0@lo:250:kworker.0
00000400:00000100:2.0:1767318005.230853:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940152320 offset 0 length 520: 4
00000100:00100000:2.0:1767318005.230870:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940152448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318005.230889:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230903:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940152576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318005.230921:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230934:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940153088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318005.230949:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.230971:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940153344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318005.230989:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318005.231010:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152448
00000100:00100000:2.0:1767318005.231013:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152448
00000100:00100000:2.0:1767318005.231025:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153088
00000100:00100000:2.0:1767318005.231027:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153088
00000100:00100000:2.0:1767318005.231034:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153344
00000100:00100000:2.0:1767318005.231036:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153344
00000100:00100000:2.0:1767318005.231045:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15912
00000100:00100000:2.0:1767318005.231049:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940152448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318005.231069:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318005.231100:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940152448:12345-0@lo:38:kworker.0 Request processed in 49us (210us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318005.231106:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15912
00000100:00100000:2.0:1767318005.231118:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15913
00000100:00100000:2.0:1767318005.231121:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940153088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318005.231129:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318005.231153:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940153088:12345-0@lo:38:kworker.0 Request processed in 30us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318005.231158:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15913
00000100:00100000:2.0:1767318005.231169:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15914
00000100:00100000:2.0:1767318005.231173:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940153344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318005.231181:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318005.231201:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940153344:12345-0@lo:38:kworker.0 Request processed in 27us (211us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318005.231207:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15914
00000100:00080000:2.0:1767318005.231238:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318005.231243:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318005.231246:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940152448:0@lo:38:kworker.0
00000100:00080000:2.0:1767318005.231358:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318005.231361:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318005.231364:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940153088:0@lo:38:kworker.0
00000100:00080000:2.0:1767318005.231372:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318005.231374:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318005.231376:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940153344:0@lo:38:kworker.0
00000100:00100000:0.0:1767318005.231470:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152832
00000100:00100000:0.0:1767318005.231474:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152832
00000100:00100000:0.0:1767318005.231511:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399
00000100:00100000:0.0:1767318005.231517:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940152832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318005.231555:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940152832:12345-0@lo:400:kworker.0 Request processed in 39us (1409us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318005.231560:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399
00000100:00100000:0.0:1767318005.231569:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152704
00000100:00100000:0.0:1767318005.231572:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152704
00000100:00100000:0.0:1767318005.231589:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400
00000100:00100000:0.0:1767318005.231594:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940152704:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318005.231617:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940152704:12345-0@lo:400:kworker.0 Request processed in 23us (1347us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318005.231622:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400
00000100:00100000:0.0:1767318005.231646:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940152576
00000100:00100000:0.0:1767318005.231650:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940152576
00000100:00100000:0.0:1767318005.231670:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861
00000100:00100000:0.0:1767318005.231675:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940152576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318005.231686:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318005.231718:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940152576:12345-0@lo:38:kworker.0 Request processed in 41us (794us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318005.231724:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861
00000100:00080000:0.0:1767318005.231753:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318005.231757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318005.231759:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940152576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318005.232399:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940152704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318005.232410:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940152832:0@lo:400:kworker.0
00000100:00080000:2.0:1767318005.233400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318005.233408:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318005.741467:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318006.189140:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318006.765645:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940153472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318006.765731:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318006.765932:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153472
00000100:00100000:1.0:1767318006.765940:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153472
00000100:00100000:1.0:1767318006.765988:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908
00000100:00100000:1.0:1767318006.765997:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940153472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318006.766027:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318006.766081:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940153472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (349us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318006.766107:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908
00000100:00100000:1.0:1767318006.766708:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318006.767248:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940153472:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318007.214256:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318007.789037:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318007.797496:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318007.797525:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940153600:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318007.797608:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318007.798314:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153600
00000100:00100000:0.0:1767318007.798324:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153600
00000100:00080000:1.0:1767318007.798400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318007.798408:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909
00000100:00100000:0.0:1767318007.798420:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940153600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318007.798464:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318007.798540:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940153600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (931us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318007.798549:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909
00000100:00100000:1.0:1767318007.798607:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940153600:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318008.237016:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318008.813119:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318009.261489:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318009.836893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318009.931747:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318009.931866:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237952
00000100:00100000:3.0:1767318009.931877:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237952
00000100:00100000:3.0:1767318009.931975:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3629
00000100:00100000:3.0:1767318009.931989:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894237952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318009.932079:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894237952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (349us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318009.932088:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3629
00000100:00080000:1.0:1767318009.932287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318009.933003:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318009.933068:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894237824
00000100:00100000:2.0:1767318009.933075:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894237824
00000100:00100000:2.0:1767318009.933112:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15915
00000100:00100000:2.0:1767318009.933120:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894237824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318009.933143:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318009.933204:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894237824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 82us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318009.933211:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15915
00010000:00010000:0.0:1767318010.285042:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318010.352901:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318010.352912:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318010.352915:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318010.352919:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318010.352923:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318010.352931:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3255
00000100:00080000:3.0:1767318010.352937:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318010.352943:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318010.352984:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221500 x1853163940153728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318010.353089:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940153728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318010.353183:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318010.353310:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153728
00000100:00100000:1.0:1767318010.353318:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153728
00000100:00100000:1.0:1767318010.353373:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15916
00000100:00100000:1.0:1767318010.353379:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940153728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318010.353404:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318010.355020:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318010.355029:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318010.355052:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318010.355059:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3255
00000100:00080000:3.0:1767318010.355063:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318010.355069:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318010.355103:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940153856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318010.362452:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940153856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318010.362523:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318010.362668:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153856
00000100:00100000:0.0:1767318010.362676:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153856
00000100:00100000:0.0:1767318010.362705:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862
00000100:00100000:0.0:1767318010.362711:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940153856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318010.362732:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318010.362823:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940153856:12345-0@lo:38:kworker.0 Request processed in 110us (298us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318010.362830:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862
00000100:00080000:3.0:1767318010.370653:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318010.370661:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318010.370665:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318010.370673:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3255
00000100:00080000:3.0:1767318010.370678:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318010.370684:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318010.370694:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318010.370711:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940154240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.370804:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318010.370879:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940154368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318010.370902:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318010.370905:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318010.370907:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318010.370911:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3255
00000100:00080000:3.0:1767318010.370913:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318010.370917:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318010.370927:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940154496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.370950:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318010.371003:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0000 x1853163940154624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318010.371044:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940154112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371076:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318010.371100:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318010.371106:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940153984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371126:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318010.371173:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154240
00000100:00100000:3.0:1767318010.371180:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154240
00000100:00100000:3.0:1767318010.371231:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154496
00000100:00100000:3.0:1767318010.371235:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154496
00000100:00100000:3.0:1767318010.371259:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630
00000100:00100000:3.0:1767318010.371268:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940154240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371321:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940154240:12345-0@lo:400:kworker.0 Request processed in 53us (516us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318010.371327:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630
00000100:00100000:3.0:1767318010.371344:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631
00000100:00100000:3.0:1767318010.371365:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940154496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371390:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940154496:12345-0@lo:400:kworker.0 Request processed in 40us (439us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318010.371396:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631
00000100:00100000:3.0:1767318010.371442:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940154496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371452:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940154240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.371483:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154112
00000100:00100000:3.0:1767318010.371487:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154112
00000100:00100000:3.0:1767318010.371511:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940153984
00000100:00100000:3.0:1767318010.371520:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940153984
00000100:00100000:3.0:1767318010.371540:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401
00000100:00100000:0.0:1767318010.371618:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402
00000100:00100000:0.0:1767318010.371626:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940153984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318010.371665:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940153984:12345-0@lo:400:kworker.0 Request processed in 41us (537us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318010.371668:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940153728:12345-0@lo:38:kworker.0 Request processed in 18287us (18484us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318010.371671:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402
00000100:00100000:1.0:1767318010.371675:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15916
00000100:00100000:0.0:1767318010.371696:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940153984:0@lo:400:kworker.0
00000100:00080000:1.0:1767318010.371700:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318010.371704:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318010.371706:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318010.371791:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318010.371797:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318010.371811:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940153728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318010.371827:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940154368:0@lo:38:kworker.0
00000100:00100000:2.0:1767318010.371853:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318010.371881:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940154624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318010.371904:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318010.371998:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154368
00000100:00100000:1.0:1767318010.372010:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154368
00000100:00100000:1.0:1767318010.372038:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15917
00000100:00100000:1.0:1767318010.372042:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940154368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318010.372058:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318010.372085:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940154368:12345-0@lo:38:kworker.0 Request processed in 42us (232us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318010.372090:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15917
00000100:00080000:2.0:1767318010.372308:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318010.372313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318010.372316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940153856:0@lo:38:kworker.0
00000100:00080000:2.0:1767318010.372331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318010.372334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318010.372337:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940154368:0@lo:38:kworker.0
00000100:00100000:0.0:1767318010.372492:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154624
00000100:00100000:0.0:1767318010.372496:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154624
00000100:00100000:0.0:1767318010.372521:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15918
00000100:00100000:0.0:1767318010.372526:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940154624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318010.372537:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318010.372572:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940154624:12345-0@lo:38:kworker.0 Request processed in 44us (667us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318010.372578:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15918
00000100:00080000:2.0:1767318010.372597:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318010.372602:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318010.372605:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940154624:0@lo:38:kworker.0
00000100:00100000:3.0:1767318010.373518:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940154112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318010.373585:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940154112:12345-0@lo:400:kworker.0 Request processed in 2038us (2509us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318010.373593:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401
00000100:00100000:0.0:1767318010.378168:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940154112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318010.861132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318011.309138:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318011.884955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318011.885388:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318011.885419:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940154752:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318011.885489:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318011.885633:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154752
00000100:00100000:1.0:1767318011.885642:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154752
00000100:00100000:1.0:1767318011.885699:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910
00000100:00100000:1.0:1767318011.885709:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940154752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318011.885743:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318011.885830:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940154752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318011.885837:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910
00000100:00100000:3.0:1767318011.885987:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940154752:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318012.333417:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318012.908889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318012.909097:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318012.909116:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940154880:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318012.909198:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318012.913881:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940154880
00000100:00100000:2.0:1767318012.913900:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940154880
00000100:00100000:2.0:1767318012.913997:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911
00000100:00100000:2.0:1767318012.914007:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940154880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318012.914055:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318012.914157:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940154880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (4959us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318012.914165:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911
00000100:00100000:3.0:1767318012.914278:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940154880:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318012.914358:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318013.357019:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318013.933547:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318014.381176:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318014.957140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318015.046948:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318015.048173:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318015.064418:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238208
00000100:00100000:1.0:1767318015.064438:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238208
00000100:00100000:1.0:1767318015.064565:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238080
00000100:00100000:1.0:1767318015.064570:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238080
00000100:00100000:1.0:1767318015.064608:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3632
00000100:00100000:1.0:1767318015.064619:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894238208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318015.064723:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894238208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 105us (17785us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318015.064731:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3632
00000100:00100000:1.0:1767318015.064757:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15919
00000100:00100000:1.0:1767318015.064763:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894238080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318015.064806:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318015.064834:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894238080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (16666us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318015.064840:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15919
00000100:00080000:2.0:1767318015.065168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318015.405102:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318015.472002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318015.472014:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318015.472017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318015.472021:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318015.472026:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318015.472035:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318015.472041:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318015.472048:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318015.472096:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940155008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318015.472342:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318015.472346:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318015.472348:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318015.472352:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318015.472354:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318015.472357:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318015.472387:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1880 x1853163940155136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318015.472458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318015.472485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318015.472488:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318015.472492:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318015.472495:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318015.472500:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318015.472514:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3100 x1853163940155648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318015.472532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318015.472535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318015.472536:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318015.472540:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318015.472542:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318015.472546:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318015.472558:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e300 x1853163940155904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318015.472647:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940155264:0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.472729:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318015.472812:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318015.472817:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940155392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.472836:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318015.472864:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940155776:0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.472887:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318015.472903:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318015.472906:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940155520:0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.472922:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318015.472948:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155776
00000100:00100000:3.0:1767318015.472955:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155776
00000100:00100000:3.0:1767318015.473022:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155520
00000100:00100000:3.0:1767318015.473032:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155520
00000100:00100000:3.0:1767318015.473058:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633
00000100:00100000:3.0:1767318015.473066:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940155776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.473116:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940155776:12345-0@lo:400:kworker.0 Request processed in 50us (227us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318015.473134:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633
00000100:00100000:3.0:1767318015.473152:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634
00000100:00100000:3.0:1767318015.473159:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940155520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.473425:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940155520:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318015.473432:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634
00000100:00100000:3.0:1767318015.473482:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940155520:0@lo:400:kworker.0
00000100:00100000:3.0:1767318015.473491:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940155776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318015.473598:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940155008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318015.473636:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318015.473667:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940155136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318015.473692:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318015.473712:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940155648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318015.473750:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318015.473770:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940155904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318015.473815:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318015.473847:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155136
00000100:00100000:0.0:1767318015.473851:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155136
00000100:00100000:0.0:1767318015.473875:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863
00000100:00100000:0.0:1767318015.473879:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940155136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318015.473900:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318015.473929:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940155136:12345-0@lo:38:kworker.0 Request processed in 49us (236us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318015.473935:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863
00000100:00100000:0.0:1767318015.473954:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155008
00000100:00100000:0.0:1767318015.473970:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155008
00000100:00100000:0.0:1767318015.473980:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155648
00000100:00100000:0.0:1767318015.473982:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155648
00000100:00100000:0.0:1767318015.473988:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155904
00000100:00100000:0.0:1767318015.473990:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155904
00000100:00100000:0.0:1767318015.473998:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15920
00000100:00100000:0.0:1767318015.474002:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318015.474012:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318015.474034:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155008:12345-0@lo:38:kworker.0 Request processed in 30us (397us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318015.474039:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15920
00000100:00100000:0.0:1767318015.474049:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15921
00000100:00100000:0.0:1767318015.474052:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318015.474061:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318015.474091:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155648:12345-0@lo:38:kworker.0 Request processed in 37us (341us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318015.474097:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15921
00000100:00100000:0.0:1767318015.474107:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15922
00000100:00100000:0.0:1767318015.474111:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318015.474129:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318015.474150:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940155904:12345-0@lo:38:kworker.0 Request processed in 37us (334us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318015.474155:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15922
00000100:00080000:0.0:1767318015.474180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318015.474407:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318015.474412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940155008:0@lo:38:kworker.0
00000100:00080000:0.0:1767318015.474427:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318015.474432:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318015.474434:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940155136:0@lo:38:kworker.0
00000100:00080000:0.0:1767318015.474442:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318015.474445:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318015.474447:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940155648:0@lo:38:kworker.0
00000100:00080000:0.0:1767318015.474453:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318015.474456:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318015.474458:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940155904:0@lo:38:kworker.0
00000100:00080000:2.0:1767318015.474561:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318015.474575:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155264
00000100:00100000:2.0:1767318015.474579:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155264
00000100:00100000:2.0:1767318015.474620:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940155392
00000100:00100000:2.0:1767318015.474622:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940155392
00000100:00100000:2.0:1767318015.474641:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403
00000100:00100000:2.0:1767318015.474647:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940155264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318015.474688:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940155264:12345-0@lo:400:kworker.0 Request processed in 41us (1958us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318015.474693:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403
00000100:00100000:2.0:1767318015.474704:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404
00000100:00100000:2.0:1767318015.474716:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940155392:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318015.474740:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940155392:12345-0@lo:400:kworker.0 Request processed in 25us (1904us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318015.474745:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404
00000100:00100000:2.0:1767318015.474793:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940155392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318015.474803:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940155264:0@lo:400:kworker.0
00000100:00080000:0.0:1767318015.474973:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318015.474976:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318015.980963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318016.429126:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318017.006600:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940156032:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318017.006678:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318017.006860:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156032
00000100:00100000:1.0:1767318017.006869:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156032
00000100:00100000:1.0:1767318017.006939:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912
00000100:00100000:1.0:1767318017.006948:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940156032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318017.006983:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318017.007028:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940156032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (350us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318017.007035:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912
00000100:00100000:3.0:1767318017.008242:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:2.0:1767318017.008535:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318017.008592:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940156032:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318017.453087:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318018.029146:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318018.030288:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318018.030311:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940156160:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318018.030412:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318018.030644:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156160
00000100:00100000:0.0:1767318018.030666:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156160
00000100:00100000:0.0:1767318018.030733:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913
00000100:00100000:0.0:1767318018.030742:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940156160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318018.030796:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318018.030895:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318018.030961:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940156160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (549us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318018.030969:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913
00000100:00100000:3.0:1767318018.031452:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940156160:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318018.477397:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318019.053130:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318019.503926:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318020.077493:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318020.166276:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318020.167949:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238464
00000100:00100000:3.0:1767318020.167964:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238464
00000100:00100000:3.0:1767318020.168069:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3635
00000100:00100000:3.0:1767318020.168083:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894238464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318020.168439:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894238464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 361us (2175us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318020.168447:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3635
00000100:00080000:2.0:1767318020.168938:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318020.183169:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318020.183371:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238336
00000100:00100000:3.0:1767318020.183383:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238336
00000100:00100000:3.0:1767318020.183429:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15923
00000100:00100000:3.0:1767318020.183436:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894238336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318020.183462:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318020.183743:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894238336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 304us (579us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318020.183751:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15923
00010000:00010000:0.0:1767318020.527402:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318020.589255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318020.589278:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318020.589281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318020.589285:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318020.589290:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318020.589298:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3265
00000100:00080000:0.0:1767318020.589303:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318020.589310:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318020.589380:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940156288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318020.589407:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318020.589411:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318020.589413:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318020.589416:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3265
00000100:00080000:0.0:1767318020.589419:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318020.589422:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318020.589451:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac700 x1853163940156416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318020.589526:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318020.589566:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940156288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318020.589636:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318020.589697:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940156416:0@lo:38:kworker.0
00000100:00100000:2.0:1767318020.589730:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318020.589789:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156288
00000100:00100000:2.0:1767318020.589798:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156288
00000100:00100000:2.0:1767318020.589835:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15924
00000100:00100000:2.0:1767318020.589842:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940156288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318020.589865:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318020.589915:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940156288:12345-0@lo:38:kworker.0 Request processed in 71us (277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318020.589922:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15924
00000100:00100000:2.0:1767318020.589957:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156416
00000100:00100000:2.0:1767318020.589961:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156416
00000100:00100000:2.0:1767318020.589983:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864
00000100:00100000:2.0:1767318020.589987:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940156416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318020.589998:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318020.590023:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940156416:12345-0@lo:38:kworker.0 Request processed in 34us (293us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318020.590030:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864
00000100:00080000:2.0:1767318020.590212:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318020.590217:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318020.590220:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940156288:0@lo:38:kworker.0
00000100:00080000:2.0:1767318020.590230:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318020.590233:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318020.590236:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940156416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318020.598127:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940156672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318020.598228:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318020.598301:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940156544:0@lo:400:kworker.0
00000100:00100000:1.0:1767318020.598339:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318020.598701:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156672
00000100:00100000:3.0:1767318020.598711:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156672
00000100:00100000:3.0:1767318020.598796:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156544
00000100:00100000:3.0:1767318020.598800:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156544
00000100:00100000:3.0:1767318020.598827:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405
00000100:00100000:3.0:1767318020.598839:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940156672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318020.598909:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940156672:12345-0@lo:400:kworker.0 Request processed in 74us (697us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318020.598916:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405
00000100:00100000:3.0:1767318020.598950:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406
00000100:00100000:3.0:1767318020.598957:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940156544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318020.598984:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940156544:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318020.598989:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406
00000100:00100000:3.0:1767318020.599045:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940156672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318020.599055:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940156544:0@lo:400:kworker.0
00000100:00080000:1.0:1767318020.599207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318020.599212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318020.602610:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318020.602617:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318020.602621:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318020.602628:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3265
00000100:00080000:0.0:1767318020.602633:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318020.602639:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318020.602660:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940156928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318020.602684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318020.602687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318020.602689:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318020.602693:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3265
00000100:00080000:0.0:1767318020.602695:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318020.602698:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318020.602708:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940157184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318020.602743:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940157056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.602832:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318020.602876:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318020.602882:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940156800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.602904:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318020.602934:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157056
00000100:00100000:0.0:1767318020.602955:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157056
00000100:00100000:0.0:1767318020.603006:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156800
00000100:00100000:0.0:1767318020.603009:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156800
00000100:00100000:0.0:1767318020.603030:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636
00000100:00100000:0.0:1767318020.603037:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940157056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.603086:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940157056:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318020.603093:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636
00000100:00100000:0.0:1767318020.603107:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637
00000100:00100000:0.0:1767318020.603113:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940156800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.603139:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940156800:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318020.603144:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637
00000100:00080000:0.0:1767318020.603165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318020.603192:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940156800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.603201:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940157056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318020.603242:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940156928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318020.603264:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318020.603279:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940157184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318020.603297:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318020.603333:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940156928
00000100:00100000:0.0:1767318020.603337:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940156928
00000100:00100000:0.0:1767318020.603353:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157184
00000100:00100000:0.0:1767318020.603356:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157184
00000100:00100000:0.0:1767318020.603369:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15925
00000100:00100000:0.0:1767318020.603372:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940156928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318020.603397:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318020.603430:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940156928:12345-0@lo:38:kworker.0 Request processed in 55us (164us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318020.603436:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15925
00000100:00100000:0.0:1767318020.603448:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15926
00000100:00100000:0.0:1767318020.603451:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940157184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318020.603461:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318020.603483:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940157184:12345-0@lo:38:kworker.0 Request processed in 30us (185us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318020.603488:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15926
00000100:00080000:0.0:1767318020.603512:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318020.603516:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318020.603519:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940156928:0@lo:38:kworker.0
00000100:00080000:0.0:1767318020.603526:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318020.603529:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318020.603531:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940157184:0@lo:38:kworker.0
00000100:00100000:3.0:1767318021.100904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318021.549014:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318022.124922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318022.125412:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318022.125438:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940157312:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318022.125535:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318022.125731:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157312
00000100:00100000:1.0:1767318022.125743:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157312
00000100:00100000:1.0:1767318022.125849:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914
00000100:00100000:1.0:1767318022.125861:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940157312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318022.125892:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318022.125959:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940157312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (424us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318022.125967:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914
00000100:00080000:2.0:1767318022.126116:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318022.126209:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940157312:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318022.573184:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318023.150329:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318023.150625:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940157440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318023.150725:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318023.150914:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157440
00000100:00100000:2.0:1767318023.150924:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157440
00000100:00100000:2.0:1767318023.150995:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915
00000100:00100000:2.0:1767318023.151005:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940157440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318023.151040:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318023.151093:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940157440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318023.151118:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915
00000100:00100000:2.0:1767318023.151170:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940157440:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318023.151545:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318023.598108:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318024.175660:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318024.273868:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318024.274526:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238848
00000100:00100000:1.0:1767318024.274539:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238848
00000100:00100000:1.0:1767318024.274674:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3638
00000100:00100000:1.0:1767318024.274686:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894238848:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318024.274822:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894238848:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 139us (968us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318024.274845:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3638
00000100:00080000:3.0:1767318024.280624:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767318024.284791:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894238592 offset 0 length 520: 4
00000100:00100000:2.0:1767318024.284866:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318024.286657:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238720
00000100:00100000:0.0:1767318024.286672:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238720
00000100:00100000:0.0:1767318024.286807:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15927
00000100:00100000:0.0:1767318024.286816:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894238720:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318024.286865:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318024.286944:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894238720:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 128us (2078us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318024.286951:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15927
00010000:00010000:1.0:1767318024.621199:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318025.196956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318025.648601:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318025.709358:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318025.709383:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318025.709387:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318025.709391:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318025.709404:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318025.709415:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3270
00000100:00080000:3.0:1767318025.709421:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318025.709430:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318025.709482:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1180 x1853163940157568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318025.709510:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318025.709514:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318025.709516:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318025.709519:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3270
00000100:00080000:3.0:1767318025.709522:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318025.709525:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318025.709537:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3800 x1853163940157696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318025.709632:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318025.709636:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318025.709638:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318025.709642:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3270
00000100:00080000:3.0:1767318025.709644:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318025.709649:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318025.709659:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3100 x1853163940158208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318025.709673:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318025.709676:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318025.709677:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318025.709680:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3270
00000100:00080000:3.0:1767318025.709683:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318025.709686:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318025.709694:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940158464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318025.709719:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940158080:0@lo:400:kworker.0
00000100:00100000:3.0:1767318025.709816:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318025.709873:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318025.709881:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940158336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318025.709903:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318025.709936:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158080
00000100:00100000:3.0:1767318025.709945:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158080
00000100:00100000:3.0:1767318025.709995:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158336
00000100:00100000:3.0:1767318025.710007:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158336
00000100:00100000:3.0:1767318025.710037:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639
00000100:00100000:3.0:1767318025.710045:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940158080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318025.710107:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940158080:12345-0@lo:400:kworker.0 Request processed in 62us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318025.710115:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639
00000100:00100000:3.0:1767318025.710133:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640
00000100:00100000:3.0:1767318025.710140:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940158336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318025.710169:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940158336:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318025.710174:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640
00000100:00080000:3.0:1767318025.710193:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318025.710240:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940158336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318025.710252:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940158080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318025.710803:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940157952:0@lo:400:kworker.0
00000100:00100000:1.0:1767318025.710845:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318025.710876:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318025.710892:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940157824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318025.710922:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318025.711234:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157952
00000100:00100000:2.0:1767318025.711240:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157952
00000100:00100000:2.0:1767318025.711300:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157824
00000100:00100000:2.0:1767318025.711304:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157824
00000100:00100000:2.0:1767318025.711325:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407
00000100:00100000:2.0:1767318025.711332:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940157952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318025.711378:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940157952:12345-0@lo:400:kworker.0 Request processed in 47us (532us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318025.711385:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407
00000100:00100000:2.0:1767318025.711414:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408
00000100:00100000:2.0:1767318025.711420:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940157824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318025.711460:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940157824:12345-0@lo:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318025.711465:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408
00000100:00080000:1.0:1767318025.711719:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318025.711723:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318025.711752:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940157824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318025.711764:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940157952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318025.712815:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940157568:0@lo:38:kworker.0
00000100:00100000:0.0:1767318025.712883:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318025.712927:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940157696:0@lo:38:kworker.0
00000100:00100000:0.0:1767318025.712956:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318025.712981:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940158208:0@lo:38:kworker.0
00000100:00100000:0.0:1767318025.713003:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318025.713030:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940158464:0@lo:38:kworker.0
00000100:00100000:0.0:1767318025.713050:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318025.713199:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157568
00000100:00100000:1.0:1767318025.713209:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157568
00000100:00100000:1.0:1767318025.713246:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158208
00000100:00100000:1.0:1767318025.713250:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158208
00000100:00100000:1.0:1767318025.713267:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158464
00000100:00100000:1.0:1767318025.713269:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158464
00000100:00100000:1.0:1767318025.713291:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15928
00000100:00100000:1.0:1767318025.713298:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940157568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318025.713319:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318025.713370:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940157568:12345-0@lo:38:kworker.0 Request processed in 60us (475us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318025.713377:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15928
00000100:00100000:1.0:1767318025.713404:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15929
00000100:00100000:1.0:1767318025.713409:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940158208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318025.713420:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318025.713933:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940158208:12345-0@lo:38:kworker.0 Request processed in 521us (928us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318025.713940:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15929
00000100:00100000:1.0:1767318025.713954:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15930
00000100:00100000:1.0:1767318025.713958:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940158464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318025.713985:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318025.714013:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940158464:12345-0@lo:38:kworker.0 Request processed in 54us (962us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318025.714019:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15930
00000100:00080000:0.0:1767318025.714267:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318025.714273:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318025.714284:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940157568:0@lo:38:kworker.0
00000100:00080000:0.0:1767318025.714296:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318025.714299:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318025.714302:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940158208:0@lo:38:kworker.0
00000100:00080000:0.0:1767318025.714309:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318025.714312:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318025.714314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940158464:0@lo:38:kworker.0
00000100:00100000:2.0:1767318025.714817:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940157696
00000100:00100000:2.0:1767318025.714824:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940157696
00000100:00100000:2.0:1767318025.714868:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865
00000100:00100000:2.0:1767318025.714873:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940157696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318025.714886:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318025.714939:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940157696:12345-0@lo:38:kworker.0 Request processed in 65us (1982us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318025.714958:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865
00000100:00080000:1.0:1767318025.715036:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318025.715041:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318025.715045:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940157696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318026.220992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318026.670057:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318027.245320:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318027.245564:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318027.245586:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940158592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318027.245664:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318027.245796:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158592
00000100:00100000:0.0:1767318027.245817:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158592
00000100:00100000:0.0:1767318027.245882:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916
00000100:00100000:0.0:1767318027.245891:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940158592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318027.245925:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318027.245972:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940158592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318027.245979:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916
00000100:00100000:3.0:1767318027.246064:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940158592:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318027.246121:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318027.701320:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318028.269860:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940158720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318028.269980:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318028.270280:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158720
00000100:00100000:0.0:1767318028.270292:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158720
00000100:00100000:0.0:1767318028.270405:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917
00000100:00100000:0.0:1767318028.270421:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940158720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318028.270467:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318028.270550:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940158720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (572us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318028.270561:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917
00000100:00080000:2.0:1767318028.270898:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318028.270976:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940158720:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318028.284895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318028.720949:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318029.294142:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318029.389720:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318029.389947:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239104
00000100:00100000:1.0:1767318029.389960:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239104
00000100:00100000:1.0:1767318029.390058:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3641
00000100:00100000:1.0:1767318029.390069:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894239104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318029.390172:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894239104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (469us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318029.390181:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3641
00000100:00100000:3.0:1767318029.390584:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318029.390954:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894238976
00000100:00100000:1.0:1767318029.390962:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894238976
00000100:00080000:2.0:1767318029.390964:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318029.391068:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15931
00000100:00100000:1.0:1767318029.391076:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894238976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318029.391106:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318029.392036:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894238976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 951us (2191us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318029.392070:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15931
00010000:00010000:1.0:1767318029.743477:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318030.316964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318030.765301:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318030.831835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318030.831851:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318030.831866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318030.831897:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318030.831902:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318030.831913:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3275
00000100:00080000:3.0:1767318030.831920:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318030.831928:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318030.831981:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3100 x1853163940158848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318030.832011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318030.832017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318030.832018:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318030.832022:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3275
00000100:00080000:3.0:1767318030.832025:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318030.832029:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318030.832043:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2d80 x1853163940158976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318030.832131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318030.832136:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318030.832138:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318030.832142:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3275
00000100:00080000:3.0:1767318030.832144:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318030.832149:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318030.832158:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940159104:0@lo:400:kworker.0
00000100:00100000:3.0:1767318030.832163:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940159488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318030.832189:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318030.832199:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318030.832201:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318030.832215:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3275
00000100:00080000:3.0:1767318030.832218:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318030.832222:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318030.832255:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940159232:0@lo:400:kworker.0
00000100:00100000:0.0:1767318030.832281:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318030.832329:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940159744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318030.832358:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318005/real 1767318005]  req@ffff93cf45409500 x1853163940152320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318030.832368:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940159360:0@lo:400:kworker.0
00000100:00100000:2.0:1767318030.832384:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318030.832402:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45409500 x1853163940152320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318030.832407:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159104
00000100:00100000:0.0:1767318030.832419:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159104
00000100:00100000:1.0:1767318030.832421:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940158848:0@lo:38:kworker.0
00000100:00100000:3.0:1767318030.832429:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318030.832453:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318030.832456:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318030.832462:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940159616:0@lo:400:kworker.0
00000100:00100000:3.0:1767318030.832485:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318030.832495:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940158976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318030.832504:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409
00000100:00100000:0.0:1767318030.832518:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940159104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318030.832522:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159360
00000100:00100000:1.0:1767318030.832525:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318030.832526:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159360
00000100:00100000:1.0:1767318030.832547:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940159488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318030.832564:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158848
00000100:00100000:3.0:1767318030.832567:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158848
00000100:00100000:3.0:1767318030.832589:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159616
00000100:00100000:3.0:1767318030.832592:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159616
00000100:00100000:3.0:1767318030.833361:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642
00000100:00100000:3.0:1767318030.833372:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940159360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318030.834721:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318030.834823:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940159104:12345-0@lo:400:kworker.0 Request processed in 2304us (2538us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318030.834838:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409
00000100:00100000:0.0:1767318030.834879:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159232
00000100:00100000:0.0:1767318030.834904:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159232
00000100:00100000:0.0:1767318030.834957:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410
00000100:00100000:0.0:1767318030.834965:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940159232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318030.835042:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940159232:12345-0@lo:400:kworker.0 Request processed in 78us (2681us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318030.835049:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410
00000100:00080000:0.0:1767318030.835080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318030.835086:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318030.835090:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318030.835111:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940159744:0@lo:38:kworker.0
00000100:00100000:0.0:1767318030.835149:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940159104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318030.835166:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318030.835184:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318030.835206:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318030.835210:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940152320:0@lo:250:kworker.0
00000100:00100000:1.0:1767318030.835281:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159488
00000100:00100000:1.0:1767318030.835286:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159488
00000100:00100000:1.0:1767318030.835307:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940159744
00000100:00100000:1.0:1767318030.835311:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940159744
00000100:00100000:1.0:1767318030.835323:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643
00000100:00100000:1.0:1767318030.835332:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940159616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318030.835351:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15932
00000100:00100000:0.0:1767318030.835358:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940158848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318030.835386:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318030.835398:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940159616:12345-0@lo:400:kworker.0 Request processed in 67us (2911us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318030.835413:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643
00000100:00100000:0.0:1767318030.835435:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940158848:12345-0@lo:38:kworker.0 Request processed in 74us (2978us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318030.835440:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15933
00000100:00100000:0.0:1767318030.835449:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15932
00000100:00100000:1.0:1767318030.835450:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940159488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318030.835464:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318030.835473:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15934
00000100:00100000:0.0:1767318030.835478:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940159744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318030.835488:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318030.836512:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940159232:0@lo:400:kworker.0
00000100:00080000:2.0:1767318030.836593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318030.836598:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318030.836601:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318030.836607:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3255
00000100:00080000:2.0:1767318030.836612:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318030.836618:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318030.836660:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940159872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318030.836745:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940159616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318030.836807:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940158976
00000100:00100000:2.0:1767318030.836814:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940158976
00000100:00100000:2.0:1767318030.836850:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866
00000100:00100000:2.0:1767318030.836855:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940158976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318030.836872:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318030.836934:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940158976:12345-0@lo:38:kworker.0 Request processed in 78us (4409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318030.836941:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866
00000100:00100000:0.0:1767318030.837048:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940159744:12345-0@lo:38:kworker.0 Request processed in 1568us (1882us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318030.837056:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15934
00000100:00100000:0.0:1767318030.837092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940159872:0@lo:250:kworker.0
00000400:00000100:0.0:1767318030.837121:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940159872 offset 0 length 520: 4
00000100:00080000:0.0:1767318030.837151:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318030.837167:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318030.837171:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940158848:0@lo:38:kworker.0
00000100:00080000:0.0:1767318030.837185:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318030.837189:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318030.837192:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940158976:0@lo:38:kworker.0
00000100:00080000:0.0:1767318030.837201:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318030.837204:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318030.837207:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940159744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318030.839128:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940159488:12345-0@lo:38:kworker.0 Request processed in 3666us (4400us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318030.839145:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15933
00000100:00100000:3.0:1767318030.839160:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940159360:12345-0@lo:400:kworker.0 Request processed in 5788us (6728us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318030.839168:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642
00000100:00080000:0.0:1767318030.839315:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318030.839321:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318030.839326:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940159488:0@lo:38:kworker.0
00000100:00100000:2.0:1767318030.840134:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940159360:0@lo:400:kworker.0
00000100:00100000:1.0:1767318031.341006:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318031.789205:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318032.364975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318032.366105:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318032.366133:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940160000:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318032.366246:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318032.366529:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160000
00000100:00100000:3.0:1767318032.366541:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160000
00000100:00100000:3.0:1767318032.366638:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918
00000100:00100000:3.0:1767318032.366651:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940160000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318032.366714:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318032.366806:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940160000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (559us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318032.366815:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918
00000100:00100000:3.0:1767318032.366879:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940160000:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318032.367386:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318032.813760:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318033.389006:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318033.390136:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318033.390160:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940160128:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318033.390262:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318033.390455:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160128
00000100:00100000:0.0:1767318033.390466:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160128
00000100:00100000:0.0:1767318033.390539:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919
00000100:00100000:0.0:1767318033.390548:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940160128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318033.390584:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318033.390716:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318033.393383:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940160128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2819us (3105us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318033.393402:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919
00000100:00100000:1.0:1767318033.401428:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940160128:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318033.838120:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318034.413033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318034.502987:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318034.503109:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239232
00000100:00100000:3.0:1767318034.503124:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239232
00000100:00100000:3.0:1767318034.503209:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15935
00000100:00100000:3.0:1767318034.503219:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894239232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318034.503252:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318034.503368:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894239232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 148us (394us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318034.503377:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15935
00000100:00100000:2.0:1767318034.505635:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318034.505760:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239360
00000100:00100000:1.0:1767318034.505816:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239360
00000100:00100000:1.0:1767318034.505924:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3644
00000100:00100000:1.0:1767318034.505936:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894239360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318034.506066:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894239360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 122us (438us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318034.506075:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3644
00000100:00080000:2.0:1767318034.506948:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318034.867944:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318035.437565:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318035.885269:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318035.951496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318035.951512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318035.951516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318035.951520:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318035.951527:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318035.951538:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3280
00000100:00080000:3.0:1767318035.951544:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318035.951552:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318035.951938:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a300 x1853163940160256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318035.952039:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940160256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318035.952137:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318035.952298:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160256
00000100:00100000:1.0:1767318035.952309:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160256
00000100:00100000:1.0:1767318035.952365:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15936
00000100:00100000:1.0:1767318035.952375:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940160256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318035.952403:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318035.955429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318035.955471:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318035.955476:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318035.955487:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3280
00000100:00080000:3.0:1767318035.955494:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318035.955504:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318035.955556:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797aa00 x1853163940160384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318035.956175:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940160384:0@lo:38:kworker.0
00000100:00100000:0.0:1767318035.956280:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318035.956438:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160384
00000100:00100000:2.0:1767318035.956449:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160384
00000100:00100000:2.0:1767318035.956498:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867
00000100:00100000:2.0:1767318035.956507:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940160384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318035.956538:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318035.956588:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940160384:12345-0@lo:38:kworker.0 Request processed in 80us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318035.956597:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867
00000100:00100000:1.0:1767318035.957224:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940160256:12345-0@lo:38:kworker.0 Request processed in 4846us (5083us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318035.957233:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15936
00000100:00080000:0.0:1767318035.957358:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318035.957365:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318035.957369:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940160256:0@lo:38:kworker.0
00000100:00080000:0.0:1767318035.957401:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318035.957405:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318035.957408:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940160384:0@lo:38:kworker.0
00000100:00100000:2.0:1767318035.958213:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940160512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.958293:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318035.958348:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318035.958356:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940160640:0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.958382:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318035.958421:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160512
00000100:00100000:2.0:1767318035.958445:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160512
00000100:00100000:0.0:1767318035.958595:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160640
00000100:00100000:0.0:1767318035.958600:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160640
00000100:00080000:3.0:1767318035.958655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318035.958661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318035.958665:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318035.958671:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3280
00000100:00080000:3.0:1767318035.958675:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318035.958682:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318035.958705:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978000 x1853163940160896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318035.958733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318035.958736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318035.958738:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318035.958741:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3280
00000100:00080000:3.0:1767318035.958744:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318035.958747:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318035.958757:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978a80 x1853163940161152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318035.958819:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940160768:0@lo:400:kworker.0
00000100:00100000:3.0:1767318035.958866:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318035.958889:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318035.958894:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940161024:0@lo:400:kworker.0
00000100:00100000:3.0:1767318035.958919:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318035.958950:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160768
00000100:00100000:3.0:1767318035.958954:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160768
00000100:00100000:2.0:1767318035.958978:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411
00000100:00100000:2.0:1767318035.958988:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940160512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.959208:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940160512:12345-0@lo:400:kworker.0 Request processed in 221us (914us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318035.959217:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411
00000100:00100000:2.0:1767318035.959233:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412
00000100:00100000:2.0:1767318035.959239:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940160640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.959274:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940160640:12345-0@lo:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318035.959282:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161024
00000100:00100000:3.0:1767318035.959286:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161024
00000100:00100000:2.0:1767318035.959303:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412
00000100:00100000:0.0:1767318035.959342:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645
00000100:00100000:2.0:1767318035.959365:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940160640:0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.959377:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940160512:0@lo:400:kworker.0
00000100:00100000:3.0:1767318035.959393:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646
00000100:00100000:2.0:1767318035.959419:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940160896:0@lo:38:kworker.0
00000100:00100000:2.0:1767318035.959446:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318035.959552:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940161152:0@lo:38:kworker.0
00000100:00080000:1.0:1767318035.959727:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318035.959750:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940160768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318035.959831:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940160768:12345-0@lo:400:kworker.0 Request processed in 481us (964us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318035.959838:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645
00000100:00100000:0.0:1767318035.959859:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940160896
00000100:00100000:0.0:1767318035.959864:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940160896
00000100:00100000:0.0:1767318035.959886:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15937
00000100:00100000:0.0:1767318035.959890:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940160896:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318035.959913:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318035.959943:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940160896:12345-0@lo:38:kworker.0 Request processed in 51us (496us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318035.959950:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15937
00000100:00100000:3.0:1767318035.960168:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940161024:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318035.960177:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318035.960216:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940161024:12345-0@lo:400:kworker.0 Request processed in 816us (1295us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318035.960223:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646
00000100:00080000:2.0:1767318035.960225:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318035.960230:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318035.960233:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940160896:0@lo:38:kworker.0
00000100:00100000:3.0:1767318035.960235:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161152
00000100:00100000:3.0:1767318035.960238:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161152
00000100:00100000:3.0:1767318035.960254:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15938
00000100:00100000:3.0:1767318035.960258:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940161152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318035.960269:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318035.960295:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940161152:12345-0@lo:38:kworker.0 Request processed in 35us (116us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318035.960300:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15938
00000100:00080000:2.0:1767318035.960322:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318035.960327:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318035.960330:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940161152:0@lo:38:kworker.0
00000100:00100000:0.0:1767318035.960666:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940160768:0@lo:400:kworker.0
00000100:00100000:0.0:1767318035.960693:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940161024:0@lo:400:kworker.0
00000100:00080000:1.0:1767318035.960766:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318035.960912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318036.461373:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318036.909818:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318037.484993:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318037.485217:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318037.485246:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940161280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318037.485446:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318037.485688:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161280
00000100:00100000:1.0:1767318037.485699:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161280
00000100:00100000:1.0:1767318037.485802:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920
00000100:00100000:1.0:1767318037.485824:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940161280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318037.485868:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318037.485943:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940161280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (590us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318037.485952:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920
00000100:00100000:0.0:1767318037.490831:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940161280:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318037.491022:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318037.934992:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318038.509660:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318038.513299:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940161408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318038.513403:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318038.513801:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161408
00000100:00100000:3.0:1767318038.513813:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161408
00000100:00100000:3.0:1767318038.513912:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921
00000100:00100000:3.0:1767318038.513926:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940161408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318038.513968:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318038.514049:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940161408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (646us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318038.514058:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921
00000100:00100000:1.0:1767318038.514371:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940161408:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318038.514452:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318038.957104:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318039.532955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318039.622209:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318039.622301:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239616
00000100:00100000:3.0:1767318039.622314:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239616
00000100:00100000:3.0:1767318039.622404:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3647
00000100:00100000:3.0:1767318039.622417:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894239616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318039.622524:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894239616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (328us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318039.622535:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3647
00000100:00080000:0.0:1767318039.622608:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318039.624216:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318039.626302:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239488
00000100:00100000:3.0:1767318039.626317:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239488
00000100:00100000:3.0:1767318039.626435:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15939
00000100:00100000:3.0:1767318039.626442:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894239488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318039.626463:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318039.626532:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894239488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 88us (2320us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318039.626539:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15939
00010000:00010000:1.0:1767318039.981160:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318040.557101:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318041.005839:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318041.070227:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318041.070261:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318041.070264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318041.070269:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318041.070273:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318041.070281:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3285
00000100:00080000:2.0:1767318041.070285:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318041.070292:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318041.070331:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e300 x1853163940161536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318041.070361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318041.070365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318041.070367:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318041.070370:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3285
00000100:00080000:2.0:1767318041.070372:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318041.070375:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318041.070389:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940161664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318041.070462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318041.070465:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318041.070466:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318041.070470:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3285
00000100:00080000:2.0:1767318041.070473:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318041.070477:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318041.070638:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940161792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318041.070711:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318041.070787:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318041.070795:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940161920:0@lo:400:kworker.0
00000100:00100000:3.0:1767318041.070817:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318041.070859:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940162048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318041.070886:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318041.070927:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162048
00000100:00100000:3.0:1767318041.070934:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162048
00000100:00100000:3.0:1767318041.070998:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648
00000100:00100000:3.0:1767318041.071010:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940162048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318041.071065:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940162048:12345-0@lo:400:kworker.0 Request processed in 59us (177us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318041.071072:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648
00000100:00100000:3.0:1767318041.071127:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940162048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318041.071820:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161792
00000100:00100000:0.0:1767318041.071826:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161792
00000100:00100000:0.0:1767318041.071865:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161920
00000100:00100000:0.0:1767318041.071869:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161920
00000100:00100000:0.0:1767318041.071895:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413
00000100:00100000:0.0:1767318041.071902:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940161792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318041.071963:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940161792:12345-0@lo:400:kworker.0 Request processed in 62us (1252us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318041.071970:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413
00000100:00100000:0.0:1767318041.071983:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1767318041.071988:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940161920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318041.072014:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940161920:12345-0@lo:400:kworker.0 Request processed in 25us (1196us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318041.072019:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1767318041.072047:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940161536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318041.072074:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318041.072091:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940161664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318041.072150:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318041.072194:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161664
00000100:00100000:0.0:1767318041.072198:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161664
00000100:00100000:0.0:1767318041.072220:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868
00000100:00100000:0.0:1767318041.072225:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940161664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318041.072243:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318041.072275:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940161664:12345-0@lo:38:kworker.0 Request processed in 49us (125us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318041.072281:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868
00000100:00080000:0.0:1767318041.072300:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318041.072304:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318041.072307:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318041.072327:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318041.072332:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318041.072335:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940161664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318041.072367:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940161920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318041.072377:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940161792:0@lo:400:kworker.0
00000100:00100000:2.0:1767318041.072749:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940162176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318041.072770:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940161536
00000100:00100000:1.0:1767318041.072786:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940161536
00000100:00100000:1.0:1767318041.072810:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15940
00000100:00100000:1.0:1767318041.072815:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940161536:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767318041.072818:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318041.072821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318041.072824:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00010000:00020000:1.0:1767318041.072826:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318041.072828:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3285
00000100:00080000:2.0:1767318041.072831:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318041.072835:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318041.072852:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d880 x1853163940162432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318041.072857:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940161536:12345-0@lo:38:kworker.0 Request processed in 41us (782us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318041.072862:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15940
00000100:00100000:1.0:1767318041.072880:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940162304:0@lo:400:kworker.0
00000100:00100000:1.0:1767318041.072905:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318041.073331:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162304
00000100:00100000:2.0:1767318041.073337:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162304
00000100:00100000:2.0:1767318041.073387:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649
00000100:00100000:2.0:1767318041.073392:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940162304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318041.073427:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940162304:12345-0@lo:400:kworker.0 Request processed in 35us (522us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318041.073433:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649
00000100:00100000:1.0:1767318041.073733:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940162304:0@lo:400:kworker.0
00000100:00080000:1.0:1767318041.073754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318041.073818:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940162176:0@lo:38:kworker.0
00000100:00100000:0.0:1767318041.073849:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318041.073876:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940162432:0@lo:38:kworker.0
00000100:00100000:0.0:1767318041.073896:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318041.073925:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318041.073930:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318041.073933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940161536:0@lo:38:kworker.0
00000100:00100000:1.0:1767318041.073990:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162176
00000100:00100000:1.0:1767318041.073995:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162176
00000100:00100000:1.0:1767318041.074022:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162432
00000100:00100000:1.0:1767318041.074025:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162432
00000100:00100000:1.0:1767318041.074046:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15941
00000100:00100000:1.0:1767318041.074051:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940162176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318041.074065:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318041.074093:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940162176:12345-0@lo:38:kworker.0 Request processed in 41us (243us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318041.074099:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15941
00000100:00100000:1.0:1767318041.074121:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15942
00000100:00100000:1.0:1767318041.074125:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940162432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318041.074134:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318041.074175:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940162432:12345-0@lo:38:kworker.0 Request processed in 48us (277us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318041.074180:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15942
00000100:00080000:0.0:1767318041.074432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318041.074443:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318041.074446:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940162176:0@lo:38:kworker.0
00000100:00080000:0.0:1767318041.074456:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318041.074459:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318041.074462:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940162432:0@lo:38:kworker.0
00000100:00100000:1.0:1767318041.581377:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318042.034761:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318042.605445:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318042.605495:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318042.605518:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940162560:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318042.605731:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318042.605872:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162560
00000100:00100000:3.0:1767318042.605881:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162560
00000100:00100000:3.0:1767318042.608595:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922
00000100:00100000:3.0:1767318042.608618:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940162560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318042.608655:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318042.608998:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940162560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 390us (3268us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318042.609006:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922
00000100:00100000:1.0:1767318042.614372:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940162560:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318043.053108:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318043.629068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318043.629201:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940162688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318043.629274:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318043.637326:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162688
00000100:00100000:2.0:1767318043.637346:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162688
00000100:00100000:2.0:1767318043.637451:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923
00000100:00100000:2.0:1767318043.637463:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940162688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318043.637501:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318043.637978:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940162688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 516us (8702us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318043.637986:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923
00000100:00100000:3.0:1767318043.638203:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940162688:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318043.639371:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318044.077282:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318044.653071:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318044.742031:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318044.742266:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239872
00000100:00100000:2.0:1767318044.742277:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239872
00000100:00100000:2.0:1767318044.742378:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3650
00000100:00100000:2.0:1767318044.742388:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894239872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318044.742467:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894239872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (450us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318044.742476:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3650
00000100:00080000:1.0:1767318044.742661:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318044.743358:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318044.745071:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894239744
00000100:00100000:2.0:1767318044.745085:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894239744
00000100:00100000:2.0:1767318044.745570:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15943
00000100:00100000:2.0:1767318044.745580:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894239744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318044.745614:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318044.745694:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894239744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 113us (2338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318044.745702:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15943
00010000:00010000:1.0:1767318045.101265:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318045.676916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318046.125042:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318046.189265:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318046.189276:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318046.189279:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318046.189283:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318046.189288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318046.189296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3291
00000100:00080000:0.0:1767318046.189302:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767318046.189310:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318046.189353:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e300 x1853163940162816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318046.189383:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318046.189387:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318046.189389:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318046.189392:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3291
00000100:00080000:0.0:1767318046.189395:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767318046.189398:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318046.189429:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2d80 x1853163940162944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318046.189634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940162816:0@lo:38:kworker.0
00000100:00100000:2.0:1767318046.189695:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318046.189724:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940163072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318046.189753:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940162944:0@lo:38:kworker.0
00000100:00100000:3.0:1767318046.189765:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318046.189810:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318046.189822:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318046.189845:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162816
00000100:00100000:2.0:1767318046.189852:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162816
00000100:00100000:2.0:1767318046.189895:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15944
00000100:00100000:2.0:1767318046.189902:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940162816:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318046.189922:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318046.189960:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940162816:12345-0@lo:38:kworker.0 Request processed in 58us (265us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318046.189967:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15944
00000100:00100000:3.0:1767318046.189987:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940163200:0@lo:400:kworker.0
00000100:00080000:2.0:1767318046.190010:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318046.190017:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318046.190019:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318046.190023:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940162816:0@lo:38:kworker.0
00000100:00100000:3.0:1767318046.190072:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163072
00000100:00100000:3.0:1767318046.190076:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163072
00000100:00100000:3.0:1767318046.190129:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163200
00000100:00100000:3.0:1767318046.190132:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163200
00000100:00080000:2.0:1767318046.190159:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318046.190159:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415
00000100:00080000:2.0:1767318046.190166:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318046.190170:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940163072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318046.190189:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416
00000100:00100000:2.0:1767318046.190200:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940163200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318046.190213:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940163072:12345-0@lo:400:kworker.0 Request processed in 45us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318046.190220:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415
00000100:00100000:2.0:1767318046.190240:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940163200:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318046.190248:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416
00000100:00100000:3.0:1767318046.190257:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940163200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318046.190291:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940162944
00000100:00100000:2.0:1767318046.190296:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940162944
00000100:00100000:2.0:1767318046.190318:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869
00000100:00100000:2.0:1767318046.190323:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940162944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318046.190333:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318046.190362:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940162944:12345-0@lo:38:kworker.0 Request processed in 38us (552us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318046.190368:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869
00000100:00080000:2.0:1767318046.190388:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318046.190393:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318046.190396:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940162944:0@lo:38:kworker.0
00000100:00080000:0.0:1767318046.190844:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318046.190849:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318046.190852:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318046.190856:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3291
00000100:00080000:0.0:1767318046.190860:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767318046.190864:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318046.190895:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940163456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318046.190920:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318046.190929:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318046.190931:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318046.190934:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3291
00000100:00080000:0.0:1767318046.190937:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318046.190940:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318046.190951:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470ff800 x1853163940163712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318046.190978:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940163456:0@lo:38:kworker.0
00000100:00100000:3.0:1767318046.190993:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940163072:0@lo:400:kworker.0
00000100:00100000:0.0:1767318046.191011:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318046.191026:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940163584:0@lo:400:kworker.0
00000100:00100000:0.0:1767318046.191034:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940163712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318046.191064:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318046.191103:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318046.191109:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940163328:0@lo:400:kworker.0
00000100:00100000:3.0:1767318046.191134:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318046.191585:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163456
00000100:00100000:0.0:1767318046.191592:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163456
00000100:00100000:0.0:1767318046.191628:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163584
00000100:00100000:0.0:1767318046.191642:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163584
00000100:00100000:0.0:1767318046.191678:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651
00000100:00100000:0.0:1767318046.191685:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940163584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318046.191723:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940163584:12345-0@lo:400:kworker.0 Request processed in 40us (661us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318046.191729:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651
00000100:00100000:0.0:1767318046.191742:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15945
00000100:00100000:0.0:1767318046.191745:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940163456:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318046.191759:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318046.191810:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940163456:12345-0@lo:38:kworker.0 Request processed in 63us (800us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318046.191816:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15945
00000100:00080000:0.0:1767318046.191829:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318046.195152:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163328
00000100:00100000:2.0:1767318046.195168:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163328
00000100:00100000:3.0:1767318046.195170:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940163584:0@lo:400:kworker.0
00000100:00080000:3.0:1767318046.195223:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318046.195410:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318046.202152:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318046.202166:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318046.202172:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940163456:0@lo:38:kworker.0
00000100:00100000:1.0:1767318046.205137:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163712
00000100:00100000:1.0:1767318046.205226:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163712
00000100:00100000:1.0:1767318046.205576:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652
00000100:00100000:1.0:1767318046.205595:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940163328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318046.205682:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940163328:12345-0@lo:400:kworker.0 Request processed in 96us (14546us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318046.205689:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652
00000100:00100000:1.0:1767318046.205709:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15946
00000100:00100000:1.0:1767318046.205713:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940163712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318046.205733:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318046.205806:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940163712:12345-0@lo:38:kworker.0 Request processed in 90us (10396us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318046.205830:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15946
00000100:00100000:2.0:1767318046.205857:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940163328:0@lo:400:kworker.0
00000100:00080000:1.0:1767318046.205870:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318046.205877:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318046.205881:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940163712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318046.700943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318047.153036:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318047.725115:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318047.725747:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318047.739332:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940163840:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318047.739416:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318047.739917:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163840
00000100:00100000:0.0:1767318047.739926:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163840
00000100:00100000:0.0:1767318047.739985:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924
00000100:00100000:0.0:1767318047.739994:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940163840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318047.740028:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318047.740100:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940163840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (682us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318047.740107:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924
00000100:00100000:1.0:1767318047.740262:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940163840:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318048.173263:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318048.748955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318048.749292:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940163968:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318048.749365:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318048.749520:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940163968
00000100:00100000:3.0:1767318048.749527:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940163968
00000100:00100000:3.0:1767318048.749583:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925
00000100:00100000:3.0:1767318048.749589:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940163968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318048.749614:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318048.749671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318048.750265:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940163968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 674us (898us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318048.750289:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925
00000100:00100000:1.0:1767318048.750456:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940163968:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318049.198384:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318049.774996:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318049.864886:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318049.865082:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240256
00000100:00100000:0.0:1767318049.865093:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240256
00000100:00100000:0.0:1767318049.865175:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3653
00000100:00100000:0.0:1767318049.865187:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894240256:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767318049.865347:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318049.865395:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894240256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 211us (517us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318049.865404:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3653
00000400:00000100:1.0:1767318049.881638:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894240000 offset 0 length 520: 4
00000100:00100000:1.0:1767318049.881753:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318049.884008:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240128
00000100:00100000:2.0:1767318049.884025:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240128
00000100:00100000:2.0:1767318049.885054:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15947
00000100:00100000:2.0:1767318049.885074:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894240128:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318049.885098:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318049.885175:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894240128:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 102us (3422us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318049.885183:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15947
00010000:00010000:1.0:1767318050.221099:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318050.797275:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318051.246025:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318051.309092:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318051.309109:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318051.309113:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318051.309118:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318051.309125:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318051.309135:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3296
00000100:00080000:3.0:1767318051.309143:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318051.309154:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318051.309217:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940164096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318051.309297:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940164096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.309393:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318051.309533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318051.309538:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318051.309540:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318051.309544:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3296
00000100:00080000:3.0:1767318051.309548:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318051.309553:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318051.309569:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d880 x1853163940164224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318051.309628:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164096
00000100:00100000:2.0:1767318051.309640:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164096
00000100:00100000:2.0:1767318051.309709:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15948
00000100:00100000:2.0:1767318051.309719:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940164096:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318051.309746:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318051.312083:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940164224:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.312182:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318051.312307:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164224
00000100:00100000:0.0:1767318051.312330:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164224
00000100:00100000:0.0:1767318051.312385:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870
00000100:00100000:0.0:1767318051.312393:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940164224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318051.312420:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318051.312467:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940164224:12345-0@lo:38:kworker.0 Request processed in 73us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318051.312476:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870
00000100:00100000:2.0:1767318051.312825:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940164096:12345-0@lo:38:kworker.0 Request processed in 3105us (3430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318051.312836:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15948
00000100:00080000:3.0:1767318051.313087:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318051.313092:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318051.313116:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318051.313122:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3296
00000100:00080000:3.0:1767318051.313128:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318051.313135:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318051.313158:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb800 x1853163940164736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318051.313179:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318051.313182:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318051.313184:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318051.313188:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3296
00000100:00080000:3.0:1767318051.313191:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318051.313195:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318051.313206:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940164992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318051.313240:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940164608:0@lo:400:kworker.0
00000100:00100000:3.0:1767318051.313286:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318051.313399:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940164480:0@lo:400:kworker.0
00000100:00100000:0.0:1767318051.313436:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318051.313476:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164480
00000100:00100000:0.0:1767318051.313481:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164480
00000100:00100000:2.0:1767318051.313559:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940164352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318051.313590:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318051.313617:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164352
00000100:00100000:2.0:1767318051.313621:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164352
00000100:00080000:1.0:1767318051.320609:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318051.320628:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318051.320635:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940164096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.320710:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940164736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.320847:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318051.321032:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164608
00000100:00100000:0.0:1767318051.321041:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164608
00000100:00100000:0.0:1767318051.321115:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164736
00000100:00100000:0.0:1767318051.321119:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164736
00000100:00100000:0.0:1767318051.321147:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654
00000100:00100000:0.0:1767318051.321160:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940164608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318051.321248:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940164608:12345-0@lo:400:kworker.0 Request processed in 90us (7960us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318051.321257:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654
00000100:00100000:0.0:1767318051.321279:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15949
00000100:00100000:0.0:1767318051.321283:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940164736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318051.321308:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318051.321354:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940164736:12345-0@lo:38:kworker.0 Request processed in 69us (507us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318051.321361:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15949
00000100:00080000:0.0:1767318051.321382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318051.321388:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318051.321392:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318051.321403:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417
00000100:00100000:0.0:1767318051.321411:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940164480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318051.321453:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940164480:12345-0@lo:400:kworker.0 Request processed in 43us (8016us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318051.321459:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417
00000100:00100000:3.0:1767318051.322013:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940164608:0@lo:400:kworker.0
00000100:00100000:3.0:1767318051.322036:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318051.322086:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940164864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318051.322121:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318051.322150:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164864
00000100:00100000:3.0:1767318051.322155:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164864
00000100:00100000:3.0:1767318051.322198:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655
00000100:00100000:3.0:1767318051.322206:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940164864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318051.322237:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940164864:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318051.322252:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655
00000100:00100000:3.0:1767318051.322294:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940164864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318051.324193:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940164480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318051.327019:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418
00000100:00100000:2.0:1767318051.327063:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940164352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318051.327216:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940164352:12345-0@lo:400:kworker.0 Request processed in 182us (13623us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318051.327225:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418
00000100:00100000:2.0:1767318051.327300:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940164352:0@lo:400:kworker.0
00000100:00080000:1.0:1767318051.333762:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318051.333797:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318051.333805:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940164736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.333822:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940164992:0@lo:38:kworker.0
00000100:00100000:1.0:1767318051.333928:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318051.333986:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318051.333991:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318051.333994:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940164224:0@lo:38:kworker.0
00000100:00080000:1.0:1767318051.334108:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318051.334383:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940164992
00000100:00100000:3.0:1767318051.334391:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940164992
00000100:00100000:3.0:1767318051.334441:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15950
00000100:00100000:3.0:1767318051.334450:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940164992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318051.334479:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318051.334543:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940164992:12345-0@lo:38:kworker.0 Request processed in 93us (615us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318051.334551:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15950
00000100:00080000:1.0:1767318051.334889:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318051.334894:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318051.334898:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940164992:0@lo:38:kworker.0
00000100:00100000:3.0:1767318051.821508:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318052.270719:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318052.844939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318052.845300:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318052.848003:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940165120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318052.848123:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318052.853277:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165120
00000100:00100000:0.0:1767318052.853302:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165120
00000100:00100000:0.0:1767318052.853490:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926
00000100:00100000:0.0:1767318052.853503:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940165120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318052.853559:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318052.853719:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940165120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 218us (5596us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318052.853730:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926
00000100:00100000:3.0:1767318052.854480:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940165120:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318053.293568:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318053.871203:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318053.871803:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940165248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318053.871899:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318053.872083:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165248
00000100:00100000:0.0:1767318053.872094:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165248
00000100:00100000:0.0:1767318053.872182:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927
00000100:00100000:0.0:1767318053.872193:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940165248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318053.872249:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318053.872312:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940165248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (412us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318053.872319:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927
00000100:00080000:1.0:1767318053.872597:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318053.872657:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940165248:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318054.317076:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318054.892933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318054.984569:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318054.985006:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318054.985410:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240512
00000100:00100000:1.0:1767318054.985424:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240512
00000100:00080000:0.0:1767318054.985503:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318054.985517:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240384
00000100:00100000:1.0:1767318054.985521:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240384
00000100:00100000:1.0:1767318054.985555:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3656
00000100:00100000:1.0:1767318054.985567:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894240512:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318054.985633:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15951
00000100:00100000:0.0:1767318054.985640:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894240384:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318054.985665:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318054.985680:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894240512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 116us (1130us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318054.985689:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3656
00000100:00100000:0.0:1767318054.985696:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894240384:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (692us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318054.985702:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15951
00010000:00010000:1.0:1767318055.342409:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318055.471508:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318030/real 1767318030]  req@ffff93d04760dc00 x1853163940159872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318055.471564:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04760dc00 x1853163940159872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318055.471593:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318055.471630:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318055.471635:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940159872:0@lo:250:kworker.0
00000100:00080000:3.0:1767318055.471901:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318055.471908:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318055.471934:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318055.471940:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3280
00000100:00080000:3.0:1767318055.471945:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318055.471953:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318055.471998:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940165376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318055.472057:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318055.472061:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318055.472064:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318055.472069:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3301
00000100:00080000:3.0:1767318055.472072:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767318055.472077:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318055.472106:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb800 x1853163940165504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318055.472117:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318055.472120:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318055.472122:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318055.472126:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3301
00000100:00080000:3.0:1767318055.472129:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767318055.472133:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318055.472150:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b100 x1853163940165632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318055.472245:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318055.472331:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940165376:0@lo:250:kworker.0
00000400:00000100:1.0:1767318055.472402:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940165376 offset 0 length 520: 4
00000100:00100000:1.0:1767318055.472457:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940165504:0@lo:38:kworker.0
00000100:00100000:1.0:1767318055.472493:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318055.472533:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940165632:0@lo:38:kworker.0
00000100:00100000:1.0:1767318055.472559:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318055.472626:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165632
00000100:00100000:1.0:1767318055.472635:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165632
00000100:00100000:1.0:1767318055.472682:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871
00000100:00100000:1.0:1767318055.472691:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940165632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318055.472716:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318055.472765:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940165632:12345-0@lo:38:kworker.0 Request processed in 73us (202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318055.472806:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871
00000100:00080000:1.0:1767318055.472851:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318055.472855:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318055.472859:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940165632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318055.473192:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318055.473206:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940165888:0@lo:400:kworker.0
00000100:00100000:2.0:1767318055.473247:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318055.473301:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165504
00000100:00100000:2.0:1767318055.473306:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165504
00000100:00100000:2.0:1767318055.473334:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15952
00000100:00100000:2.0:1767318055.473339:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940165504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318055.473351:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318055.473384:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940165504:12345-0@lo:38:kworker.0 Request processed in 43us (890us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318055.473389:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15952
00000100:00080000:1.0:1767318055.474279:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318055.474288:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318055.474292:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940165504:0@lo:38:kworker.0
00000100:00100000:1.0:1767318055.474338:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165888
00000100:00100000:1.0:1767318055.474345:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165888
00000100:00100000:1.0:1767318055.474431:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419
00000100:00100000:1.0:1767318055.474441:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940165888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318055.474531:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940165888:12345-0@lo:400:kworker.0 Request processed in 79us (1270us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318055.474539:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419
00000100:00100000:1.0:1767318055.474583:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940165888:0@lo:400:kworker.0
00000100:00080000:2.0:1767318055.474806:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318055.476973:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940165760:0@lo:400:kworker.0
00000100:00100000:0.0:1767318055.477700:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318055.477961:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940165760
00000100:00100000:1.0:1767318055.477973:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940165760
00000100:00100000:1.0:1767318055.478132:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420
00000100:00100000:1.0:1767318055.478145:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940165760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318055.478228:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940165760:12345-0@lo:400:kworker.0 Request processed in 86us (533us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318055.478237:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420
00000100:00080000:3.0:1767318055.479573:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318055.479580:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318055.479584:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318055.479611:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3301
00000100:00080000:3.0:1767318055.479619:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767318055.479626:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318055.479652:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88a80 x1853163940166144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318055.479683:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318055.479687:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318055.479689:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318055.479693:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3301
00000100:00080000:3.0:1767318055.479695:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318055.479699:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318055.479709:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89f80 x1853163940166400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318055.479794:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940166016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318055.479867:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318055.479912:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318055.479918:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940166272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318055.479941:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318055.479976:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166016
00000100:00100000:3.0:1767318055.479984:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166016
00000100:00100000:0.0:1767318055.480135:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940165760:0@lo:400:kworker.0
00000100:00100000:0.0:1767318055.480180:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166272
00000100:00100000:0.0:1767318055.480184:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166272
00000100:00100000:1.0:1767318055.480240:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940166144:0@lo:38:kworker.0
00000100:00100000:1.0:1767318055.480272:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318055.480297:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940166400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318055.480946:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318055.480997:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166144
00000100:00100000:1.0:1767318055.481002:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166144
00000100:00100000:1.0:1767318055.481055:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166400
00000100:00100000:1.0:1767318055.481075:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166400
00000100:00100000:1.0:1767318055.481113:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15953
00000100:00100000:1.0:1767318055.481121:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940166144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318055.481148:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318055.481196:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940166144:12345-0@lo:38:kworker.0 Request processed in 74us (922us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318055.481202:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15953
00000100:00100000:1.0:1767318055.481220:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15954
00000100:00100000:1.0:1767318055.481224:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940166400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318055.481234:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318055.481254:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940166400:12345-0@lo:38:kworker.0 Request processed in 28us (311us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318055.481260:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15954
00000100:00080000:1.0:1767318055.481297:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318055.481302:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318055.481320:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940166144:0@lo:38:kworker.0
00000100:00080000:1.0:1767318055.481330:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318055.481333:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318055.481335:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940166400:0@lo:38:kworker.0
00000100:00080000:2.0:1767318055.482576:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318055.482590:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318055.482886:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657
00000100:00100000:3.0:1767318055.482917:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940166016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318055.483037:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940166016:12345-0@lo:400:kworker.0 Request processed in 141us (3169us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318055.483044:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657
00000100:00100000:3.0:1767318055.483139:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940166016:0@lo:400:kworker.0
00000100:00100000:0.0:1767318055.483693:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658
00000100:00100000:0.0:1767318055.483704:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940166272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318055.483793:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940166272:12345-0@lo:400:kworker.0 Request processed in 90us (3849us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318055.483800:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658
00000100:00100000:3.0:1767318055.483878:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940166272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318055.917308:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318056.365808:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318056.941790:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318057.394524:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318057.965958:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940166528:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318057.966091:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318057.966331:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318057.966534:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166528
00000100:00100000:0.0:1767318057.966545:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166528
00000100:00100000:0.0:1767318057.966637:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928
00000100:00100000:0.0:1767318057.966648:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940166528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318057.966686:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318057.966752:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940166528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (661us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318057.966760:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928
00000100:00100000:0.0:1767318057.966840:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940166528:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318057.966908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318058.414501:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318058.988971:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318058.989056:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318058.989082:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940166656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318058.989483:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318058.989535:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166656
00000100:00100000:1.0:1767318058.989547:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166656
00000100:00100000:1.0:1767318058.989624:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929
00000100:00100000:1.0:1767318058.989657:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940166656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318058.989699:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318058.989765:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940166656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318058.989800:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929
00000100:00100000:3.0:1767318058.990222:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940166656:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318058.991309:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318059.438560:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318060.014845:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318060.102682:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318060.103281:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318060.103363:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240768
00000100:00100000:0.0:1767318060.103376:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240768
00000100:00100000:0.0:1767318060.103464:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240640
00000100:00100000:0.0:1767318060.103467:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240640
00000100:00100000:0.0:1767318060.103492:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3659
00000100:00100000:0.0:1767318060.103503:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894240768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318060.103604:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894240768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (937us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318060.103613:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3659
00000100:00100000:0.0:1767318060.103636:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15955
00000100:00100000:0.0:1767318060.103641:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894240640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318060.103688:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318060.103721:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894240640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 78us (982us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318060.103728:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15955
00000100:00080000:2.0:1767318060.106275:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318060.462258:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318060.526180:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318060.526192:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318060.526196:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318060.526200:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318060.526206:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318060.526215:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3305
00000100:00080000:2.0:1767318060.526230:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318060.526242:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318060.526298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3100 x1853163940166784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318060.526356:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318060.526360:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318060.526362:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318060.526366:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3305
00000100:00080000:2.0:1767318060.526368:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318060.526372:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318060.526389:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2d80 x1853163940166912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318060.526440:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318060.526443:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318060.526445:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318060.526448:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3305
00000100:00080000:2.0:1767318060.526450:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318060.526454:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318060.526473:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3480 x1853163940167424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318060.526488:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318060.526491:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318060.526493:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318060.526496:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3305
00000100:00080000:2.0:1767318060.526498:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318060.526502:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318060.526514:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940167680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318060.526553:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940167552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318060.526646:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318060.526728:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318060.526734:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940167296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318060.526755:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318060.527275:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167552
00000100:00100000:1.0:1767318060.527287:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167552
00000100:00100000:3.0:1767318060.527326:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940166784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318060.527368:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318060.527398:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940166912:0@lo:38:kworker.0
00000100:00100000:3.0:1767318060.527427:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318060.527434:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167296
00000100:00100000:1.0:1767318060.527438:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167296
00000100:00100000:3.0:1767318060.527446:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940167424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318060.527462:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166784
00000100:00100000:1.0:1767318060.527465:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166784
00000100:00100000:3.0:1767318060.527479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318060.527482:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167424
00000100:00100000:1.0:1767318060.527484:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167424
00000100:00100000:3.0:1767318060.527491:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940167680:0@lo:38:kworker.0
00000100:00100000:3.0:1767318060.527512:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318060.527545:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940166912
00000100:00100000:3.0:1767318060.527549:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940166912
00000100:00100000:3.0:1767318060.527578:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872
00000100:00100000:3.0:1767318060.527586:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940166912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318060.527611:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318060.527671:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940166912:12345-0@lo:38:kworker.0 Request processed in 84us (242us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318060.527680:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872
00000100:00100000:3.0:1767318060.527712:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167040:0@lo:400:kworker.0
00000100:00100000:0.0:1767318060.527715:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940167168:0@lo:400:kworker.0
00000100:00100000:1.0:1767318060.527765:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167680
00000100:00100000:1.0:1767318060.527768:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167680
00000100:00100000:1.0:1767318060.527798:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660
00000100:00100000:1.0:1767318060.527806:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940167552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318060.528283:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661
00000100:00100000:2.0:1767318060.528294:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940167296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318060.531250:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318060.531396:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167168
00000100:00100000:0.0:1767318060.531410:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167168
00000100:00100000:0.0:1767318060.531484:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421
00000100:00100000:0.0:1767318060.531496:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940167168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318060.531582:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940167168:12345-0@lo:400:kworker.0 Request processed in 86us (343us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318060.531591:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421
00000100:00100000:0.0:1767318060.531682:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940167168:0@lo:400:kworker.0
00000100:00100000:0.0:1767318060.532148:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15956
00000100:00100000:0.0:1767318060.532156:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940166784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318060.532188:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318060.532247:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940166784:12345-0@lo:38:kworker.0 Request processed in 90us (4878us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318060.532256:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15956
00000100:00100000:0.0:1767318060.532280:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15957
00000100:00100000:0.0:1767318060.532285:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940167424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318060.532298:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318060.532329:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940167424:12345-0@lo:38:kworker.0 Request processed in 43us (4849us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318060.532356:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15957
00000100:00100000:0.0:1767318060.532370:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15958
00000100:00100000:0.0:1767318060.532375:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940167680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318060.532386:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318060.532414:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940167680:12345-0@lo:38:kworker.0 Request processed in 37us (4900us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318060.532424:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15958
00000100:00080000:0.0:1767318060.532484:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318060.532491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318060.532577:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318060.532583:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318060.532588:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940166784:0@lo:38:kworker.0
00000100:00080000:0.0:1767318060.532604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318060.532608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318060.532614:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940166912:0@lo:38:kworker.0
00000100:00080000:0.0:1767318060.532623:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318060.532627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318060.532632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940167424:0@lo:38:kworker.0
00000100:00080000:0.0:1767318060.532643:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318060.532646:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318060.532652:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940167680:0@lo:38:kworker.0
00000100:00100000:1.0:1767318060.533645:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940167552:12345-0@lo:400:kworker.0 Request processed in 5831us (6989us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318060.533659:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660
00000100:00100000:0.0:1767318060.533875:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940167552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318060.534860:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940167296:12345-0@lo:400:kworker.0 Request processed in 6556us (8090us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318060.534873:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661
00000100:00100000:0.0:1767318060.535144:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940167296:0@lo:400:kworker.0
00000100:00100000:3.0:1767318060.541397:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318060.541575:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167040
00000100:00100000:0.0:1767318060.541588:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167040
00000100:00100000:0.0:1767318060.541746:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422
00000100:00100000:0.0:1767318060.541758:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318060.541890:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167040:12345-0@lo:400:kworker.0 Request processed in 134us (503us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318060.541898:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422
00000100:00100000:3.0:1767318060.542012:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167040:0@lo:400:kworker.0
00000100:00080000:2.0:1767318060.542200:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318061.037206:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318061.485143:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318062.060940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318062.509148:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318063.084901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318063.085153:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318063.085242:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318063.085371:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167808
00000100:00100000:0.0:1767318063.085379:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167808
00000100:00100000:0.0:1767318063.085449:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930
00000100:00100000:0.0:1767318063.085458:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318063.085487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318063.085532:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318063.085549:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930
00000100:00100000:3.0:1767318063.085863:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167808:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318063.086361:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318063.533028:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318064.109111:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318064.109134:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318064.109208:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318064.109276:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940167936
00000100:00100000:0.0:1767318064.109284:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940167936
00000100:00100000:0.0:1767318064.109333:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931
00000100:00100000:0.0:1767318064.109341:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318064.109372:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318064.109431:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940167936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318064.109453:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931
00000100:00080000:0.0:1767318064.109671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318064.109707:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940167936:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318064.110593:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318064.557833:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318065.136715:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318065.223816:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318065.223862:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318065.223994:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241024
00000100:00100000:2.0:1767318065.224005:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241024
00000100:00100000:1.0:1767318065.224013:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894240896
00000100:00100000:1.0:1767318065.224017:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894240896
00000100:00100000:1.0:1767318065.224055:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15959
00000100:00100000:1.0:1767318065.224063:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894240896:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:3.0:1767318065.224091:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767318065.224092:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318065.224174:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894240896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 110us (311us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318065.224947:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3662
00000100:00100000:0.0:1767318065.224960:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894241024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318065.225020:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894241024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 64us (1249us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318065.225027:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3662
00000100:00100000:1.0:1767318065.227581:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15959
00010000:00010000:1.0:1767318065.581037:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318065.645103:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318065.645113:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318065.645116:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318065.645121:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318065.645125:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318065.645133:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3310
00000100:00080000:1.0:1767318065.645137:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318065.645143:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318065.645183:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940168064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318065.645212:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318065.645216:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318065.645218:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318065.645222:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3310
00000100:00080000:1.0:1767318065.645225:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318065.645228:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318065.645247:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940168192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318065.645317:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318065.645320:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318065.645335:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318065.645338:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3310
00000100:00080000:1.0:1767318065.645340:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318065.645344:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318065.645356:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abce00 x1853163940168704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318065.645370:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318065.645373:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318065.645374:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318065.645377:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3310
00000100:00080000:1.0:1767318065.645379:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318065.645382:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318065.645390:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abca80 x1853163940168960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318065.645796:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940168320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318065.645865:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.645874:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940168832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.645905:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318065.645931:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318065.645933:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318065.645937:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940168448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.645937:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940168576:0@lo:400:kworker.0
00000100:00100000:2.0:1767318065.645959:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.645959:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.645993:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940168064:0@lo:38:kworker.0
00000100:00100000:3.0:1767318065.646018:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.646037:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940168192:0@lo:38:kworker.0
00000100:00100000:3.0:1767318065.646069:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.646087:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940168704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318065.646118:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.646133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940168960:0@lo:38:kworker.0
00000100:00100000:3.0:1767318065.646159:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318065.646190:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168832
00000100:00100000:3.0:1767318065.646198:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168832
00000100:00100000:3.0:1767318065.646250:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168576
00000100:00100000:3.0:1767318065.646252:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168576
00000100:00100000:3.0:1767318065.646266:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168064
00000100:00100000:3.0:1767318065.646268:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168064
00000100:00100000:3.0:1767318065.646276:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168704
00000100:00100000:3.0:1767318065.646278:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168704
00000100:00100000:3.0:1767318065.646285:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168960
00000100:00100000:3.0:1767318065.646287:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168960
00000100:00100000:3.0:1767318065.646297:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663
00000100:00100000:3.0:1767318065.646305:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940168832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.646355:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940168832:12345-0@lo:400:kworker.0 Request processed in 50us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318065.646363:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663
00000100:00100000:3.0:1767318065.646395:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664
00000100:00100000:3.0:1767318065.646403:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940168576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.646429:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940168576:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318065.646434:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664
00000100:00100000:3.0:1767318065.646449:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15960
00000100:00100000:3.0:1767318065.646453:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318065.646471:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318065.646502:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168064:12345-0@lo:38:kworker.0 Request processed in 46us (483us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318065.646518:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15960
00000100:00100000:3.0:1767318065.646532:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15961
00000100:00100000:3.0:1767318065.646536:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318065.646545:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318065.646569:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168704:12345-0@lo:38:kworker.0 Request processed in 31us (450us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318065.646574:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15961
00000100:00100000:3.0:1767318065.646584:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15962
00000100:00100000:3.0:1767318065.646588:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318065.646597:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318065.646617:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940168960:12345-0@lo:38:kworker.0 Request processed in 28us (466us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318065.646622:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15962
00000100:00100000:3.0:1767318065.646639:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168192
00000100:00100000:3.0:1767318065.646642:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168192
00000100:00100000:3.0:1767318065.646662:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873
00000100:00100000:3.0:1767318065.646666:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940168192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318065.646675:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318065.646698:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940168192:12345-0@lo:38:kworker.0 Request processed in 31us (639us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318065.646703:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873
00000100:00080000:3.0:1767318065.646719:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318065.646748:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940168576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.646760:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940168832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318065.646795:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168320
00000100:00100000:1.0:1767318065.646799:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168320
00000100:00080000:3.0:1767318065.646815:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318065.646820:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318065.646823:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940168064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318065.646831:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940168448
00000100:00080000:3.0:1767318065.646831:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318065.646833:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940168448
00000100:00080000:3.0:1767318065.646834:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318065.646836:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940168192:0@lo:38:kworker.0
00000100:00080000:3.0:1767318065.646844:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318065.646847:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318065.646849:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940168704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318065.646851:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423
00000100:00100000:1.0:1767318065.646856:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940168320:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318065.646856:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318065.646859:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318065.646861:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940168960:0@lo:38:kworker.0
00000100:00100000:1.0:1767318065.646892:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940168320:12345-0@lo:400:kworker.0 Request processed in 36us (1027us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318065.646894:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424
00000100:00100000:1.0:1767318065.646899:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423
00000100:00100000:3.0:1767318065.646901:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940168448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318065.646946:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940168448:12345-0@lo:400:kworker.0 Request processed in 45us (986us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318065.646951:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424
00000100:00080000:3.0:1767318065.646984:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318065.647302:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940168448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318065.647314:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940168320:0@lo:400:kworker.0
00000100:00100000:1.0:1767318066.156906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318066.610141:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318067.180940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318067.629174:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318068.204908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318068.205038:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318068.205070:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940169088:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318068.205134:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318068.205425:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169088
00000100:00100000:0.0:1767318068.205434:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169088
00000100:00100000:0.0:1767318068.205506:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932
00000100:00100000:0.0:1767318068.205516:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940169088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318068.205548:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318068.205606:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940169088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (471us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318068.205613:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932
00000100:00080000:3.0:1767318068.205671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318068.205750:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940169088:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318068.653550:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318069.230119:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318069.231027:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940169216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318069.231112:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318069.231425:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169216
00000100:00100000:0.0:1767318069.231433:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169216
00000100:00100000:0.0:1767318069.231493:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933
00000100:00100000:0.0:1767318069.231502:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940169216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318069.231545:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318069.231592:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940169216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (480us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318069.231600:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933
00000100:00100000:1.0:1767318069.231921:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940169216:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318069.238987:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318069.678297:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318070.253082:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318070.342896:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318070.342972:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318070.343082:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241280
00000100:00100000:0.0:1767318070.343093:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241280
00000100:00100000:1.0:1767318070.343107:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241152
00000100:00100000:1.0:1767318070.343113:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241152
00000100:00100000:1.0:1767318070.343169:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3665
00000100:00080000:3.0:1767318070.343175:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318070.343182:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894241280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318070.343265:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894241280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (378us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318070.343273:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3665
00000100:00100000:1.0:1767318070.343291:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15963
00000100:00100000:1.0:1767318070.343295:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894241152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318070.343316:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318070.343341:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894241152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (369us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318070.343348:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15963
00010000:00010000:1.0:1767318070.701029:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318070.765420:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318070.765431:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318070.765451:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318070.765455:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318070.765459:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318070.765467:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3315
00000100:00080000:1.0:1767318070.765472:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318070.765480:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318070.765520:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abe680 x1853163940169344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318070.765551:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318070.765555:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318070.765556:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318070.765561:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3315
00000100:00080000:1.0:1767318070.765563:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318070.765567:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318070.765582:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf480 x1853163940169472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318070.765643:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318070.765646:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318070.765648:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318070.765652:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3315
00000100:00080000:1.0:1767318070.765655:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318070.765661:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318070.765662:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940169344:0@lo:38:kworker.0
00000100:00100000:1.0:1767318070.765674:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abfb80 x1853163940169984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318070.765714:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318070.765718:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318070.765720:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318070.765724:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3315
00000100:00080000:1.0:1767318070.765727:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318070.765731:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318070.765738:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318070.765745:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8000 x1853163940170240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318070.765769:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940169856:0@lo:400:kworker.0
00000100:00100000:0.0:1767318070.765817:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940169472:0@lo:38:kworker.0
00000100:00100000:1.0:1767318070.765827:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318070.765855:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318070.765855:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318070.765863:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940170112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318070.765890:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940169984:0@lo:38:kworker.0
00000100:00100000:1.0:1767318070.765903:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318070.765929:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169344
00000100:00100000:0.0:1767318070.765937:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169344
00000100:00100000:1.0:1767318070.765949:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169856
00000100:00100000:1.0:1767318070.765956:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169856
00000100:00100000:0.0:1767318070.765971:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170112
00000100:00100000:0.0:1767318070.765975:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170112
00000100:00100000:1.0:1767318070.766006:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666
00000100:00100000:1.0:1767318070.766016:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940169856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318070.766046:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940169600:0@lo:400:kworker.0
00000100:00100000:1.0:1767318070.766067:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940169856:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318070.766083:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318070.766114:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318070.766121:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940169728:0@lo:400:kworker.0
00000100:00100000:2.0:1767318070.766145:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318070.766154:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318070.766177:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169600
00000100:00100000:3.0:1767318070.766187:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169600
00000100:00100000:3.0:1767318070.766229:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169728
00000100:00100000:3.0:1767318070.766233:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169728
00000100:00100000:3.0:1767318070.766255:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425
00000100:00100000:3.0:1767318070.766261:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940169600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318070.766300:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940169600:12345-0@lo:400:kworker.0 Request processed in 40us (218us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318070.766307:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425
00000100:00100000:3.0:1767318070.766328:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426
00000100:00100000:3.0:1767318070.766334:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940169728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318070.766360:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940169728:12345-0@lo:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318070.766365:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426
00000100:00080000:3.0:1767318070.766382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318070.766407:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940169728:0@lo:400:kworker.0
00000100:00100000:3.0:1767318070.766416:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940169600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318070.766487:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169472
00000100:00100000:3.0:1767318070.766491:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169472
00000100:00100000:3.0:1767318070.766512:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874
00000100:00100000:3.0:1767318070.766516:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940169472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318070.766534:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318070.766563:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940169472:12345-0@lo:38:kworker.0 Request processed in 46us (710us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318070.766568:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874
00000100:00100000:0.0:1767318070.769108:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667
00000100:00100000:0.0:1767318070.769137:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940170112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318070.769227:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940170112:12345-0@lo:400:kworker.0 Request processed in 105us (3323us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318070.769235:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667
00000100:00100000:0.0:1767318070.769268:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15964
00000100:00100000:0.0:1767318070.769273:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940169344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318070.769292:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318070.769322:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940169344:12345-0@lo:38:kworker.0 Request processed in 47us (3585us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318070.769343:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15964
00000100:00100000:0.0:1767318070.769390:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318070.769444:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940170240:0@lo:38:kworker.0
00000100:00100000:0.0:1767318070.769478:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318070.769520:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318070.769526:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318070.769530:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940169344:0@lo:38:kworker.0
00000100:00080000:0.0:1767318070.769544:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318070.769768:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318070.769790:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940169472:0@lo:38:kworker.0
00000100:00100000:0.0:1767318070.769831:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940169984
00000100:00100000:0.0:1767318070.769836:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940169984
00000100:00100000:0.0:1767318070.769861:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170240
00000100:00100000:0.0:1767318070.769864:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170240
00000100:00100000:0.0:1767318070.769887:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15965
00000100:00100000:0.0:1767318070.769891:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940169984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318070.769903:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318070.769935:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940169984:12345-0@lo:38:kworker.0 Request processed in 42us (545us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318070.769941:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15965
00000100:00100000:0.0:1767318070.769953:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15966
00000100:00100000:0.0:1767318070.769957:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940170240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318070.769965:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318070.769986:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940170240:12345-0@lo:38:kworker.0 Request processed in 27us (508us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318070.769999:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15966
00000100:00080000:0.0:1767318070.770026:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318070.770030:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318070.770034:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940169984:0@lo:38:kworker.0
00000100:00080000:0.0:1767318070.770041:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318070.770044:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318070.770046:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940170240:0@lo:38:kworker.0
00000100:00100000:0.0:1767318070.770098:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940170112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318070.770111:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940169856:0@lo:400:kworker.0
00000100:00100000:1.0:1767318070.778887:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666
00000100:00100000:1.0:1767318071.276959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318071.725180:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318072.301811:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318072.749803:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318073.325033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318073.326936:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318073.326959:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940170368:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318073.327043:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318073.328060:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170368
00000100:00100000:0.0:1767318073.328071:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170368
00000100:00080000:3.0:1767318073.328188:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318073.328247:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934
00000100:00100000:0.0:1767318073.328258:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940170368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318073.328290:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318073.328357:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940170368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1316us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318073.328365:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934
00000100:00100000:3.0:1767318073.328510:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940170368:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318073.774449:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318074.351282:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318074.351593:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940170496:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318074.351668:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318074.352084:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170496
00000100:00100000:1.0:1767318074.352093:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170496
00000100:00100000:1.0:1767318074.352179:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935
00000100:00100000:1.0:1767318074.352188:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940170496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318074.352519:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318074.352585:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940170496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 398us (917us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318074.352592:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935
00000100:00100000:0.0:1767318074.352647:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940170496:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318074.353054:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318074.439425:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318074.439471:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894241408 offset 0 length 520: 4
00000100:00100000:3.0:1767318074.439492:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318074.439802:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241664
00000100:00100000:2.0:1767318074.439829:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241664
00000100:00100000:2.0:1767318074.439902:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241536
00000100:00100000:2.0:1767318074.439906:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241536
00000100:00100000:2.0:1767318074.439934:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3668
00000100:00100000:2.0:1767318074.439946:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894241664:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318074.440023:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894241664:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (620us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318074.440031:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3668
00000100:00100000:2.0:1767318074.440050:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15967
00000100:00100000:2.0:1767318074.440055:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894241536:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318074.440075:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318074.440100:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894241536:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (607us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318074.440107:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15967
00000100:00080000:3.0:1767318074.440915:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318074.797028:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318075.372934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318075.821154:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318075.884956:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318075.884966:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318075.884969:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318075.884972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318075.884977:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318075.884985:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3320
00000100:00080000:2.0:1767318075.884989:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318075.884996:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318075.885034:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5500 x1853163940170624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318075.885049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318075.885066:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318075.885069:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318075.885072:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3320
00000100:00080000:2.0:1767318075.885075:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318075.885078:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318075.885092:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4000 x1853163940170752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318075.885166:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940170880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318075.885226:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318075.885347:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170880
00000100:00100000:3.0:1767318075.885357:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170880
00000100:00100000:3.0:1767318075.885428:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427
00000100:00100000:3.0:1767318075.885439:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940170880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318075.885561:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940170624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318075.885600:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318075.885628:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940170752:0@lo:38:kworker.0
00000100:00100000:0.0:1767318075.885665:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318075.885730:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170624
00000100:00100000:0.0:1767318075.885733:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170624
00000100:00100000:0.0:1767318075.885755:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15968
00000100:00100000:0.0:1767318075.885759:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940170624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318075.885803:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318075.885847:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940170624:12345-0@lo:38:kworker.0 Request processed in 85us (246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318075.885858:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15968
00000100:00080000:0.0:1767318075.885894:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318075.885899:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318075.885902:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940170624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318075.885947:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940170752
00000100:00100000:0.0:1767318075.885951:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940170752
00000100:00100000:0.0:1767318075.885970:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875
00000100:00100000:0.0:1767318075.885974:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940170752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318075.885984:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318075.886019:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940170752:12345-0@lo:38:kworker.0 Request processed in 44us (354us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318075.886026:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875
00000100:00080000:0.0:1767318075.886044:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318075.886059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318075.886063:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318075.886066:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940170752:0@lo:38:kworker.0
00000100:00100000:0.0:1767318075.886091:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940171008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318075.886124:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318075.886146:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940170880:12345-0@lo:400:kworker.0 Request processed in 710us (919us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318075.886153:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427
00000100:00100000:0.0:1767318075.886154:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171008
00000100:00100000:0.0:1767318075.886157:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171008
00000100:00100000:3.0:1767318075.886183:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428
00000100:00100000:3.0:1767318075.886195:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940171008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318075.886240:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940171008:12345-0@lo:400:kworker.0 Request processed in 50us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318075.886412:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940170880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318075.886445:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940171008:0@lo:400:kworker.0
00000100:00080000:2.0:1767318075.886512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318075.886516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318075.886518:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318075.886522:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3320
00000100:00080000:2.0:1767318075.886525:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318075.886529:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318075.886544:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6680 x1853163940171264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318075.886566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318075.886569:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318075.886571:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318075.886574:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3320
00000100:00080000:2.0:1767318075.886576:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318075.886579:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318075.886589:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5880 x1853163940171520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318075.886619:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940171136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318075.886651:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318075.886673:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318075.886678:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940171392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318075.886697:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318075.886721:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171136
00000100:00100000:2.0:1767318075.886725:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171136
00000100:00100000:2.0:1767318075.886765:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171392
00000100:00100000:2.0:1767318075.886768:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171392
00000100:00100000:2.0:1767318075.886804:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669
00000100:00100000:2.0:1767318075.886810:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940171136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318075.886852:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940171136:12345-0@lo:400:kworker.0 Request processed in 42us (200us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318075.886857:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669
00000100:00100000:2.0:1767318075.886869:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670
00000100:00100000:2.0:1767318075.886875:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940171392:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318075.886903:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940171392:12345-0@lo:400:kworker.0 Request processed in 28us (205us total) trans 0 rc 0/0
00000100:00080000:0.0:1767318075.887047:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318075.887058:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940171264:0@lo:38:kworker.0
00000100:00100000:2.0:1767318075.887058:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670
00000100:00100000:0.0:1767318075.887083:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318075.887111:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428
00000100:00100000:1.0:1767318075.888562:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940171392:0@lo:400:kworker.0
00000100:00100000:1.0:1767318075.888571:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940171136:0@lo:400:kworker.0
00000100:00100000:0.0:1767318075.888767:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940171520:0@lo:38:kworker.0
00000100:00100000:1.0:1767318075.889140:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171264
00000100:00100000:1.0:1767318075.889146:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171264
00000100:00100000:0.0:1767318075.889157:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318075.889179:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171520
00000100:00100000:1.0:1767318075.889182:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171520
00000100:00100000:1.0:1767318075.889403:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15969
00000100:00100000:1.0:1767318075.889409:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940171264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318075.889430:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318075.889484:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940171264:12345-0@lo:38:kworker.0 Request processed in 73us (2399us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318075.889490:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15969
00000100:00100000:1.0:1767318075.889506:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15970
00000100:00100000:1.0:1767318075.889509:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940171520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318075.889519:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318075.889541:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940171520:12345-0@lo:38:kworker.0 Request processed in 30us (384us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318075.889547:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15970
00000100:00080000:0.0:1767318075.889566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318075.889572:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318075.889575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940171264:0@lo:38:kworker.0
00000100:00080000:0.0:1767318075.889583:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318075.889586:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318075.889589:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940171520:0@lo:38:kworker.0
00000100:00100000:1.0:1767318076.397264:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318076.845115:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318077.420943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318077.869441:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318078.445222:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318078.445961:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940171648:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318078.446031:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318078.446192:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171648
00000100:00100000:0.0:1767318078.446203:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171648
00000100:00100000:0.0:1767318078.446265:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936
00000100:00100000:0.0:1767318078.446277:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940171648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318078.446309:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318078.446362:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940171648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318078.446370:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936
00000100:00080000:0.0:1767318078.446395:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318078.446448:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940171648:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318078.894513:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318079.468906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318079.470583:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318079.470603:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940171776:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318079.470682:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318079.471022:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940171776
00000100:00100000:0.0:1767318079.471041:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940171776
00000100:00100000:0.0:1767318079.471112:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937
00000100:00100000:0.0:1767318079.471122:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940171776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318079.471151:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318079.471215:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940171776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (532us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318079.471222:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937
00000100:00080000:1.0:1767318079.471282:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318079.471671:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940171776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318079.558142:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318079.558226:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241792
00000100:00100000:0.0:1767318079.558237:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241792
00000100:00100000:3.0:1767318079.558237:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318079.558284:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894241920
00000100:00100000:0.0:1767318079.558287:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894241920
00000100:00100000:0.0:1767318079.558345:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3671
00000100:00100000:0.0:1767318079.558355:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894241920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318079.558376:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15971
00000100:00100000:2.0:1767318079.558385:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894241792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318079.558422:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318079.558429:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894241920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (189us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318079.558438:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3671
00000100:00100000:2.0:1767318079.558459:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894241792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 72us (324us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318079.558469:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15971
00000100:00080000:3.0:1767318079.559942:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318079.917344:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318080.496075:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318080.941508:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318081.005472:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318055/real 1767318055]  req@ffff93d0737fb100 x1853163940165376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318081.005507:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0737fb100 x1853163940165376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318081.005527:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318081.005536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318081.005540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940165376:0@lo:250:kworker.0
00000100:00080000:3.0:1767318081.005628:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318081.005633:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318081.005652:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318081.005657:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3305
00000100:00080000:3.0:1767318081.005661:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318081.005667:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318081.005694:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc000 x1853163940171904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318081.005720:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318081.005723:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318081.005725:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318081.005728:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3325
00000100:00080000:3.0:1767318081.005730:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318081.005733:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318081.005755:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940172032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318081.005800:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318081.005804:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318081.005805:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318081.005808:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3325
00000100:00080000:3.0:1767318081.005811:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318081.005814:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318081.005827:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abd500 x1853163940172160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318081.005900:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940172288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318081.005962:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.006063:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940171904:0@lo:250:kworker.0
00000400:00000100:2.0:1767318081.006086:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940171904 offset 0 length 520: 4
00000100:00100000:2.0:1767318081.006104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940172032:0@lo:38:kworker.0
00000100:00100000:2.0:1767318081.006127:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.006145:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940172160:0@lo:38:kworker.0
00000100:00100000:2.0:1767318081.006179:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.006216:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172160
00000100:00100000:2.0:1767318081.006223:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172160
00000100:00100000:2.0:1767318081.006255:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876
00000100:00100000:2.0:1767318081.006262:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940172160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318081.006282:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318081.006322:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940172160:12345-0@lo:38:kworker.0 Request processed in 59us (141us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318081.006336:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876
00000100:00080000:2.0:1767318081.006369:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318081.006374:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318081.006376:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940172160:0@lo:38:kworker.0
00000100:00100000:0.0:1767318081.006544:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172288
00000100:00100000:0.0:1767318081.006548:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172288
00000100:00100000:0.0:1767318081.006603:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429
00000100:00100000:0.0:1767318081.006609:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940172288:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318081.006676:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318081.006710:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172032
00000100:00100000:2.0:1767318081.006715:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172032
00000100:00100000:2.0:1767318081.006736:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15972
00000100:00100000:2.0:1767318081.006740:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940172032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318081.006750:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318081.006808:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940172032:12345-0@lo:38:kworker.0 Request processed in 65us (679us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318081.006814:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15972
00000100:00080000:2.0:1767318081.006838:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318081.006842:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318081.006845:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940172032:0@lo:38:kworker.0
00000100:00100000:2.0:1767318081.007433:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940172416:0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.007476:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.007511:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172416
00000100:00100000:2.0:1767318081.007515:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172416
00000100:00100000:2.0:1767318081.007547:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430
00000100:00100000:2.0:1767318081.007553:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940172416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.007587:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940172416:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318081.007592:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430
00000100:00100000:2.0:1767318081.007646:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940172416:0@lo:400:kworker.0
00000100:00080000:2.0:1767318081.007663:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318081.011644:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940172288:12345-0@lo:400:kworker.0 Request processed in 5023us (5669us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318081.011659:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429
00000100:00080000:3.0:1767318081.012619:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318081.012632:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318081.012636:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318081.012654:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3325
00000100:00080000:3.0:1767318081.012659:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318081.012664:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318081.012685:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abca80 x1853163940172672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318081.012715:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318081.012719:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318081.012720:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318081.012724:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3325
00000100:00080000:3.0:1767318081.012726:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318081.012730:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318081.012740:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf480 x1853163940172928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318081.012992:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940172672:0@lo:38:kworker.0
00000100:00100000:3.0:1767318081.013053:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318081.013083:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940172928:0@lo:38:kworker.0
00000100:00100000:3.0:1767318081.013105:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318081.013143:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172672
00000100:00100000:3.0:1767318081.013151:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172672
00000100:00100000:3.0:1767318081.013178:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172928
00000100:00100000:3.0:1767318081.013181:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172928
00000100:00100000:3.0:1767318081.013196:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15973
00000100:00100000:3.0:1767318081.013202:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940172672:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318081.013222:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318081.013260:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940172672:12345-0@lo:38:kworker.0 Request processed in 57us (207us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318081.013272:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15973
00000100:00100000:3.0:1767318081.013289:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15974
00000100:00100000:3.0:1767318081.013293:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940172928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318081.013302:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318081.013327:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940172928:12345-0@lo:38:kworker.0 Request processed in 31us (220us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318081.013332:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15974
00000100:00080000:3.0:1767318081.013368:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318081.013373:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318081.013376:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940172672:0@lo:38:kworker.0
00000100:00080000:3.0:1767318081.013384:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318081.013387:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318081.013390:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940172928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318081.013490:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940172544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.013522:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.013551:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318081.013556:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940172800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.013575:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318081.013602:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172544
00000100:00100000:2.0:1767318081.013606:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172544
00000100:00100000:2.0:1767318081.013653:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940172800
00000100:00100000:2.0:1767318081.013656:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940172800
00000100:00100000:2.0:1767318081.013674:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672
00000100:00100000:2.0:1767318081.013680:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940172544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.013719:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940172544:12345-0@lo:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318081.013725:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672
00000100:00100000:2.0:1767318081.013737:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673
00000100:00100000:2.0:1767318081.013743:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940172800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.014143:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940172800:12345-0@lo:400:kworker.0 Request processed in 400us (567us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318081.014149:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673
00000100:00080000:2.0:1767318081.014168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318081.014190:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940172800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318081.014200:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940172544:0@lo:400:kworker.0
00000100:00100000:1.0:1767318081.016573:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940172288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318081.517006:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318081.971956:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318082.540970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318082.991422:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318083.564936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318083.567910:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940173056:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318083.567984:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318083.568183:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173056
00000100:00100000:0.0:1767318083.568202:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173056
00000100:00100000:0.0:1767318083.568271:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938
00000100:00100000:0.0:1767318083.568281:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940173056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318083.568312:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318083.568361:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940173056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318083.568368:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938
00000100:00100000:1.0:1767318083.568459:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940173056:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318083.568520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318084.015007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318084.589114:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318084.589663:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940173184:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318084.589760:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318084.590341:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173184
00000100:00100000:0.0:1767318084.590351:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173184
00000100:00100000:0.0:1767318084.590419:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939
00000100:00100000:0.0:1767318084.590429:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940173184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318084.590459:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318084.590590:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318084.590890:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940173184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 461us (1128us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318084.590909:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939
00000100:00100000:1.0:1767318084.594407:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940173184:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318084.682656:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318084.682713:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318084.684626:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242176
00000100:00100000:1.0:1767318084.684639:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242176
00000100:00100000:1.0:1767318084.684725:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242048
00000100:00100000:1.0:1767318084.684728:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242048
00000100:00100000:1.0:1767318084.684761:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3674
00000100:00100000:1.0:1767318084.684798:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318084.684885:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 114us (2238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318084.684899:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3674
00000100:00100000:1.0:1767318084.684919:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15975
00000100:00100000:1.0:1767318084.684924:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894242048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318084.684943:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318084.684964:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894242048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 39us (2252us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318084.684970:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15975
00000100:00080000:3.0:1767318084.685614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318085.037368:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318085.616976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318086.061112:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318086.125885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318086.125896:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318086.125899:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318086.125904:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318086.125908:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318086.125916:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3331
00000100:00080000:0.0:1767318086.125921:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318086.125928:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318086.125969:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ea680 x1853163940173312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318086.126013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318086.126017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318086.126019:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318086.126022:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3331
00000100:00080000:0.0:1767318086.126025:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318086.126029:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318086.126045:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7f480 x1853163940173440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318086.126133:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940173568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318086.126219:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318086.126560:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173568
00000100:00100000:2.0:1767318086.126568:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173568
00000100:00100000:2.0:1767318086.126639:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431
00000100:00100000:2.0:1767318086.126648:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940173568:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318086.126748:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318086.126764:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940173312:0@lo:38:kworker.0
00000100:00100000:3.0:1767318086.126816:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318086.126839:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940173440:0@lo:38:kworker.0
00000100:00100000:3.0:1767318086.126861:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318086.126890:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173312
00000100:00100000:3.0:1767318086.126894:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173312
00000100:00100000:3.0:1767318086.126932:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15976
00000100:00100000:3.0:1767318086.126937:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940173312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318086.126955:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318086.126990:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940173312:12345-0@lo:38:kworker.0 Request processed in 52us (172us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318086.126997:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15976
00000100:00100000:3.0:1767318086.127022:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173440
00000100:00100000:3.0:1767318086.127026:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173440
00000100:00100000:3.0:1767318086.127045:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877
00000100:00100000:3.0:1767318086.127050:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940173440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318086.127060:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318086.127085:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940173440:12345-0@lo:38:kworker.0 Request processed in 34us (222us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318086.127091:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877
00000100:00080000:3.0:1767318086.127143:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318086.127148:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318086.127151:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940173312:0@lo:38:kworker.0
00000100:00080000:3.0:1767318086.127161:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318086.127164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318086.127167:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940173440:0@lo:38:kworker.0
00000100:00100000:3.0:1767318086.129516:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940173696:0@lo:400:kworker.0
00000100:00100000:3.0:1767318086.129590:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318086.129665:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173696
00000100:00100000:3.0:1767318086.129684:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173696
00000100:00100000:3.0:1767318086.129754:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432
00000100:00100000:3.0:1767318086.129765:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940173696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318086.129860:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940173696:12345-0@lo:400:kworker.0 Request processed in 98us (270us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318086.129867:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432
00000100:00080000:3.0:1767318086.129891:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318086.129920:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940173696:0@lo:400:kworker.0
00000100:00100000:2.0:1767318086.131455:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940173568:12345-0@lo:400:kworker.0 Request processed in 4800us (5227us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318086.131467:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431
00000100:00080000:0.0:1767318086.131709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318086.131714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318086.131718:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318086.131723:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3331
00000100:00080000:0.0:1767318086.131738:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318086.131745:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318086.131766:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399ca80 x1853163940173952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318086.132122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318086.132135:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318086.132137:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318086.132142:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3331
00000100:00080000:0.0:1767318086.132144:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318086.132148:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318086.132163:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399c700 x1853163940174208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318086.132583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940173952:0@lo:38:kworker.0
00000100:00100000:0.0:1767318086.132652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318086.132917:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940174208:0@lo:38:kworker.0
00000100:00100000:0.0:1767318086.132946:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318086.132991:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173952
00000100:00100000:0.0:1767318086.132998:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173952
00000100:00100000:0.0:1767318086.133030:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174208
00000100:00100000:0.0:1767318086.133033:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174208
00000100:00100000:0.0:1767318086.133055:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15977
00000100:00100000:0.0:1767318086.133062:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940173952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318086.133084:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318086.134113:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940173952:12345-0@lo:38:kworker.0 Request processed in 1036us (1447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318086.137199:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940174080:0@lo:400:kworker.0
00000100:00100000:3.0:1767318086.137456:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318086.137513:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318086.137522:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940173824:0@lo:400:kworker.0
00000100:00100000:3.0:1767318086.137545:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318086.137584:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174080
00000100:00100000:3.0:1767318086.137592:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174080
00000100:00100000:2.0:1767318086.137738:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940173824
00000100:00100000:2.0:1767318086.137743:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940173824
00000100:00100000:0.0:1767318086.138092:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15977
00000100:00100000:3.0:1767318086.138367:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675
00000100:00100000:3.0:1767318086.138380:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940174080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318086.138512:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940174080:12345-0@lo:400:kworker.0 Request processed in 136us (1055us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318086.138520:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675
00000100:00100000:3.0:1767318086.138539:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15978
00000100:00100000:3.0:1767318086.138543:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940174208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318086.138563:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318086.138591:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940174208:12345-0@lo:38:kworker.0 Request processed in 47us (5645us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318086.138597:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15978
00000100:00080000:3.0:1767318086.138614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318086.139553:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318086.139562:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318086.139568:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940173952:0@lo:38:kworker.0
00000100:00080000:0.0:1767318086.139584:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318086.139588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318086.139592:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940174208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318086.139951:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940174080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318086.140117:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676
00000100:00100000:2.0:1767318086.140141:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940173824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318086.140232:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940173824:12345-0@lo:400:kworker.0 Request processed in 107us (2686us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318086.140239:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676
00000100:00100000:3.0:1767318086.141146:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940173824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318086.161283:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940173568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318086.636908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318087.092132:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318087.660918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318088.109005:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318088.686421:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318088.691333:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318088.691358:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940174336:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318088.691431:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318088.691593:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174336
00000100:00100000:0.0:1767318088.691601:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174336
00000100:00100000:0.0:1767318088.691666:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940
00000100:00100000:0.0:1767318088.691677:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940174336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318088.691744:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318088.691831:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940174336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (400us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318088.691839:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940
00000100:00080000:3.0:1767318088.691927:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318088.691985:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940174336:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318089.133191:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318089.711901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318089.712347:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318089.713151:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940174464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318089.713216:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318089.714881:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174464
00000100:00100000:2.0:1767318089.714891:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174464
00000100:00100000:2.0:1767318089.714960:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941
00000100:00100000:2.0:1767318089.714969:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940174464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318089.715002:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318089.715227:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940174464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (2009us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318089.715254:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941
00000100:00100000:1.0:1767318089.715403:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940174464:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318089.715688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318089.798836:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318089.798991:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318089.803299:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242432
00000100:00100000:0.0:1767318089.803315:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242432
00000100:00080000:3.0:1767318089.803524:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318089.803633:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242304
00000100:00100000:0.0:1767318089.803638:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242304
00000100:00100000:2.0:1767318089.803689:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3677
00000100:00100000:2.0:1767318089.803713:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318089.803836:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 126us (5010us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318089.803844:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3677
00000100:00100000:2.0:1767318089.803864:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15979
00000100:00100000:2.0:1767318089.803869:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894242304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318089.803889:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318089.803915:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894242304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (4924us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318089.803921:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15979
00010000:00010000:0.0:1767318090.157238:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318090.733165:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318091.181173:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318091.245884:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318091.245895:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318091.245898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318091.245902:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318091.245906:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318091.245915:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3336
00000100:00080000:3.0:1767318091.245920:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318091.245927:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318091.245965:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212d80 x1853163940174592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318091.245992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318091.245995:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318091.245997:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318091.246001:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3336
00000100:00080000:3.0:1767318091.246018:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318091.246022:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318091.246042:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213480 x1853163940174720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318091.246117:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318091.246120:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318091.246122:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318091.246126:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3336
00000100:00080000:3.0:1767318091.246128:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318091.246132:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318091.246144:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211500 x1853163940175232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318091.246160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318091.246163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318091.246165:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318091.246168:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3336
00000100:00080000:3.0:1767318091.246170:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318091.246173:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318091.246184:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940175488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318091.246342:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940175360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.246405:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318091.246471:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318091.246478:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940175104:0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.246501:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318091.246718:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940174976:0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.246748:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318091.246789:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318091.246795:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940174848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.246814:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318091.246896:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174976
00000100:00100000:0.0:1767318091.246904:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174976
00000100:00100000:0.0:1767318091.246953:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174848
00000100:00100000:0.0:1767318091.246956:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174848
00000100:00100000:0.0:1767318091.246979:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433
00000100:00100000:0.0:1767318091.246987:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940174976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.247040:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940174976:12345-0@lo:400:kworker.0 Request processed in 52us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318091.247058:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433
00000100:00100000:0.0:1767318091.247074:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434
00000100:00100000:0.0:1767318091.247080:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940174848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.247250:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940174848:12345-0@lo:400:kworker.0 Request processed in 169us (433us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318091.247257:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434
00000100:00100000:0.0:1767318091.247277:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175360
00000100:00100000:0.0:1767318091.247280:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175360
00000100:00100000:0.0:1767318091.247307:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175104
00000100:00100000:0.0:1767318091.247311:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175104
00000100:00100000:0.0:1767318091.247330:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678
00000100:00100000:0.0:1767318091.247336:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940175360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.247366:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940175360:12345-0@lo:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318091.247371:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678
00000100:00100000:0.0:1767318091.247381:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679
00000100:00100000:0.0:1767318091.247387:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940175104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.247413:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940175104:12345-0@lo:400:kworker.0 Request processed in 26us (912us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318091.247419:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679
00000100:00100000:1.0:1767318091.247557:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940174592:0@lo:38:kworker.0
00000100:00100000:1.0:1767318091.247589:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318091.247608:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940174720:0@lo:38:kworker.0
00000100:00100000:1.0:1767318091.247630:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318091.247646:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940175232:0@lo:38:kworker.0
00000100:00100000:1.0:1767318091.247664:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318091.247679:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940175488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318091.247708:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318091.247738:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174720
00000100:00100000:1.0:1767318091.247741:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174720
00000100:00100000:1.0:1767318091.247764:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878
00000100:00100000:1.0:1767318091.247768:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940174720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318091.247806:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318091.247842:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940174720:12345-0@lo:38:kworker.0 Request processed in 72us (210us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318091.247848:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878
00000100:00100000:1.0:1767318091.247867:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940174592
00000100:00100000:1.0:1767318091.247871:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940174592
00000100:00100000:1.0:1767318091.247888:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175232
00000100:00100000:1.0:1767318091.247891:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175232
00000100:00100000:1.0:1767318091.247897:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175488
00000100:00100000:1.0:1767318091.247899:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175488
00000100:00100000:1.0:1767318091.247907:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15980
00000100:00100000:1.0:1767318091.247911:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940174592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318091.247920:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318091.247953:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940174592:12345-0@lo:38:kworker.0 Request processed in 41us (363us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318091.247959:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15980
00000100:00100000:1.0:1767318091.247971:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15981
00000100:00100000:1.0:1767318091.247974:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940175232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318091.247983:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318091.248005:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940175232:12345-0@lo:38:kworker.0 Request processed in 28us (339us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318091.248010:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15981
00000100:00100000:1.0:1767318091.248022:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15982
00000100:00100000:1.0:1767318091.248025:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940175488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318091.248034:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318091.248057:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940175488:12345-0@lo:38:kworker.0 Request processed in 30us (348us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318091.248063:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15982
00000100:00080000:1.0:1767318091.248119:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318091.248124:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318091.248127:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940174592:0@lo:38:kworker.0
00000100:00080000:1.0:1767318091.248136:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318091.248140:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318091.248142:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940174720:0@lo:38:kworker.0
00000100:00080000:1.0:1767318091.248149:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318091.248152:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318091.248154:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940175232:0@lo:38:kworker.0
00000100:00080000:1.0:1767318091.248173:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318091.248176:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318091.248178:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940175488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318091.248248:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940175104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318091.248258:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940175360:0@lo:400:kworker.0
00000100:00080000:1.0:1767318091.248288:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318091.248292:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318091.248294:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318091.249235:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940174848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318091.249257:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940174976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318091.756915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318092.205264:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318092.780932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318093.230074:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318093.804899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318093.805292:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940175616:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318093.805377:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318093.806010:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175616
00000100:00100000:0.0:1767318093.806019:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175616
00000100:00100000:0.0:1767318093.806101:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942
00000100:00100000:0.0:1767318093.806111:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940175616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318093.806153:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318093.806204:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940175616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (826us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318093.806211:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942
00000100:00100000:2.0:1767318093.806314:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940175616:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318093.806649:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318094.254435:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318094.830281:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318094.831020:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318094.831039:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940175744:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318094.831265:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318094.831743:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175744
00000100:00100000:0.0:1767318094.831752:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175744
00000100:00100000:0.0:1767318094.831845:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943
00000100:00100000:0.0:1767318094.831856:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940175744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318094.831888:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318094.831946:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940175744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (682us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318094.831954:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943
00000100:00100000:1.0:1767318094.832088:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940175744:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318094.833468:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318094.920895:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318094.920978:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242688
00000100:00100000:1.0:1767318094.920989:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242688
00000100:00100000:1.0:1767318094.921070:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3680
00000100:00100000:1.0:1767318094.921080:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318094.921159:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894242688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318094.921168:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3680
00000100:00080000:3.0:1767318094.931444:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318094.931584:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318094.934063:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242560
00000100:00100000:1.0:1767318094.934076:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242560
00000100:00100000:1.0:1767318094.934142:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15983
00000100:00100000:1.0:1767318094.934151:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894242560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318094.934175:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318094.934316:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894242560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 163us (2736us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318094.934342:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15983
00010000:00010000:0.0:1767318095.277138:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318095.856864:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318096.301446:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318096.365305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318096.365316:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318096.365319:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318096.365323:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318096.365327:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318096.365334:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3341
00000100:00080000:0.0:1767318096.365339:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318096.365345:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318096.365382:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046addf80 x1853163940175872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318096.365438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318096.365442:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318096.365443:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318096.365448:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3341
00000100:00080000:0.0:1767318096.365450:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318096.365454:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318096.365473:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38000 x1853163940176000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318096.365537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318096.365541:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318096.365542:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318096.365546:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3341
00000100:00080000:0.0:1767318096.365548:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318096.365552:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318096.365563:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72300 x1853163940176512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318096.365577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318096.365580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318096.365582:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318096.365585:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3341
00000100:00080000:0.0:1767318096.365587:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318096.365590:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318096.365600:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989180 x1853163940176768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318096.365684:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.365759:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318096.365862:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318096.365869:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.365891:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318096.365922:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940176384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.365947:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318096.365964:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318096.365969:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940176640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.365990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318096.366023:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176128
00000100:00100000:1.0:1767318096.366030:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176128
00000100:00100000:1.0:1767318096.366085:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176256
00000100:00100000:1.0:1767318096.366088:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176256
00000100:00100000:1.0:1767318096.366110:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435
00000100:00100000:1.0:1767318096.366119:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366170:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176128:12345-0@lo:400:kworker.0 Request processed in 52us (410us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318096.366178:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435
00000100:00100000:1.0:1767318096.366195:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436
00000100:00100000:1.0:1767318096.366201:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366228:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176256:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318096.366233:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436
00000100:00100000:1.0:1767318096.366262:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176384
00000100:00100000:1.0:1767318096.366265:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176384
00000100:00100000:1.0:1767318096.366286:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176640
00000100:00100000:1.0:1767318096.366288:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176640
00000100:00100000:1.0:1767318096.366303:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681
00000100:00100000:1.0:1767318096.366309:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940176384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366338:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940176384:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318096.366343:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681
00000100:00100000:1.0:1767318096.366353:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682
00000100:00100000:1.0:1767318096.366357:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940176640:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366377:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940176640:12345-0@lo:400:kworker.0 Request processed in 20us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318096.366382:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682
00000100:00080000:1.0:1767318096.366396:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318096.366400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318096.366402:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318096.366440:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940176640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366450:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940176384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366475:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318096.366484:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176128:0@lo:400:kworker.0
00000100:00100000:2.0:1767318096.366722:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940175872:0@lo:38:kworker.0
00000100:00100000:2.0:1767318096.366756:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318096.366808:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940176000:0@lo:38:kworker.0
00000100:00100000:2.0:1767318096.366833:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318096.366865:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940176512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318096.366886:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318096.366901:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940176768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318096.366918:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318096.366948:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176000
00000100:00100000:2.0:1767318096.366952:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176000
00000100:00100000:2.0:1767318096.366977:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879
00000100:00100000:2.0:1767318096.366982:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940176000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318096.367002:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318096.367035:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940176000:12345-0@lo:38:kworker.0 Request processed in 52us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318096.367042:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879
00000100:00100000:2.0:1767318096.367062:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940175872
00000100:00100000:2.0:1767318096.367066:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940175872
00000100:00100000:2.0:1767318096.367085:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176512
00000100:00100000:2.0:1767318096.367088:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176512
00000100:00100000:2.0:1767318096.367101:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176768
00000100:00100000:2.0:1767318096.367104:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176768
00000100:00100000:2.0:1767318096.367112:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15984
00000100:00100000:2.0:1767318096.367116:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940175872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318096.367127:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318096.367152:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940175872:12345-0@lo:38:kworker.0 Request processed in 34us (395us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318096.367168:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15984
00000100:00100000:2.0:1767318096.367180:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15985
00000100:00100000:2.0:1767318096.367184:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940176512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318096.367193:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318096.367217:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940176512:12345-0@lo:38:kworker.0 Request processed in 32us (331us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318096.367223:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15985
00000100:00100000:2.0:1767318096.367234:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15986
00000100:00100000:2.0:1767318096.367238:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940176768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318096.367248:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318096.367271:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940176768:12345-0@lo:38:kworker.0 Request processed in 31us (352us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318096.367277:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15986
00000100:00080000:2.0:1767318096.367312:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318096.367317:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318096.367321:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940175872:0@lo:38:kworker.0
00000100:00080000:2.0:1767318096.367331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318096.367334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318096.367337:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940176000:0@lo:38:kworker.0
00000100:00080000:2.0:1767318096.367344:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318096.367348:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318096.367350:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940176512:0@lo:38:kworker.0
00000100:00080000:2.0:1767318096.367357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318096.367366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318096.367369:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940176768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318096.876918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318097.325390:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318097.900869:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318098.356095:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318098.925595:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318098.928388:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176896:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318098.928473:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318098.929489:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940176896
00000100:00100000:2.0:1767318098.929500:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940176896
00000100:00100000:2.0:1767318098.929589:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944
00000100:00100000:2.0:1767318098.929599:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176896:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318098.929610:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767318098.929647:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318098.939268:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940176896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9654us (10778us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318098.939287:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944
00000100:00100000:1.0:1767318098.950509:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940176896:0@lo:13:osp-pre-1-1.0
00000400:00000100:3.0:1767318099.026048:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894242816 offset 0 length 520: 4
00000100:00100000:3.0:1767318099.026115:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318099.026232:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243072
00000100:00100000:1.0:1767318099.026255:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243072
00000100:00100000:1.0:1767318099.026385:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3683
00000100:00100000:1.0:1767318099.026398:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894243072:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318099.026491:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894243072:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318099.026499:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3683
00000100:00080000:3.0:1767318099.035198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318099.035355:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318099.035465:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894242944
00000100:00100000:2.0:1767318099.035476:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894242944
00000100:00100000:2.0:1767318099.035533:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15987
00000100:00100000:2.0:1767318099.035540:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894242944:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318099.035565:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318099.035658:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894242944:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 117us (308us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318099.035666:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15987
00010000:00010000:1.0:1767318099.373122:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318099.948917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318099.950804:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940177024:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318099.950883:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318099.951087:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177024
00000100:00100000:0.0:1767318099.951096:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177024
00000100:00100000:0.0:1767318099.951169:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945
00000100:00100000:0.0:1767318099.951179:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940177024:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318099.951346:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767318099.952316:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318099.952397:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940177024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1218us (1513us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318099.952405:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945
00000100:00100000:3.0:1767318099.952494:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940177024:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318100.397018:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318100.972898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318101.421420:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318101.488162:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318101.488173:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318101.488176:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318101.488180:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318101.488184:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318101.488192:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3346
00000100:00080000:0.0:1767318101.488197:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318101.488203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318101.488249:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989180 x1853163940177152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318101.488280:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318101.488284:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318101.488285:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318101.488302:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3346
00000100:00080000:0.0:1767318101.488305:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318101.488308:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318101.488323:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046989500 x1853163940177280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318101.488376:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318101.488379:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318101.488381:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318101.488384:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3346
00000100:00080000:0.0:1767318101.488387:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318101.488390:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318101.488399:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0e00 x1853163940177792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318101.488414:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318101.488416:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318101.488418:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318101.488420:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3346
00000100:00080000:0.0:1767318101.488434:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318101.488438:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318101.488448:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940178048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318101.488476:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940177536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318101.488540:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318101.489043:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177536
00000100:00100000:2.0:1767318101.489053:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177536
00000100:00100000:2.0:1767318101.489112:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437
00000100:00100000:2.0:1767318101.489121:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940177536:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318101.489228:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318101.489243:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940177920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318101.489341:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318101.489361:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940177408:0@lo:400:kworker.0
00000100:00100000:1.0:1767318101.492187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940177152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318101.493158:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940177536:12345-0@lo:400:kworker.0 Request processed in 4034us (4613us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318101.493181:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437
00000100:00100000:2.0:1767318101.493239:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940177664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318101.493272:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318101.493318:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177664
00000100:00100000:2.0:1767318101.493324:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177664
00000100:00100000:2.0:1767318101.493365:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684
00000100:00100000:2.0:1767318101.493372:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940177664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318101.493413:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940177664:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318101.493418:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684
00000100:00100000:2.0:1767318101.493468:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940177664:0@lo:400:kworker.0
00000100:00080000:2.0:1767318101.493492:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318101.494634:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318101.494828:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177920
00000100:00100000:2.0:1767318101.494835:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177920
00000100:00100000:2.0:1767318101.494894:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685
00000100:00100000:2.0:1767318101.494902:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940177920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318101.494950:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940177920:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318101.494957:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685
00000100:00080000:3.0:1767318101.495212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318101.495242:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940177920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318101.495500:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318101.495532:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940177536:0@lo:400:kworker.0
00000100:00100000:1.0:1767318101.495817:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318101.495849:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940177280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318101.495877:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318101.495903:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940177792:0@lo:38:kworker.0
00000100:00100000:1.0:1767318101.495923:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318101.495941:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940178048:0@lo:38:kworker.0
00000100:00100000:1.0:1767318101.495960:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318101.496005:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177152
00000100:00100000:1.0:1767318101.496009:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177152
00000100:00100000:1.0:1767318101.496035:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177792
00000100:00100000:1.0:1767318101.496038:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177792
00000100:00100000:1.0:1767318101.496052:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178048
00000100:00100000:1.0:1767318101.496055:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178048
00000100:00100000:1.0:1767318101.496072:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15988
00000100:00100000:1.0:1767318101.496091:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940177152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318101.496111:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318101.496147:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940177152:12345-0@lo:38:kworker.0 Request processed in 55us (329us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318101.496153:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15988
00000100:00100000:1.0:1767318101.496169:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15989
00000100:00100000:1.0:1767318101.496173:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940177792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318101.496182:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318101.496204:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940177792:12345-0@lo:38:kworker.0 Request processed in 29us (280us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318101.496209:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15989
00000100:00100000:1.0:1767318101.496219:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15990
00000100:00100000:1.0:1767318101.496223:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940178048:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318101.496230:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318101.496249:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940178048:12345-0@lo:38:kworker.0 Request processed in 25us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318101.496254:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15990
00000100:00080000:1.0:1767318101.496290:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318101.496295:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318101.496298:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940177152:0@lo:38:kworker.0
00000100:00080000:1.0:1767318101.496306:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318101.496309:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318101.496312:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940177792:0@lo:38:kworker.0
00000100:00080000:1.0:1767318101.496318:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318101.496327:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318101.496330:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940178048:0@lo:38:kworker.0
00000100:00100000:2.0:1767318101.496703:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177408
00000100:00100000:2.0:1767318101.496709:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177408
00000100:00100000:2.0:1767318101.496763:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438
00000100:00100000:2.0:1767318101.496771:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940177408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318101.496837:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940177408:12345-0@lo:400:kworker.0 Request processed in 67us (1337us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318101.496843:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438
00000100:00080000:3.0:1767318101.496907:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318101.496965:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940177280
00000100:00100000:0.0:1767318101.496969:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940177280
00000100:00100000:0.0:1767318101.497004:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880
00000100:00100000:0.0:1767318101.497009:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940177280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318101.497020:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318101.497064:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940177280:12345-0@lo:38:kworker.0 Request processed in 54us (1185us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318101.497071:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880
00000100:00100000:0.0:1767318101.497100:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04698b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940177408:0@lo:400:kworker.0
00000100:00080000:3.0:1767318101.497236:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318101.497242:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318101.497245:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940177280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318101.997019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318102.445098:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318103.021297:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318103.469066:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318104.044924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318104.045114:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318104.045134:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940178176:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318104.045203:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318104.045267:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178176
00000100:00100000:1.0:1767318104.045276:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178176
00000100:00080000:3.0:1767318104.045323:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318104.045330:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946
00000100:00100000:1.0:1767318104.045339:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940178176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318104.045369:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318104.045421:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940178176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (218us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318104.045428:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946
00000100:00100000:2.0:1767318104.045524:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940178176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318104.135153:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318104.135195:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318104.135602:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243328
00000100:00100000:1.0:1767318104.135612:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243328
00000100:00100000:1.0:1767318104.135755:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243200
00000100:00100000:1.0:1767318104.135759:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243200
00000100:00100000:1.0:1767318104.135823:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3686
00000100:00100000:1.0:1767318104.135834:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894243328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318104.135918:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894243328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (773us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318104.135927:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3686
00000100:00100000:1.0:1767318104.135956:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15991
00000100:00100000:1.0:1767318104.135961:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894243200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318104.135981:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318104.136007:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894243200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (811us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318104.136028:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15991
00000100:00080000:2.0:1767318104.139251:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318104.495408:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318105.069352:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318105.071903:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318105.071929:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940178304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318105.072017:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318105.072590:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178304
00000100:00100000:3.0:1767318105.072599:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178304
00000100:00100000:3.0:1767318105.072679:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947
00000100:00100000:3.0:1767318105.072690:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940178304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318105.072723:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767318105.072896:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318105.072961:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940178304:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318105.073031:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940178304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 343us (1024us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318105.073039:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947
00010000:00010000:0.0:1767318105.519694:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318106.093018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318106.541819:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318106.604960:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318081/real 1767318081]  req@ffff93cf50adc000 x1853163940171904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318106 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318106.604998:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf50adc000 x1853163940171904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318106 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318106.605037:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318106.605061:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318106.605065:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940171904:0@lo:250:kworker.0
00000100:00080000:0.0:1767318106.605208:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318106.605215:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318106.605217:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318106.605222:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3331
00000100:00080000:0.0:1767318106.605226:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318106.605232:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318106.605264:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4a80 x1853163940178432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318106.605304:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318106.605307:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318106.605309:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318106.605313:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3351
00000100:00080000:0.0:1767318106.605316:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318106.605318:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318106.605331:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7480 x1853163940178560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318106.605337:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318106.605339:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318106.605340:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318106.605343:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3351
00000100:00080000:0.0:1767318106.605344:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318106.605346:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318106.605353:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7800 x1853163940178688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318106.605411:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940178432:0@lo:250:kworker.0
00000100:00100000:1.0:1767318106.605423:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940178816:0@lo:400:kworker.0
00000400:00000100:3.0:1767318106.605462:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940178432 offset 0 length 520: 4
00000100:00100000:1.0:1767318106.605485:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318106.605507:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940178560:0@lo:38:kworker.0
00000100:00100000:3.0:1767318106.605535:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318106.605582:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940178688:0@lo:38:kworker.0
00000100:00100000:3.0:1767318106.605605:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318106.605640:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178560
00000100:00100000:3.0:1767318106.605648:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178560
00000100:00100000:2.0:1767318106.605655:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178688
00000100:00100000:2.0:1767318106.605661:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178688
00000100:00100000:3.0:1767318106.605692:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15992
00000100:00100000:2.0:1767318106.605696:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881
00000100:00100000:3.0:1767318106.605701:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940178560:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318106.605706:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940178688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318106.605726:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318106.605768:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940178560:12345-0@lo:38:kworker.0 Request processed in 67us (231us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318106.605802:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15992
00000100:00080000:3.0:1767318106.605839:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318106.605843:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318106.605846:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940178560:0@lo:38:kworker.0
00000100:00100000:3.0:1767318106.605904:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940178944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318106.605930:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318106.605964:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178816
00000100:00100000:3.0:1767318106.605974:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178816
00000100:00100000:3.0:1767318106.606013:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940178944
00000100:00100000:3.0:1767318106.606016:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940178944
00000100:00100000:3.0:1767318106.606039:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439
00000100:00100000:3.0:1767318106.606045:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940178816:12345-0@lo:400:kworker.0
00010000:00020000:2.0:1767318106.606692:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318106.606726:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940178688:12345-0@lo:38:kworker.0 Request processed in 1023us (1120us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318106.606732:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881
00000100:00080000:2.0:1767318106.606755:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318106.606758:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318106.606760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940178688:0@lo:38:kworker.0
00000100:00080000:0.0:1767318106.607203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318106.607208:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318106.607211:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318106.607216:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3351
00000100:00080000:0.0:1767318106.607220:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318106.607225:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318106.607242:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940179200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318106.607277:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318106.607280:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318106.607282:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318106.607286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3351
00000100:00080000:0.0:1767318106.607288:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318106.607292:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318106.607302:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839f80 x1853163940179456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318106.607330:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940179328:0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.607359:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318106.607379:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318106.607382:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940179072:0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.607407:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318106.607424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318106.607434:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179328
00000100:00100000:0.0:1767318106.607438:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179328
00000100:00100000:0.0:1767318106.607488:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179072
00000100:00100000:0.0:1767318106.607492:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179072
00000100:00100000:0.0:1767318106.607696:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687
00000100:00100000:0.0:1767318106.607703:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940179328:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.607735:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940179328:12345-0@lo:400:kworker.0 Request processed in 34us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318106.607739:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687
00000100:00100000:0.0:1767318106.607750:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688
00000100:00100000:0.0:1767318106.607754:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940179072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.607803:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940179072:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318106.607808:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688
00000100:00100000:0.0:1767318106.607845:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940179072:0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.607853:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940179328:0@lo:400:kworker.0
00000100:00080000:0.0:1767318106.607864:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318106.607876:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940179200:0@lo:38:kworker.0
00000100:00100000:0.0:1767318106.607891:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318106.607902:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940179456:0@lo:38:kworker.0
00000100:00100000:0.0:1767318106.607912:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318106.607936:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179200
00000100:00100000:0.0:1767318106.607939:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179200
00000100:00100000:0.0:1767318106.607949:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15993
00000100:00100000:0.0:1767318106.607952:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940179200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318106.607963:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318106.607982:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940179200:12345-0@lo:38:kworker.0 Request processed in 29us (90us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318106.607986:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15993
00000100:00100000:0.0:1767318106.607992:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179456
00000100:00100000:0.0:1767318106.607994:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179456
00000100:00100000:0.0:1767318106.608213:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15994
00000100:00100000:0.0:1767318106.608218:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940179456:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318106.608228:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318106.608254:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940179456:12345-0@lo:38:kworker.0 Request processed in 34us (339us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318106.608266:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15994
00000100:00080000:0.0:1767318106.608295:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318106.608300:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318106.608303:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940179200:0@lo:38:kworker.0
00000100:00080000:0.0:1767318106.608310:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318106.608312:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318106.608314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940179456:0@lo:38:kworker.0
00000100:00100000:0.0:1767318106.608344:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440
00000100:00100000:0.0:1767318106.608350:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940178944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318106.608376:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940178944:12345-0@lo:400:kworker.0 Request processed in 28us (2446us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318106.608380:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440
00000100:00100000:0.0:1767318106.608412:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940178944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318106.609356:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940178816:12345-0@lo:400:kworker.0 Request processed in 3306us (3867us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318106.609365:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439
00000100:00100000:1.0:1767318106.610158:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940178816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318107.116907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318107.570848:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318108.140966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318108.589086:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318109.165178:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318109.165205:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940179584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318109.165291:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318109.165552:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179584
00000100:00100000:0.0:1767318109.165560:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179584
00000100:00100000:0.0:1767318109.165646:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948
00000100:00100000:0.0:1767318109.165655:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940179584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318109.165689:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318109.165737:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940179584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (445us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318109.165744:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948
00000100:00080000:2.0:1767318109.165814:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318109.165907:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940179584:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318109.168221:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318109.257311:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318109.259744:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243584
00000100:00100000:2.0:1767318109.259758:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243584
00000100:00100000:2.0:1767318109.259880:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3689
00000100:00100000:2.0:1767318109.259891:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894243584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318109.259965:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894243584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (2664us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318109.259988:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3689
00000100:00080000:0.0:1767318109.260220:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318109.270968:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318109.271649:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243456
00000100:00100000:0.0:1767318109.271661:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243456
00000100:00100000:0.0:1767318109.271713:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15995
00000100:00100000:0.0:1767318109.271722:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894243456:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318109.271756:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318109.271864:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894243456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 141us (906us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318109.271873:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15995
00010000:00010000:1.0:1767318109.613901:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318110.189120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318110.189642:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940179712:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318110.189719:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318110.190544:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179712
00000100:00100000:1.0:1767318110.190556:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179712
00000100:00100000:1.0:1767318110.190665:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949
00000100:00100000:1.0:1767318110.190675:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940179712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318110.190706:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318110.190809:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940179712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1053us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318110.190817:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949
00000100:00100000:3.0:1767318110.190924:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940179712:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318110.191098:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318110.637028:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318111.213704:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318111.661005:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318111.727695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318111.727708:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318111.727711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318111.727716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318111.727722:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318111.727729:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3356
00000100:00080000:3.0:1767318111.727734:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318111.727742:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318111.727807:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211880 x1853163940179840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318111.727858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318111.727862:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318111.727864:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318111.727867:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3356
00000100:00080000:3.0:1767318111.727870:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318111.727874:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318111.727891:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940179968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318111.727958:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318111.727961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318111.727963:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318111.727967:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3356
00000100:00080000:3.0:1767318111.727970:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318111.727974:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318111.727987:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70380 x1853163940180480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318111.728003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318111.728006:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318111.728008:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318111.728011:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3356
00000100:00080000:3.0:1767318111.728013:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318111.728016:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318111.728026:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d500 x1853163940180736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318111.728070:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940180352:0@lo:400:kworker.0
00000100:00100000:3.0:1767318111.728143:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318111.728209:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318111.728216:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940180608:0@lo:400:kworker.0
00000100:00100000:3.0:1767318111.728238:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.731613:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180352
00000100:00100000:2.0:1767318111.731629:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180352
00000100:00100000:2.0:1767318111.731715:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180608
00000100:00100000:2.0:1767318111.731719:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180608
00000100:00100000:2.0:1767318111.731748:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690
00000100:00100000:2.0:1767318111.731758:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940180352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.731882:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940180352:12345-0@lo:400:kworker.0 Request processed in 125us (3738us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318111.731890:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690
00000100:00100000:2.0:1767318111.731908:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691
00000100:00100000:2.0:1767318111.731915:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940180608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.731945:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940180608:12345-0@lo:400:kworker.0 Request processed in 31us (3705us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318111.731951:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691
00000100:00100000:2.0:1767318111.731996:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940180608:0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.732009:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940180352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.732047:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940179840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318111.732083:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.732117:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940179968:0@lo:38:kworker.0
00000100:00100000:2.0:1767318111.732143:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.732161:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940180480:0@lo:38:kworker.0
00000100:00100000:2.0:1767318111.732206:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.732224:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940180736:0@lo:38:kworker.0
00000100:00100000:2.0:1767318111.732245:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.732280:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179968
00000100:00100000:2.0:1767318111.732283:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179968
00000100:00100000:2.0:1767318111.732303:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882
00000100:00100000:2.0:1767318111.732308:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940179968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318111.732329:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318111.732361:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940179968:12345-0@lo:38:kworker.0 Request processed in 53us (218us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318111.732367:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882
00000100:00100000:2.0:1767318111.732381:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940179840
00000100:00100000:2.0:1767318111.732384:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940179840
00000100:00100000:2.0:1767318111.732394:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180480
00000100:00100000:2.0:1767318111.732396:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180480
00000100:00100000:2.0:1767318111.732402:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180736
00000100:00100000:2.0:1767318111.732405:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180736
00000100:00100000:2.0:1767318111.732414:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15996
00000100:00100000:2.0:1767318111.732418:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940179840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318111.732427:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318111.732450:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940179840:12345-0@lo:38:kworker.0 Request processed in 31us (367us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318111.732456:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15996
00000100:00100000:2.0:1767318111.732466:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15997
00000100:00100000:2.0:1767318111.732470:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940180480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318111.732479:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318111.732512:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940180480:12345-0@lo:38:kworker.0 Request processed in 41us (306us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318111.732517:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15997
00000100:00100000:2.0:1767318111.732527:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15998
00000100:00100000:2.0:1767318111.732530:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940180736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318111.732538:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318111.732559:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940180736:12345-0@lo:38:kworker.0 Request processed in 27us (313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318111.732564:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15998
00000100:00080000:2.0:1767318111.732588:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318111.732593:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318111.732596:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940179840:0@lo:38:kworker.0
00000100:00080000:2.0:1767318111.732604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318111.732607:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318111.732609:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940179968:0@lo:38:kworker.0
00000100:00080000:2.0:1767318111.732616:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318111.732619:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318111.732621:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940180480:0@lo:38:kworker.0
00000100:00080000:2.0:1767318111.732627:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318111.732630:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318111.732632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940180736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318111.732742:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318111.732798:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318111.732841:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318111.732848:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318111.732869:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318111.732944:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180096
00000100:00100000:2.0:1767318111.732949:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180096
00000100:00100000:2.0:1767318111.732985:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180224
00000100:00100000:2.0:1767318111.732989:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180224
00000100:00100000:2.0:1767318111.733006:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441
00000100:00100000:2.0:1767318111.733013:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.733047:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180096:12345-0@lo:400:kworker.0 Request processed in 34us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318111.733053:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441
00000100:00100000:2.0:1767318111.733065:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442
00000100:00100000:2.0:1767318111.733071:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04698b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318111.733096:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04698b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180224:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318111.733102:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442
00000100:00080000:3.0:1767318111.733265:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318111.733270:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318111.733338:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318111.733347:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180096:0@lo:400:kworker.0
00000100:00100000:2.0:1767318112.237234:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318112.684992:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318113.261160:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318113.710867:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318114.285120:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318114.285144:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940180864:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318114.285215:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318114.285345:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318114.285383:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180864
00000100:00100000:3.0:1767318114.285391:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180864
00000100:00100000:3.0:1767318114.285451:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950
00000100:00100000:3.0:1767318114.285462:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940180864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318114.285501:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318114.285548:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940180864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (333us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318114.285569:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950
00000100:00080000:3.0:1767318114.286480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318114.286817:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940180864:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318114.375533:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318114.375680:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318114.375811:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243840
00000100:00100000:1.0:1767318114.375822:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243840
00000100:00100000:1.0:1767318114.375905:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243712
00000100:00100000:1.0:1767318114.375909:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243712
00000100:00100000:1.0:1767318114.376019:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3692
00000100:00100000:1.0:1767318114.376029:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894243840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318114.376110:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894243840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (587us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318114.376117:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3692
00000100:00100000:1.0:1767318114.376135:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15999
00000100:00100000:1.0:1767318114.376140:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894243712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318114.376161:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318114.376626:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318114.426410:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894243712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50255us (50718us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318114.426425:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15999
00010000:00010000:1.0:1767318114.733814:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318115.308900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318115.309039:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318115.309063:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180992:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318115.309138:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318115.309277:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940180992
00000100:00100000:0.0:1767318115.309294:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940180992
00000100:00100000:0.0:1767318115.309373:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951
00000100:00100000:0.0:1767318115.309382:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318115.309423:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318115.309485:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940180992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318115.309492:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951
00000100:00080000:3.0:1767318115.309545:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318115.309583:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940180992:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318115.757674:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318116.334147:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318116.781005:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318116.844927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318116.844941:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318116.844945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318116.844972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318116.844977:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318116.845000:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3361
00000100:00080000:3.0:1767318116.845005:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318116.845014:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318116.845063:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2d80 x1853163940181120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318116.845096:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318116.845099:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318116.845101:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318116.845106:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3361
00000100:00080000:3.0:1767318116.845109:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318116.845113:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318116.845149:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47979180 x1853163940181248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318116.845220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318116.845224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318116.845226:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318116.845230:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3361
00000100:00080000:3.0:1767318116.845234:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318116.845238:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318116.845248:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940181376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.845254:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ed80 x1853163940181760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318116.845283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318116.845293:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318116.845296:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318116.845299:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3361
00000100:00080000:3.0:1767318116.845302:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318116.845307:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318116.845321:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223100 x1853163940182016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318116.845342:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318116.845349:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940181888:0@lo:400:kworker.0
00000100:00100000:1.0:1767318116.845435:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940181504:0@lo:400:kworker.0
00000100:00100000:2.0:1767318116.845481:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940181120:0@lo:38:kworker.0
00000100:00100000:3.0:1767318116.846658:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318116.846727:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318116.846738:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940181632:0@lo:400:kworker.0
00000100:00100000:0.0:1767318116.846754:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181376
00000100:00100000:0.0:1767318116.846763:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181376
00000100:00100000:3.0:1767318116.846806:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318116.846844:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443
00000100:00100000:0.0:1767318116.846855:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940181376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.846909:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181888
00000100:00100000:3.0:1767318116.846914:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181888
00000100:00100000:0.0:1767318116.846919:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940181376:12345-0@lo:400:kworker.0 Request processed in 65us (1576us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318116.846927:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443
00000100:00080000:0.0:1767318116.846953:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318116.846954:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181632
00000100:00080000:0.0:1767318116.846959:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318116.846959:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181632
00000100:00100000:0.0:1767318116.846976:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693
00000100:00100000:0.0:1767318116.846985:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940181888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.847011:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694
00000100:00100000:3.0:1767318116.847020:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940181632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318116.847027:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940181888:12345-0@lo:400:kworker.0 Request processed in 43us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318116.847033:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693
00000100:00080000:0.0:1767318116.847058:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318116.847064:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940181632:12345-0@lo:400:kworker.0 Request processed in 45us (257us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318116.847073:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694
00000100:00100000:0.0:1767318116.847092:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940181376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.847139:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940181632:0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.847154:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940181888:0@lo:400:kworker.0
00000100:00100000:1.0:1767318116.851030:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318116.851592:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318116.851628:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940181248:0@lo:38:kworker.0
00000100:00100000:2.0:1767318116.851659:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318116.851668:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181120
00000100:00100000:2.0:1767318116.851675:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940181760:0@lo:38:kworker.0
00000100:00100000:1.0:1767318116.851690:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181120
00000100:00100000:2.0:1767318116.851694:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318116.851706:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940182016:0@lo:38:kworker.0
00000100:00100000:2.0:1767318116.851724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318116.851755:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181504
00000100:00100000:3.0:1767318116.851761:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181504
00000100:00100000:2.0:1767318116.851763:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181248
00000100:00100000:2.0:1767318116.851769:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181248
00000100:00100000:3.0:1767318116.851829:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444
00000100:00100000:3.0:1767318116.851838:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940181504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318116.851891:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940181504:12345-0@lo:400:kworker.0 Request processed in 55us (867us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318116.851898:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444
00000100:00100000:2.0:1767318116.853826:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883
00000100:00100000:2.0:1767318116.853929:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940181248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318116.853956:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318116.854050:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940181248:12345-0@lo:38:kworker.0 Request processed in 124us (2389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318116.854058:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883
00000100:00080000:2.0:1767318116.854123:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318116.854178:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318116.854183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940181248:0@lo:38:kworker.0
00000100:00100000:2.0:1767318116.854477:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940181760
00000100:00100000:2.0:1767318116.854484:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940181760
00000100:00100000:1.0:1767318116.855126:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182016
00000100:00100000:1.0:1767318116.855132:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182016
00000100:00100000:1.0:1767318116.855175:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16000
00000100:00100000:1.0:1767318116.855181:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940181120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318116.855948:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318116.856026:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940181120:12345-0@lo:38:kworker.0 Request processed in 843us (4433us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318116.856032:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16000
00000100:00100000:1.0:1767318116.856049:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16001
00000100:00100000:1.0:1767318116.856052:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940181760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318116.856062:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318116.856079:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940181760:12345-0@lo:38:kworker.0 Request processed in 26us (4387us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318116.856082:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16001
00000100:00100000:1.0:1767318116.856090:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16002
00000100:00100000:1.0:1767318116.856092:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940182016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318116.856098:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318116.856110:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940182016:12345-0@lo:38:kworker.0 Request processed in 17us (4387us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318116.856113:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16002
00000100:00100000:1.0:1767318116.856155:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940181504:0@lo:400:kworker.0
00000100:00080000:1.0:1767318116.857640:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318116.857654:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318116.857659:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940181120:0@lo:38:kworker.0
00000100:00080000:1.0:1767318116.857700:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318116.857703:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318116.857706:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940181760:0@lo:38:kworker.0
00000100:00080000:1.0:1767318116.857715:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318116.857718:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318116.857721:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940182016:0@lo:38:kworker.0
00000100:00100000:2.0:1767318117.358009:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318117.805872:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318118.380892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318118.829255:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318119.405109:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940182144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318119.405182:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318119.405420:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318119.405521:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182144
00000100:00100000:0.0:1767318119.405529:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182144
00000100:00100000:0.0:1767318119.405594:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952
00000100:00100000:0.0:1767318119.405609:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940182144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318119.405639:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318119.405697:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318119.406478:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940182144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 874us (1293us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318119.406487:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952
00000100:00100000:2.0:1767318119.407050:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940182144:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318119.493978:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318119.494086:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244096
00000100:00100000:2.0:1767318119.494096:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244096
00000100:00100000:2.0:1767318119.494174:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3695
00000100:00100000:2.0:1767318119.494184:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894244096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318119.494274:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894244096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318119.494283:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3695
00000100:00080000:3.0:1767318119.494884:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318119.494960:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318119.495019:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894243968
00000100:00100000:3.0:1767318119.495025:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894243968
00000100:00100000:3.0:1767318119.495058:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16003
00000100:00100000:3.0:1767318119.495064:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894243968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318119.495084:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318119.499680:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894243968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4601us (4708us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318119.499697:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16003
00010000:00010000:1.0:1767318119.853021:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318120.429146:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318120.429558:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940182272:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318120.429634:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318120.430003:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182272
00000100:00100000:0.0:1767318120.430013:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182272
00000100:00100000:0.0:1767318120.430082:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953
00000100:00100000:0.0:1767318120.430092:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940182272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318120.430121:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318120.430329:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940182272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 237us (694us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318120.430336:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953
00000100:00100000:1.0:1767318120.430413:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940182272:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318120.430475:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318120.877737:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318121.453496:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318121.905273:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318121.964938:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318121.964948:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318121.964951:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318121.964955:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318121.964960:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318121.964967:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3366
00000100:00080000:2.0:1767318121.964972:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318121.964980:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318121.965036:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213480 x1853163940182400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318121.965067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318121.965071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318121.965073:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318121.965076:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3366
00000100:00080000:2.0:1767318121.965079:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318121.965083:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318121.965097:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940182528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318121.965225:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940182656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318121.965293:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318121.965348:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318121.965355:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940182784:0@lo:400:kworker.0
00000100:00100000:1.0:1767318121.965378:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318121.965449:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182656
00000100:00100000:1.0:1767318121.965457:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182656
00000100:00100000:1.0:1767318121.965503:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182784
00000100:00100000:1.0:1767318121.965506:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182784
00000100:00100000:1.0:1767318121.965528:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445
00000100:00100000:1.0:1767318121.965536:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940182656:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318121.965573:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318121.965577:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318121.965579:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767318121.965583:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940182656:12345-0@lo:400:kworker.0 Request processed in 48us (289us total) trans 0 rc 0/0
00000100:00080000:2.0:1767318121.965583:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3366
00000100:00080000:2.0:1767318121.965585:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318121.965589:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318121.965590:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445
00000100:00100000:2.0:1767318121.965601:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046add880 x1853163940183040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318121.965614:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318121.965617:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318121.965619:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767318121.965620:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446
00000100:00080000:2.0:1767318121.965622:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3366
00000100:00080000:2.0:1767318121.965624:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318121.965625:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940182784:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318121.965627:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318121.965639:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011180 x1853163940183296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318121.965653:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940182784:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318121.965658:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446
00000100:00100000:2.0:1767318121.965671:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940182912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318121.965681:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940183168:0@lo:400:kworker.0
00000100:00100000:2.0:1767318121.965701:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318121.965721:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940182784:0@lo:400:kworker.0
00000100:00100000:1.0:1767318121.965731:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940182656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318121.965754:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318121.965879:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940182400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.965910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318121.965940:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940182528:0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.965962:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318121.965979:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940183040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.966010:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318121.966027:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940183296:0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.966045:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318121.966079:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182528
00000100:00100000:3.0:1767318121.966083:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182528
00000100:00100000:3.0:1767318121.966103:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884
00000100:00100000:3.0:1767318121.966109:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940182528:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318121.966122:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182912
00000100:00100000:0.0:1767318121.966125:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182912
00010000:00020000:3.0:1767318121.966126:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318121.966163:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183168
00000100:00100000:0.0:1767318121.966166:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183168
00000100:00100000:3.0:1767318121.966178:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940182528:12345-0@lo:38:kworker.0 Request processed in 69us (215us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318121.966181:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940182400
00000100:00100000:0.0:1767318121.966183:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940182400
00000100:00100000:3.0:1767318121.966184:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884
00000100:00100000:0.0:1767318121.966191:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183040
00000100:00100000:0.0:1767318121.966193:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183040
00000100:00100000:0.0:1767318121.966199:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183296
00000100:00100000:0.0:1767318121.966201:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183296
00000100:00100000:0.0:1767318121.966210:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696
00000100:00080000:3.0:1767318121.966213:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318121.966216:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940182912:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318121.966217:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318121.966220:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940182528:0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.966253:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697
00000100:00100000:0.0:1767318121.966254:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940182912:12345-0@lo:400:kworker.0 Request processed in 37us (551us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318121.966259:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696
00000100:00100000:3.0:1767318121.966260:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940183168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318121.966271:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16004
00000100:00100000:0.0:1767318121.966274:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940182400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318121.966284:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318121.966291:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940183168:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318121.966296:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697
00000100:00100000:3.0:1767318121.966310:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16005
00000100:00100000:0.0:1767318121.966314:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940182400:12345-0@lo:38:kworker.0 Request processed in 38us (404us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318121.966314:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940183040:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318121.966320:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16004
00010000:00020000:3.0:1767318121.966323:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318121.966331:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16006
00000100:00100000:0.0:1767318121.966334:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940183296:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318121.966341:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940183040:12345-0@lo:38:kworker.0 Request processed in 27us (331us total) trans 0 rc -19/-19
00010000:00020000:0.0:1767318121.966343:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318121.966346:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16005
00000100:00100000:0.0:1767318121.966361:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940183296:12345-0@lo:38:kworker.0 Request processed in 25us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318121.966367:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16006
00000100:00100000:3.0:1767318121.966368:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940183168:0@lo:400:kworker.0
00000100:00080000:3.0:1767318121.966385:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318121.966387:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940182912:0@lo:400:kworker.0
00000100:00080000:3.0:1767318121.966389:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318121.966398:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940182400:0@lo:38:kworker.0
00000100:00080000:3.0:1767318121.966419:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318121.966422:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318121.966425:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940183040:0@lo:38:kworker.0
00000100:00080000:3.0:1767318121.966432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318121.966435:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318121.966438:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940183296:0@lo:38:kworker.0
00000100:00080000:3.0:1767318121.966463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318121.966467:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318122.476905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318122.925373:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318123.501736:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318123.949297:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318124.529150:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940183424:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318124.529239:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318124.534223:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183424
00000100:00100000:0.0:1767318124.534243:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183424
00000100:00100000:0.0:1767318124.534342:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954
00000100:00100000:0.0:1767318124.534352:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940183424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318124.534399:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318124.534498:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940183424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (5259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318124.534506:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954
00000100:00100000:3.0:1767318124.534573:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767318124.535574:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318124.535664:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940183424:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318124.621718:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318124.621896:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244480
00000100:00100000:2.0:1767318124.621909:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244480
00000100:00080000:1.0:1767318124.622005:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318124.623874:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894244224 offset 0 length 520: 4
00000100:00100000:0.0:1767318124.623932:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318124.630434:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244352
00000100:00100000:1.0:1767318124.630452:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244352
00000100:00100000:1.0:1767318124.630553:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3698
00000100:00100000:1.0:1767318124.630571:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894244480:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318124.630666:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894244480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (8958us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318124.630674:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3698
00000100:00100000:1.0:1767318124.630696:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16007
00000100:00100000:1.0:1767318124.630701:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894244352:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318124.630739:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318124.630769:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894244352:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 67us (6838us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318124.630793:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16007
00010000:00010000:1.0:1767318124.973090:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318125.550279:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940183552:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318125.550356:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318125.550837:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183552
00000100:00100000:3.0:1767318125.550848:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183552
00000100:00100000:3.0:1767318125.550914:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955
00000100:00100000:3.0:1767318125.550924:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940183552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318125.550953:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318125.550994:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940183552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (640us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318125.550998:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955
00000100:00100000:2.0:1767318125.551052:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318125.551083:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940183552:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318125.551144:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318125.999692:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318126.573203:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318127.021011:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318127.084998:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318127.085007:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318127.085010:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318127.085030:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318127.085034:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318127.085041:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3371
00000100:00080000:0.0:1767318127.085046:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318127.085054:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318127.085092:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940183680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318127.085118:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318127.085122:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318127.085124:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318127.085134:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3371
00000100:00080000:0.0:1767318127.085137:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318127.085140:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318127.085170:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797b800 x1853163940183808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318127.085236:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318127.085239:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318127.085241:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318127.085244:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3371
00000100:00080000:0.0:1767318127.085247:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318127.085250:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318127.085260:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940184320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318127.085273:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318127.085280:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318127.085282:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318127.085286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3371
00000100:00080000:0.0:1767318127.085289:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767318127.085292:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318127.085302:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940184576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318127.085326:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940184448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318127.085415:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318127.085471:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318127.085477:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940184192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318127.085503:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318127.085587:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940184064:0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.085621:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318127.085652:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318127.085658:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940183936:0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.085678:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318127.085707:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184064
00000100:00100000:1.0:1767318127.085713:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184064
00000100:00100000:1.0:1767318127.085765:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183936
00000100:00100000:1.0:1767318127.085769:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183936
00000100:00100000:1.0:1767318127.085815:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447
00000100:00100000:1.0:1767318127.085825:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940184064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.085870:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940184064:12345-0@lo:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318127.085877:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447
00000100:00100000:1.0:1767318127.085891:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448
00000100:00100000:1.0:1767318127.085897:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940183936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.085922:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940183936:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318127.085928:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448
00000100:00080000:1.0:1767318127.085962:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318127.085966:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318127.085993:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940183936:0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.086004:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940184064:0@lo:400:kworker.0
00000100:00100000:2.0:1767318127.086014:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184448
00000100:00100000:2.0:1767318127.086018:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184448
00000100:00080000:1.0:1767318127.086039:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318127.086050:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184192
00000100:00100000:2.0:1767318127.086052:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184192
00000100:00100000:1.0:1767318127.086054:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699
00000100:00100000:1.0:1767318127.086060:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940184448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318127.086075:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700
00000100:00100000:2.0:1767318127.086081:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940184192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318127.086092:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940184448:12345-0@lo:400:kworker.0 Request processed in 32us (678us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318127.086098:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699
00000100:00100000:2.0:1767318127.086109:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940184192:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318127.086115:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700
00000100:00080000:1.0:1767318127.086121:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318127.086190:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940183680:0@lo:38:kworker.0
00000100:00100000:3.0:1767318127.086220:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318127.086247:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940183808:0@lo:38:kworker.0
00000100:00100000:3.0:1767318127.086268:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318127.086295:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940184320:0@lo:38:kworker.0
00000100:00100000:3.0:1767318127.086314:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318127.086330:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940184576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318127.086370:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318127.086398:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183680
00000100:00100000:3.0:1767318127.086402:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183680
00000100:00100000:3.0:1767318127.086420:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184320
00000100:00100000:3.0:1767318127.086423:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184320
00000100:00100000:3.0:1767318127.086435:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184576
00000100:00100000:3.0:1767318127.086437:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184576
00000100:00100000:3.0:1767318127.086450:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16008
00000100:00100000:3.0:1767318127.086455:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940183680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318127.086473:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318127.086505:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940183680:12345-0@lo:38:kworker.0 Request processed in 48us (284us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318127.086508:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16009
00000100:00100000:3.0:1767318127.086512:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16008
00000100:00100000:2.0:1767318127.086513:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940184320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318127.086524:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318127.086525:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16010
00000100:00100000:3.0:1767318127.086528:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940184576:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318127.086537:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318127.086549:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940184320:12345-0@lo:38:kworker.0 Request processed in 35us (235us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318127.086554:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940184576:12345-0@lo:38:kworker.0 Request processed in 25us (184us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318127.086555:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16009
00000100:00100000:3.0:1767318127.086559:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16010
00000100:00080000:3.0:1767318127.086587:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318127.086592:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318127.086595:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940183680:0@lo:38:kworker.0
00000100:00080000:3.0:1767318127.086604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318127.086606:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318127.086609:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940184320:0@lo:38:kworker.0
00000100:00080000:3.0:1767318127.086614:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318127.086623:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318127.086625:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940184576:0@lo:38:kworker.0
00000100:00100000:1.0:1767318127.086689:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940183808
00000100:00100000:1.0:1767318127.086693:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940183808
00000100:00100000:1.0:1767318127.086721:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885
00000100:00100000:1.0:1767318127.086726:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940183808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318127.086736:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318127.086795:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940183808:12345-0@lo:38:kworker.0 Request processed in 66us (524us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318127.086800:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885
00000100:00080000:2.0:1767318127.086811:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318127.086815:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318127.086818:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940183808:0@lo:38:kworker.0
00000100:00100000:0.0:1767318127.087284:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940184192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318127.087296:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940184448:0@lo:400:kworker.0
00000100:00100000:2.0:1767318127.597385:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318128.046241:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318128.621731:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318129.069372:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318129.644905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318129.649643:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940184704:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318129.649717:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318129.649856:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184704
00000100:00100000:3.0:1767318129.649865:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184704
00000100:00100000:3.0:1767318129.651247:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956
00000100:00100000:3.0:1767318129.651263:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940184704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318129.651301:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767318129.659493:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318129.666122:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940184704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14854us (16393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318129.666138:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956
00000100:00100000:2.0:1767318129.672060:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940184704:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318129.734269:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318129.734401:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244736
00000100:00100000:2.0:1767318129.734412:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244736
00000100:00080000:1.0:1767318129.734744:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318129.736426:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3701
00000100:00100000:2.0:1767318129.736451:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894244736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318129.736564:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894244736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (2305us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318129.736573:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3701
00000100:00100000:1.0:1767318129.742405:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318129.742821:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244608
00000100:00100000:3.0:1767318129.742833:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244608
00000100:00100000:3.0:1767318129.742918:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16011
00000100:00100000:3.0:1767318129.742927:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894244608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318129.742951:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318129.743055:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894244608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 127us (660us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318129.743062:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16011
00010000:00010000:1.0:1767318130.094604:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318130.668908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318130.669133:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940184832:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318130.669204:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318130.669377:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940184832
00000100:00100000:3.0:1767318130.669387:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940184832
00000100:00100000:3.0:1767318130.669477:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957
00000100:00100000:3.0:1767318130.669488:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940184832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318130.669526:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318130.669571:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940184832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (366us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318130.669577:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957
00000100:00080000:1.0:1767318130.669727:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318130.669814:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940184832:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318131.117188:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318131.180925:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318106/real 1767318106]  req@ffff93d06d3d4a80 x1853163940178432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318131.180964:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d3d4a80 x1853163940178432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318131.180986:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318131.181006:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318131.181010:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940178432:0@lo:250:kworker.0
00000100:00080000:3.0:1767318131.187817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318131.187826:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318131.187829:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318131.187835:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3356
00000100:00080000:3.0:1767318131.187839:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318131.187845:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318131.187883:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940184960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318131.187918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318131.187921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318131.187922:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318131.187926:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3377
00000100:00080000:3.0:1767318131.187929:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318131.187932:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318131.187950:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45408380 x1853163940185088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318131.187960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318131.187963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318131.187965:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318131.187968:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3377
00000100:00080000:3.0:1767318131.187970:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318131.187973:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318131.187985:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940185216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318131.188073:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940185344:0@lo:400:kworker.0
00000100:00100000:1.0:1767318131.188161:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318131.190950:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940184960:0@lo:250:kworker.0
00000400:00000100:0.0:1767318131.191012:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940184960 offset 0 length 520: 4
00000100:00100000:0.0:1767318131.191053:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940185088:0@lo:38:kworker.0
00000100:00100000:0.0:1767318131.191087:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318131.191128:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940185216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318131.191153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318131.191201:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185088
00000100:00100000:0.0:1767318131.191209:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185088
00000100:00100000:0.0:1767318131.191245:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16012
00000100:00100000:0.0:1767318131.191251:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940185088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318131.191273:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318131.191312:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940185088:12345-0@lo:38:kworker.0 Request processed in 60us (225us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318131.191330:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16012
00000100:00080000:0.0:1767318131.191372:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318131.191377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318131.191380:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940185088:0@lo:38:kworker.0
00000100:00100000:0.0:1767318131.191422:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185344
00000100:00100000:0.0:1767318131.191426:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185344
00000100:00100000:0.0:1767318131.191466:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449
00000100:00100000:0.0:1767318131.191470:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940185344:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318131.194009:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318131.194139:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940185472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.194199:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318131.194237:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185472
00000100:00100000:2.0:1767318131.194242:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185472
00000100:00100000:2.0:1767318131.194273:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450
00000100:00100000:2.0:1767318131.194278:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940185472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.194316:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940185472:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318131.194333:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450
00000100:00100000:2.0:1767318131.194373:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940185472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.194405:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185216
00000100:00100000:2.0:1767318131.194408:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185216
00000100:00100000:2.0:1767318131.194423:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886
00000100:00100000:2.0:1767318131.194426:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940185216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318131.194442:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318131.194466:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940185216:12345-0@lo:38:kworker.0 Request processed in 39us (3313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318131.194470:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886
00000100:00080000:2.0:1767318131.194492:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318131.194495:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318131.194498:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940185216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318131.194744:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940185344:12345-0@lo:400:kworker.0 Request processed in 3272us (6582us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318131.194750:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449
00000100:00080000:3.0:1767318131.196416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318131.196434:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318131.196437:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318131.196443:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3377
00000100:00080000:3.0:1767318131.196447:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318131.196453:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318131.196484:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940185728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318131.196515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318131.196518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318131.196520:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318131.196523:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3377
00000100:00080000:3.0:1767318131.196526:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318131.196530:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318131.196539:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9880 x1853163940185984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318131.196579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940185728:0@lo:38:kworker.0
00000100:00100000:3.0:1767318131.196626:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318131.196647:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940185984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318131.196670:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318131.196697:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185728
00000100:00100000:3.0:1767318131.196702:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185728
00000100:00100000:3.0:1767318131.196723:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185984
00000100:00100000:3.0:1767318131.196724:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185984
00000100:00100000:3.0:1767318131.196735:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16013
00000100:00100000:3.0:1767318131.196740:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940185728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318131.196764:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318131.196808:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940185728:12345-0@lo:38:kworker.0 Request processed in 67us (180us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318131.196815:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16013
00000100:00100000:3.0:1767318131.196839:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16014
00000100:00100000:3.0:1767318131.196842:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940185984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318131.196852:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318131.196873:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940185984:12345-0@lo:38:kworker.0 Request processed in 29us (202us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318131.196878:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16014
00000100:00080000:3.0:1767318131.196913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318131.196919:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318131.196922:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940185728:0@lo:38:kworker.0
00000100:00080000:3.0:1767318131.196931:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318131.196934:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318131.196936:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940185984:0@lo:38:kworker.0
00000100:00100000:2.0:1767318131.197126:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940185600:0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.197162:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318131.197192:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318131.197197:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940185856:0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.197219:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318131.197424:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185600
00000100:00100000:3.0:1767318131.197429:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185600
00000100:00100000:3.0:1767318131.197479:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940185856
00000100:00100000:3.0:1767318131.197481:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940185856
00000100:00100000:3.0:1767318131.197499:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702
00000100:00100000:3.0:1767318131.197505:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940185600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318131.197546:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940185600:12345-0@lo:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318131.197552:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702
00000100:00100000:3.0:1767318131.197575:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703
00000100:00100000:3.0:1767318131.197582:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940185856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318131.197602:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940185856:12345-0@lo:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318131.197606:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703
00000100:00100000:3.0:1767318131.197627:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940185856:0@lo:400:kworker.0
00000100:00100000:3.0:1767318131.197633:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940185600:0@lo:400:kworker.0
00000100:00080000:0.0:1767318131.197725:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318131.197806:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940185344:0@lo:400:kworker.0
00000100:00100000:2.0:1767318131.692918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318132.141032:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318132.717923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318133.174091:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318133.741193:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318134.189018:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318134.765092:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318134.765189:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318134.765212:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940186112:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318134.765281:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318134.765441:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186112
00000100:00100000:0.0:1767318134.765448:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186112
00000100:00100000:0.0:1767318134.765512:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958
00000100:00100000:0.0:1767318134.765521:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940186112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318134.765555:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318134.765609:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940186112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318134.765617:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958
00000100:00100000:0.0:1767318134.765673:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940186112:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318134.765854:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318134.854238:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318134.855923:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244864
00000100:00100000:2.0:1767318134.855938:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244864
00000100:00100000:2.0:1767318134.856068:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16015
00000100:00100000:2.0:1767318134.856078:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894244864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318134.856105:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318134.856188:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894244864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 110us (1963us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318134.856195:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16015
00000100:00100000:1.0:1767318134.863200:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318134.863312:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894244992
00000100:00100000:2.0:1767318134.863324:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894244992
00000100:00100000:2.0:1767318134.863442:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3704
00000100:00100000:2.0:1767318134.863451:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894244992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318134.863534:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894244992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (344us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318134.863542:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3704
00000100:00080000:0.0:1767318134.864771:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318135.213021:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318135.789470:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318135.789503:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940186240:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318135.789572:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318135.789813:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186240
00000100:00100000:3.0:1767318135.789822:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186240
00000100:00100000:3.0:1767318135.789885:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959
00000100:00100000:3.0:1767318135.789895:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940186240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318135.789927:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318135.789942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318135.789978:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940186240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (404us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318135.789985:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959
00000100:00080000:2.0:1767318135.789999:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318135.790034:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940186240:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318136.238068:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318136.301076:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318136.301086:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318136.301088:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318136.301092:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318136.301097:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318136.301105:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3381
00000100:00080000:0.0:1767318136.301110:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318136.301116:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318136.301156:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0000 x1853163940186368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318136.301231:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940186368:0@lo:38:kworker.0
00000100:00100000:3.0:1767318136.301306:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318136.301418:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186368
00000100:00100000:1.0:1767318136.301426:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186368
00000100:00100000:1.0:1767318136.301453:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16016
00000100:00100000:1.0:1767318136.301469:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940186368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318136.301487:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318136.301720:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318136.301723:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318136.301725:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318136.301728:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3381
00000100:00080000:0.0:1767318136.301730:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318136.301732:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318136.301744:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940186496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318136.301977:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940186368:12345-0@lo:38:kworker.0 Request processed in 506us (670us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318136.301985:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16016
00000100:00080000:3.0:1767318136.302116:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318136.302121:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318136.302125:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940186368:0@lo:38:kworker.0
00000100:00100000:3.0:1767318136.302156:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940186496:0@lo:38:kworker.0
00000100:00100000:3.0:1767318136.302181:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318136.302255:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186496
00000100:00100000:2.0:1767318136.302260:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186496
00000100:00100000:2.0:1767318136.302302:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887
00000100:00100000:2.0:1767318136.302307:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940186496:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318136.302321:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318136.302357:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940186496:12345-0@lo:38:kworker.0 Request processed in 49us (176us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318136.302361:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887
00000100:00080000:1.0:1767318136.302431:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318136.302434:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318136.302436:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940186496:0@lo:38:kworker.0
00000100:00100000:3.0:1767318136.302855:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940186624:0@lo:400:kworker.0
00000100:00100000:3.0:1767318136.302947:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318136.303005:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186624
00000100:00100000:1.0:1767318136.303010:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186624
00000100:00100000:1.0:1767318136.303058:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451
00000100:00100000:1.0:1767318136.303065:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940186624:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318136.303133:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318136.303226:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940186752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.303253:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318136.303296:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186752
00000100:00100000:2.0:1767318136.303299:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186752
00000100:00100000:2.0:1767318136.303323:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452
00000100:00100000:2.0:1767318136.303329:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940186752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.303362:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940186752:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318136.303368:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452
00000100:00100000:2.0:1767318136.303397:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940186752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318136.303448:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940186624:12345-0@lo:400:kworker.0 Request processed in 385us (500us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318136.303471:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451
00000100:00080000:0.0:1767318136.303702:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318136.303705:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318136.303707:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318136.303711:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3381
00000100:00080000:0.0:1767318136.303715:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318136.303718:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318136.303730:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940187008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318136.303746:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318136.303748:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318136.303749:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318136.303751:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3381
00000100:00080000:0.0:1767318136.303753:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767318136.303755:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318136.303761:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940187264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318136.303814:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940187008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318136.303846:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318136.303971:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940186880:0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.303993:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318136.304012:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318136.304018:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940187136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.304040:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318136.304066:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187008
00000100:00100000:2.0:1767318136.304070:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187008
00000100:00100000:2.0:1767318136.304091:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940186880
00000100:00100000:2.0:1767318136.304094:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940186880
00000100:00100000:2.0:1767318136.304120:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187136
00000100:00100000:2.0:1767318136.304122:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187136
00000100:00100000:2.0:1767318136.304145:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705
00000100:00100000:2.0:1767318136.304150:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940186880:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.304178:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940186880:12345-0@lo:400:kworker.0 Request processed in 28us (184us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318136.304184:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705
00000100:00100000:2.0:1767318136.304195:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706
00000100:00100000:2.0:1767318136.304200:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940187136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.304223:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940187136:12345-0@lo:400:kworker.0 Request processed in 23us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318136.304229:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706
00000100:00100000:2.0:1767318136.304240:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16017
00000100:00100000:2.0:1767318136.304244:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940187008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318136.304259:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318136.304294:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940187008:12345-0@lo:38:kworker.0 Request processed in 48us (447us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318136.304299:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16017
00000100:00080000:2.0:1767318136.304323:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318136.304340:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940187136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.304346:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940186880:0@lo:400:kworker.0
00000100:00080000:0.0:1767318136.304444:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318136.304447:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318136.304449:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940187008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318136.304453:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940187264:0@lo:38:kworker.0
00000100:00100000:0.0:1767318136.304475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318136.304527:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187264
00000100:00100000:1.0:1767318136.304530:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187264
00000100:00100000:1.0:1767318136.304550:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16018
00000100:00100000:1.0:1767318136.304553:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940187264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318136.304560:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318136.304591:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940187264:12345-0@lo:38:kworker.0 Request processed in 37us (115us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318136.304594:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16018
00000100:00080000:0.0:1767318136.304717:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318136.304720:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318136.304722:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940187264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318136.305039:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940186624:0@lo:400:kworker.0
00000100:00100000:2.0:1767318136.813003:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318137.261028:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318137.836901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318138.285001:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318138.869864:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318139.309017:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318139.885391:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318139.885478:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940187392:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318139.885553:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318139.885798:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187392
00000100:00100000:0.0:1767318139.885807:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187392
00000100:00100000:0.0:1767318139.885873:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960
00000100:00100000:0.0:1767318139.885881:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940187392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318139.885908:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318139.885954:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940187392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (401us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318139.885961:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960
00000100:00080000:2.0:1767318139.886065:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318139.886152:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940187392:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318139.978182:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318139.978253:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318139.978370:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245248
00000100:00100000:1.0:1767318139.978381:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245248
00000100:00100000:1.0:1767318139.978463:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245120
00000100:00100000:1.0:1767318139.978466:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245120
00000100:00100000:1.0:1767318139.978500:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3707
00000100:00100000:1.0:1767318139.978510:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894245248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318139.978585:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894245248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318139.978592:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3707
00000100:00100000:1.0:1767318139.978611:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16019
00000100:00100000:1.0:1767318139.978616:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894245120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318139.978637:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318139.978661:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894245120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (408us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318139.978668:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16019
00000100:00080000:3.0:1767318139.979482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318140.333318:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318140.909227:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318140.909269:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940187520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318140.909357:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318140.909487:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187520
00000100:00100000:0.0:1767318140.909497:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187520
00000100:00100000:0.0:1767318140.909565:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961
00000100:00100000:0.0:1767318140.909590:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940187520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318140.909621:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318140.909669:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940187520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (322us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318140.909677:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961
00000100:00100000:0.0:1767318140.909723:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940187520:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318140.910263:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318140.911398:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318141.357024:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318141.421829:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318141.421842:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318141.421845:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318141.421849:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318141.421856:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318141.421873:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3386
00000100:00080000:2.0:1767318141.421878:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318141.421885:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318141.421925:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02680 x1853163940187648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318141.421943:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318141.421947:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318141.421948:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318141.421951:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3386
00000100:00080000:2.0:1767318141.421954:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318141.421957:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318141.421973:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02d80 x1853163940187776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318141.422024:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318141.422027:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318141.422029:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318141.422032:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3386
00000100:00080000:2.0:1767318141.422035:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318141.422039:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318141.422049:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0000 x1853163940188288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318141.422064:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318141.422067:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318141.422069:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318141.422072:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3386
00000100:00080000:2.0:1767318141.422074:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318141.422077:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318141.422086:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2d80 x1853163940188544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318141.422119:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940187904:0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422182:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318141.422438:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318141.422446:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940188032:0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422472:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318141.422513:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187904
00000100:00100000:2.0:1767318141.422520:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187904
00000100:00100000:2.0:1767318141.422566:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188032
00000100:00100000:2.0:1767318141.422569:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188032
00000100:00100000:2.0:1767318141.422592:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453
00000100:00100000:2.0:1767318141.422600:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940187904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422656:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940187904:12345-0@lo:400:kworker.0 Request processed in 56us (473us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318141.422663:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453
00000100:00100000:2.0:1767318141.422680:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454
00000100:00100000:2.0:1767318141.422686:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940188032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422712:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940188032:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318141.422717:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454
00000100:00100000:2.0:1767318141.422737:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940188416:0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422764:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318141.422809:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318141.422815:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940188160:0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.422838:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318141.422979:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318141.423049:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940187648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318141.423080:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318141.423102:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940187776:0@lo:38:kworker.0
00000100:00100000:0.0:1767318141.423124:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318141.423140:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940188288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318141.423161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318141.423178:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940188544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318141.423196:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318141.423262:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188416
00000100:00100000:0.0:1767318141.423266:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188416
00000100:00100000:0.0:1767318141.423303:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188160
00000100:00100000:0.0:1767318141.423306:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188160
00000100:00100000:0.0:1767318141.423320:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187648
00000100:00100000:0.0:1767318141.423322:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187648
00000100:00100000:0.0:1767318141.423330:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188288
00000100:00100000:0.0:1767318141.423333:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188288
00000100:00100000:0.0:1767318141.423340:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188544
00000100:00100000:0.0:1767318141.423342:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188544
00000100:00100000:0.0:1767318141.423351:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708
00000100:00100000:0.0:1767318141.423358:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940188416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318141.423475:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940187776
00000100:00100000:1.0:1767318141.423479:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940187776
00000100:00100000:1.0:1767318141.423502:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888
00000100:00100000:1.0:1767318141.423507:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940187776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318141.423526:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318141.423562:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940187776:12345-0@lo:38:kworker.0 Request processed in 53us (436us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318141.423569:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888
00000100:00100000:1.0:1767318141.423590:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709
00000100:00100000:1.0:1767318141.423597:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940188160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318141.423650:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16020
00000100:00100000:2.0:1767318141.423655:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940187648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318141.423666:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318141.423692:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940187648:12345-0@lo:38:kworker.0 Request processed in 36us (610us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318141.423698:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16020
00000100:00100000:2.0:1767318141.423715:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16021
00000100:00100000:2.0:1767318141.423718:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940188288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318141.423727:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318141.423748:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940188288:12345-0@lo:38:kworker.0 Request processed in 28us (586us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318141.423754:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16021
00000100:00100000:2.0:1767318141.423765:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16022
00000100:00100000:2.0:1767318141.423769:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940188544:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318141.429263:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940188032:0@lo:400:kworker.0
00000100:00100000:3.0:1767318141.429286:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940187904:0@lo:400:kworker.0
00000100:00080000:3.0:1767318141.429325:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318141.430494:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940188416:12345-0@lo:400:kworker.0 Request processed in 7128us (7721us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318141.430506:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708
00000100:00080000:0.0:1767318141.430582:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318141.430588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318141.430592:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940187648:0@lo:38:kworker.0
00000100:00080000:0.0:1767318141.430604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318141.430608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318141.430610:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940187776:0@lo:38:kworker.0
00000100:00080000:0.0:1767318141.430619:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318141.430622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318141.430624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940188288:0@lo:38:kworker.0
00010000:00020000:2.0:1767318141.434181:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318141.436283:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940188160:12345-0@lo:400:kworker.0 Request processed in 12677us (13434us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318141.436300:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709
00000100:00100000:2.0:1767318141.436753:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940188544:12345-0@lo:38:kworker.0 Request processed in 12980us (13553us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318141.436763:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16022
00000100:00100000:3.0:1767318141.443173:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940188160:0@lo:400:kworker.0
00000100:00100000:3.0:1767318141.443194:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940188416:0@lo:400:kworker.0
00000100:00080000:0.0:1767318141.447075:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318141.447089:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318141.447094:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940188544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318141.932966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318142.383591:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318142.957728:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318143.405831:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318143.980936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318144.429876:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318145.004900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318145.005173:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318145.005230:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940188672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318145.005303:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318145.005480:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188672
00000100:00100000:0.0:1767318145.005488:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188672
00000100:00100000:0.0:1767318145.005549:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962
00000100:00100000:0.0:1767318145.005559:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940188672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318145.005592:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318145.005633:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940188672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318145.005656:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962
00000100:00100000:2.0:1767318145.005735:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940188672:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318145.007849:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318145.095034:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318145.100211:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245376
00000100:00100000:2.0:1767318145.100228:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245376
00000100:00100000:2.0:1767318145.100295:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16023
00000100:00100000:2.0:1767318145.100304:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894245376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318145.100331:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318145.100429:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894245376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 124us (5407us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318145.100437:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16023
00000100:00100000:0.0:1767318145.109965:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318145.112174:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245504
00000100:00100000:1.0:1767318145.112190:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245504
00000100:00100000:1.0:1767318145.112460:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3710
00000100:00100000:1.0:1767318145.112470:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894245504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318145.112560:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894245504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (2606us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318145.112567:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3710
00000100:00080000:3.0:1767318145.118892:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318145.453030:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318146.028907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318146.031122:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940188800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318146.031207:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318146.032843:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188800
00000100:00100000:1.0:1767318146.032858:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188800
00000100:00100000:1.0:1767318146.032953:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963
00000100:00100000:1.0:1767318146.032980:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940188800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318146.033017:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318146.033107:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940188800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (1900us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318146.033115:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963
00000100:00080000:3.0:1767318146.033217:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318146.033366:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940188800:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318146.477104:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318146.544394:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318146.544410:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318146.544414:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318146.544418:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318146.544423:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318146.544431:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3391
00000100:00080000:0.0:1767318146.544436:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318146.544443:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318146.544501:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02d80 x1853163940188928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318146.544533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318146.544537:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318146.544538:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318146.544542:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3391
00000100:00080000:0.0:1767318146.544544:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318146.544547:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318146.544565:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abce00 x1853163940189056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318146.544621:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318146.544624:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318146.544640:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318146.544643:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3391
00000100:00080000:0.0:1767318146.544646:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318146.544650:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318146.544661:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401ad80 x1853163940189440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318146.544682:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318146.544685:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318146.544687:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318146.544690:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3391
00000100:00080000:0.0:1767318146.544692:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318146.544695:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318146.544703:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399fb80 x1853163940189696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318146.544855:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940188928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.544925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318146.544997:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940189056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.545025:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318146.545041:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940189440:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.545060:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318146.545078:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940189696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.545097:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318146.545140:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940188928
00000100:00100000:2.0:1767318146.545148:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940188928
00000100:00100000:2.0:1767318146.545173:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189440
00000100:00100000:2.0:1767318146.545176:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189440
00000100:00100000:2.0:1767318146.545199:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189696
00000100:00100000:2.0:1767318146.545202:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189696
00000100:00100000:2.0:1767318146.545218:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16024
00000100:00100000:2.0:1767318146.545224:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940188928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318146.545246:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318146.545287:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940188928:12345-0@lo:38:kworker.0 Request processed in 62us (362us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318146.545295:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16024
00000100:00100000:2.0:1767318146.545311:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16025
00000100:00100000:2.0:1767318146.545314:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940189440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318146.545323:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318146.545346:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940189440:12345-0@lo:38:kworker.0 Request processed in 30us (285us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318146.545352:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16025
00000100:00100000:2.0:1767318146.545363:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16026
00000100:00100000:2.0:1767318146.545366:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940189696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318146.545377:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318146.545398:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940189696:12345-0@lo:38:kworker.0 Request processed in 30us (300us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318146.545404:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16026
00000100:00100000:2.0:1767318146.545423:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318146.545432:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940189568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318146.545457:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318146.545481:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189568
00000100:00100000:2.0:1767318146.545484:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189568
00000100:00100000:2.0:1767318146.545536:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711
00000100:00100000:2.0:1767318146.545542:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940189568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318146.545582:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940189568:12345-0@lo:400:kworker.0 Request processed in 40us (124us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318146.545588:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711
00000100:00080000:2.0:1767318146.545622:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318146.545627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318146.545630:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940188928:0@lo:38:kworker.0
00000100:00080000:2.0:1767318146.545639:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318146.545642:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318146.545644:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940189440:0@lo:38:kworker.0
00000100:00080000:2.0:1767318146.545651:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318146.545653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318146.545656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940189696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.545695:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940189568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318146.545911:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940189184:0@lo:400:kworker.0
00000100:00100000:1.0:1767318146.545944:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318146.545983:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318146.545989:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940189312:0@lo:400:kworker.0
00000100:00100000:1.0:1767318146.546010:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318146.546094:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318146.546158:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189056
00000100:00100000:0.0:1767318146.546163:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189056
00000100:00100000:0.0:1767318146.546203:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889
00000100:00100000:0.0:1767318146.546208:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940189056:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318146.546221:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318146.546245:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189312
00000100:00100000:1.0:1767318146.546249:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189312
00000100:00100000:0.0:1767318146.546263:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940189056:12345-0@lo:38:kworker.0 Request processed in 54us (1238us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318146.546269:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889
00000100:00100000:1.0:1767318146.546277:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712
00000100:00100000:1.0:1767318146.546283:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940189312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318146.546317:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940189312:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318146.546324:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712
00000100:00100000:0.0:1767318146.546339:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940189312:0@lo:400:kworker.0
00000100:00080000:3.0:1767318146.546390:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318146.546420:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318146.546425:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318146.546428:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940189056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318146.547171:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189184
00000100:00100000:2.0:1767318146.547177:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189184
00000100:00100000:2.0:1767318146.547235:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455
00000100:00100000:2.0:1767318146.547243:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940189184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318146.547307:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940189184:12345-0@lo:400:kworker.0 Request processed in 64us (1361us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318146.547313:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455
00000100:00100000:0.0:1767318146.547419:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940189184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318147.053115:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318147.501224:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318148.077068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318148.527389:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318149.101576:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318149.194354:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767318149.194408:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894245632 offset 0 length 520: 4
00000100:00100000:0.0:1767318149.194431:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318149.194540:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245888
00000100:00100000:2.0:1767318149.194550:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245888
00000100:00100000:2.0:1767318149.194626:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894245760
00000100:00100000:2.0:1767318149.194629:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894245760
00000100:00100000:2.0:1767318149.194653:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3713
00000100:00100000:2.0:1767318149.194663:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894245888:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318149.194746:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894245888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (412us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318149.194753:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3713
00000100:00100000:2.0:1767318149.194814:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16027
00000100:00100000:2.0:1767318149.194820:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894245760:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318149.194841:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318149.194869:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894245760:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (437us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318149.194876:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16027
00000100:00080000:0.0:1767318149.195062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318149.549023:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318150.124929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318150.125000:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940189824:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318150.125073:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318150.125254:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189824
00000100:00100000:3.0:1767318150.125263:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189824
00000100:00100000:3.0:1767318150.125395:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964
00000100:00080000:1.0:1767318150.125407:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318150.125410:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940189824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318150.125442:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318150.125492:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940189824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (419us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318150.125500:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964
00000100:00100000:1.0:1767318150.125789:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940189824:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318150.573607:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318151.149305:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318151.149518:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940189952:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318151.149588:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318151.149771:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940189952
00000100:00100000:0.0:1767318151.149796:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940189952
00000100:00100000:0.0:1767318151.149862:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965
00000100:00100000:0.0:1767318151.149872:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940189952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318151.149914:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318151.149972:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940189952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (383us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318151.149979:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965
00000100:00100000:3.0:1767318151.150066:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940189952:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318151.150196:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318151.599553:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318151.661092:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318151.661103:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318151.661124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318151.661128:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318151.661143:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318151.661151:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3396
00000100:00080000:1.0:1767318151.661155:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318151.661161:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318151.661196:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adfb80 x1853163940190080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318151.661226:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318151.661230:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318151.661232:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318151.661235:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3396
00000100:00080000:1.0:1767318151.661237:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318151.661240:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318151.661263:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0700 x1853163940190208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318151.661321:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318151.661325:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318151.661327:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318151.661330:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3396
00000100:00080000:1.0:1767318151.661332:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318151.661346:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318151.661359:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc000 x1853163940190592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318151.661388:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318151.661391:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318151.661392:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318151.661396:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3396
00000100:00080000:1.0:1767318151.661398:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318151.661401:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318151.661412:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7800 x1853163940190848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318151.661437:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940190720:0@lo:400:kworker.0
00000100:00100000:1.0:1767318151.661501:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318151.661562:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318151.661569:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940190464:0@lo:400:kworker.0
00000100:00100000:1.0:1767318151.661592:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318151.661619:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190720
00000100:00100000:1.0:1767318151.661625:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190720
00000100:00100000:1.0:1767318151.661670:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190464
00000100:00100000:1.0:1767318151.661674:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190464
00000100:00100000:1.0:1767318151.661696:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714
00000100:00100000:1.0:1767318151.661704:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940190720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318151.661760:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940190720:12345-0@lo:400:kworker.0 Request processed in 56us (258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318151.661766:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714
00000100:00100000:1.0:1767318151.661805:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715
00000100:00100000:1.0:1767318151.661811:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940190464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318151.661837:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940190464:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318151.661848:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715
00000100:00080000:1.0:1767318151.661865:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318151.661900:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940190464:0@lo:400:kworker.0
00000100:00100000:1.0:1767318151.661910:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940190720:0@lo:400:kworker.0
00000100:00100000:3.0:1767318151.662465:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940190080:0@lo:38:kworker.0
00000100:00100000:3.0:1767318151.662502:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318151.662538:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940190208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318151.662563:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318151.662583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940190592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318151.662603:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318151.662619:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940190848:0@lo:38:kworker.0
00000100:00100000:3.0:1767318151.662637:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318151.662672:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190208
00000100:00100000:3.0:1767318151.662677:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190208
00000100:00100000:3.0:1767318151.662701:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890
00000100:00100000:3.0:1767318151.662706:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940190208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318151.662723:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318151.662763:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940190208:12345-0@lo:38:kworker.0 Request processed in 55us (199us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318151.662770:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890
00000100:00100000:3.0:1767318151.662813:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190080
00000100:00100000:3.0:1767318151.662817:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190080
00000100:00100000:3.0:1767318151.662834:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190592
00000100:00100000:3.0:1767318151.662836:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190592
00000100:00100000:3.0:1767318151.662843:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190848
00000100:00100000:3.0:1767318151.662845:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190848
00000100:00100000:3.0:1767318151.662855:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16028
00000100:00100000:3.0:1767318151.662860:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318151.662869:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318151.662895:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190080:12345-0@lo:38:kworker.0 Request processed in 33us (391us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318151.662900:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16028
00000100:00100000:3.0:1767318151.662910:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16029
00000100:00100000:3.0:1767318151.662913:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318151.662921:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318151.662939:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190592:12345-0@lo:38:kworker.0 Request processed in 25us (336us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318151.662944:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16029
00000100:00100000:3.0:1767318151.662953:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16030
00000100:00100000:3.0:1767318151.662956:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318151.662964:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318151.662982:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940190848:12345-0@lo:38:kworker.0 Request processed in 24us (343us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318151.662996:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16030
00000100:00080000:3.0:1767318151.663055:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318151.663060:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318151.663064:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940190080:0@lo:38:kworker.0
00000100:00080000:3.0:1767318151.663072:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318151.663075:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318151.663077:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940190208:0@lo:38:kworker.0
00000100:00080000:3.0:1767318151.663084:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318151.663087:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318151.663089:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940190592:0@lo:38:kworker.0
00000100:00080000:3.0:1767318151.663095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318151.663098:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318151.663100:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940190848:0@lo:38:kworker.0
00000100:00100000:2.0:1767318151.663219:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940190336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318151.663249:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318151.663579:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190336
00000100:00100000:3.0:1767318151.663584:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190336
00000100:00100000:3.0:1767318151.663624:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456
00000100:00100000:3.0:1767318151.663631:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940190336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318151.663678:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940190336:12345-0@lo:400:kworker.0 Request processed in 48us (428us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318151.663685:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456
00000100:00100000:1.0:1767318151.663803:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940190336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318152.173445:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318152.628656:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318153.197053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318153.648755:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318154.220939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318154.311190:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318154.311989:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246144
00000100:00100000:1.0:1767318154.312000:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246144
00000100:00100000:1.0:1767318154.312093:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3716
00000100:00080000:2.0:1767318154.312098:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318154.312105:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894246144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318154.312216:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894246144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 115us (1035us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318154.312224:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3716
00000100:00100000:3.0:1767318154.312836:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318154.313203:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246016
00000100:00100000:1.0:1767318154.313208:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246016
00000100:00100000:1.0:1767318154.313241:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16031
00000100:00100000:1.0:1767318154.313247:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894246016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318154.313267:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318154.313313:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894246016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 65us (477us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318154.313319:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16031
00010000:00010000:0.0:1767318154.670153:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318155.246816:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318155.247428:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940190976:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318155.247506:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318155.247841:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940190976
00000100:00100000:2.0:1767318155.247850:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940190976
00000100:00100000:2.0:1767318155.247937:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966
00000100:00100000:2.0:1767318155.247947:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940190976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318155.247995:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318155.248055:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940190976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (549us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318155.248062:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966
00000100:00100000:3.0:1767318155.248234:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940190976:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318155.248305:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318155.693147:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318156.269217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318156.276413:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318156.276441:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940191104:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318156.276518:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318156.278457:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191104
00000100:00100000:0.0:1767318156.278482:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191104
00000100:00100000:0.0:1767318156.278568:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967
00000100:00100000:0.0:1767318156.278577:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940191104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318156.278610:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318156.278700:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940191104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318156.278709:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967
00000100:00100000:3.0:1767318156.278877:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940191104:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318156.279062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318156.717051:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318156.780932:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318156.780944:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318156.780946:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318156.780950:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318156.780954:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318156.780963:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3401
00000100:00080000:1.0:1767318156.780968:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318156.780975:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318156.781016:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940191232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318156.781042:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318156.781046:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318156.781048:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318156.781051:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3401
00000100:00080000:1.0:1767318156.781054:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318156.781057:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318156.781070:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940191360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318156.781113:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318131/real 1767318131]  req@ffff93cf49a8b800 x1853163940184960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318156.781132:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318156.781135:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318156.781137:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318156.781140:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3401
00000100:00100000:0.0:1767318156.781142:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf49a8b800 x1853163940184960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318156.781143:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318156.781147:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318156.781175:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4a80 x1853163940191744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318156.781197:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940191232:0@lo:38:kworker.0
00000100:00080000:1.0:1767318156.781199:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318156.781202:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318156.781204:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318156.781207:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3401
00000100:00080000:1.0:1767318156.781209:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318156.781212:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318156.781222:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0700 x1853163940192000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318156.781247:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940191616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318156.781270:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318156.781280:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318156.781289:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940191872:0@lo:400:kworker.0
00000100:00100000:1.0:1767318156.781310:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318156.781328:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940191360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318156.781342:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191232
00000100:00100000:1.0:1767318156.781348:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191232
00000100:00100000:0.0:1767318156.781351:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318156.781365:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940191744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318156.781375:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191872
00000100:00100000:1.0:1767318156.781378:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191872
00000100:00100000:0.0:1767318156.781382:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318156.781395:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318156.781406:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318156.781409:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940184960:0@lo:250:kworker.0
00000100:00100000:1.0:1767318156.781411:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191744
00000100:00100000:1.0:1767318156.781413:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191744
00000100:00100000:1.0:1767318156.781428:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717
00000100:00100000:0.0:1767318156.781430:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940192000:0@lo:38:kworker.0
00000100:00100000:1.0:1767318156.781436:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940191872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318156.781450:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318156.781502:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940191872:12345-0@lo:400:kworker.0 Request processed in 65us (190us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318156.781509:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717
00000100:00100000:0.0:1767318156.781515:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192000
00000100:00100000:0.0:1767318156.781518:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192000
00000100:00100000:1.0:1767318156.781527:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16032
00000100:00100000:1.0:1767318156.781542:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940191232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318156.781565:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318156.781598:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940191232:12345-0@lo:38:kworker.0 Request processed in 54us (328us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318156.781958:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16033
00000100:00100000:0.0:1767318156.781963:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940191744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318156.781974:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318156.782004:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940191744:12345-0@lo:38:kworker.0 Request processed in 39us (619us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318156.782010:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16033
00000100:00100000:0.0:1767318156.782024:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16034
00000100:00100000:0.0:1767318156.782028:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940192000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318156.782038:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318156.782059:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940192000:12345-0@lo:38:kworker.0 Request processed in 30us (609us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318156.782073:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16034
00000100:00100000:0.0:1767318156.782118:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318156.782170:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16032
00000100:00100000:1.0:1767318156.782184:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191616
00000100:00100000:1.0:1767318156.782188:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191616
00000100:00100000:1.0:1767318156.782209:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718
00000100:00100000:1.0:1767318156.782215:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940191616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318156.782247:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940191616:12345-0@lo:400:kworker.0 Request processed in 32us (129us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318156.782253:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718
00000100:00100000:1.0:1767318156.782292:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940191872:0@lo:400:kworker.0
00000100:00100000:0.0:1767318156.782301:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940191616:0@lo:400:kworker.0
00000100:00080000:1.0:1767318156.782310:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767318156.782312:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:1.0:1767318156.782314:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318156.782316:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767318156.782318:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940191488:0@lo:400:kworker.0
00000100:00080000:1.0:1767318156.782320:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3381
00000100:00080000:1.0:1767318156.782322:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318156.782326:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318156.782340:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3800 x1853163940192128/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318156.782344:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318156.782379:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940192128:0@lo:250:kworker.0
00000100:00100000:1.0:1767318156.782392:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191488
00000100:00100000:1.0:1767318156.782396:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191488
00000400:00000100:0.0:1767318156.782399:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940192128 offset 0 length 520: 4
00000100:00080000:0.0:1767318156.782420:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318156.782421:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457
00000100:00080000:0.0:1767318156.782423:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318156.782426:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940192000:0@lo:38:kworker.0
00000100:00100000:1.0:1767318156.782427:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940191488:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767318156.782434:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318156.782437:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318156.782439:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940191232:0@lo:38:kworker.0
00000100:00080000:0.0:1767318156.782447:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318156.782450:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318156.782452:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940191744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318156.782466:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940191488:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318156.782473:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457
00000100:00100000:0.0:1767318156.782561:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940191488:0@lo:400:kworker.0
00000100:00080000:0.0:1767318156.782596:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318156.782752:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940191360
00000100:00100000:0.0:1767318156.782757:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940191360
00000100:00100000:0.0:1767318156.782894:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891
00000100:00100000:0.0:1767318156.782899:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940191360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318156.782913:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318156.782954:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940191360:12345-0@lo:38:kworker.0 Request processed in 53us (1601us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318156.782960:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891
00000100:00080000:0.0:1767318156.782989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318156.782992:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318156.782996:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940191360:0@lo:38:kworker.0
00000100:00100000:2.0:1767318157.294415:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318157.742319:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318158.317640:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318158.765179:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318159.340957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318159.434266:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318159.434352:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318159.434427:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246400
00000100:00100000:0.0:1767318159.434437:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246400
00000100:00100000:0.0:1767318159.434523:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246272
00000100:00100000:0.0:1767318159.434527:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246272
00000100:00100000:0.0:1767318159.434549:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3719
00000100:00100000:0.0:1767318159.434560:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894246400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318159.434627:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318159.434634:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894246400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318159.434641:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3719
00000100:00100000:1.0:1767318159.434658:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16035
00000100:00100000:1.0:1767318159.434664:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894246272:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318159.434686:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318159.434717:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894246272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318159.439818:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16035
00010000:00010000:0.0:1767318159.790337:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318160.364928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318160.365291:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940192256:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318160.365363:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318160.365590:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192256
00000100:00100000:2.0:1767318160.365600:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192256
00000100:00100000:2.0:1767318160.365676:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968
00000100:00100000:2.0:1767318160.365686:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940192256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318160.365722:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767318160.365867:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318160.366473:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940192256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 787us (1108us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318160.366483:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968
00000100:00100000:1.0:1767318160.366648:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940192256:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318160.814810:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318161.388913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318161.389144:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318161.389165:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940192384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318161.389253:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318161.389382:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192384
00000100:00100000:2.0:1767318161.389391:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192384
00000100:00100000:2.0:1767318161.389463:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969
00000100:00100000:2.0:1767318161.389473:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940192384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318161.389504:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318161.389550:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940192384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318161.389557:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969
00000100:00100000:1.0:1767318161.389703:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940192384:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318161.389904:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318161.840198:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318161.901177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318161.901189:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318161.901192:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318161.901196:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318161.901201:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318161.901210:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3406
00000100:00080000:0.0:1767318161.901216:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318161.901243:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318161.901284:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712d9880 x1853163940192512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318161.901318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318161.901322:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318161.901324:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318161.901327:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3406
00000100:00080000:0.0:1767318161.901330:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318161.901334:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318161.901349:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712db100 x1853163940192640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318161.901402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318161.901407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318161.901408:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318161.901411:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3406
00000100:00080000:0.0:1767318161.901414:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318161.901417:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318161.901427:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dad80 x1853163940193024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318161.901440:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318161.901443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318161.901445:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318161.901448:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3406
00000100:00080000:0.0:1767318161.901450:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318161.901459:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318161.901470:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712d8e00 x1853163940193280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318161.901539:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940192512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318161.901629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318161.901705:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940192640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318161.901733:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318161.901764:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940193024:0@lo:38:kworker.0
00000100:00100000:2.0:1767318161.901809:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318161.901833:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940193280:0@lo:38:kworker.0
00000100:00100000:2.0:1767318161.901873:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318161.901918:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192640
00000100:00100000:2.0:1767318161.901926:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192640
00000100:00100000:2.0:1767318161.901962:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892
00000100:00100000:2.0:1767318161.901969:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940192640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318161.901991:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318161.902031:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940192640:12345-0@lo:38:kworker.0 Request processed in 61us (296us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318161.902038:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892
00000100:00100000:2.0:1767318161.902073:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192512
00000100:00100000:2.0:1767318161.902077:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192512
00000100:00100000:2.0:1767318161.902095:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193024
00000100:00100000:2.0:1767318161.902099:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193024
00000100:00100000:2.0:1767318161.902113:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193280
00000100:00100000:2.0:1767318161.902116:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193280
00000100:00100000:2.0:1767318161.902127:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16036
00000100:00100000:2.0:1767318161.902131:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940192512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318161.902141:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318161.902165:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940192512:12345-0@lo:38:kworker.0 Request processed in 32us (536us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318161.902170:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16036
00000100:00100000:2.0:1767318161.902181:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16037
00000100:00100000:2.0:1767318161.902185:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940193024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318161.902194:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318161.902215:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940193024:12345-0@lo:38:kworker.0 Request processed in 29us (405us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318161.902221:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16037
00000100:00100000:2.0:1767318161.902231:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16038
00000100:00100000:2.0:1767318161.902235:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940193280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318161.902246:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318161.902267:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940193280:12345-0@lo:38:kworker.0 Request processed in 30us (393us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318161.902272:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16038
00000100:00080000:2.0:1767318161.902309:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318161.902314:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318161.902317:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940192512:0@lo:38:kworker.0
00000100:00080000:2.0:1767318161.902326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318161.902329:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318161.902331:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940192640:0@lo:38:kworker.0
00000100:00080000:2.0:1767318161.902338:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318161.902340:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318161.902343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940193024:0@lo:38:kworker.0
00000100:00080000:2.0:1767318161.902348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318161.902350:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318161.902352:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940193280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318161.902596:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940192768:0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.902629:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318161.902676:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940193152:0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.902701:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318161.902726:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318161.902743:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940192896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.902797:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318161.902821:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193152
00000100:00100000:1.0:1767318161.902826:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193152
00000100:00100000:1.0:1767318161.902864:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192896
00000100:00100000:1.0:1767318161.902867:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192896
00000100:00100000:1.0:1767318161.902885:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720
00000100:00100000:1.0:1767318161.902891:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940193152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.902931:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940193152:12345-0@lo:400:kworker.0 Request processed in 40us (229us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318161.902938:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720
00000100:00100000:1.0:1767318161.902952:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721
00000100:00100000:1.0:1767318161.902958:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940192896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.902984:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940192896:12345-0@lo:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318161.902990:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721
00000100:00080000:1.0:1767318161.903005:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318161.903026:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940192896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318161.903036:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940193152:0@lo:400:kworker.0
00000100:00100000:2.0:1767318161.904585:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940192768
00000100:00100000:2.0:1767318161.904596:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940192768
00000100:00100000:2.0:1767318161.904702:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458
00000100:00100000:2.0:1767318161.904711:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940192768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318161.904829:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940192768:12345-0@lo:400:kworker.0 Request processed in 119us (2199us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318161.904836:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458
00000100:00100000:1.0:1767318161.904912:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940192768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318162.412897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318162.861094:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318163.437180:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318163.885274:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318164.462116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318164.550011:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318164.551335:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246656
00000100:00100000:0.0:1767318164.551348:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246656
00000100:00100000:0.0:1767318164.551456:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3722
00000100:00100000:0.0:1767318164.551468:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894246656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318164.551558:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894246656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (1557us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318164.551566:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3722
00000100:00080000:1.0:1767318164.551650:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318164.556683:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318164.556850:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246528
00000100:00100000:1.0:1767318164.556861:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246528
00000100:00100000:1.0:1767318164.556902:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16039
00000100:00100000:1.0:1767318164.556911:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894246528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318164.556939:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318164.557030:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894246528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 117us (355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318164.557038:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16039
00010000:00010000:0.0:1767318164.909801:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318165.485883:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318165.485915:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940193408:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318165.485983:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318165.486064:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193408
00000100:00100000:0.0:1767318165.486071:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193408
00000100:00100000:0.0:1767318165.486137:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970
00000100:00100000:0.0:1767318165.486146:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940193408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318165.486181:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318165.486222:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940193408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (239us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318165.486230:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970
00000100:00080000:0.0:1767318165.486250:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318165.486283:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940193408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318165.487115:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318165.933226:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318166.508901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318166.512354:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318166.512377:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940193536:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318166.512451:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318166.512649:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193536
00000100:00100000:3.0:1767318166.512657:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193536
00000100:00080000:0.0:1767318166.512711:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318166.512724:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971
00000100:00100000:3.0:1767318166.512735:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940193536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318166.512764:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318166.512852:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940193536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318166.512859:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971
00000100:00100000:0.0:1767318166.512930:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940193536:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318166.957542:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318167.027450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318167.027461:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318167.027464:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318167.027467:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318167.027471:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318167.027479:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3411
00000100:00080000:1.0:1767318167.027483:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318167.027489:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318167.027529:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df480 x1853163940193664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318167.027557:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318167.027562:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318167.027563:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318167.027566:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3411
00000100:00080000:1.0:1767318167.027568:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318167.027572:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318167.027588:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dea00 x1853163940193792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318167.027652:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318167.027655:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318167.027657:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318167.027661:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3411
00000100:00080000:1.0:1767318167.027663:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318167.027667:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318167.027679:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dc000 x1853163940194304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318167.027706:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318167.027709:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318167.027711:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318167.027715:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3411
00000100:00080000:1.0:1767318167.027717:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318167.027721:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318167.027741:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dfb80 x1853163940194560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318167.027827:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194048:0@lo:400:kworker.0
00000100:00100000:2.0:1767318167.027897:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318167.027966:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318167.027973:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940193920:0@lo:400:kworker.0
00000100:00100000:2.0:1767318167.028004:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318167.028031:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940194432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318167.028057:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318167.028074:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318167.028079:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940194176:0@lo:400:kworker.0
00000100:00100000:2.0:1767318167.028100:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318167.029902:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194048
00000100:00100000:1.0:1767318167.029919:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194048
00000100:00100000:1.0:1767318167.030009:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193920
00000100:00100000:1.0:1767318167.030013:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193920
00000100:00100000:2.0:1767318167.030047:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459
00000100:00100000:2.0:1767318167.030058:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194048:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318167.030088:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318167.030149:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194048:12345-0@lo:400:kworker.0 Request processed in 92us (2250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318167.030227:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194432
00000100:00100000:3.0:1767318167.030228:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318167.030231:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194432
00000100:00080000:3.0:1767318167.030264:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318167.030265:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194176
00000100:00100000:0.0:1767318167.030268:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194176
00000100:00100000:3.0:1767318167.030288:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723
00000100:00100000:0.0:1767318167.030292:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724
00000100:00100000:0.0:1767318167.030297:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940194176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318167.030297:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940194432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318167.030335:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940194432:12345-0@lo:400:kworker.0 Request processed in 40us (2277us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318167.030337:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940194176:12345-0@lo:400:kworker.0 Request processed in 40us (2237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318167.030341:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723
00000100:00100000:0.0:1767318167.030345:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724
00000100:00100000:3.0:1767318167.030371:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940194176:0@lo:400:kworker.0
00000100:00100000:0.0:1767318167.030372:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940193664:0@lo:38:kworker.0
00000100:00100000:3.0:1767318167.030381:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940194432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318167.030401:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318167.030404:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318167.030420:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940193792:0@lo:38:kworker.0
00000100:00100000:0.0:1767318167.030444:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318167.030470:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940194304:0@lo:38:kworker.0
00000100:00100000:0.0:1767318167.030490:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318167.030507:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940194560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318167.030529:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318167.030534:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193792
00000100:00100000:3.0:1767318167.030538:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193792
00000100:00100000:0.0:1767318167.030556:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940193664
00000100:00100000:0.0:1767318167.030559:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940193664
00000100:00100000:3.0:1767318167.030559:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893
00000100:00100000:3.0:1767318167.030564:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940193792:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318167.030575:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194304
00000100:00100000:0.0:1767318167.030577:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194304
00010000:00020000:3.0:1767318167.030582:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318167.030588:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194560
00000100:00100000:0.0:1767318167.030590:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194560
00000100:00100000:0.0:1767318167.030598:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16040
00000100:00100000:0.0:1767318167.030602:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940193664:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318167.030613:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940193792:12345-0@lo:38:kworker.0 Request processed in 49us (168us total) trans 0 rc -19/-19
00010000:00020000:0.0:1767318167.030619:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318167.030619:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893
00000100:00100000:0.0:1767318167.030656:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940193664:12345-0@lo:38:kworker.0 Request processed in 52us (254us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318167.030662:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16040
00000100:00100000:3.0:1767318167.030673:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16041
00000100:00100000:3.0:1767318167.030678:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940194304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318167.030687:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318167.030722:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940194304:12345-0@lo:38:kworker.0 Request processed in 43us (231us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318167.039541:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460
00000100:00100000:1.0:1767318167.039563:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940193920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318167.039669:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940193920:12345-0@lo:400:kworker.0 Request processed in 118us (11674us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318167.039677:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460
00000100:00100000:0.0:1767318167.039757:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16042
00000100:00100000:0.0:1767318167.039764:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940194560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318167.039793:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318167.039843:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318167.039848:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318167.039852:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940193664:0@lo:38:kworker.0
00000100:00080000:0.0:1767318167.039864:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318167.039867:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318167.039870:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940193792:0@lo:38:kworker.0
00000100:00080000:0.0:1767318167.039878:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318167.039881:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318167.039884:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940194304:0@lo:38:kworker.0
00000100:00100000:0.0:1767318167.039939:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940194560:12345-0@lo:38:kworker.0 Request processed in 174us (9408us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318167.039945:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16042
00000100:00100000:2.0:1767318167.042766:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459
00000100:00100000:3.0:1767318167.043762:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16041
00000100:00100000:1.0:1767318167.044277:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940193920:0@lo:400:kworker.0
00000100:00080000:0.0:1767318167.044616:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318167.044626:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318167.044629:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940194560:0@lo:38:kworker.0
00000100:00100000:2.0:1767318167.533325:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318167.982449:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318168.558315:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318169.007033:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318169.581609:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318169.676667:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318169.676719:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318169.676889:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246784
00000100:00100000:3.0:1767318169.676901:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246784
00000100:00100000:3.0:1767318169.676947:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894246912
00000100:00100000:3.0:1767318169.676951:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894246912
00000100:00100000:3.0:1767318169.677033:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3725
00000100:00100000:3.0:1767318169.677048:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894246912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318169.677151:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894246912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (431us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318169.677159:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3725
00000100:00100000:2.0:1767318169.677328:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16043
00000100:00100000:2.0:1767318169.677334:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894246784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318169.677354:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318169.677381:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894246784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (726us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318169.677387:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16043
00000100:00080000:0.0:1767318169.677696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318170.029024:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318170.604892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318170.605020:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318170.605041:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194688:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318170.605216:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318170.605353:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194688
00000100:00100000:0.0:1767318170.605362:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194688
00000100:00100000:0.0:1767318170.605436:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972
00000100:00100000:0.0:1767318170.605445:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318170.605475:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318170.605609:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318170.605617:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972
00000100:00100000:2.0:1767318170.605668:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194688:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318170.605925:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318171.053405:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318171.629192:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194816:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318171.629255:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318171.629388:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194816
00000100:00100000:2.0:1767318171.629395:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194816
00000100:00100000:3.0:1767318171.629469:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318171.629470:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973
00000100:00100000:2.0:1767318171.629484:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318171.629515:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318171.629573:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940194816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (316us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318171.629580:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973
00000100:00080000:0.0:1767318171.629789:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318171.631300:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940194816:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318172.077719:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318172.141076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318172.141087:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318172.141090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318172.141094:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318172.141098:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318172.141107:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3417
00000100:00080000:1.0:1767318172.141112:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318172.141119:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318172.141159:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddf80 x1853163940194944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318172.141190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318172.141194:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318172.141196:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318172.141199:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3417
00000100:00080000:1.0:1767318172.141202:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318172.141205:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318172.141219:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dd880 x1853163940195072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318172.141284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318172.141288:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318172.141289:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318172.141293:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3417
00000100:00080000:1.0:1767318172.141296:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318172.141300:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318172.141313:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dfb80 x1853163940195584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318172.141329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318172.141332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318172.141334:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318172.141337:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3417
00000100:00080000:1.0:1767318172.141339:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318172.141343:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318172.141354:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dea00 x1853163940195840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318172.141395:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940195456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318172.141474:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318172.141535:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318172.141541:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940195712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318172.141561:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318172.141591:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195456
00000100:00100000:1.0:1767318172.141599:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195456
00000100:00100000:1.0:1767318172.141648:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195712
00000100:00100000:1.0:1767318172.141651:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195712
00000100:00100000:1.0:1767318172.141674:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726
00000100:00100000:1.0:1767318172.141682:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940195456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318172.141726:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940195456:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318172.141734:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726
00000100:00100000:1.0:1767318172.141750:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727
00000100:00100000:1.0:1767318172.141755:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940195712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318172.141806:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940195712:12345-0@lo:400:kworker.0 Request processed in 50us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318172.141812:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727
00000100:00100000:1.0:1767318172.141862:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940195712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318172.141872:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940195456:0@lo:400:kworker.0
00000100:00080000:0.0:1767318172.142176:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318172.142192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940194944:0@lo:38:kworker.0
00000100:00100000:0.0:1767318172.142227:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318172.142260:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940195072:0@lo:38:kworker.0
00000100:00100000:0.0:1767318172.142287:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318172.142308:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940195584:0@lo:38:kworker.0
00000100:00100000:0.0:1767318172.142328:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318172.142344:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940195840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318172.142377:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318172.142413:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195072
00000100:00100000:0.0:1767318172.142417:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195072
00000100:00100000:0.0:1767318172.142460:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894
00000100:00100000:0.0:1767318172.142465:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940195072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318172.142489:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318172.142543:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940195072:12345-0@lo:38:kworker.0 Request processed in 75us (255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318172.142551:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894
00000100:00100000:0.0:1767318172.142570:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940194944
00000100:00100000:0.0:1767318172.142574:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940194944
00000100:00100000:0.0:1767318172.142587:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195584
00000100:00100000:0.0:1767318172.142589:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195584
00000100:00100000:0.0:1767318172.142597:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195840
00000100:00100000:0.0:1767318172.142599:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195840
00000100:00100000:0.0:1767318172.142609:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16044
00000100:00100000:0.0:1767318172.142613:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940194944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318172.142623:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318172.142648:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940194944:12345-0@lo:38:kworker.0 Request processed in 34us (421us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318172.142655:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16044
00000100:00100000:0.0:1767318172.142666:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16045
00000100:00100000:0.0:1767318172.142669:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940195584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318172.142679:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318172.142700:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940195584:12345-0@lo:38:kworker.0 Request processed in 29us (371us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318172.142706:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16045
00000100:00100000:0.0:1767318172.142715:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16046
00000100:00100000:0.0:1767318172.142719:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940195840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318172.142727:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318172.142746:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940195840:12345-0@lo:38:kworker.0 Request processed in 25us (368us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318172.142759:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16046
00000100:00080000:0.0:1767318172.142871:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318172.142876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318172.142880:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940194944:0@lo:38:kworker.0
00000100:00080000:0.0:1767318172.142888:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318172.142891:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318172.142894:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940195072:0@lo:38:kworker.0
00000100:00080000:0.0:1767318172.142900:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318172.142903:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318172.142906:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940195584:0@lo:38:kworker.0
00000100:00080000:0.0:1767318172.142912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318172.142915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318172.142917:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940195840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318172.143253:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195200:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.143299:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318172.143340:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318172.143347:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195328:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.143379:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318172.143415:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195200
00000100:00100000:3.0:1767318172.143419:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195200
00000100:00100000:3.0:1767318172.143471:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195328
00000100:00100000:3.0:1767318172.143474:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195328
00000100:00100000:3.0:1767318172.143494:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461
00000100:00100000:3.0:1767318172.143500:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.143539:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195200:12345-0@lo:400:kworker.0 Request processed in 40us (240us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318172.143544:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461
00000100:00100000:3.0:1767318172.143558:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462
00000100:00100000:3.0:1767318172.143564:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.143591:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195328:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318172.143596:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462
00000100:00080000:3.0:1767318172.143613:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318172.143632:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195328:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.143640:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195200:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.654193:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318173.101066:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318173.676959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318174.129451:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318174.701518:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318174.791544:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318174.791582:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894247040 offset 0 length 520: 4
00000100:00100000:3.0:1767318174.791606:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318174.794133:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247296
00000100:00100000:1.0:1767318174.794150:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247296
00000100:00100000:1.0:1767318174.794305:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247168
00000100:00100000:1.0:1767318174.794309:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247168
00000100:00100000:1.0:1767318174.794335:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3728
00000100:00100000:1.0:1767318174.794346:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894247296:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318174.794447:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894247296:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 103us (2912us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318174.794455:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3728
00000100:00100000:1.0:1767318174.794476:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16047
00000100:00100000:1.0:1767318174.794481:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894247168:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318174.794500:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318174.794526:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894247168:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (2919us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318174.794532:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16047
00000100:00080000:3.0:1767318174.798608:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318175.153950:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318175.724895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318175.725065:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195968:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318175.725134:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318175.725273:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940195968
00000100:00100000:0.0:1767318175.725283:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940195968
00000100:00100000:0.0:1767318175.725355:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974
00000100:00100000:0.0:1767318175.725364:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318175.725397:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318175.725444:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940195968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318175.725452:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974
00000100:00080000:3.0:1767318175.725803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318175.725845:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940195968:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318176.173130:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318176.748950:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318176.749297:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318176.749316:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940196096:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318176.749386:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318176.751243:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196096
00000100:00100000:1.0:1767318176.751256:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196096
00000100:00100000:1.0:1767318176.751338:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975
00000100:00100000:1.0:1767318176.751349:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940196096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318176.751716:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318176.751839:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940196096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 491us (2451us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318176.751847:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975
00000100:00100000:2.0:1767318176.751967:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940196096:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318176.752598:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318177.197725:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318177.261427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318177.261435:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318177.261438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318177.261443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318177.261446:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318177.261454:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3422
00000100:00080000:3.0:1767318177.261458:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318177.261464:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318177.261498:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940196224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318177.261532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318177.261535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318177.261537:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318177.261540:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3422
00000100:00080000:3.0:1767318177.261555:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318177.261558:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318177.261679:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940196224:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.261751:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318177.261874:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196224
00000100:00100000:1.0:1767318177.261881:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196224
00000100:00100000:1.0:1767318177.261948:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16048
00000100:00100000:1.0:1767318177.261956:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940196224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318177.261977:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318177.262023:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940196224:12345-0@lo:38:kworker.0 Request processed in 66us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318177.262029:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16048
00000100:00080000:0.0:1767318177.262164:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.262168:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.262172:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940196224:0@lo:38:kworker.0
00000100:00100000:3.0:1767318177.262333:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8700 x1853163940196352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318177.262392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318177.262395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318177.262397:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318177.262401:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3422
00000100:00080000:3.0:1767318177.262403:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318177.262407:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318177.262416:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9180 x1853163940196864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318177.262429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318177.262432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318177.262434:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318177.262437:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3422
00000100:00080000:3.0:1767318177.262439:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318177.262442:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318177.262449:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9f80 x1853163940197120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318177.262469:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940196608:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.262496:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318177.262533:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318177.262537:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940196480:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.262563:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.262791:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940196352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.262818:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.262833:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940196864:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.262849:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.262861:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940197120:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.262875:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.262897:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196864
00000100:00100000:0.0:1767318177.262911:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196864
00000100:00100000:0.0:1767318177.262932:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197120
00000100:00100000:0.0:1767318177.262934:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197120
00000100:00100000:0.0:1767318177.262947:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16049
00000100:00100000:0.0:1767318177.262951:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940196864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318177.262963:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318177.262992:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940196864:12345-0@lo:38:kworker.0 Request processed in 40us (141us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318177.262998:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16049
00000100:00100000:0.0:1767318177.263008:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16050
00000100:00100000:0.0:1767318177.263011:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940197120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318177.263020:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318177.263036:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940197120:12345-0@lo:38:kworker.0 Request processed in 23us (160us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318177.263049:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16050
00000100:00080000:0.0:1767318177.263076:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.263080:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.263083:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940196864:0@lo:38:kworker.0
00000100:00080000:0.0:1767318177.263089:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.263092:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.263095:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940197120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318177.263161:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196352
00000100:00100000:1.0:1767318177.263164:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196352
00000100:00100000:1.0:1767318177.263189:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895
00000100:00100000:1.0:1767318177.263194:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940196352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318177.263205:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318177.263233:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940196352:12345-0@lo:38:kworker.0 Request processed in 38us (414us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318177.263238:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895
00000100:00080000:1.0:1767318177.263256:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318177.263258:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318177.263261:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940196352:0@lo:38:kworker.0
00000100:00100000:3.0:1767318177.263313:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196608
00000100:00100000:3.0:1767318177.263317:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196608
00000100:00100000:3.0:1767318177.263353:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196480
00000100:00100000:3.0:1767318177.263356:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196480
00000100:00100000:3.0:1767318177.263380:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463
00000100:00100000:3.0:1767318177.263385:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940196608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.263420:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940196608:12345-0@lo:400:kworker.0 Request processed in 35us (923us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318177.263426:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463
00000100:00100000:3.0:1767318177.263439:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464
00000100:00100000:3.0:1767318177.263444:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940196480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.263464:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940196480:12345-0@lo:400:kworker.0 Request processed in 21us (900us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318177.263469:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464
00000100:00100000:3.0:1767318177.263494:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940196480:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.263502:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940196608:0@lo:400:kworker.0
00000100:00080000:1.0:1767318177.263626:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318177.270092:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940196992:0@lo:400:kworker.0
00000100:00100000:2.0:1767318177.270194:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318177.270238:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318177.270245:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940196736:0@lo:400:kworker.0
00000100:00100000:2.0:1767318177.270270:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.270398:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196736
00000100:00100000:1.0:1767318177.270398:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940196992
00000100:00100000:0.0:1767318177.270407:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196736
00000100:00100000:1.0:1767318177.270407:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940196992
00000100:00100000:0.0:1767318177.270480:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729
00000100:00080000:2.0:1767318177.270522:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318177.274039:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730
00000100:00100000:1.0:1767318177.274055:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940196992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318177.274165:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940196992:12345-0@lo:400:kworker.0 Request processed in 115us (3971us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318177.274173:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730
00000100:00100000:0.0:1767318177.278119:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940196736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318177.278229:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940196736:12345-0@lo:400:kworker.0 Request processed in 7741us (7957us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318177.278242:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729
00000100:00100000:3.0:1767318177.278396:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940196736:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.278411:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940196992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.781143:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318178.225977:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318178.797750:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318179.245007:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318179.821153:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318179.910498:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318179.910595:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247552
00000100:00100000:0.0:1767318179.910604:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247552
00000100:00100000:0.0:1767318179.910685:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3731
00000100:00100000:0.0:1767318179.910695:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894247552:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318179.910822:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894247552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 127us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318179.910830:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3731
00000100:00080000:2.0:1767318179.911009:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318179.911470:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318179.911537:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247424
00000100:00100000:0.0:1767318179.911542:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247424
00000100:00100000:0.0:1767318179.911570:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16051
00000100:00100000:0.0:1767318179.911576:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894247424:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318179.911610:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318179.911655:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894247424:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 77us (186us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318179.911662:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16051
00010000:00010000:0.0:1767318180.269254:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318180.845129:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318180.846505:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940197248:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318180.846590:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318180.846708:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197248
00000100:00100000:2.0:1767318180.846718:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197248
00000100:00100000:2.0:1767318180.847135:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976
00000100:00100000:2.0:1767318180.847146:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940197248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318180.847180:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318180.847229:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940197248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (639us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318180.847237:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976
00000100:00080000:1.0:1767318180.847305:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318180.847346:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940197248:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318181.293130:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318181.357170:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318156/real 1767318156]  req@ffff93cf514a3800 x1853163940192128/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318181.357214:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf514a3800 x1853163940192128/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318181.357240:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318181.357264:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318181.357268:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940192128:0@lo:250:kworker.0
00000100:00080000:3.0:1767318181.357292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318181.357315:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318181.357318:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318181.357323:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3406
00000100:00080000:3.0:1767318181.357326:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318181.357331:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318181.357357:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8000 x1853163940197376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318181.357382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318181.357386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318181.357387:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318181.357390:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3427
00000100:00080000:3.0:1767318181.357393:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318181.357396:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318181.357409:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fb800 x1853163940197504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318181.357419:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318181.357422:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318181.357423:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318181.357426:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3427
00000100:00080000:3.0:1767318181.357429:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318181.357432:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318181.357442:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9500 x1853163940197632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318181.357492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318181.357494:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318181.357500:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318181.357502:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3427
00000100:00080000:3.0:1767318181.357504:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318181.357507:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318181.357515:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9c00 x1853163940198144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318181.357525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318181.357527:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318181.357528:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318181.357530:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3427
00000100:00080000:3.0:1767318181.357531:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318181.357533:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318181.357538:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8380 x1853163940198400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318181.357557:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940198016:0@lo:400:kworker.0
00000100:00100000:2.0:1767318181.357566:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940197888:0@lo:400:kworker.0
00000100:00100000:0.0:1767318181.357648:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940197760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318181.359149:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940197376:0@lo:250:kworker.0
00000100:00100000:3.0:1767318181.361278:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318181.361294:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318181.361389:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197888
00000100:00100000:2.0:1767318181.361398:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197888
00000100:00100000:3.0:1767318181.361403:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940198272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318181.361444:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318181.361475:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198016
00000100:00100000:3.0:1767318181.361479:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198016
00000100:00100000:3.0:1767318181.361508:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198272
00000100:00100000:3.0:1767318181.361511:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198272
00000100:00100000:3.0:1767318181.361534:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732
00000100:00100000:3.0:1767318181.361541:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940198016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318181.361569:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465
00000100:00100000:2.0:1767318181.361579:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940197888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318181.361609:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940198016:12345-0@lo:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318181.361629:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940197888:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318181.361633:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732
00000100:00100000:2.0:1767318181.361641:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465
00000100:00100000:3.0:1767318181.361663:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733
00000100:00100000:3.0:1767318181.361672:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940198272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318181.361690:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940197888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318181.361714:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940198272:12345-0@lo:400:kworker.0 Request processed in 43us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318181.361720:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733
00000100:00100000:2.0:1767318181.361735:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940198016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318181.361757:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940198272:0@lo:400:kworker.0
00000100:00080000:3.0:1767318181.362071:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318181.362076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318181.362421:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318181.362501:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197760
00000100:00100000:3.0:1767318181.362506:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197760
00000100:00100000:3.0:1767318181.362543:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466
00000100:00100000:3.0:1767318181.362550:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940197760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318181.362679:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940197760:12345-0@lo:400:kworker.0 Request processed in 128us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318181.362686:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466
00000100:00100000:0.0:1767318181.362760:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940197760:0@lo:400:kworker.0
00000400:00000100:1.0:1767318181.362952:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940197376 offset 0 length 520: 4
00000100:00100000:1.0:1767318181.362985:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940197504:0@lo:38:kworker.0
00000100:00100000:1.0:1767318181.363013:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318181.365537:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940197632:0@lo:38:kworker.0
00000100:00100000:1.0:1767318181.365768:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318181.365889:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940198144:0@lo:38:kworker.0
00000100:00100000:1.0:1767318181.365915:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318181.365978:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197632
00000100:00100000:0.0:1767318181.365987:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197632
00000100:00100000:0.0:1767318181.366032:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896
00000100:00100000:0.0:1767318181.366039:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940197632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318181.366061:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318181.366102:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940197632:12345-0@lo:38:kworker.0 Request processed in 62us (334us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318181.366122:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896
00000100:00100000:1.0:1767318181.366415:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940198400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318181.366440:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318181.366491:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940197504
00000100:00100000:3.0:1767318181.366496:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940197504
00000100:00080000:1.0:1767318181.368094:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318181.368105:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318181.368120:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940197632:0@lo:38:kworker.0
00000100:00100000:0.0:1767318181.368273:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198144
00000100:00100000:0.0:1767318181.368280:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198144
00000100:00100000:0.0:1767318181.368313:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198400
00000100:00100000:0.0:1767318181.368316:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198400
00000100:00100000:0.0:1767318181.368333:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16052
00000100:00100000:0.0:1767318181.368339:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940197504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318181.368358:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318181.368414:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940197504:12345-0@lo:38:kworker.0 Request processed in 74us (5399us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318181.368436:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16052
00000100:00100000:0.0:1767318181.368455:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16053
00000100:00100000:0.0:1767318181.368459:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940198144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318181.368468:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318181.368493:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940198144:12345-0@lo:38:kworker.0 Request processed in 33us (2577us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318181.368499:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16053
00000100:00100000:0.0:1767318181.368509:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16054
00000100:00100000:0.0:1767318181.368512:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940198400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318181.368521:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318181.368540:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940198400:12345-0@lo:38:kworker.0 Request processed in 26us (2100us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318181.368546:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16054
00000100:00080000:0.0:1767318181.368973:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318181.368979:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318181.368983:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940197504:0@lo:38:kworker.0
00000100:00080000:0.0:1767318181.368992:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318181.368995:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318181.368998:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940198144:0@lo:38:kworker.0
00000100:00080000:0.0:1767318181.369005:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318181.369008:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318181.369011:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940198400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318181.869044:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318181.869068:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940198528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318181.869139:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318181.869226:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198528
00000100:00100000:0.0:1767318181.869247:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198528
00000100:00100000:0.0:1767318181.869299:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977
00000100:00100000:0.0:1767318181.869308:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940198528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318181.869339:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318181.869385:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940198528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (246us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318181.869393:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977
00000100:00100000:0.0:1767318181.869447:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940198528:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318181.869955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318181.959093:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318181.959396:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247680
00000100:00100000:1.0:1767318181.959409:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247680
00000100:00100000:1.0:1767318181.959498:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16055
00000100:00100000:1.0:1767318181.959508:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894247680:12345-192.168.202.21@tcp:17:kworker.0
00000100:00080000:3.0:1767318181.959726:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318181.960375:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894247680:12345-192.168.202.21@tcp:17:kworker.0 Request processed in 858us (1285us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318181.960391:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16055
00010000:00010000:0.0:1767318182.317680:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318182.892899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318183.344166:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318183.916946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318184.369305:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318184.940967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318185.035647:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318185.035760:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318185.035884:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247936
00000100:00100000:2.0:1767318185.035903:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247936
00000100:00100000:2.0:1767318185.036012:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894247808
00000100:00100000:2.0:1767318185.036017:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894247808
00000100:00100000:2.0:1767318185.036052:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3734
00000100:00100000:2.0:1767318185.036066:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894247936:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318185.036172:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894247936:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (535us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318185.036181:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3734
00000100:00100000:2.0:1767318185.036201:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16056
00000100:00100000:2.0:1767318185.036206:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894247808:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318185.036232:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318185.036262:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894247808:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318185.036269:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16056
00000100:00080000:1.0:1767318185.037226:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318185.389646:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318185.965757:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318185.965793:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940198656:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318185.965872:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318185.965998:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318185.966063:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198656
00000100:00100000:1.0:1767318185.966072:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198656
00000100:00100000:1.0:1767318185.966144:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978
00000100:00100000:1.0:1767318185.966154:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940198656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318185.966184:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318185.966229:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940198656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318185.966236:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978
00000100:00080000:3.0:1767318185.966714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318185.966765:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940198656:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318186.414497:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318186.480079:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318186.480090:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318186.480092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318186.480096:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318186.480101:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318186.480109:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3431
00000100:00080000:3.0:1767318186.480115:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318186.480123:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318186.480162:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711faa00 x1853163940198784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318186.480203:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318186.480207:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318186.480209:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318186.480214:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3431
00000100:00080000:3.0:1767318186.480217:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318186.480220:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318186.480238:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8380 x1853163940198912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318186.480315:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318186.480319:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318186.480321:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318186.480325:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3431
00000100:00080000:3.0:1767318186.480327:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318186.480346:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318186.480358:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fa300 x1853163940199424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318186.480372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318186.480375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318186.480377:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318186.480380:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3431
00000100:00080000:3.0:1767318186.480382:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318186.480385:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318186.480393:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8a80 x1853163940199680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318186.480422:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940199168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318186.480485:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318186.480547:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318186.480553:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940199296:0@lo:400:kworker.0
00000100:00100000:3.0:1767318186.480581:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318186.480616:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199296
00000100:00100000:3.0:1767318186.480624:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199296
00000100:00100000:3.0:1767318186.480683:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735
00000100:00100000:3.0:1767318186.480695:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940199296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318186.480745:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940199296:12345-0@lo:400:kworker.0 Request processed in 54us (162us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318186.480752:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735
00000100:00080000:3.0:1767318186.480805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318186.480846:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940199296:0@lo:400:kworker.0
00000100:00100000:0.0:1767318186.481068:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199168
00000100:00100000:0.0:1767318186.481073:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199168
00000100:00100000:0.0:1767318186.481118:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467
00000100:00100000:0.0:1767318186.481126:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940199168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318186.481166:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940199168:12345-0@lo:400:kworker.0 Request processed in 41us (680us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318186.481172:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467
00000100:00100000:0.0:1767318186.481194:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940198784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318186.481221:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318186.481237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940198912:0@lo:38:kworker.0
00000100:00100000:0.0:1767318186.481262:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318186.481279:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940199424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318186.481298:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318186.481311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940199680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318186.481327:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318186.481370:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198912
00000100:00100000:0.0:1767318186.481374:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198912
00000100:00100000:0.0:1767318186.481395:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897
00000100:00100000:0.0:1767318186.481399:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940198912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318186.481419:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318186.481451:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940198912:12345-0@lo:38:kworker.0 Request processed in 50us (188us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318186.481457:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897
00000100:00100000:0.0:1767318186.481475:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940198784
00000100:00100000:0.0:1767318186.481478:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940198784
00000100:00100000:0.0:1767318186.481495:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199424
00000100:00100000:0.0:1767318186.481498:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199424
00000100:00100000:0.0:1767318186.481512:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199680
00000100:00100000:0.0:1767318186.481515:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199680
00000100:00100000:0.0:1767318186.481529:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16057
00000100:00100000:0.0:1767318186.481533:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940198784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318186.481542:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318186.481568:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940198784:12345-0@lo:38:kworker.0 Request processed in 33us (346us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318186.481574:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16057
00000100:00100000:0.0:1767318186.481597:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16058
00000100:00100000:0.0:1767318186.481601:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940199424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318186.481610:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318186.481631:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940199424:12345-0@lo:38:kworker.0 Request processed in 29us (332us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318186.481637:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16058
00000100:00100000:0.0:1767318186.481647:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16059
00000100:00100000:0.0:1767318186.481657:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940199680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318186.481667:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318186.481691:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940199680:12345-0@lo:38:kworker.0 Request processed in 33us (363us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318186.481696:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16059
00000100:00080000:0.0:1767318186.481733:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318186.481738:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318186.481742:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940198784:0@lo:38:kworker.0
00000100:00080000:0.0:1767318186.481751:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318186.481754:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318186.481757:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940198912:0@lo:38:kworker.0
00000100:00080000:0.0:1767318186.481764:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318186.481768:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318186.481771:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940199424:0@lo:38:kworker.0
00000100:00080000:0.0:1767318186.481808:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318186.481811:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318186.481814:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940199680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318186.482736:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940199552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318186.482835:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318186.482863:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318186.482870:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940199040:0@lo:400:kworker.0
00000100:00100000:2.0:1767318186.482897:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318186.482940:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199552
00000100:00100000:2.0:1767318186.482945:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199552
00000100:00100000:2.0:1767318186.483002:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736
00000100:00100000:2.0:1767318186.483011:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b832450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940199552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318186.483053:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b832450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940199552:12345-0@lo:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318186.483059:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736
00000100:00100000:2.0:1767318186.484155:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199040
00000100:00100000:2.0:1767318186.484165:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199040
00000100:00100000:2.0:1767318186.484200:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468
00000100:00100000:2.0:1767318186.484208:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940199040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318186.484257:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940199040:12345-0@lo:400:kworker.0 Request processed in 51us (1360us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318186.484264:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468
00000100:00100000:2.0:1767318186.484324:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940199040:0@lo:400:kworker.0
00000100:00100000:2.0:1767318186.484336:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940199552:0@lo:400:kworker.0
00000100:00080000:3.0:1767318186.486993:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318186.487004:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318186.487070:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940199168:0@lo:400:kworker.0
00000100:00100000:1.0:1767318186.995757:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940199808:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318186.995877:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318186.999646:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199808
00000100:00100000:0.0:1767318186.999661:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199808
00000100:00100000:0.0:1767318186.999743:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979
00000100:00100000:0.0:1767318186.999753:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940199808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318186.999839:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318186.999938:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940199808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (4060us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318186.999962:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979
00000100:00100000:2.0:1767318186.999990:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940199808:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318187.005271:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318187.437047:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318188.012953:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318188.461141:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318189.037111:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318189.486935:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318190.060948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318190.159274:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318190.159590:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248192
00000100:00100000:1.0:1767318190.159600:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248192
00000100:00100000:1.0:1767318190.159680:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3737
00000100:00100000:1.0:1767318190.159690:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894248192:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318190.159766:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894248192:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (500us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318190.159812:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3737
00000100:00080000:3.0:1767318190.159973:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318190.167497:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318190.167634:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248064
00000100:00100000:3.0:1767318190.167648:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248064
00000100:00100000:3.0:1767318190.167703:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16060
00000100:00100000:3.0:1767318190.167712:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894248064:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318190.167743:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318190.167893:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894248064:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 180us (409us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318190.167902:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16060
00010000:00010000:0.0:1767318190.509333:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318191.085746:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318191.086039:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318191.086065:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940199936:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318191.086159:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318191.086344:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940199936
00000100:00100000:2.0:1767318191.086355:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940199936
00000100:00100000:2.0:1767318191.086447:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980
00000100:00100000:2.0:1767318191.086458:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940199936:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318191.086499:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318191.086555:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940199936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318191.086563:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980
00000100:00080000:0.0:1767318191.086633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318191.086723:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940199936:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318191.537367:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318191.597954:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318191.597969:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318191.597972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318191.597977:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318191.597982:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318191.597993:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3436
00000100:00080000:3.0:1767318191.597999:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318191.598014:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318191.598095:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9500 x1853163940200064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318191.598199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318191.598203:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318191.598205:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318191.598209:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3436
00000100:00080000:3.0:1767318191.598211:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318191.598215:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318191.598232:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9180 x1853163940200192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318191.598311:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:3.0:1767318191.598411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318191.598416:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318191.598418:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318191.598422:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3436
00000100:00080000:3.0:1767318191.598425:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318191.598429:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318191.598442:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fbb80 x1853163940200576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318191.598459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318191.598463:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318191.598465:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318191.598469:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3436
00000100:00080000:3.0:1767318191.598471:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318191.598475:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318191.598497:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fb480 x1853163940200832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318191.598541:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940200704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318191.598626:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318191.598704:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318191.598710:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940200448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318191.598734:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318191.598808:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200704
00000100:00100000:3.0:1767318191.599879:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200704
00000100:00100000:1.0:1767318191.599949:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200448
00000100:00100000:1.0:1767318191.599956:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200448
00000100:00100000:3.0:1767318191.599978:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738
00000100:00100000:3.0:1767318191.599991:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940200704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318191.600007:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739
00000100:00100000:1.0:1767318191.600018:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940200448:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767318191.600112:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318191.600141:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940200064:0@lo:38:kworker.0
00000100:00100000:2.0:1767318191.601353:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940200320:0@lo:400:kworker.0
00000100:00100000:1.0:1767318191.602612:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940200448:12345-0@lo:400:kworker.0 Request processed in 2586us (3867us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318191.602622:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940200704:12345-0@lo:400:kworker.0 Request processed in 2632us (3992us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318191.602631:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739
00000100:00100000:3.0:1767318191.602639:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738
00000100:00100000:1.0:1767318191.602735:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940200448:0@lo:400:kworker.0
00000100:00100000:1.0:1767318191.602751:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940200704:0@lo:400:kworker.0
00000100:00100000:2.0:1767318191.603016:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318191.603082:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200320
00000100:00100000:2.0:1767318191.603090:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200320
00000100:00100000:2.0:1767318191.603147:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469
00000100:00100000:2.0:1767318191.603158:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940200320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318191.603215:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940200320:12345-0@lo:400:kworker.0 Request processed in 60us (200us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318191.603276:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469
00000100:00100000:2.0:1767318191.603309:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940200320:0@lo:400:kworker.0
00000100:00080000:2.0:1767318191.603346:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318191.603497:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318191.603656:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940200192:0@lo:38:kworker.0
00000100:00100000:0.0:1767318191.604043:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318191.604067:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940200576:0@lo:38:kworker.0
00000100:00100000:0.0:1767318191.604090:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318191.607126:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200064
00000100:00100000:1.0:1767318191.607145:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200064
00000100:00100000:3.0:1767318191.607208:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200192
00000100:00100000:3.0:1767318191.607216:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200192
00000100:00100000:3.0:1767318191.607258:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898
00000100:00100000:3.0:1767318191.607268:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940200192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318191.607298:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318191.607406:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940200192:12345-0@lo:38:kworker.0 Request processed in 137us (3361us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318191.607413:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898
00000100:00100000:2.0:1767318191.607630:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16061
00000100:00100000:2.0:1767318191.607636:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940200064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318191.607647:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318191.607887:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940200064:12345-0@lo:38:kworker.0 Request processed in 244us (4384us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318191.607894:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16061
00000100:00100000:0.0:1767318191.608030:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940200832:0@lo:38:kworker.0
00000100:00100000:1.0:1767318191.608067:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200576
00000100:00100000:1.0:1767318191.608074:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200576
00000100:00100000:0.0:1767318191.608075:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318191.608130:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318191.608136:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318191.608140:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940200064:0@lo:38:kworker.0
00000100:00080000:0.0:1767318191.608153:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318191.608156:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318191.608159:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940200192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318191.611198:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200832
00000100:00100000:1.0:1767318191.611209:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16062
00000100:00100000:2.0:1767318191.611218:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200832
00000100:00100000:1.0:1767318191.611223:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940200576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318191.611255:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318191.611279:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16063
00000100:00100000:2.0:1767318191.611287:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940200832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318191.611299:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318191.611368:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940200832:12345-0@lo:38:kworker.0 Request processed in 80us (3293us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318191.611376:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16063
00000100:00100000:1.0:1767318191.616300:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940200576:12345-0@lo:38:kworker.0 Request processed in 5063us (12194us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318191.616320:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16062
00000100:00080000:0.0:1767318191.617047:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318191.617057:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318191.617062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940200576:0@lo:38:kworker.0
00000100:00080000:0.0:1767318191.617082:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318191.617086:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318191.617189:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940200832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318192.108881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318192.109990:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318192.110026:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940200960:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318192.110130:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318192.110195:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940200960
00000100:00100000:0.0:1767318192.110208:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940200960
00000100:00100000:0.0:1767318192.110280:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981
00000100:00100000:0.0:1767318192.110291:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940200960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318192.110337:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318192.110420:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940200960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (288us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318192.110428:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981
00000100:00100000:1.0:1767318192.110678:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940200960:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318192.557127:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318193.134524:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318193.581255:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318194.156849:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318194.606394:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318195.180902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318195.271764:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318195.272007:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248448
00000100:00100000:1.0:1767318195.272016:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248448
00000100:00100000:1.0:1767318195.272095:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3740
00000100:00100000:1.0:1767318195.272115:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894248448:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318195.272200:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894248448:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (473us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318195.272209:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3740
00000100:00080000:2.0:1767318195.272412:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318195.278683:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318195.282422:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248320
00000100:00100000:3.0:1767318195.282438:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248320
00000100:00100000:3.0:1767318195.282649:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16064
00000100:00100000:3.0:1767318195.282658:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894248320:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318195.282684:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318195.282796:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894248320:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 136us (4983us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318195.282804:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16064
00010000:00010000:0.0:1767318195.629807:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318196.206841:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318196.206866:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940201088:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318196.206950:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318196.207184:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201088
00000100:00100000:3.0:1767318196.207192:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201088
00000100:00100000:3.0:1767318196.207259:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982
00000100:00100000:3.0:1767318196.207271:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940201088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318196.207305:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767318196.207605:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318196.207662:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940201088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 394us (711us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318196.207670:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982
00000100:00100000:2.0:1767318196.207766:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940201088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318196.208044:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318196.653410:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318196.717843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318196.717853:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318196.717856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318196.717860:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318196.717864:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318196.717872:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3441
00000100:00080000:2.0:1767318196.717876:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318196.717883:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318196.717933:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3480 x1853163940201216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318196.717962:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318196.717966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318196.717967:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318196.717971:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3441
00000100:00080000:2.0:1767318196.717973:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318196.717977:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318196.717990:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f2a00 x1853163940201344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318196.718048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318196.718051:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318196.718053:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318196.718057:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3441
00000100:00080000:2.0:1767318196.718060:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318196.718063:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318196.718073:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3800 x1853163940201728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318196.718100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318196.718104:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318196.718105:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318196.718109:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3441
00000100:00080000:2.0:1767318196.718111:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318196.718115:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318196.718125:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f1880 x1853163940201984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318196.718151:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940201856:0@lo:400:kworker.0
00000100:00100000:2.0:1767318196.718223:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318196.718584:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201856
00000100:00100000:3.0:1767318196.718593:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201856
00000100:00100000:3.0:1767318196.718659:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741
00000100:00100000:3.0:1767318196.718672:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940201856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318196.718744:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940201856:12345-0@lo:400:kworker.0 Request processed in 77us (520us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318196.718752:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741
00000100:00100000:3.0:1767318196.719149:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940201856:0@lo:400:kworker.0
00000100:00100000:3.0:1767318196.719184:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940201600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318196.719229:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318196.719256:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318196.719262:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940201472:0@lo:400:kworker.0
00000100:00100000:3.0:1767318196.719285:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318196.719311:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201600
00000100:00100000:3.0:1767318196.719315:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201600
00000100:00100000:3.0:1767318196.719338:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742
00000100:00100000:3.0:1767318196.719344:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940201600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318196.719377:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940201600:12345-0@lo:400:kworker.0 Request processed in 32us (147us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318196.719383:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742
00000100:00100000:3.0:1767318196.719406:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940201600:0@lo:400:kworker.0
00000100:00100000:0.0:1767318196.720240:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940201216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318196.720285:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318196.720321:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940201344:0@lo:38:kworker.0
00000100:00100000:0.0:1767318196.720344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318196.720364:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940201728:0@lo:38:kworker.0
00000100:00100000:0.0:1767318196.720383:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318196.720398:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940201984:0@lo:38:kworker.0
00000100:00100000:0.0:1767318196.720415:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318196.720460:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201344
00000100:00100000:0.0:1767318196.720465:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201344
00000100:00100000:0.0:1767318196.720493:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899
00000100:00100000:0.0:1767318196.720497:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940201344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318196.720516:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318196.720548:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940201344:12345-0@lo:38:kworker.0 Request processed in 49us (202us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318196.720564:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899
00000100:00100000:0.0:1767318196.720588:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201216
00000100:00100000:0.0:1767318196.720592:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201216
00000100:00100000:0.0:1767318196.720607:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201728
00000100:00100000:0.0:1767318196.720609:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201728
00000100:00100000:0.0:1767318196.720621:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201984
00000100:00100000:0.0:1767318196.720623:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201984
00000100:00100000:0.0:1767318196.720641:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16065
00000100:00100000:0.0:1767318196.720645:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318196.720655:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318196.720681:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201216:12345-0@lo:38:kworker.0 Request processed in 35us (396us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318196.720688:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16065
00000100:00100000:0.0:1767318196.720699:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16066
00000100:00100000:0.0:1767318196.720702:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318196.720710:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318196.720744:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201728:12345-0@lo:38:kworker.0 Request processed in 40us (360us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318196.720750:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16066
00000100:00100000:0.0:1767318196.720761:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16067
00000100:00100000:0.0:1767318196.720765:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318196.720826:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318196.720852:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940201984:12345-0@lo:38:kworker.0 Request processed in 85us (435us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318196.720858:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16067
00000100:00080000:0.0:1767318196.720930:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318196.720941:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318196.720945:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940201216:0@lo:38:kworker.0
00000100:00080000:0.0:1767318196.720957:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318196.720960:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318196.720962:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940201344:0@lo:38:kworker.0
00000100:00080000:0.0:1767318196.720969:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318196.720971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318196.720974:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940201728:0@lo:38:kworker.0
00000100:00080000:0.0:1767318196.720980:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318196.720983:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318196.720986:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940201984:0@lo:38:kworker.0
00000100:00080000:2.0:1767318196.721717:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318196.721744:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940201472
00000100:00100000:2.0:1767318196.721749:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940201472
00000100:00100000:2.0:1767318196.721830:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1767318196.721838:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940201472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318196.721912:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940201472:12345-0@lo:400:kworker.0 Request processed in 74us (2624us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318196.721918:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1767318196.721968:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940201472:0@lo:400:kworker.0
00000100:00080000:1.0:1767318196.722367:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318197.229350:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318197.232262:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318197.232285:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940202112:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318197.232357:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318197.232617:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202112
00000100:00100000:2.0:1767318197.232627:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202112
00000100:00100000:2.0:1767318197.232683:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983
00000100:00100000:2.0:1767318197.232691:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940202112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318197.232731:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318197.232830:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940202112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (472us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318197.232838:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983
00000100:00100000:3.0:1767318197.233076:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940202112:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318197.677075:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318198.252918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318198.704441:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318199.277975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000400:00000100:0.0:1767318199.370659:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894248576 offset 0 length 520: 4
00000100:00100000:0.0:1767318199.370724:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318199.370847:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248832
00000100:00100000:3.0:1767318199.370858:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248832
00000100:00100000:3.0:1767318199.370940:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3743
00000100:00100000:3.0:1767318199.370951:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894248832:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318199.371041:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894248832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (315us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318199.371050:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3743
00000100:00080000:1.0:1767318199.371115:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318199.373190:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318199.373544:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248704
00000100:00100000:3.0:1767318199.373553:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248704
00000100:00100000:3.0:1767318199.374034:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16068
00000100:00100000:3.0:1767318199.374042:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894248704:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318199.374067:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318199.374142:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894248704:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (1082us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318199.374149:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16068
00010000:00010000:2.0:1767318199.725561:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318200.304179:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318200.749465:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318201.325261:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940202240:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318201.325325:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318201.327512:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202240
00000100:00100000:3.0:1767318201.327528:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202240
00000100:00100000:3.0:1767318201.327648:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984
00000100:00100000:3.0:1767318201.327659:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940202240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318201.327700:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318201.327764:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940202240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2438us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318201.327768:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984
00000100:00100000:3.0:1767318201.327848:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940202240:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318201.327926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767318201.328543:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318201.774284:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318201.838877:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318201.838888:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318201.838891:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318201.838895:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318201.838899:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318201.838907:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3446
00000100:00080000:1.0:1767318201.838912:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318201.838919:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318201.838960:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dc380 x1853163940202368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318201.838991:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318201.838995:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318201.838996:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318201.839000:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3446
00000100:00080000:1.0:1767318201.839002:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318201.839006:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318201.839029:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df480 x1853163940202496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318201.839164:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940202624:0@lo:400:kworker.0
00000100:00100000:2.0:1767318201.839239:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318201.839418:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202624
00000100:00100000:3.0:1767318201.839427:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202624
00000100:00100000:3.0:1767318201.839490:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471
00000100:00100000:3.0:1767318201.839502:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940202624:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318201.839586:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318201.839589:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318201.839591:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318201.839596:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3446
00000100:00080000:1.0:1767318201.839598:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318201.839602:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318201.839614:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dd500 x1853163940202880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318201.839630:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318201.839633:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318201.839634:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318201.839637:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3446
00000100:00080000:1.0:1767318201.839639:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318201.839642:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318201.839650:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940203136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318201.839672:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940203008:0@lo:400:kworker.0
00000100:00100000:1.0:1767318201.839712:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318201.839736:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318201.839748:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940202752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318201.839811:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318201.839840:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203008
00000100:00100000:1.0:1767318201.839844:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203008
00000100:00100000:1.0:1767318201.839873:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202752
00000100:00100000:1.0:1767318201.839876:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202752
00000100:00100000:1.0:1767318201.839903:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744
00000100:00100000:1.0:1767318201.839909:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940203008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318201.839943:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940203008:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318201.839951:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744
00000100:00100000:1.0:1767318201.839967:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745
00000100:00100000:1.0:1767318201.839974:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940202752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318201.840000:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940202752:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318201.840005:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745
00000100:00100000:1.0:1767318201.840049:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940202752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318201.840059:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940203008:0@lo:400:kworker.0
00000100:00080000:1.0:1767318201.840080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318201.840763:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318201.843243:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940202368:0@lo:38:kworker.0
00000100:00100000:0.0:1767318201.843323:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318201.843373:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940202496:0@lo:38:kworker.0
00000100:00100000:0.0:1767318201.843400:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318201.843421:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940202880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318201.843458:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318201.843479:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940203136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318201.843497:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318201.843548:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202496
00000100:00100000:0.0:1767318201.843555:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202496
00000100:00100000:0.0:1767318201.843591:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900
00000100:00100000:0.0:1767318201.843597:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940202496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318201.843618:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318201.843659:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940202496:12345-0@lo:38:kworker.0 Request processed in 60us (257us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318201.843666:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900
00000100:00100000:0.0:1767318201.843712:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202368
00000100:00100000:0.0:1767318201.843716:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202368
00000100:00100000:0.0:1767318201.843735:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940202880
00000100:00100000:0.0:1767318201.843739:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940202880
00000100:00100000:0.0:1767318201.843751:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203136
00000100:00100000:0.0:1767318201.843753:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203136
00000100:00100000:0.0:1767318201.843767:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16069
00000100:00100000:0.0:1767318201.843772:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940202368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318201.843814:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318201.843839:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940202368:12345-0@lo:38:kworker.0 Request processed in 66us (516us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318201.843845:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16069
00000100:00100000:0.0:1767318201.843855:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16070
00000100:00100000:0.0:1767318201.843858:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940202880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318201.843866:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318201.843896:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940202880:12345-0@lo:38:kworker.0 Request processed in 35us (437us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318201.843901:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16070
00000100:00100000:0.0:1767318201.843912:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16071
00000100:00100000:0.0:1767318201.843916:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940203136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318201.843924:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318201.843944:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940203136:12345-0@lo:38:kworker.0 Request processed in 26us (445us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318201.843949:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16071
00000100:00080000:0.0:1767318201.843989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318201.843995:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318201.843998:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940202368:0@lo:38:kworker.0
00000100:00080000:0.0:1767318201.844007:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318201.844011:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318201.844015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940202496:0@lo:38:kworker.0
00000100:00080000:0.0:1767318201.844021:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318201.844025:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318201.844027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940202880:0@lo:38:kworker.0
00000100:00080000:0.0:1767318201.844034:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318201.844037:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318201.844039:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940203136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318201.849217:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940202624:12345-0@lo:400:kworker.0 Request processed in 9709us (9966us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318201.849231:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471
00000100:00100000:2.0:1767318201.849624:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940202624:0@lo:400:kworker.0
00000100:00100000:2.0:1767318202.349122:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318202.349150:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940203264:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318202.349219:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318202.349295:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203264
00000100:00100000:2.0:1767318202.349302:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203264
00000100:00100000:2.0:1767318202.349342:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985
00000100:00100000:2.0:1767318202.349350:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940203264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318202.349376:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318202.349415:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940203264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318202.349422:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985
00000100:00100000:2.0:1767318202.349464:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940203264:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318202.349581:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318202.797060:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318203.373289:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318203.821099:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318204.396975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318204.486277:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318204.486326:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318204.486444:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249088
00000100:00100000:2.0:1767318204.486455:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249088
00000100:00100000:2.0:1767318204.486531:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894248960
00000100:00100000:2.0:1767318204.486534:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894248960
00000100:00100000:2.0:1767318204.486554:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3746
00000100:00100000:2.0:1767318204.486564:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894249088:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318204.486637:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894249088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (370us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318204.486645:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3746
00000100:00100000:2.0:1767318204.486699:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16072
00000100:00100000:2.0:1767318204.486704:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894248960:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318204.486724:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318204.486760:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894248960:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (433us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318204.486767:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16072
00000100:00080000:3.0:1767318204.487342:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318204.845005:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318205.424467:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318205.871311:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318206.444964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318206.445158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940203392:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318206.445236:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318206.445345:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203392
00000100:00100000:3.0:1767318206.445353:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203392
00000100:00100000:3.0:1767318206.445418:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986
00000100:00100000:3.0:1767318206.445427:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940203392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318206.445455:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318206.445603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318206.450923:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940203392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5484us (5674us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318206.451009:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986
00000100:00100000:2.0:1767318206.451378:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940203392:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318206.893559:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318206.958387:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318181/real 1767318181]  req@ffff93d0711f8000 x1853163940197376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318206.958436:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0711f8000 x1853163940197376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318206.958456:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318206.958465:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318206.958469:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940197376:0@lo:250:kworker.0
00000100:00080000:2.0:1767318206.958725:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318206.958732:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318206.958734:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318206.958739:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3431
00000100:00080000:2.0:1767318206.958744:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318206.958751:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318206.958934:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3800 x1853163940203520/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318206.958960:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318206.958964:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318206.958966:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318206.958969:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3451
00000100:00080000:2.0:1767318206.958972:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318206.958975:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318206.958994:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f2a00 x1853163940203648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318206.959003:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318206.959006:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318206.959008:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318206.959012:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3451
00000100:00080000:2.0:1767318206.959014:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318206.959020:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318206.959032:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3480 x1853163940203776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318206.959084:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318206.959087:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318206.959088:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318206.959091:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3451
00000100:00080000:2.0:1767318206.959093:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318206.959096:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318206.959107:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50ad9180 x1853163940204160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318206.959244:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940204288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.959310:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318206.959403:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204288
00000100:00100000:1.0:1767318206.959410:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204288
00000100:00100000:1.0:1767318206.959466:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747
00000100:00100000:1.0:1767318206.959475:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940204288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.959522:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940204288:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318206.959529:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747
00000100:00080000:1.0:1767318206.959556:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318206.959585:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940204288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.959603:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940203904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.959644:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318206.959670:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318206.959676:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940204032:0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.959927:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318206.959951:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204032
00000100:00100000:1.0:1767318206.959956:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204032
00000100:00100000:1.0:1767318206.959984:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748
00000100:00100000:1.0:1767318206.959990:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940204032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318206.960023:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940204032:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318206.960029:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748
00000100:00080000:1.0:1767318206.960046:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318206.960063:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940204032:0@lo:400:kworker.0
00000100:00080000:2.0:1767318206.960258:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318206.960314:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318206.960317:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318206.960321:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3451
00000100:00080000:2.0:1767318206.960325:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318206.960329:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318206.960359:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219dc00 x1853163940204416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318206.960657:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203904
00000100:00100000:3.0:1767318206.960663:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203904
00000100:00100000:3.0:1767318206.960724:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472
00000100:00100000:3.0:1767318206.960731:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940203904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318206.960789:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940203904:12345-0@lo:400:kworker.0 Request processed in 59us (1145us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318206.960795:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472
00000100:00100000:0.0:1767318206.961012:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940203520:0@lo:250:kworker.0
00000400:00000100:0.0:1767318206.961040:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940203520 offset 0 length 520: 4
00000100:00100000:0.0:1767318206.961062:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940203648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318206.961083:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318206.961110:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940203776:0@lo:38:kworker.0
00000100:00100000:0.0:1767318206.961512:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318206.961535:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940204160:0@lo:38:kworker.0
00000100:00100000:0.0:1767318206.961556:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318206.961571:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940204416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318206.961587:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318206.961619:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203776
00000100:00100000:0.0:1767318206.961623:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203776
00000100:00100000:0.0:1767318206.961657:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901
00000100:00100000:0.0:1767318206.961662:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940203776:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318206.961792:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940203648
00000100:00100000:3.0:1767318206.961796:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940203648
00000100:00100000:3.0:1767318206.961889:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204160
00000100:00100000:3.0:1767318206.961892:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204160
00000100:00100000:3.0:1767318206.961906:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204416
00000100:00100000:3.0:1767318206.961908:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204416
00000100:00100000:3.0:1767318206.961922:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16073
00000100:00100000:3.0:1767318206.961926:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940203648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318206.961937:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318206.961990:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940203648:12345-0@lo:38:kworker.0 Request processed in 61us (905us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318206.961996:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16073
00000100:00100000:3.0:1767318206.962012:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16074
00000100:00100000:3.0:1767318206.962015:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940204160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318206.962026:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318206.962049:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940204160:12345-0@lo:38:kworker.0 Request processed in 32us (492us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318206.962054:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16074
00000100:00100000:3.0:1767318206.962064:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16075
00000100:00100000:3.0:1767318206.962067:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940204416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318206.962076:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318206.962101:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940204416:12345-0@lo:38:kworker.0 Request processed in 28us (509us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318206.962106:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16075
00010000:00020000:0.0:1767318206.962295:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318206.962324:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940203776:12345-0@lo:38:kworker.0 Request processed in 661us (812us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318206.962330:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901
00000100:00080000:1.0:1767318206.962456:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318206.962491:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940203904:0@lo:400:kworker.0
00000100:00080000:1.0:1767318206.962530:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318206.962535:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318206.962538:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940203648:0@lo:38:kworker.0
00000100:00080000:1.0:1767318206.962547:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318206.962550:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318206.962553:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940203776:0@lo:38:kworker.0
00000100:00080000:1.0:1767318206.962559:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318206.962562:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318206.962564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940204160:0@lo:38:kworker.0
00000100:00080000:1.0:1767318206.962570:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318206.962573:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318206.962575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940204416:0@lo:38:kworker.0
00000100:00100000:3.0:1767318207.470744:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318207.471924:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318207.481879:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940204544:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318207.481959:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318207.482081:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204544
00000100:00100000:0.0:1767318207.482090:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204544
00000100:00100000:0.0:1767318207.482143:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987
00000100:00100000:0.0:1767318207.482154:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940204544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318207.482186:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318207.482243:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940204544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318207.482263:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987
00000100:00100000:1.0:1767318207.483003:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940204544:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318207.918934:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318208.492946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318208.941050:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318209.518482:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318209.606891:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318209.610303:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318209.621152:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249344
00000100:00100000:1.0:1767318209.621173:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249344
00000100:00100000:1.0:1767318209.621302:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249216
00000100:00100000:1.0:1767318209.621306:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249216
00000100:00100000:1.0:1767318209.621337:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3749
00000100:00100000:1.0:1767318209.621348:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894249344:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318209.621443:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894249344:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (14562us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318209.621451:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3749
00000100:00100000:1.0:1767318209.621471:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16076
00000100:00100000:1.0:1767318209.621475:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894249216:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318209.621496:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318209.621515:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318209.621521:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894249216:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (11240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318209.629758:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16076
00010000:00010000:2.0:1767318209.965421:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318210.544979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318210.989054:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318211.568502:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318211.570528:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318211.570552:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940204672:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318211.570635:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318211.571187:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204672
00000100:00100000:2.0:1767318211.571196:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204672
00000100:00100000:2.0:1767318211.571272:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988
00000100:00100000:2.0:1767318211.571281:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940204672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318211.571310:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318211.571375:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940204672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (739us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318211.571383:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988
00000100:00080000:3.0:1767318211.571501:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318211.571557:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940204672:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318212.014095:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318212.083246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318212.083273:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318212.083276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318212.083280:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318212.083284:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318212.083292:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3456
00000100:00080000:3.0:1767318212.083296:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318212.083303:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318212.083360:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fa680 x1853163940204800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318212.083390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318212.083393:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318212.083395:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318212.083399:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3456
00000100:00080000:3.0:1767318212.083402:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318212.083405:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318212.083420:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9c00 x1853163940204928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318212.083496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318212.083500:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318212.083502:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318212.083505:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3456
00000100:00080000:3.0:1767318212.083507:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318212.083511:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318212.083521:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95180 x1853163940205440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318212.083544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318212.083547:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318212.083549:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318212.083554:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3456
00000100:00080000:3.0:1767318212.083556:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318212.083560:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318212.083570:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940205696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318212.083619:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940205312:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.083685:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318212.083759:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318212.083765:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940205184:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.083810:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318212.083844:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205184
00000100:00100000:2.0:1767318212.083853:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205184
00000100:00100000:3.0:1767318212.083856:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940205568:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.083879:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318212.083895:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318212.083900:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940205056:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.083922:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318212.083923:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473
00000100:00100000:2.0:1767318212.083932:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940205184:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318212.083973:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318212.083986:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940205184:12345-0@lo:400:kworker.0 Request processed in 55us (174us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318212.083988:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205056
00000100:00100000:3.0:1767318212.083991:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205056
00000100:00100000:2.0:1767318212.083993:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473
00000100:00100000:2.0:1767318212.084009:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474
00000100:00100000:2.0:1767318212.084014:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940205056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.084254:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205312
00000100:00100000:0.0:1767318212.084259:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205312
00000100:00100000:0.0:1767318212.084297:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205568
00000100:00100000:0.0:1767318212.084300:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205568
00000100:00100000:0.0:1767318212.084321:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750
00000100:00100000:0.0:1767318212.084327:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940205312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.084379:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940205312:12345-0@lo:400:kworker.0 Request processed in 52us (693us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318212.084385:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750
00000100:00100000:0.0:1767318212.084398:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751
00000100:00100000:0.0:1767318212.084404:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940205568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318212.084695:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940204800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318212.084742:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318212.084764:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940204928:0@lo:38:kworker.0
00000100:00100000:1.0:1767318212.084809:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318212.084827:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940205440:0@lo:38:kworker.0
00000100:00100000:1.0:1767318212.084847:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318212.084867:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940205696:0@lo:38:kworker.0
00000100:00100000:1.0:1767318212.084887:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318212.084914:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204800
00000100:00100000:1.0:1767318212.084919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204800
00000100:00100000:1.0:1767318212.084935:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205440
00000100:00100000:1.0:1767318212.084937:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205440
00000100:00100000:1.0:1767318212.084944:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205696
00000100:00100000:1.0:1767318212.084946:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205696
00000100:00100000:1.0:1767318212.084955:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16077
00000100:00100000:1.0:1767318212.084959:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940204800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318212.084978:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318212.085013:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940204800:12345-0@lo:38:kworker.0 Request processed in 51us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318212.085020:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16077
00000100:00100000:1.0:1767318212.085127:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16078
00000100:00100000:1.0:1767318212.085132:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940205440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318212.085142:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318212.085168:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940205440:12345-0@lo:38:kworker.0 Request processed in 35us (320us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318212.085174:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16078
00000100:00100000:1.0:1767318212.085185:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16079
00000100:00100000:1.0:1767318212.085189:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940205696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318212.085197:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318212.085218:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940205696:12345-0@lo:38:kworker.0 Request processed in 27us (329us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318212.085222:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16079
00000100:00080000:1.0:1767318212.085256:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318212.085262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318212.085265:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940204800:0@lo:38:kworker.0
00000100:00080000:1.0:1767318212.085274:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318212.085277:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318212.085279:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940205440:0@lo:38:kworker.0
00000100:00080000:1.0:1767318212.085286:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318212.085289:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318212.085291:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940205696:0@lo:38:kworker.0
00000100:00080000:1.0:1767318212.085771:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318212.085833:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940204928
00000100:00100000:1.0:1767318212.085840:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940204928
00000100:00100000:1.0:1767318212.090708:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902
00000100:00100000:1.0:1767318212.090726:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940204928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318212.090754:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318212.090755:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940205184:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.090792:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940205312:0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.091204:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940205568:12345-0@lo:400:kworker.0 Request processed in 6796us (7320us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318212.091215:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751
00000100:00100000:2.0:1767318212.091387:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940205056:12345-0@lo:400:kworker.0 Request processed in 7369us (7461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318212.091389:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940205056:0@lo:400:kworker.0
00000100:00100000:2.0:1767318212.091399:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474
00000100:00100000:3.0:1767318212.091429:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940205568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318212.092623:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940204928:12345-0@lo:38:kworker.0 Request processed in 1894us (7807us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318212.092635:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902
00000100:00080000:2.0:1767318212.096221:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318212.096234:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318212.096240:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940204928:0@lo:38:kworker.0
00000100:00100000:3.0:1767318212.588912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318212.589213:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318212.589233:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940205824:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318212.589302:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318212.589405:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205824
00000100:00100000:0.0:1767318212.589428:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205824
00000100:00100000:0.0:1767318212.589480:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989
00000100:00100000:0.0:1767318212.589490:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940205824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318212.589529:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318212.589573:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940205824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (271us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318212.589589:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989
00000100:00100000:1.0:1767318212.589740:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940205824:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318213.037067:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318213.613361:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318214.061259:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318214.636946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318214.729901:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318214.730188:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249600
00000100:00100000:2.0:1767318214.730196:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249600
00000100:00100000:2.0:1767318214.730260:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3752
00000100:00100000:2.0:1767318214.730267:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894249600:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318214.730335:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894249600:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 68us (444us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318214.730341:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3752
00000100:00080000:1.0:1767318214.730629:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318214.731331:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318214.731419:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249472
00000100:00100000:3.0:1767318214.731425:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249472
00000100:00100000:3.0:1767318214.731497:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16080
00000100:00100000:3.0:1767318214.731503:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894249472:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318214.731527:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318214.731593:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894249472:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 88us (266us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318214.731601:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16080
00010000:00010000:2.0:1767318215.093867:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318215.661964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318216.109408:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318216.685237:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318216.685262:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940205952:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318216.685327:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318216.685443:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940205952
00000100:00100000:0.0:1767318216.685456:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940205952
00000100:00100000:0.0:1767318216.685510:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990
00000100:00100000:0.0:1767318216.685518:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940205952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318216.685575:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318216.685627:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940205952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (299us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318216.685634:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990
00000100:00080000:1.0:1767318216.685797:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318216.685841:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940205952:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318216.686721:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318217.133220:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318217.198034:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318217.198045:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318217.198048:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318217.198052:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318217.198062:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318217.198071:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3462
00000100:00080000:0.0:1767318217.198076:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318217.198084:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318217.198145:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7b80 x1853163940206080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318217.198218:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940206080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318217.198286:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318217.198593:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206080
00000100:00100000:3.0:1767318217.198601:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206080
00000100:00100000:3.0:1767318217.198651:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16081
00000100:00100000:3.0:1767318217.198659:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940206080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318217.198694:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318217.198870:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318217.198874:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318217.198877:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318217.198882:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3462
00000100:00080000:0.0:1767318217.198884:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318217.198889:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318217.198908:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7480 x1853163940206208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318217.202883:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940206208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318217.203046:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318217.203207:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940206080:12345-0@lo:38:kworker.0 Request processed in 4546us (4918us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318217.203218:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16081
00000100:00080000:0.0:1767318217.203853:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318217.203857:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318217.203861:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318217.203866:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3462
00000100:00080000:0.0:1767318217.203870:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318217.203876:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318217.203894:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4000 x1853163940206720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318217.203912:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318217.203915:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318217.203917:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318217.203921:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3462
00000100:00080000:0.0:1767318217.203935:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318217.203938:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318217.203968:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4700 x1853163940206976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318217.204013:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940206464:0@lo:400:kworker.0
00000100:00100000:0.0:1767318217.204052:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318217.204088:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318217.204093:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940206592:0@lo:400:kworker.0
00000100:00100000:0.0:1767318217.204121:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318217.204146:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206464
00000100:00100000:0.0:1767318217.204153:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206464
00000100:00100000:0.0:1767318217.204201:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767318217.204209:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940206464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318217.204256:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940206464:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318217.204262:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475
00000100:00080000:0.0:1767318217.204279:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318217.204309:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940206464:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204476:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940206336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204506:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318217.204535:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318217.204552:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940206848:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204587:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318217.204619:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206592
00000100:00100000:3.0:1767318217.204622:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206592
00000100:00100000:3.0:1767318217.204653:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206848
00000100:00100000:3.0:1767318217.204657:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206848
00000100:00100000:3.0:1767318217.204688:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753
00000100:00100000:3.0:1767318217.204695:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940206592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204732:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940206592:12345-0@lo:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318217.204737:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753
00000100:00100000:3.0:1767318217.204749:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754
00000100:00100000:3.0:1767318217.204755:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940206848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204807:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940206848:12345-0@lo:400:kworker.0 Request processed in 52us (218us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318217.204813:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754
00000100:00080000:3.0:1767318217.204835:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318217.204852:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940206848:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204872:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940206592:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204893:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206336
00000100:00100000:3.0:1767318217.204896:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206336
00000100:00100000:3.0:1767318217.204939:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476
00000100:00100000:3.0:1767318217.204946:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940206336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.204981:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940206336:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318217.204987:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476
00000100:00100000:3.0:1767318217.205013:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940206336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318217.206432:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206208
00000100:00100000:1.0:1767318217.206442:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206208
00000100:00100000:1.0:1767318217.206478:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903
00000100:00100000:1.0:1767318217.206484:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940206208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318217.206506:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318217.206581:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940206208:12345-0@lo:38:kworker.0 Request processed in 95us (3534us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318217.206588:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903
00000100:00080000:2.0:1767318217.206767:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318217.206789:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318217.206793:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940206080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318217.206820:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940206720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318217.206856:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318217.206946:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940206976:0@lo:38:kworker.0
00000100:00100000:2.0:1767318217.206972:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318217.207362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318217.207367:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318217.207371:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940206208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318217.207419:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206720
00000100:00100000:3.0:1767318217.207424:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206720
00000100:00100000:1.0:1767318217.207461:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940206976
00000100:00100000:1.0:1767318217.207465:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940206976
00000100:00100000:1.0:1767318217.207529:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16082
00000100:00100000:1.0:1767318217.207535:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940206720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318217.207561:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318217.207609:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940206720:12345-0@lo:38:kworker.0 Request processed in 72us (751us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318217.207615:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16082
00000100:00100000:1.0:1767318217.207629:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16083
00000100:00100000:1.0:1767318217.207633:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940206976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318217.207642:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318217.207664:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940206976:12345-0@lo:38:kworker.0 Request processed in 29us (690us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318217.207670:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16083
00000100:00080000:0.0:1767318217.207804:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318217.207809:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318217.207813:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940206720:0@lo:38:kworker.0
00000100:00080000:0.0:1767318217.207820:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318217.207824:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318217.207826:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940206976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318217.710752:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318217.711701:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318217.711731:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940207104:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318217.711831:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318217.712108:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207104
00000100:00100000:2.0:1767318217.712125:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207104
00000100:00100000:2.0:1767318217.712183:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991
00000100:00100000:2.0:1767318217.712192:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940207104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318217.712224:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318217.712277:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940207104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (446us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318217.712284:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991
00000100:00100000:1.0:1767318217.713013:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940207104:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318218.158793:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318218.733504:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318219.181628:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318219.757725:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318219.847868:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318219.847959:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318219.848043:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249856
00000100:00100000:1.0:1767318219.848057:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249856
00000100:00100000:1.0:1767318219.848142:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894249728
00000100:00100000:1.0:1767318219.848154:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894249728
00000100:00100000:1.0:1767318219.848175:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3755
00000100:00100000:1.0:1767318219.848184:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894249856:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318219.848255:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894249856:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318219.848263:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3755
00000100:00100000:1.0:1767318219.848283:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16084
00000100:00100000:1.0:1767318219.848288:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894249728:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318219.848308:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318219.848332:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894249728:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318219.848339:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16084
00000100:00080000:3.0:1767318219.848946:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318220.205884:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318220.780916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318221.229610:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318221.804967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318221.805760:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940207232:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318221.805862:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318221.806218:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207232
00000100:00100000:2.0:1767318221.806226:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207232
00000100:00100000:2.0:1767318221.806285:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992
00000100:00100000:2.0:1767318221.806294:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940207232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318221.806325:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318221.806369:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940207232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (506us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318221.806377:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992
00000100:00080000:2.0:1767318221.806409:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318221.806755:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940207232:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318222.253093:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318222.319400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318222.319410:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318222.319413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318222.319417:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318222.319421:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318222.319428:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3467
00000100:00080000:3.0:1767318222.319433:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318222.319438:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318222.319475:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89c00 x1853163940207360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318222.319527:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318222.319531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318222.319533:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318222.319537:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3467
00000100:00080000:3.0:1767318222.319540:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318222.319544:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318222.319556:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940207488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318222.319647:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318222.319650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318222.319652:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318222.319656:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3467
00000100:00080000:3.0:1767318222.319658:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318222.319662:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318222.319672:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940208000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318222.319686:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318222.319689:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318222.319691:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318222.319694:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3467
00000100:00080000:3.0:1767318222.319697:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318222.319700:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318222.319711:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88a80 x1853163940208256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318222.319736:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940207744:0@lo:400:kworker.0
00000100:00100000:3.0:1767318222.319830:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318222.319895:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318222.319901:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940207872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318222.319926:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318222.319961:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207872
00000100:00100000:3.0:1767318222.319970:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207872
00000100:00100000:3.0:1767318222.320018:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756
00000100:00100000:3.0:1767318222.320036:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940207872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318222.320090:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940207872:12345-0@lo:400:kworker.0 Request processed in 57us (161us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318222.320097:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756
00000100:00100000:3.0:1767318222.320136:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940207872:0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.320344:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940207616:0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.320374:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.320401:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318222.320407:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940208128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.320428:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.320451:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208128
00000100:00100000:1.0:1767318222.320454:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208128
00000100:00100000:1.0:1767318222.320478:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757
00000100:00100000:1.0:1767318222.320484:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940208128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.320526:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940208128:12345-0@lo:400:kworker.0 Request processed in 42us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318222.320532:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757
00000100:00100000:1.0:1767318222.320558:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940208128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318222.320622:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207744
00000100:00100000:3.0:1767318222.320626:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207744
00000100:00080000:2.0:1767318222.320725:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318222.320730:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318222.320798:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207616
00000100:00100000:3.0:1767318222.320802:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207616
00000100:00100000:1.0:1767318222.322109:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477
00000100:00100000:1.0:1767318222.322126:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940207744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.322207:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940207744:12345-0@lo:400:kworker.0 Request processed in 87us (2376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318222.322214:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477
00000100:00100000:1.0:1767318222.322234:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478
00000100:00100000:1.0:1767318222.322240:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940207616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.322272:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940207616:12345-0@lo:400:kworker.0 Request processed in 33us (1897us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318222.322278:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478
00000100:00100000:1.0:1767318222.322317:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940207616:0@lo:400:kworker.0
00000100:00100000:1.0:1767318222.322359:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940207360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318222.322391:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.322410:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940207488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318222.322433:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.322450:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940208000:0@lo:38:kworker.0
00000100:00100000:1.0:1767318222.322468:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.322482:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940208256:0@lo:38:kworker.0
00000100:00100000:1.0:1767318222.322514:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318222.322544:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207488
00000100:00100000:1.0:1767318222.322549:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207488
00000100:00100000:1.0:1767318222.322573:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904
00000100:00100000:1.0:1767318222.322577:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940207488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318222.322595:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318222.322628:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940207488:12345-0@lo:38:kworker.0 Request processed in 49us (194us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318222.322634:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904
00000100:00100000:1.0:1767318222.322651:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940207360
00000100:00100000:1.0:1767318222.322655:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940207360
00000100:00100000:1.0:1767318222.322672:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208000
00000100:00100000:1.0:1767318222.322675:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208000
00000100:00100000:1.0:1767318222.322686:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208256
00000100:00100000:1.0:1767318222.322688:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208256
00000100:00100000:1.0:1767318222.322697:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16085
00000100:00100000:1.0:1767318222.322701:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940207360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318222.322710:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318222.322734:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940207360:12345-0@lo:38:kworker.0 Request processed in 31us (342us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318222.322739:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16085
00000100:00100000:1.0:1767318222.322750:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16086
00000100:00100000:1.0:1767318222.322753:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940208000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318222.322761:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318222.323582:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16087
00000100:00100000:2.0:1767318222.323588:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940208256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318222.323601:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318222.323644:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940208256:12345-0@lo:38:kworker.0 Request processed in 55us (1129us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318222.323651:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16087
00000100:00100000:2.0:1767318222.323692:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940207744:0@lo:400:kworker.0
00000100:00080000:2.0:1767318222.323744:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318222.323749:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318222.323752:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940207360:0@lo:38:kworker.0
00000100:00080000:2.0:1767318222.323761:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318222.323764:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318222.323767:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940207488:0@lo:38:kworker.0
00000100:00080000:2.0:1767318222.323819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318222.323823:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318222.323826:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940208256:0@lo:38:kworker.0
00000100:00100000:1.0:1767318222.326719:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940208000:12345-0@lo:38:kworker.0 Request processed in 3954us (4240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318222.326733:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16086
00000100:00080000:1.0:1767318222.326817:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318222.326825:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318222.326828:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940208000:0@lo:38:kworker.0
00000100:00100000:0.0:1767318222.828934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318222.829389:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318222.829408:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940208384:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318222.829480:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318222.829627:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208384
00000100:00100000:0.0:1767318222.829635:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208384
00000100:00100000:0.0:1767318222.829688:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993
00000100:00100000:0.0:1767318222.829698:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940208384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318222.829727:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318222.829797:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940208384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318222.829804:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993
00000100:00100000:3.0:1767318222.829905:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940208384:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318223.277071:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318223.853087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318223.945737:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767318223.945824:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894249984 offset 0 length 520: 4
00000100:00100000:2.0:1767318223.945864:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318223.946028:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250240
00000100:00100000:1.0:1767318223.946039:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250240
00000100:00100000:1.0:1767318223.946119:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250112
00000100:00100000:1.0:1767318223.946123:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250112
00000100:00100000:1.0:1767318223.946144:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3758
00000100:00100000:1.0:1767318223.946154:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894250240:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318223.946227:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894250240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (500us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318223.946235:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3758
00000100:00100000:1.0:1767318223.946254:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16088
00000100:00100000:1.0:1767318223.946259:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894250112:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318223.946279:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318223.946303:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894250112:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318223.946309:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16088
00000100:00080000:2.0:1767318223.947568:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318224.301168:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318224.877103:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318225.327090:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318225.900938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318226.349179:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318226.924912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318226.924994:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318226.925015:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940208512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318226.925083:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318226.925245:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208512
00000100:00100000:2.0:1767318226.925254:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208512
00000100:00100000:2.0:1767318226.925322:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994
00000100:00100000:2.0:1767318226.925331:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940208512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318226.925361:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318226.925414:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940208512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (330us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318226.925421:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994
00000100:00100000:3.0:1767318226.925517:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940208512:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318226.925652:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318227.373230:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318227.437646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318227.437657:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318227.437660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318227.437664:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318227.437668:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318227.437675:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3472
00000100:00080000:3.0:1767318227.437680:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318227.437687:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318227.437738:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940208640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318227.437761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318227.437765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318227.437766:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318227.437801:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3472
00000100:00080000:3.0:1767318227.437804:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318227.437808:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318227.437938:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940208640:0@lo:38:kworker.0
00000100:00100000:1.0:1767318227.438006:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318227.438220:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208640
00000100:00100000:2.0:1767318227.438229:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208640
00000100:00100000:2.0:1767318227.438271:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16089
00000100:00100000:2.0:1767318227.438280:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940208640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318227.438301:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318227.438356:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940208640:12345-0@lo:38:kworker.0 Request processed in 75us (349us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318227.438363:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16089
00000100:00080000:1.0:1767318227.438524:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318227.438530:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318227.438533:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940208640:0@lo:38:kworker.0
00000100:00100000:3.0:1767318227.438653:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c700 x1853163940208768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318227.438993:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318227.438997:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318227.438999:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318227.439004:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3472
00000100:00080000:3.0:1767318227.439006:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318227.439011:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318227.439026:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ed80 x1853163940209280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318227.439047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318227.439052:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318227.439054:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318227.439058:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3472
00000100:00080000:3.0:1767318227.439060:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318227.439064:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318227.439075:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940209536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318227.439077:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940208896:0@lo:400:kworker.0
00000100:00100000:3.0:1767318227.439109:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940209152:0@lo:400:kworker.0
00000100:00100000:0.0:1767318227.439130:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.439148:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318227.439172:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318227.439178:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318227.439194:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940209408:0@lo:400:kworker.0
00000100:00100000:3.0:1767318227.439200:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940209024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318227.439227:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.439238:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318227.439330:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209152
00000100:00100000:2.0:1767318227.439336:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209152
00000100:00100000:2.0:1767318227.439376:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209408
00000100:00100000:2.0:1767318227.439379:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209408
00000100:00100000:2.0:1767318227.439398:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759
00000100:00100000:2.0:1767318227.439405:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940209152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318227.439459:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940209152:12345-0@lo:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318227.439466:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759
00000100:00100000:2.0:1767318227.439479:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760
00000100:00100000:2.0:1767318227.439486:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940209408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318227.439526:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940209408:12345-0@lo:400:kworker.0 Request processed in 40us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318227.439533:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760
00000100:00080000:2.0:1767318227.439559:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318227.439721:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208896
00000100:00100000:1.0:1767318227.439726:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208896
00000100:00100000:1.0:1767318227.439768:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209024
00000100:00100000:1.0:1767318227.439787:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209024
00000100:00100000:1.0:1767318227.439818:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479
00000100:00100000:1.0:1767318227.439837:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940208896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318227.439871:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940208896:12345-0@lo:400:kworker.0 Request processed in 47us (742us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318227.439877:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479
00000100:00100000:1.0:1767318227.439890:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480
00000100:00100000:1.0:1767318227.439895:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940209024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318227.439923:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940209024:12345-0@lo:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318227.439929:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480
00000100:00080000:1.0:1767318227.439948:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318227.439960:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940208768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318227.439986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318227.440133:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940208768
00000100:00100000:2.0:1767318227.440138:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940208768
00000100:00100000:2.0:1767318227.440161:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905
00000100:00100000:2.0:1767318227.440165:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940208768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318227.440184:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318227.440216:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940208768:12345-0@lo:38:kworker.0 Request processed in 50us (229us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318227.440222:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905
00000100:00100000:3.0:1767318227.445614:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940209024:0@lo:400:kworker.0
00000100:00100000:3.0:1767318227.445633:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940209152:0@lo:400:kworker.0
00000100:00100000:1.0:1767318227.446080:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940209408:0@lo:400:kworker.0
00000100:00100000:1.0:1767318227.446093:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940208896:0@lo:400:kworker.0
00000100:00080000:0.0:1767318227.447040:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318227.447050:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318227.447055:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940208768:0@lo:38:kworker.0
00000100:00100000:0.0:1767318227.447067:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940209280:0@lo:38:kworker.0
00000100:00100000:0.0:1767318227.447137:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318227.447188:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940209536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318227.447214:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318227.447516:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209280
00000100:00100000:2.0:1767318227.447524:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209280
00000100:00100000:2.0:1767318227.447568:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209536
00000100:00100000:2.0:1767318227.447571:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209536
00000100:00100000:2.0:1767318227.447601:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16090
00000100:00100000:2.0:1767318227.447609:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940209280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318227.447631:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318227.447676:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940209280:12345-0@lo:38:kworker.0 Request processed in 66us (538us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318227.447683:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16090
00000100:00100000:2.0:1767318227.447698:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16091
00000100:00100000:2.0:1767318227.447703:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940209536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318227.447724:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318227.447757:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318227.447765:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318227.447767:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940209536:12345-0@lo:38:kworker.0 Request processed in 60us (549us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318227.447771:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940209280:0@lo:38:kworker.0
00000100:00100000:2.0:1767318227.447797:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16091
00000100:00080000:0.0:1767318227.447807:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318227.447812:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318227.447816:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940209536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318227.948998:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318227.949378:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940209664:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318227.949479:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318227.949854:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209664
00000100:00100000:0.0:1767318227.949862:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209664
00000100:00100000:0.0:1767318227.949916:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995
00000100:00100000:0.0:1767318227.949925:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940209664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318227.949956:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318227.950014:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940209664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (533us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318227.950021:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995
00000100:00100000:2.0:1767318227.950110:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940209664:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318228.399156:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318228.972885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318229.064463:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318229.064525:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318229.064618:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250368
00000100:00100000:3.0:1767318229.064629:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250368
00000100:00100000:3.0:1767318229.064676:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250496
00000100:00100000:3.0:1767318229.064679:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250496
00000100:00100000:3.0:1767318229.064739:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3761
00000100:00100000:3.0:1767318229.064751:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894250496:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318229.064873:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894250496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318229.064880:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3761
00000100:00100000:3.0:1767318229.064902:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16092
00000100:00100000:3.0:1767318229.064907:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894250368:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318229.064927:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318229.064954:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894250368:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (533us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318229.064960:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16092
00000100:00080000:0.0:1767318229.065343:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318229.421122:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318229.997190:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318230.445272:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318231.021015:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318231.469581:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318231.533009:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318206/real 1767318206]  req@ffff93d0711f3800 x1853163940203520/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318231 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318231.533041:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0711f3800 x1853163940203520/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318231 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318231.533060:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318231.533086:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318231.533090:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940203520:0@lo:250:kworker.0
00000100:00080000:1.0:1767318231.533194:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318231.533200:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318231.533203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318231.533208:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3456
00000100:00080000:1.0:1767318231.533212:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318231.533217:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318231.533251:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3800 x1853163940209792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318231.533282:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318231.533286:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318231.533288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318231.533291:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318231.533293:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318231.533296:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318231.533312:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f3480 x1853163940209920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318231.533319:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318231.533322:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318231.533323:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318231.533326:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318231.533328:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318231.533331:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318231.533341:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f2a00 x1853163940210048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318231.533415:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318231.533418:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318231.533420:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318231.533423:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318231.533425:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318231.533429:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318231.533439:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940210560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318231.533454:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318231.533457:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318231.533458:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318231.533461:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318231.533463:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318231.533466:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318231.533485:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df480 x1853163940210816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318231.533921:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940209792:0@lo:250:kworker.0
00000400:00000100:0.0:1767318231.533973:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940209792 offset 0 length 520: 4
00000100:00100000:0.0:1767318231.534015:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940209920:0@lo:38:kworker.0
00000100:00100000:0.0:1767318231.534047:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318231.534070:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940210048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318231.534092:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318231.534110:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940210560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318231.534129:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318231.534162:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210048
00000100:00100000:0.0:1767318231.534180:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210048
00000100:00100000:0.0:1767318231.534214:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906
00000100:00100000:0.0:1767318231.534221:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940210048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318231.534241:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318231.534277:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940210048:12345-0@lo:38:kworker.0 Request processed in 55us (183us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318231.534285:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906
00000100:00100000:0.0:1767318231.534306:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940209920
00000100:00100000:0.0:1767318231.534309:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940209920
00000100:00100000:0.0:1767318231.534328:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210560
00000100:00100000:0.0:1767318231.534330:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210560
00000100:00100000:0.0:1767318231.534345:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16093
00000100:00100000:0.0:1767318231.534350:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940209920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318231.534359:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318231.534385:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940209920:12345-0@lo:38:kworker.0 Request processed in 33us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318231.534390:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16093
00000100:00100000:0.0:1767318231.534401:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16094
00000100:00100000:0.0:1767318231.534405:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940210560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318231.534426:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318231.534449:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940210560:12345-0@lo:38:kworker.0 Request processed in 41us (318us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318231.534455:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16094
00000100:00080000:0.0:1767318231.534658:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318231.534663:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318231.534666:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940209920:0@lo:38:kworker.0
00000100:00100000:3.0:1767318231.534722:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940210304:0@lo:400:kworker.0
00000100:00080000:0.0:1767318231.535006:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318231.535011:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318231.535014:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940210048:0@lo:38:kworker.0
00000100:00100000:2.0:1767318231.535035:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940210176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318231.535116:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940210432:0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.541007:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318231.541099:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210304
00000100:00100000:3.0:1767318231.541110:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210304
00000100:00100000:3.0:1767318231.541176:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481
00000100:00100000:3.0:1767318231.541188:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940210304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.543124:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940210304:12345-0@lo:400:kworker.0 Request processed in 1931us (2116us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318231.543139:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481
00000100:00080000:3.0:1767318231.544584:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318231.544654:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940210304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.546100:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940210688:0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.547043:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318231.547116:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210688
00000100:00100000:3.0:1767318231.547124:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210688
00000100:00100000:3.0:1767318231.548629:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762
00000100:00100000:3.0:1767318231.548658:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940210688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.550129:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940210688:12345-0@lo:400:kworker.0 Request processed in 1484us (3084us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318231.550142:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762
00000100:00080000:0.0:1767318231.550644:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318231.550651:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318231.550656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940210560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318231.550719:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940210816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318231.550766:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318231.550807:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210816
00000100:00100000:3.0:1767318231.550822:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210816
00000100:00080000:0.0:1767318231.550870:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318231.551221:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318231.551250:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210176
00000100:00100000:2.0:1767318231.551254:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210176
00000100:00100000:2.0:1767318231.551296:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1767318231.551304:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940210176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.551341:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16095
00000100:00100000:3.0:1767318231.551346:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940210816:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318231.551351:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940210176:12345-0@lo:400:kworker.0 Request processed in 49us (131us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318231.551357:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482
00010000:00020000:3.0:1767318231.551365:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318231.551373:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318231.551398:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940210816:12345-0@lo:38:kworker.0 Request processed in 50us (631us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318231.551404:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16095
00000100:00100000:2.0:1767318231.551417:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940210176:0@lo:400:kworker.0
00000100:00100000:3.0:1767318231.551445:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940210688:0@lo:400:kworker.0
00000100:00080000:0.0:1767318231.551762:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318231.551767:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318231.551771:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940210816:0@lo:38:kworker.0
00000100:00100000:1.0:1767318231.562099:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318231.563302:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210432
00000100:00100000:0.0:1767318231.563314:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210432
00000100:00100000:0.0:1767318231.563403:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763
00000100:00100000:0.0:1767318231.563421:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940210432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318231.563507:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940210432:12345-0@lo:400:kworker.0 Request processed in 87us (1413us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318231.563515:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763
00000100:00080000:2.0:1767318231.563595:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318231.565215:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940210432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318232.045079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318232.046160:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318232.046181:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940210944:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318232.046262:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318232.046443:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940210944
00000100:00100000:1.0:1767318232.046451:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940210944
00000100:00100000:1.0:1767318232.046522:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996
00000100:00100000:1.0:1767318232.046531:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940210944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318232.046563:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318232.046632:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940210944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (368us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318232.046640:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996
00000100:00100000:3.0:1767318232.046892:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940210944:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318232.493448:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318233.068920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318233.069276:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940211072:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318233.069362:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318233.069607:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211072
00000100:00100000:0.0:1767318233.069616:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211072
00000100:00100000:0.0:1767318233.069689:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997
00000100:00100000:0.0:1767318233.069700:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940211072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318233.069731:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318233.069811:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940211072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (438us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318233.069823:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997
00000100:00100000:3.0:1767318233.070012:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940211072:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318233.070101:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318233.517257:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318234.096743:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318234.184412:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318234.184458:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318234.184681:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250752
00000100:00100000:3.0:1767318234.184691:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250752
00000100:00100000:3.0:1767318234.184761:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250624
00000100:00100000:3.0:1767318234.184765:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250624
00000100:00100000:3.0:1767318234.184820:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3764
00000100:00100000:3.0:1767318234.184831:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894250752:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318234.184900:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894250752:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (499us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318234.184908:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3764
00000100:00100000:3.0:1767318234.184929:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16096
00000100:00100000:3.0:1767318234.184934:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894250624:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318234.184955:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318234.184993:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894250624:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (534us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318234.185000:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16096
00000100:00080000:2.0:1767318234.191380:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318234.552338:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318235.118261:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318235.573081:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318236.141344:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318236.589527:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318236.659860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318236.659871:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318236.659874:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318236.659878:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318236.659883:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318236.659892:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3481
00000100:00080000:3.0:1767318236.659918:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318236.659925:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318236.659964:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a680 x1853163940211200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318236.660002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318236.660006:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318236.660007:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318236.660011:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3481
00000100:00080000:3.0:1767318236.660013:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318236.660016:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318236.660030:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89f80 x1853163940211328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318236.660141:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318236.660154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940211200:0@lo:38:kworker.0
00000100:00100000:0.0:1767318236.660228:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318236.660295:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940211328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318236.660323:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318236.660377:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211328
00000100:00100000:0.0:1767318236.660385:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211328
00000100:00100000:0.0:1767318236.660423:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907
00000100:00100000:0.0:1767318236.660431:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940211328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318236.660455:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318236.660502:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940211328:12345-0@lo:38:kworker.0 Request processed in 70us (177us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318236.660509:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907
00000100:00080000:0.0:1767318236.660550:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318236.660554:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318236.660559:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940211328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318236.660812:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211200
00000100:00100000:1.0:1767318236.660818:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211200
00000100:00100000:1.0:1767318236.660843:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16097
00000100:00100000:1.0:1767318236.660847:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940211200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318236.660860:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318236.660910:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940211200:12345-0@lo:38:kworker.0 Request processed in 61us (681us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318236.660916:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16097
00000100:00080000:1.0:1767318236.660941:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318236.660945:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318236.660947:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940211200:0@lo:38:kworker.0
00000100:00100000:2.0:1767318236.666885:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940211584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318236.666993:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318236.667133:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940211456:0@lo:400:kworker.0
00000100:00100000:2.0:1767318236.667157:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318236.667278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318236.667286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318236.667290:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318236.667298:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3481
00000100:00080000:3.0:1767318236.667313:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318236.667322:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318236.667351:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89f80 x1853163940211840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318236.667396:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318236.667407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318236.667408:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318236.667412:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3481
00000100:00080000:3.0:1767318236.667431:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318236.667435:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318236.667448:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f2a00 x1853163940212096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318236.667476:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940211968:0@lo:400:kworker.0
00000100:00100000:3.0:1767318236.667508:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318236.667534:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318236.667539:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940211712:0@lo:400:kworker.0
00000100:00100000:3.0:1767318236.667571:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318236.667602:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211968
00000100:00100000:3.0:1767318236.667610:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211968
00000100:00100000:3.0:1767318236.667673:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211712
00000100:00100000:3.0:1767318236.667677:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211712
00000100:00100000:3.0:1767318236.667704:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765
00000100:00100000:3.0:1767318236.667712:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940211968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318236.667765:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940211968:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318236.667789:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765
00000100:00100000:3.0:1767318236.667809:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766
00000100:00100000:3.0:1767318236.667816:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940211712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318236.667846:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940211712:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318236.667852:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766
00000100:00100000:3.0:1767318236.667896:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940211712:0@lo:400:kworker.0
00000100:00100000:3.0:1767318236.667906:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940211968:0@lo:400:kworker.0
00000100:00080000:3.0:1767318236.667958:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318236.671552:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940211840:0@lo:38:kworker.0
00000100:00100000:1.0:1767318236.671637:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318236.671687:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940212096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318236.671709:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318236.671759:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211840
00000100:00100000:1.0:1767318236.671768:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211840
00000100:00100000:1.0:1767318236.671818:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212096
00000100:00100000:1.0:1767318236.671822:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212096
00000100:00100000:1.0:1767318236.671840:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16098
00000100:00100000:1.0:1767318236.671846:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940211840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318236.671869:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318236.671915:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940211840:12345-0@lo:38:kworker.0 Request processed in 67us (278us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318236.671922:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16098
00000100:00100000:1.0:1767318236.671941:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16099
00000100:00100000:1.0:1767318236.671945:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940212096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318236.671954:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318236.671977:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940212096:12345-0@lo:38:kworker.0 Request processed in 31us (267us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318236.671983:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16099
00000100:00080000:1.0:1767318236.672025:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318236.672032:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318236.672037:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940211840:0@lo:38:kworker.0
00000100:00080000:1.0:1767318236.672045:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318236.672048:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318236.672051:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940212096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318236.680937:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211584
00000100:00100000:0.0:1767318236.680954:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211584
00000100:00100000:0.0:1767318236.681052:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940211456
00000100:00100000:0.0:1767318236.681056:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940211456
00000100:00100000:0.0:1767318236.681086:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483
00000100:00100000:0.0:1767318236.681095:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940211584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318236.681179:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940211584:12345-0@lo:400:kworker.0 Request processed in 86us (14186us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318236.681187:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483
00000100:00100000:0.0:1767318236.681202:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484
00000100:00100000:0.0:1767318236.681208:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940211456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318236.681236:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940211456:12345-0@lo:400:kworker.0 Request processed in 28us (14077us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318236.681241:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484
00000100:00080000:2.0:1767318236.681574:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318236.681579:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318236.681620:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940211584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318236.681634:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940211456:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.164911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318237.165113:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940212224:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318237.165193:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.165539:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212224
00000100:00100000:0.0:1767318237.165548:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212224
00000100:00100000:0.0:1767318237.165605:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998
00000100:00100000:0.0:1767318237.165613:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940212224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318237.165644:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318237.165697:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940212224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318237.165704:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998
00000100:00100000:3.0:1767318237.166032:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940212224:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318237.615771:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318238.191497:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318238.191752:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318238.191786:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940212352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318238.191912:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318238.192073:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212352
00000100:00100000:1.0:1767318238.192081:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212352
00000100:00100000:1.0:1767318238.192156:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999
00000100:00100000:1.0:1767318238.192166:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940212352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318238.192196:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318238.192243:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940212352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318238.192250:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999
00000100:00080000:3.0:1767318238.192415:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318238.192452:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940212352:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318238.640630:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318239.212893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318239.316669:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318239.316711:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894250880
00000100:00100000:3.0:1767318239.316716:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318239.316721:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894250880
00000100:00100000:1.0:1767318239.316761:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251008
00000100:00100000:1.0:1767318239.316765:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251008
00000100:00100000:3.0:1767318239.316811:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16100
00000100:00100000:3.0:1767318239.316821:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894250880:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767318239.316838:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3767
00010000:00020000:3.0:1767318239.316848:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318239.316851:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894251008:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767318239.316909:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318239.316937:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894250880:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 114us (275us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318239.316944:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16100
00000100:00100000:1.0:1767318239.316976:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894251008:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 130us (262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318239.316986:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3767
00010000:00010000:1.0:1767318239.662307:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318240.237789:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318240.686981:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318241.261313:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318241.709966:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318241.773242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318241.773252:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318241.773255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318241.773259:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318241.773263:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318241.773271:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3486
00000100:00080000:0.0:1767318241.773276:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318241.773282:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318241.773332:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d7800 x1853163940212480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318241.773363:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318241.773366:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318241.773368:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318241.773372:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3486
00000100:00080000:0.0:1767318241.773383:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318241.773387:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318241.773409:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d5880 x1853163940212608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318241.773477:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940212736:0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.773543:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318241.773659:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212736
00000100:00100000:2.0:1767318241.773667:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212736
00000100:00100000:2.0:1767318241.773725:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485
00000100:00100000:2.0:1767318241.773745:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940212736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318241.773966:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940212480:0@lo:38:kworker.0
00000100:00100000:1.0:1767318241.774001:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318241.774020:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940212608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318241.774040:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318241.774072:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212480
00000100:00100000:1.0:1767318241.774076:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212480
00000100:00100000:1.0:1767318241.774101:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16101
00000100:00100000:1.0:1767318241.774107:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940212480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318241.774126:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318241.774159:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940212480:12345-0@lo:38:kworker.0 Request processed in 51us (157us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318241.774166:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16101
00000100:00100000:1.0:1767318241.774187:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212608
00000100:00100000:1.0:1767318241.774190:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212608
00000100:00100000:1.0:1767318241.774210:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908
00000100:00100000:1.0:1767318241.774214:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940212608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318241.774223:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318241.774245:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940212608:12345-0@lo:38:kworker.0 Request processed in 30us (204us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318241.774251:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908
00000100:00080000:1.0:1767318241.774282:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318241.774286:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318241.774289:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940212480:0@lo:38:kworker.0
00000100:00080000:1.0:1767318241.774298:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318241.774301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318241.774303:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940212608:0@lo:38:kworker.0
00000100:00080000:1.0:1767318241.774361:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318241.774377:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940212864:0@lo:400:kworker.0
00000100:00100000:1.0:1767318241.774402:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318241.774435:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212864
00000100:00100000:1.0:1767318241.774439:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212864
00000100:00100000:1.0:1767318241.774469:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486
00000100:00100000:1.0:1767318241.774475:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940212864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318241.774539:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940212864:12345-0@lo:400:kworker.0 Request processed in 64us (135us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318241.774545:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486
00000100:00080000:1.0:1767318241.774559:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318241.774577:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940212864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318241.780688:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940212736:12345-0@lo:400:kworker.0 Request processed in 6944us (7133us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318241.780704:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485
00000100:00100000:3.0:1767318241.781621:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940212736:0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.781901:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940212992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.781953:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318241.782213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318241.782218:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318241.782222:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318241.782227:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3486
00000100:00080000:0.0:1767318241.782231:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318241.782236:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318241.782256:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940213120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318241.782309:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940213120:0@lo:38:kworker.0
00000100:00100000:2.0:1767318241.782347:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318241.782419:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318241.782425:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940213248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.782446:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318241.782470:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940212992
00000100:00100000:3.0:1767318241.782476:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940212992
00000100:00100000:3.0:1767318241.782517:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213120
00000100:00100000:3.0:1767318241.782519:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213120
00000100:00100000:3.0:1767318241.782531:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213248
00000100:00100000:3.0:1767318241.782533:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213248
00000100:00100000:3.0:1767318241.782553:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768
00000100:00100000:3.0:1767318241.782559:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940212992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.782608:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940212992:12345-0@lo:400:kworker.0 Request processed in 49us (654us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318241.782615:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768
00000100:00100000:3.0:1767318241.782630:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769
00000100:00100000:3.0:1767318241.782635:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940213248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.782657:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940213248:12345-0@lo:400:kworker.0 Request processed in 22us (210us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318241.782662:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769
00000100:00100000:3.0:1767318241.782672:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16102
00000100:00100000:3.0:1767318241.782675:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940213120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318241.782694:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318241.782793:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318241.783354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318241.783359:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318241.783362:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318241.783368:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3486
00000100:00080000:0.0:1767318241.783379:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318241.783383:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318241.783544:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88380 x1853163940213376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318241.783619:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940213248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318241.783630:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940212992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318241.783745:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940213120:12345-0@lo:38:kworker.0 Request processed in 1066us (1396us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318241.783753:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16102
00000100:00080000:2.0:1767318241.783883:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318241.783889:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318241.783892:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940213120:0@lo:38:kworker.0
00000100:00100000:2.0:1767318241.783906:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940213376:0@lo:38:kworker.0
00000100:00100000:2.0:1767318241.783939:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318241.784099:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213376
00000100:00100000:3.0:1767318241.784104:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213376
00000100:00100000:3.0:1767318241.784241:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16103
00000100:00100000:3.0:1767318241.784247:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940213376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318241.784263:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318241.784301:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940213376:12345-0@lo:38:kworker.0 Request processed in 54us (361us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318241.784307:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16103
00000100:00080000:2.0:1767318241.784365:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318241.784370:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318241.784373:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940213376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318242.285055:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318242.285078:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940213504:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318242.285168:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318242.285577:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213504
00000100:00100000:0.0:1767318242.285586:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213504
00000100:00100000:3.0:1767318242.285688:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318242.285740:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000
00000100:00100000:0.0:1767318242.285750:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940213504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318242.285793:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318242.285855:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940213504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (687us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318242.285862:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000
00000100:00100000:2.0:1767318242.286141:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940213504:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318242.733341:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318243.309659:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318243.310288:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318243.310316:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940213632:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318243.310610:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318243.310651:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213632
00000100:00100000:3.0:1767318243.310659:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213632
00000100:00100000:3.0:1767318243.310713:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001
00000100:00100000:3.0:1767318243.310724:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940213632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318243.310755:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318243.310832:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940213632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318243.310840:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001
00000100:00100000:2.0:1767318243.310894:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940213632:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318243.311177:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318243.757833:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318244.332906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318244.425746:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318244.425848:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318244.425957:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251264
00000100:00100000:1.0:1767318244.425967:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251264
00000100:00080000:2.0:1767318244.426082:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318244.426121:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251136
00000100:00100000:1.0:1767318244.426125:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251136
00000100:00100000:3.0:1767318244.427128:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3770
00000100:00100000:3.0:1767318244.427145:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894251264:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318244.427247:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894251264:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (1510us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318244.427254:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3770
00000100:00100000:3.0:1767318244.427287:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16104
00000100:00100000:3.0:1767318244.427300:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894251136:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318244.427321:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318244.427356:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894251136:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (1500us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318244.427363:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16104
00010000:00010000:1.0:1767318244.782860:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318245.357387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318245.805097:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318246.380908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318246.829708:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318246.894112:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318246.894123:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318246.894126:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318246.894131:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318246.894135:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318246.894143:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3491
00000100:00080000:0.0:1767318246.894148:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318246.894155:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318246.894196:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a89f80 x1853163940213760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318246.894224:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318246.894227:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318246.894229:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318246.894232:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3491
00000100:00080000:0.0:1767318246.894234:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318246.894332:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318246.894345:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940213888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318246.894401:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318246.894404:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318246.894406:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318246.894408:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3491
00000100:00080000:0.0:1767318246.894409:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318246.894412:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318246.894418:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8a680 x1853163940214400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318246.894429:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318246.894432:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318246.894434:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318246.894437:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3491
00000100:00080000:0.0:1767318246.894439:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318246.894442:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318246.894454:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fb480 x1853163940214656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318246.894491:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940214528:0@lo:400:kworker.0
00000100:00100000:0.0:1767318246.894551:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318246.894590:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214144:0@lo:400:kworker.0
00000100:00100000:0.0:1767318246.894604:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318246.894611:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940214272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318246.894639:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318246.894639:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318246.894700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940213760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318246.894711:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940214016:0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.898358:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214144
00000100:00100000:2.0:1767318246.898374:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214144
00000100:00100000:2.0:1767318246.898465:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487
00000100:00100000:2.0:1767318246.898477:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214144:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.898551:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214144:12345-0@lo:400:kworker.0 Request processed in 78us (3915us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318246.898558:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487
00000100:00080000:2.0:1767318246.898580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318246.898611:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.898649:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214528
00000100:00100000:2.0:1767318246.898653:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214528
00000100:00100000:2.0:1767318246.898685:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214272
00000100:00100000:2.0:1767318246.898689:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214272
00000100:00100000:2.0:1767318246.898708:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771
00000100:00100000:2.0:1767318246.898714:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940214528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.898749:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940214528:12345-0@lo:400:kworker.0 Request processed in 36us (4197us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318246.898756:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771
00000100:00100000:2.0:1767318246.898768:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772
00000100:00100000:2.0:1767318246.898794:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940214272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.898838:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940214272:12345-0@lo:400:kworker.0 Request processed in 65us (4201us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318246.898845:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772
00000100:00080000:2.0:1767318246.898864:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318246.900395:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940214272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318246.900413:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940214528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318246.903224:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318246.903224:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318246.903381:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214016
00000100:00100000:2.0:1767318246.903390:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214016
00000100:00100000:2.0:1767318246.903470:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488
00000100:00100000:2.0:1767318246.903479:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940214016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.903543:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940214016:12345-0@lo:400:kworker.0 Request processed in 64us (328us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318246.903552:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488
00000100:00100000:2.0:1767318246.903578:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213760
00000100:00100000:2.0:1767318246.903581:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213760
00000100:00100000:2.0:1767318246.903602:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16105
00000100:00100000:2.0:1767318246.903606:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940213760:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318246.903625:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318246.903907:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318246.903939:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940214016:0@lo:400:kworker.0
00000100:00100000:2.0:1767318246.904170:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940213760:12345-0@lo:38:kworker.0 Request processed in 561us (955us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318246.904177:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16105
00000100:00080000:1.0:1767318246.914011:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318246.914023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318246.914028:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940213760:0@lo:38:kworker.0
00000100:00100000:1.0:1767318246.914039:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940213888:0@lo:38:kworker.0
00000100:00100000:1.0:1767318246.914192:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318246.914315:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940214400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318246.914342:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318246.914371:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940214656:0@lo:38:kworker.0
00000100:00100000:2.0:1767318246.914546:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214400
00000100:00100000:2.0:1767318246.914555:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214400
00000100:00100000:2.0:1767318246.914608:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16106
00000100:00100000:2.0:1767318246.914616:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940214400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318246.914637:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318246.916467:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940213888
00000100:00100000:0.0:1767318246.916480:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940213888
00000100:00100000:0.0:1767318246.916528:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909
00000100:00100000:0.0:1767318246.916536:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940213888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318246.916558:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318246.916688:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940214400:12345-0@lo:38:kworker.0 Request processed in 2070us (2342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318246.916697:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16106
00000100:00100000:1.0:1767318246.917115:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318246.917180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318246.917187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318246.917191:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940214400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318246.917342:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214656
00000100:00100000:2.0:1767318246.917348:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214656
00000100:00100000:2.0:1767318246.917424:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16107
00000100:00100000:2.0:1767318246.917429:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940214656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318246.917442:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318246.917483:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940214656:12345-0@lo:38:kworker.0 Request processed in 53us (368us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318246.917489:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16107
00000100:00080000:1.0:1767318246.917603:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318246.917608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318246.917611:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940214656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318246.918554:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940213888:12345-0@lo:38:kworker.0 Request processed in 2015us (4359us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318246.918564:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909
00000100:00080000:1.0:1767318246.918706:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318246.918711:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318246.918715:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940213888:0@lo:38:kworker.0
00000100:00100000:3.0:1767318247.404976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318247.406996:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318247.407018:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214784:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318247.407102:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318247.407612:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214784
00000100:00100000:1.0:1767318247.407622:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214784
00000100:00100000:1.0:1767318247.407672:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002
00000100:00100000:1.0:1767318247.407681:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318247.407712:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318247.407804:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (670us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318247.407812:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002
00000100:00100000:2.0:1767318247.407914:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214784:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318247.852971:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318248.428904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318248.429139:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214912:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318248.429218:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318248.429369:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940214912
00000100:00100000:3.0:1767318248.429388:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940214912
00000100:00100000:3.0:1767318248.429461:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003
00000100:00100000:3.0:1767318248.429472:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318248.429501:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318248.429549:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940214912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (330us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318248.429557:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003
00000100:00100000:0.0:1767318248.429873:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940214912:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318248.430050:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318248.877576:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318249.452901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318249.547041:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767318249.547089:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894251392 offset 0 length 520: 4
00000100:00100000:2.0:1767318249.547112:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318249.547202:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251648
00000100:00100000:0.0:1767318249.547213:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251648
00000100:00100000:3.0:1767318249.547381:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251520
00000100:00100000:3.0:1767318249.547388:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251520
00000100:00100000:0.0:1767318249.547434:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3773
00000100:00100000:0.0:1767318249.547446:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894251648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318249.547522:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894251648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (491us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318249.547533:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3773
00000100:00100000:0.0:1767318249.547550:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16108
00000100:00100000:0.0:1767318249.547555:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894251520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318249.547577:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318249.547602:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894251520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (489us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318249.547608:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16108
00000100:00080000:2.0:1767318249.552825:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318249.902811:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318250.476895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318250.930141:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318251.500891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318251.950868:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318252.013173:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318252.013183:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318252.013186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318252.013189:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318252.013193:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318252.013202:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318252.013207:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318252.013213:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318252.013264:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b100 x1853163940215040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318252.013295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318252.013299:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318252.013301:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318252.013304:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318252.013306:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318252.013309:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318252.013321:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940215168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318252.013368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318252.013372:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318252.013373:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318252.013377:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318252.013379:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318252.013383:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318252.013394:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940215680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318252.013410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318252.013413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318252.013414:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318252.013418:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318252.013420:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318252.013424:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318252.013433:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940215936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318252.013474:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940215296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318252.013535:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318252.013592:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318252.013597:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940215424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318252.013617:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318252.013651:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215296
00000100:00100000:2.0:1767318252.013658:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215296
00000100:00100000:2.0:1767318252.013703:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215424
00000100:00100000:2.0:1767318252.013706:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215424
00000100:00100000:2.0:1767318252.013727:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489
00000100:00100000:2.0:1767318252.013734:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940215296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318252.013807:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940215296:12345-0@lo:400:kworker.0 Request processed in 73us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318252.013814:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489
00000100:00100000:2.0:1767318252.013829:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490
00000100:00100000:2.0:1767318252.013835:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940215424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318252.013861:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940215424:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318252.013866:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490
00000100:00080000:2.0:1767318252.013883:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318252.013886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318252.013913:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940215424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318252.013922:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940215296:0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014132:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940215040:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.014171:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014195:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940215168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.014217:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014244:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940215680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.014261:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940215936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.014288:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014317:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940215808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014337:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014351:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318252.014355:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940215552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014373:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.014400:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215168
00000100:00100000:0.0:1767318252.014404:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215168
00000100:00100000:0.0:1767318252.014424:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910
00000100:00100000:0.0:1767318252.014428:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940215168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318252.014446:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318252.014477:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940215168:12345-0@lo:38:kworker.0 Request processed in 47us (258us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318252.014482:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910
00000100:00100000:0.0:1767318252.014627:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215040
00000100:00100000:0.0:1767318252.014630:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215040
00000100:00100000:0.0:1767318252.014645:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215680
00000100:00100000:0.0:1767318252.014647:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215680
00000100:00100000:0.0:1767318252.014654:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215936
00000100:00100000:0.0:1767318252.014656:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215936
00000100:00100000:0.0:1767318252.014665:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215808
00000100:00100000:0.0:1767318252.014667:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215808
00000100:00100000:0.0:1767318252.014688:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940215552
00000100:00100000:0.0:1767318252.014690:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940215552
00000100:00100000:0.0:1767318252.014703:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774
00000100:00100000:0.0:1767318252.014708:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940215808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014738:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940215808:12345-0@lo:400:kworker.0 Request processed in 30us (400us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318252.014743:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774
00000100:00100000:0.0:1767318252.014753:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775
00000100:00100000:0.0:1767318252.014758:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940215552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014800:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940215552:12345-0@lo:400:kworker.0 Request processed in 42us (426us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318252.014805:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775
00000100:00100000:0.0:1767318252.014815:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16109
00000100:00100000:0.0:1767318252.014818:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318252.014826:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318252.014847:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215040:12345-0@lo:38:kworker.0 Request processed in 28us (676us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318252.014853:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16109
00000100:00100000:0.0:1767318252.014863:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16110
00000100:00100000:0.0:1767318252.014866:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318252.014875:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318252.014894:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215680:12345-0@lo:38:kworker.0 Request processed in 26us (632us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318252.014900:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16110
00000100:00100000:0.0:1767318252.014910:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16111
00000100:00100000:0.0:1767318252.014914:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318252.014922:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318252.014941:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940215936:12345-0@lo:38:kworker.0 Request processed in 26us (652us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318252.014947:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16111
00000100:00080000:0.0:1767318252.014960:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318252.014979:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940215552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318252.014989:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940215808:0@lo:400:kworker.0
00000100:00080000:0.0:1767318252.015026:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318252.015032:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318252.015034:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940215040:0@lo:38:kworker.0
00000100:00080000:0.0:1767318252.015043:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318252.015045:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318252.015048:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940215168:0@lo:38:kworker.0
00000100:00080000:0.0:1767318252.015054:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318252.015057:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318252.015059:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940215680:0@lo:38:kworker.0
00000100:00080000:0.0:1767318252.015065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318252.015068:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318252.015070:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940215936:0@lo:38:kworker.0
00000100:00100000:2.0:1767318252.526249:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940216064:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318252.526323:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.528003:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318252.528089:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216064
00000100:00100000:3.0:1767318252.528099:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216064
00000100:00100000:3.0:1767318252.528170:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004
00000100:00100000:3.0:1767318252.528180:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940216064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318252.528226:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318252.528307:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940216064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (1984us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318252.528315:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004
00000100:00100000:2.0:1767318252.528854:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940216064:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318252.973007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318253.549104:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940216192:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318253.549173:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318253.549326:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216192
00000100:00100000:2.0:1767318253.549335:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216192
00000100:00100000:2.0:1767318253.549395:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005
00000100:00100000:2.0:1767318253.549405:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940216192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318253.549434:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318253.549535:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318253.553242:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940216192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3828us (4058us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318253.553257:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005
00000100:00100000:1.0:1767318253.555665:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940216192:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318253.997025:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318254.574531:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318254.662960:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318254.663006:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318254.663092:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251904
00000100:00100000:3.0:1767318254.663103:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251904
00000100:00100000:3.0:1767318254.663176:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894251776
00000100:00100000:3.0:1767318254.663180:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894251776
00000100:00100000:3.0:1767318254.663210:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3776
00000100:00100000:3.0:1767318254.663223:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894251904:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318254.663301:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894251904:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (350us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318254.663309:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3776
00000100:00100000:3.0:1767318254.663332:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16112
00000100:00100000:3.0:1767318254.663337:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894251776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318254.663358:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318254.663394:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894251776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 55us (387us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318254.663400:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16112
00000100:00080000:2.0:1767318254.663578:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318255.021221:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318255.596924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318256.045719:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318256.108903:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318231/real 1767318231]  req@ffff93d0711f3800 x1853163940209792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318256.108935:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0711f3800 x1853163940209792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318256.108952:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318256.108975:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318256.108979:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940209792:0@lo:250:kworker.0
00000100:00080000:1.0:1767318256.109042:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318256.109047:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318256.109050:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318256.109054:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3481
00000100:00080000:1.0:1767318256.109057:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318256.109063:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318256.109096:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dd880 x1853163940216320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318256.109123:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318256.109127:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318256.109128:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318256.109131:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3502
00000100:00080000:1.0:1767318256.109134:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318256.109137:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318256.109151:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddf80 x1853163940216448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318256.109164:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318256.109166:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318256.109168:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318256.109170:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3502
00000100:00080000:1.0:1767318256.109172:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318256.109175:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318256.109309:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940216320:0@lo:250:kworker.0
00000400:00000100:2.0:1767318256.109355:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940216320 offset 0 length 520: 4
00000100:00100000:2.0:1767318256.109397:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940216448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318256.109426:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318256.109591:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dce00 x1853163940216576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318256.109657:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318256.109670:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318256.109672:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318256.109676:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3502
00000100:00080000:1.0:1767318256.109678:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318256.109682:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318256.109693:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de680 x1853163940217088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318256.109708:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318256.109711:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318256.109712:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318256.109715:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3502
00000100:00080000:1.0:1767318256.109718:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318256.109720:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318256.109728:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6300 x1853163940217344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318256.109747:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940217216:0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.109865:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940216704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.109897:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318256.109932:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318256.109937:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940216832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.109956:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318256.109980:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216704
00000100:00100000:3.0:1767318256.109987:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216704
00000100:00100000:3.0:1767318256.110027:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216832
00000100:00100000:3.0:1767318256.110029:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216832
00000100:00100000:3.0:1767318256.110048:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491
00000100:00100000:3.0:1767318256.110057:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940216704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.110101:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940216704:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318256.110108:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491
00000100:00100000:3.0:1767318256.110125:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492
00000100:00100000:3.0:1767318256.110131:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940216832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.110156:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940216832:12345-0@lo:400:kworker.0 Request processed in 25us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318256.110161:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492
00000100:00080000:3.0:1767318256.110176:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318256.110180:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318256.110220:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940216832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.110230:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940216704:0@lo:400:kworker.0
00000100:00100000:0.0:1767318256.110242:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216448
00000100:00100000:0.0:1767318256.110246:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216448
00000100:00100000:0.0:1767318256.110270:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16113
00000100:00100000:0.0:1767318256.110275:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940216448:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318256.110287:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940216960:0@lo:400:kworker.0
00010000:00020000:0.0:1767318256.110293:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318256.110311:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318256.110321:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940216448:12345-0@lo:38:kworker.0 Request processed in 46us (894us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318256.110327:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16113
00000100:00100000:3.0:1767318256.110334:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216960
00000100:00100000:3.0:1767318256.110338:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216960
00000100:00080000:0.0:1767318256.110362:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318256.110363:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777
00000100:00100000:3.0:1767318256.110369:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940216960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.110415:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940216960:12345-0@lo:400:kworker.0 Request processed in 46us (103us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318256.110421:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777
00000100:00100000:0.0:1767318256.110568:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940216960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318256.111079:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940216576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318256.111115:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318256.111143:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940217088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318256.111163:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318256.111176:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940217344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318256.111206:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318256.111232:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318256.111237:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318256.111241:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940216448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318256.111274:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217088
00000100:00100000:2.0:1767318256.111277:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217088
00000100:00100000:2.0:1767318256.111297:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217344
00000100:00100000:2.0:1767318256.111300:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217344
00000100:00100000:2.0:1767318256.111314:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16114
00000100:00100000:2.0:1767318256.111319:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940217088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318256.111333:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318256.111360:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940217088:12345-0@lo:38:kworker.0 Request processed in 40us (196us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318256.111366:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16114
00000100:00100000:2.0:1767318256.111379:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16115
00000100:00100000:2.0:1767318256.111383:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940217344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318256.111393:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318256.111413:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940217344:12345-0@lo:38:kworker.0 Request processed in 28us (206us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318256.111418:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16115
00000100:00080000:2.0:1767318256.111436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318256.111440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318256.111443:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940217088:0@lo:38:kworker.0
00000100:00080000:2.0:1767318256.111450:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318256.111453:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318256.111456:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940217344:0@lo:38:kworker.0
00000100:00100000:1.0:1767318256.111542:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318256.112249:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217216
00000100:00100000:2.0:1767318256.112256:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217216
00000100:00100000:2.0:1767318256.112302:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778
00000100:00100000:2.0:1767318256.112308:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940217216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318256.112348:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940217216:12345-0@lo:400:kworker.0 Request processed in 40us (806us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318256.112354:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778
00000100:00080000:1.0:1767318256.112413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318256.112438:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940217216:0@lo:400:kworker.0
00000100:00100000:3.0:1767318256.112961:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940216576
00000100:00100000:3.0:1767318256.112966:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940216576
00000100:00100000:3.0:1767318256.112998:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911
00000100:00100000:3.0:1767318256.113003:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940216576:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318256.113018:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318256.113060:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940216576:12345-0@lo:38:kworker.0 Request processed in 56us (1944us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318256.113065:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911
00000100:00080000:2.0:1767318256.113216:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318256.113221:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318256.113225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940216576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318256.621924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318257.068968:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318257.647893:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318257.647930:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940217472:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318257.648008:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.648071:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217472
00000100:00100000:3.0:1767318257.648079:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217472
00000100:00100000:3.0:1767318257.648129:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006
00000100:00100000:3.0:1767318257.648138:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940217472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318257.648179:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318257.648221:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940217472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (212us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318257.648228:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006
00000100:00100000:2.0:1767318257.648261:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940217472:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318257.649380:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318258.093527:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318258.668915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318258.669077:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318258.669097:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940217600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318258.669171:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318258.669283:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217600
00000100:00100000:0.0:1767318258.669291:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217600
00000100:00100000:0.0:1767318258.669355:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007
00000100:00100000:0.0:1767318258.669362:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940217600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318258.669386:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318258.669419:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940217600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (258us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318258.669423:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007
00000100:00100000:3.0:1767318258.669491:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940217600:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318258.669536:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318259.116996:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318259.692979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318259.783079:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318259.784714:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252160
00000100:00100000:3.0:1767318259.784911:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252160
00000100:00100000:3.0:1767318259.788834:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3779
00000100:00100000:3.0:1767318259.788854:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894252160:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318259.788982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318259.789706:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894252160:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 858us (6635us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318259.789717:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3779
00000100:00100000:0.0:1767318259.791655:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318259.797530:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252032
00000100:00100000:3.0:1767318259.797548:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252032
00000100:00100000:3.0:1767318259.797658:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16116
00000100:00100000:3.0:1767318259.797667:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252032:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318259.797690:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318259.797769:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252032:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 101us (6121us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318259.797802:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16116
00010000:00010000:1.0:1767318260.141901:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318260.716896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318261.165089:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318261.229331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318261.229343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318261.229346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318261.229350:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318261.229354:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318261.229361:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1767318261.229365:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318261.229381:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318261.229419:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711fa680 x1853163940217728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318261.229478:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940217728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318261.229545:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318261.229616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318261.229621:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318261.229623:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318261.229627:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1767318261.229630:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318261.229634:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318261.229650:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059c00 x1853163940217856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318261.229818:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217728
00000100:00100000:3.0:1767318261.229827:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217728
00000100:00100000:3.0:1767318261.229870:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16117
00000100:00100000:3.0:1767318261.229877:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940217728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318261.229898:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318261.230698:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940217856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318261.230836:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318261.231010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318261.231014:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318261.231017:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318261.231021:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1767318261.231024:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318261.231030:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318261.231045:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940218368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318261.231064:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318261.231067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318261.231069:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318261.231072:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1767318261.231075:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318261.231078:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318261.231088:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d180 x1853163940218624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318261.231114:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940217984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.231660:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940217728:12345-0@lo:38:kworker.0 Request processed in 1780us (2112us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318261.231671:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16117
00000100:00100000:3.0:1767318261.231704:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940218240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.231752:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318261.231799:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318261.231806:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940218496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.231829:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318261.231854:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218240
00000100:00100000:3.0:1767318261.231860:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218240
00000100:00100000:3.0:1767318261.231907:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218496
00000100:00100000:3.0:1767318261.231911:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218496
00000100:00100000:3.0:1767318261.231933:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780
00000100:00100000:3.0:1767318261.231940:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940218240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.231987:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940218240:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.231994:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780
00000100:00100000:3.0:1767318261.232005:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781
00000100:00100000:3.0:1767318261.232011:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940218496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.232039:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940218496:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.232044:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781
00000100:00080000:3.0:1767318261.232062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318261.232093:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940218496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.232103:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940218240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.232363:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.232392:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318261.232431:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218112
00000100:00100000:3.0:1767318261.232435:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218112
00000100:00100000:3.0:1767318261.232462:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493
00000100:00100000:3.0:1767318261.232469:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.232501:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218112:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.232507:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493
00000100:00100000:3.0:1767318261.232530:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218112:0@lo:400:kworker.0
00000100:00080000:3.0:1767318261.232549:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318261.232979:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318261.235178:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217984
00000100:00100000:3.0:1767318261.235193:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217984
00000100:00100000:3.0:1767318261.235277:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494
00000100:00100000:3.0:1767318261.235287:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940217984:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767318261.235539:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318261.235580:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940217984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318261.235658:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940217984:12345-0@lo:400:kworker.0 Request processed in 84us (2389us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.235666:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494
00000100:00100000:1.0:1767318261.235759:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940217856
00000100:00100000:1.0:1767318261.235765:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940217856
00000100:00100000:1.0:1767318261.235805:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912
00000100:00100000:1.0:1767318261.235810:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940217856:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318261.235830:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318261.235866:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940217856:12345-0@lo:38:kworker.0 Request processed in 55us (5030us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318261.235872:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912
00000100:00080000:2.0:1767318261.237033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318261.237041:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318261.237045:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940217728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318261.237072:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940218368:0@lo:38:kworker.0
00000100:00100000:2.0:1767318261.237206:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318261.237390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940218624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318261.237414:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318261.238319:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318261.238325:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318261.238329:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940217856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318261.238495:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218368
00000100:00100000:3.0:1767318261.238501:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218368
00000100:00100000:3.0:1767318261.238542:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218624
00000100:00100000:3.0:1767318261.238545:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218624
00000100:00100000:3.0:1767318261.238573:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16118
00000100:00100000:3.0:1767318261.238580:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940218368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318261.238603:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318261.238649:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940218368:12345-0@lo:38:kworker.0 Request processed in 68us (1443us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318261.238656:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16118
00000100:00100000:3.0:1767318261.238673:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16119
00000100:00100000:3.0:1767318261.238677:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940218624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318261.238686:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318261.238706:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940218624:12345-0@lo:38:kworker.0 Request processed in 28us (1291us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318261.238715:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16119
00000100:00080000:2.0:1767318261.239037:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318261.239043:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318261.239047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940218368:0@lo:38:kworker.0
00000100:00080000:2.0:1767318261.239057:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318261.239060:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318261.239063:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940218624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318261.742518:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318262.193448:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318262.764946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318262.765087:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318262.765106:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318262.765203:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318262.765347:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218752
00000100:00100000:3.0:1767318262.765355:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218752
00000100:00100000:3.0:1767318262.765415:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008
00000100:00100000:3.0:1767318262.765425:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318262.765457:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318262.765517:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (314us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318262.765524:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008
00000100:00100000:2.0:1767318262.766730:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218752:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318263.215347:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318263.788939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318263.789071:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318263.789147:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318263.789767:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940218880
00000100:00100000:0.0:1767318263.789806:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940218880
00000100:00100000:0.0:1767318263.789877:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009
00000100:00100000:0.0:1767318263.789887:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318263.789916:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318263.789975:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940218880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (828us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318263.789982:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009
00000100:00080000:3.0:1767318263.790135:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318263.790223:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940218880:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318264.237109:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318264.813464:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318264.903696:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318264.903826:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318264.903911:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252416
00000100:00100000:1.0:1767318264.903921:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252416
00000100:00100000:1.0:1767318264.903984:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252288
00000100:00100000:1.0:1767318264.903987:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252288
00000100:00100000:1.0:1767318264.904004:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3782
00000100:00100000:1.0:1767318264.904013:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894252416:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318264.904080:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894252416:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 68us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318264.904087:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3782
00000100:00100000:1.0:1767318264.904114:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16120
00000100:00100000:1.0:1767318264.904118:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252288:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318264.904148:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318264.904169:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252288:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (345us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318264.904175:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16120
00000100:00080000:3.0:1767318264.904587:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318265.261093:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318265.838406:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318266.286533:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318266.349417:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318266.349427:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318266.349430:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318266.349434:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318266.349438:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318266.349446:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3511
00000100:00080000:1.0:1767318266.349451:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318266.349458:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318266.349507:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d5180 x1853163940219008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318266.349533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318266.349536:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318266.349538:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318266.349541:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3511
00000100:00080000:1.0:1767318266.349544:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318266.349547:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318266.349563:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d4700 x1853163940219136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318266.349612:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318266.349615:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318266.349617:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318266.349620:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3511
00000100:00080000:1.0:1767318266.349624:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318266.349628:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318266.349639:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6300 x1853163940219648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318266.349656:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318266.349659:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318266.349660:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318266.349663:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3511
00000100:00080000:1.0:1767318266.349665:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318266.349668:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318266.349677:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa300 x1853163940219904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318266.349734:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940219264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318266.349831:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.349840:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940219392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318266.349880:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318266.349920:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940219008:0@lo:38:kworker.0
00000100:00100000:3.0:1767318266.349935:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219264
00000100:00100000:3.0:1767318266.349944:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219264
00000100:00100000:0.0:1767318266.349974:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.350002:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219392
00000100:00100000:3.0:1767318266.350006:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219392
00000100:00100000:0.0:1767318266.350007:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940219136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318266.350035:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495
00000100:00100000:0.0:1767318266.350047:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.350048:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940219264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318266.350080:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940219648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318266.350120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.350121:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940219264:12345-0@lo:400:kworker.0 Request processed in 72us (288us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318266.350131:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495
00000100:00100000:0.0:1767318266.350146:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940219904:0@lo:38:kworker.0
00000100:00100000:3.0:1767318266.350153:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496
00000100:00100000:3.0:1767318266.350161:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940219392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318266.350187:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.350202:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940219392:12345-0@lo:400:kworker.0 Request processed in 41us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318266.350212:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496
00000100:00100000:0.0:1767318266.350229:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219008
00000100:00100000:0.0:1767318266.350234:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219008
00000100:00100000:3.0:1767318266.350248:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219136
00000100:00100000:3.0:1767318266.350253:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219136
00000100:00100000:1.0:1767318266.360241:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940219520:0@lo:400:kworker.0
00000100:00100000:1.0:1767318266.360321:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318266.380632:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318266.380655:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940219776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318266.380717:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318266.380847:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913
00000100:00100000:3.0:1767318266.380856:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940219136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318266.380879:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318266.380931:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940219136:12345-0@lo:38:kworker.0 Request processed in 75us (30893us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318266.380939:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913
00000100:00100000:0.0:1767318266.384175:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219648
00000100:00100000:0.0:1767318266.384191:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219648
00000100:00080000:0.0:1767318266.384251:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318266.384260:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318266.384264:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940219136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318266.384344:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219904
00000100:00100000:0.0:1767318266.384348:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219904
00000100:00100000:0.0:1767318266.384361:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219520
00000100:00100000:0.0:1767318266.384363:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219520
00000100:00100000:0.0:1767318266.384391:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783
00000100:00100000:0.0:1767318266.384398:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940219520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318266.384471:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940219520:12345-0@lo:400:kworker.0 Request processed in 73us (24150us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318266.384478:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783
00000100:00100000:0.0:1767318266.388275:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16121
00000100:00100000:0.0:1767318266.388285:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318266.388309:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318266.388400:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219008:12345-0@lo:38:kworker.0 Request processed in 114us (38433us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318266.388406:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16121
00000100:00100000:0.0:1767318266.388419:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16122
00000100:00100000:0.0:1767318266.388423:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318266.388432:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318266.388455:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219648:12345-0@lo:38:kworker.0 Request processed in 31us (38337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318266.388460:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16122
00000100:00100000:0.0:1767318266.388470:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16123
00000100:00100000:0.0:1767318266.388474:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318266.388482:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318266.388499:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940219904:12345-0@lo:38:kworker.0 Request processed in 24us (38313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318266.388504:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16123
00000100:00080000:0.0:1767318266.388547:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318266.388552:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318266.388555:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940219008:0@lo:38:kworker.0
00000100:00080000:0.0:1767318266.388565:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318266.388568:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318266.388570:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940219648:0@lo:38:kworker.0
00000100:00080000:0.0:1767318266.388577:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318266.388580:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318266.388583:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940219904:0@lo:38:kworker.0
00000100:00080000:0.0:1767318266.388748:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318266.388754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318266.388757:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318266.388799:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940219392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318266.388825:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940219264:0@lo:400:kworker.0
00000100:00100000:1.0:1767318266.391706:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940219520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318266.391811:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940219776
00000100:00100000:2.0:1767318266.391818:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940219776
00000100:00100000:2.0:1767318266.391885:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784
00000100:00100000:2.0:1767318266.391894:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940219776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318266.391959:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940219776:12345-0@lo:400:kworker.0 Request processed in 66us (11242us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318266.391966:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784
00000100:00080000:1.0:1767318266.392194:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318266.392216:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940219776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318266.860894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318267.309174:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318267.885647:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318267.885672:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940220032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318267.885747:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318267.885944:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220032
00000100:00100000:2.0:1767318267.885954:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220032
00000100:00100000:2.0:1767318267.886009:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010
00000100:00100000:2.0:1767318267.886018:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940220032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318267.886051:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318267.886108:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940220032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (361us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318267.886115:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010
00000100:00100000:1.0:1767318267.886228:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940220032:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318267.889234:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318268.333031:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318268.913934:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318268.913976:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940220160:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318268.914047:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318268.914082:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220160
00000100:00100000:3.0:1767318268.914091:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220160
00000100:00100000:3.0:1767318268.914149:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011
00000100:00100000:3.0:1767318268.914159:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940220160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318268.914188:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318268.914242:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940220160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (195us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318268.914248:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011
00000100:00100000:0.0:1767318268.914313:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318268.914433:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940220160:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318268.915479:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318269.358161:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318269.932933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318270.023712:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318270.024416:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318270.024739:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252544
00000100:00100000:0.0:1767318270.024750:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252544
00000100:00100000:3.0:1767318270.025299:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252672
00000100:00100000:3.0:1767318270.025321:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252672
00000100:00100000:3.0:1767318270.025583:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3785
00000100:00100000:3.0:1767318270.025604:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894252672:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318270.025703:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894252672:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 111us (1288us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318270.025712:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3785
00000100:00100000:3.0:1767318270.026125:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16124
00000100:00100000:3.0:1767318270.026132:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894252544:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318270.026159:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318270.026195:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894252544:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 61us (2492us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318270.026201:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16124
00000100:00080000:1.0:1767318270.030352:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318270.385724:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318270.962365:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318271.405089:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318271.471699:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318271.471712:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318271.471715:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318271.471719:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318271.471724:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318271.471732:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3516
00000100:00080000:1.0:1767318271.471737:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318271.471819:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318271.471875:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459faa00 x1853163940220288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318271.471911:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318271.471915:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318271.471918:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318271.471922:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3516
00000100:00080000:1.0:1767318271.471925:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318271.471929:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318271.471943:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb800 x1853163940220416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318271.472030:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318271.472034:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318271.472036:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318271.472039:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3516
00000100:00080000:1.0:1767318271.472042:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318271.472065:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318271.472077:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940220928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318271.472092:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318271.472095:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318271.472097:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318271.472111:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3516
00000100:00080000:1.0:1767318271.472114:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318271.472118:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318271.472130:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa300 x1853163940221184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318271.472158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940221056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318271.472242:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318271.472312:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318271.472318:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940220800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318271.472341:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318271.472384:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221056
00000100:00100000:1.0:1767318271.472392:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221056
00000100:00100000:1.0:1767318271.472444:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220800
00000100:00100000:1.0:1767318271.472447:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220800
00000100:00100000:1.0:1767318271.472470:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786
00000100:00100000:1.0:1767318271.472478:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940221056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318271.472526:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940221056:12345-0@lo:400:kworker.0 Request processed in 49us (284us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318271.472534:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786
00000100:00100000:1.0:1767318271.472551:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787
00000100:00100000:1.0:1767318271.472557:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940220800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318271.472582:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940220800:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318271.472588:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787
00000100:00100000:1.0:1767318271.472625:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940220800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318271.472636:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940221056:0@lo:400:kworker.0
00000100:00080000:1.0:1767318271.472657:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318271.472746:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940220672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318271.472837:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318271.472887:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318271.472893:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940220544:0@lo:400:kworker.0
00000100:00100000:3.0:1767318271.472917:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.472937:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940220288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318271.472980:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.473000:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940220416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318271.473032:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.473058:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940220928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318271.473076:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.473092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940221184:0@lo:38:kworker.0
00000100:00100000:3.0:1767318271.473094:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220672
00000100:00100000:3.0:1767318271.473100:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220672
00000100:00100000:0.0:1767318271.473116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.473146:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220416
00000100:00100000:0.0:1767318271.473150:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220416
00000100:00100000:0.0:1767318271.473173:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914
00000100:00100000:0.0:1767318271.473178:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940220416:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318271.473196:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318271.473248:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940220416:12345-0@lo:38:kworker.0 Request processed in 68us (214us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318271.473255:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914
00000100:00100000:3.0:1767318271.473267:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220544
00000100:00100000:3.0:1767318271.473272:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220544
00000100:00100000:0.0:1767318271.473277:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220288
00000100:00100000:0.0:1767318271.473282:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220288
00000100:00100000:3.0:1767318271.473300:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497
00000100:00100000:0.0:1767318271.473307:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940220928
00000100:00100000:3.0:1767318271.473309:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940220672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318271.473312:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940220928
00000100:00100000:0.0:1767318271.473325:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221184
00000100:00100000:0.0:1767318271.473328:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221184
00000100:00100000:0.0:1767318271.473343:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16125
00000100:00100000:0.0:1767318271.473349:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940220288:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318271.473355:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940220672:12345-0@lo:400:kworker.0 Request processed in 47us (518us total) trans 0 rc 0/0
00010000:00020000:0.0:1767318271.473362:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318271.473364:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497
00000100:00100000:3.0:1767318271.473386:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498
00000100:00100000:0.0:1767318271.473398:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940220288:12345-0@lo:38:kworker.0 Request processed in 46us (415us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318271.473399:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940220544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318271.473412:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16125
00000100:00100000:0.0:1767318271.473426:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16126
00000100:00100000:0.0:1767318271.473430:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940220928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318271.473438:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318271.473550:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318271.473554:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318271.473579:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127
00000100:00100000:1.0:1767318271.473584:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940221184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318271.473596:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318271.473735:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940220672:0@lo:400:kworker.0
00000100:00080000:2.0:1767318271.473770:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318271.473788:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318271.473791:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940220288:0@lo:38:kworker.0
00000100:00080000:2.0:1767318271.473800:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318271.473803:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318271.473806:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940220416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318271.475688:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940220928:12345-0@lo:38:kworker.0 Request processed in 2245us (2599us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318271.475704:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16126
00000100:00080000:2.0:1767318271.475852:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318271.475858:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318271.475862:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940220928:0@lo:38:kworker.0
00000100:00100000:1.0:1767318271.481040:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940221184:12345-0@lo:38:kworker.0 Request processed in 7444us (7914us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318271.481066:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127
00000100:00080000:0.0:1767318271.481273:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318271.481280:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318271.481284:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940221184:0@lo:38:kworker.0
00000100:00100000:3.0:1767318271.481716:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940220544:12345-0@lo:400:kworker.0 Request processed in 8319us (8795us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318271.481862:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940220544:0@lo:400:kworker.0
00000100:00100000:3.0:1767318271.481923:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498
00000100:00100000:3.0:1767318271.980868:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318272.429091:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318273.004984:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318273.005186:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940221312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318273.005255:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318273.005525:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221312
00000100:00100000:3.0:1767318273.005534:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221312
00000100:00100000:3.0:1767318273.005599:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012
00000100:00100000:3.0:1767318273.005609:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940221312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318273.005655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318273.005722:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940221312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318273.005729:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012
00000100:00100000:0.0:1767318273.005828:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940221312:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318273.006122:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318273.453017:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318274.029041:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318274.029064:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940221440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318274.029133:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318274.029253:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221440
00000100:00100000:2.0:1767318274.029263:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221440
00000100:00100000:2.0:1767318274.029345:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013
00000100:00100000:2.0:1767318274.029355:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940221440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318274.029386:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318274.029432:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940221440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318274.029440:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013
00000100:00100000:2.0:1767318274.029485:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940221440:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318274.029662:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318274.029802:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318274.121821:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318274.125377:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253056
00000100:00100000:1.0:1767318274.125395:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253056
00000100:00080000:3.0:1767318274.125543:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318274.125554:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3788
00000100:00100000:1.0:1767318274.125567:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894253056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318274.125662:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894253056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (3850us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318274.125670:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3788
00000400:00000100:3.0:1767318274.126560:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894252800 offset 0 length 520: 4
00000100:00100000:3.0:1767318274.126650:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318274.127257:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894252928
00000100:00100000:0.0:1767318274.127265:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894252928
00000100:00100000:0.0:1767318274.127339:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16128
00000100:00100000:0.0:1767318274.127346:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252928:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318274.127373:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318274.127437:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894252928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 89us (786us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318274.127443:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16128
00010000:00010000:2.0:1767318274.477748:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318275.053108:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318275.501133:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318276.077135:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318276.525534:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318276.590072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318276.590082:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318276.590085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318276.590089:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318276.590093:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318276.590101:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3521
00000100:00080000:2.0:1767318276.590106:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318276.590157:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318276.590208:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940221568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318276.590240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318276.590244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318276.590246:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318276.590260:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3521
00000100:00080000:2.0:1767318276.590263:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318276.590266:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318276.590281:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a300 x1853163940221696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318276.590355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318276.590358:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318276.590360:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318276.590364:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3521
00000100:00080000:2.0:1767318276.590366:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318276.590370:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318276.590392:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a680 x1853163940222208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318276.590407:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318276.590409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318276.590411:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318276.590414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3521
00000100:00080000:2.0:1767318276.590416:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318276.590419:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318276.590427:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019880 x1853163940222464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318276.590464:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940222080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318276.590545:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318276.590611:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318276.590618:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940222336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318276.590660:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318276.590757:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940221824:0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.590832:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318276.590881:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318276.590887:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940221952:0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.590909:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318276.590943:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222080
00000100:00100000:3.0:1767318276.590951:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222080
00000100:00100000:3.0:1767318276.591027:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222336
00000100:00100000:3.0:1767318276.591032:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222336
00000100:00100000:3.0:1767318276.591058:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789
00000100:00100000:3.0:1767318276.591066:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940222080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591116:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940222080:12345-0@lo:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318276.591123:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789
00000100:00100000:3.0:1767318276.591140:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790
00000100:00100000:3.0:1767318276.591145:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940222336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591185:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940222336:12345-0@lo:400:kworker.0 Request processed in 39us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318276.591190:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790
00000100:00100000:3.0:1767318276.591209:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221824
00000100:00100000:3.0:1767318276.591212:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221824
00000100:00100000:3.0:1767318276.591237:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221952
00000100:00100000:3.0:1767318276.591240:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221952
00000100:00100000:3.0:1767318276.591269:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499
00000100:00100000:3.0:1767318276.591275:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940221824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591306:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940221824:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318276.591311:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499
00000100:00100000:3.0:1767318276.591323:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1767318276.591329:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940221952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591355:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940221952:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318276.591361:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1767318276.591406:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940221952:0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591416:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940221824:0@lo:400:kworker.0
00000100:00080000:3.0:1767318276.591438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318276.591442:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318276.591444:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318276.591457:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940222336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318276.591466:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940222080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318276.591978:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940221568:0@lo:38:kworker.0
00000100:00100000:1.0:1767318276.592024:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318276.592052:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940221696:0@lo:38:kworker.0
00000100:00100000:1.0:1767318276.592075:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318276.592090:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940222208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318276.592109:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318276.592133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940222464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318276.592153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318276.592184:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221568
00000100:00100000:1.0:1767318276.592188:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221568
00000100:00100000:1.0:1767318276.592208:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222208
00000100:00100000:1.0:1767318276.592211:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222208
00000100:00100000:1.0:1767318276.592223:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222464
00000100:00100000:1.0:1767318276.592225:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222464
00000100:00100000:1.0:1767318276.592239:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16129
00000100:00100000:1.0:1767318276.592244:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940221568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318276.592260:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318276.592297:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940221568:12345-0@lo:38:kworker.0 Request processed in 51us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318276.592304:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16129
00000100:00100000:1.0:1767318276.592319:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16130
00000100:00100000:1.0:1767318276.592323:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940222208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318276.592335:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318276.592358:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940222208:12345-0@lo:38:kworker.0 Request processed in 33us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318276.592364:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16130
00000100:00100000:1.0:1767318276.592375:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16131
00000100:00100000:1.0:1767318276.592393:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940222464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318276.592404:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318276.592427:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940222464:12345-0@lo:38:kworker.0 Request processed in 33us (272us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318276.592433:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16131
00000100:00080000:1.0:1767318276.592479:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318276.592485:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318276.592488:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940221568:0@lo:38:kworker.0
00000100:00080000:1.0:1767318276.592497:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318276.592500:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318276.592504:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940222208:0@lo:38:kworker.0
00000100:00080000:1.0:1767318276.592511:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318276.592515:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318276.592517:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940222464:0@lo:38:kworker.0
00000100:00100000:2.0:1767318276.594225:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940221696
00000100:00100000:2.0:1767318276.594238:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940221696
00000100:00100000:2.0:1767318276.594290:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915
00000100:00100000:2.0:1767318276.594298:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940221696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318276.594316:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318276.594405:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940221696:12345-0@lo:38:kworker.0 Request processed in 106us (2328us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318276.594412:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915
00000100:00080000:1.0:1767318276.595552:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318276.595560:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318276.595564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940221696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318277.103595:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318277.549578:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318278.125153:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318278.125176:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940222592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318278.125244:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318278.125461:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222592
00000100:00100000:3.0:1767318278.125470:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222592
00000100:00100000:3.0:1767318278.125542:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014
00000100:00100000:3.0:1767318278.125554:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940222592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318278.125584:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318278.125630:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940222592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (385us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318278.125637:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014
00000100:00100000:3.0:1767318278.125684:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940222592:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318278.125756:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318278.125904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318278.573216:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318279.149420:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940222720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318279.149495:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318279.149614:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222720
00000100:00100000:1.0:1767318279.149623:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222720
00000100:00100000:1.0:1767318279.149697:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015
00000100:00100000:1.0:1767318279.149707:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940222720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318279.149742:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318279.149807:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940222720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318279.149814:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015
00000100:00100000:1.0:1767318279.149862:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940222720:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318279.149924:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318279.149996:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318279.238590:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318279.238626:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318279.238707:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253184
00000100:00100000:2.0:1767318279.238717:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253184
00000100:00100000:2.0:1767318279.238753:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253312
00000100:00100000:2.0:1767318279.238755:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253312
00000100:00100000:2.0:1767318279.238815:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3791
00000100:00100000:2.0:1767318279.238822:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894253312:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318279.238891:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894253312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318279.238896:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3791
00000100:00100000:2.0:1767318279.238909:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16132
00000100:00100000:2.0:1767318279.238912:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894253184:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318279.238928:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318279.238951:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894253184:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 36us (378us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318279.238957:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16132
00000100:00080000:3.0:1767318279.239477:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318279.597477:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318280.173324:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318280.628203:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318281.198083:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318281.645033:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318281.708949:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318256/real 1767318256]  req@ffff93d0712dd880 x1853163940216320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318281.709032:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0712dd880 x1853163940216320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318281.709058:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318281.709067:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318281.709071:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940216320:0@lo:250:kworker.0
00000100:00080000:1.0:1767318281.709220:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318281.709225:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318281.709229:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318281.709233:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3506
00000100:00080000:1.0:1767318281.709237:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318281.709242:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318281.709273:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02680 x1853163940222848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318281.709299:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318281.709302:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318281.709304:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318281.709307:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3526
00000100:00080000:1.0:1767318281.709309:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318281.709312:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318281.709327:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02d80 x1853163940222976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318281.709336:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318281.709338:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318281.709340:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318281.709342:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3526
00000100:00080000:1.0:1767318281.709344:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318281.709347:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318281.709359:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940223104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318281.709416:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318281.709420:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318281.709422:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318281.709446:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3526
00000100:00080000:1.0:1767318281.709450:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318281.709455:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318281.709462:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940223232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318281.709468:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459faa00 x1853163940223616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318281.709494:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318281.709498:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318281.709500:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318281.709503:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3526
00000100:00080000:1.0:1767318281.709506:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318281.709510:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318281.709521:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb100 x1853163940223872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318281.709542:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940223488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318281.709582:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318281.709608:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318281.709666:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318281.709673:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940223360:0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.709688:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940222848:0@lo:250:kworker.0
00000100:00100000:0.0:1767318281.709695:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:2.0:1767318281.709719:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940222848 offset 0 length 520: 4
00000100:00100000:0.0:1767318281.709734:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223232
00000100:00100000:2.0:1767318281.709746:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940222976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318281.709753:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223232
00000100:00100000:2.0:1767318281.709802:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318281.709822:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940223104:0@lo:38:kworker.0
00000100:00100000:0.0:1767318281.709845:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223360
00000100:00100000:2.0:1767318281.709850:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318281.709851:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223360
00000100:00100000:0.0:1767318281.709879:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501
00000100:00100000:2.0:1767318281.709885:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940223616:0@lo:38:kworker.0
00000100:00100000:0.0:1767318281.709891:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940223232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.709909:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318281.709928:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940223872:0@lo:38:kworker.0
00000100:00100000:0.0:1767318281.709965:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940223232:12345-0@lo:400:kworker.0 Request processed in 66us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318281.709965:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318281.709978:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501
00000100:00100000:0.0:1767318281.709998:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502
00000100:00100000:0.0:1767318281.710003:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940223360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.710016:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223104
00000100:00100000:2.0:1767318281.710021:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223104
00000100:00100000:0.0:1767318281.710027:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940223360:12345-0@lo:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318281.710031:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502
00000100:00100000:2.0:1767318281.710052:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916
00000100:00100000:2.0:1767318281.710059:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940223104:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318281.710060:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940223360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318281.710082:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940223232:0@lo:400:kworker.0
00010000:00020000:2.0:1767318281.710094:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318281.710117:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940223744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.710137:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940223104:12345-0@lo:38:kworker.0 Request processed in 76us (287us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318281.710143:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318281.710149:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916
00000100:00100000:2.0:1767318281.710172:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223488
00000100:00100000:2.0:1767318281.710176:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223488
00000100:00100000:0.0:1767318281.710197:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940222976
00000100:00100000:0.0:1767318281.710201:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940222976
00000100:00100000:2.0:1767318281.710206:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223616
00000100:00100000:2.0:1767318281.710211:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223616
00000100:00100000:0.0:1767318281.710217:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223872
00000100:00100000:0.0:1767318281.710222:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223872
00000100:00100000:2.0:1767318281.710225:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940223744
00000100:00100000:2.0:1767318281.710229:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940223744
00000100:00100000:0.0:1767318281.710239:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792
00000100:00100000:0.0:1767318281.710248:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940223488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.710254:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793
00000100:00100000:2.0:1767318281.710264:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940223744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318281.710284:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940223488:12345-0@lo:400:kworker.0 Request processed in 36us (675us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318281.710302:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792
00000100:00100000:2.0:1767318281.710306:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940223744:12345-0@lo:400:kworker.0 Request processed in 43us (163us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318281.710314:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793
00000100:00100000:0.0:1767318281.710321:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16133
00000100:00100000:0.0:1767318281.710327:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940222976:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318281.710335:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16134
00010000:00020000:0.0:1767318281.710340:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318281.710342:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940223616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318281.710354:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318281.710371:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940222976:12345-0@lo:38:kworker.0 Request processed in 43us (570us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318281.710379:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16133
00000100:00100000:2.0:1767318281.710387:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940223616:12345-0@lo:38:kworker.0 Request processed in 43us (476us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318281.710393:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16135
00000100:00100000:0.0:1767318281.710398:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940223872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318281.710407:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318281.710434:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940223872:12345-0@lo:38:kworker.0 Request processed in 34us (469us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767318281.710458:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318281.710464:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318281.710465:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318281.710506:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318281.710511:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318281.710514:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940222976:0@lo:38:kworker.0
00000100:00080000:3.0:1767318281.710521:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318281.710524:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318281.710527:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940223104:0@lo:38:kworker.0
00000100:00080000:3.0:1767318281.710533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318281.710536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318281.710538:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940223616:0@lo:38:kworker.0
00000100:00080000:3.0:1767318281.710545:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318281.710548:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318281.710550:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940223872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318281.710592:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940223744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318281.712416:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16134
00000100:00100000:1.0:1767318281.712558:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940223488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318281.713449:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16135
00000100:00100000:3.0:1767318282.222052:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318282.673534:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318283.245217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318283.246550:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940224000:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318283.246673:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318283.246823:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224000
00000100:00100000:3.0:1767318283.246832:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224000
00000100:00100000:3.0:1767318283.246897:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016
00000100:00100000:3.0:1767318283.246908:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940224000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318283.246949:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318283.247026:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940224000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (352us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318283.247033:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016
00000100:00080000:2.0:1767318283.247110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318283.247138:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940224000:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318283.693885:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318284.269065:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318284.269090:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940224128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318284.269206:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318284.269212:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318284.269272:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224128
00000100:00100000:1.0:1767318284.269281:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224128
00000100:00100000:1.0:1767318284.269350:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017
00000100:00100000:1.0:1767318284.269359:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940224128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318284.269403:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318284.269457:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940224128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318284.269468:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017
00000100:00100000:0.0:1767318284.269521:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940224128:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318284.269594:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318284.365146:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318284.365253:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318284.365850:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253440
00000100:00100000:0.0:1767318284.365861:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253440
00000100:00100000:0.0:1767318284.365909:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253568
00000100:00100000:0.0:1767318284.365912:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253568
00000100:00100000:0.0:1767318284.365977:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3794
00000100:00100000:0.0:1767318284.365987:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894253568:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318284.366059:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894253568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (806us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318284.366066:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3794
00000100:00100000:0.0:1767318284.366084:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16136
00000100:00100000:0.0:1767318284.366089:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894253440:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318284.366110:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318284.366134:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894253440:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (1001us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318284.366140:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16136
00000100:00080000:1.0:1767318284.367892:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318284.718992:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318285.295666:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318285.741032:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318286.319525:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318286.765059:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318286.828931:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318286.828943:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318286.828946:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318286.828950:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318286.828954:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318286.828962:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3531
00000100:00080000:2.0:1767318286.828967:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318286.828974:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318286.829014:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a680 x1853163940224256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318286.829031:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318286.829034:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318286.829036:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318286.829040:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3531
00000100:00080000:2.0:1767318286.829042:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318286.829046:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318286.829058:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940224384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318286.829133:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318286.829136:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318286.829138:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318286.829141:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3531
00000100:00080000:2.0:1767318286.829143:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318286.829147:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318286.829159:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019c00 x1853163940224896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318286.829177:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318286.829180:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318286.829182:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318286.829185:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3531
00000100:00080000:2.0:1767318286.829187:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318286.829190:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318286.829200:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940225152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318286.829226:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940225024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318286.829243:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940224640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318286.829406:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940224512:0@lo:400:kworker.0
00000100:00100000:3.0:1767318286.829461:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940224256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318286.839598:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318286.839695:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318286.839726:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224640
00000100:00100000:0.0:1767318286.839735:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224640
00000100:00100000:2.0:1767318286.839787:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318286.839799:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940224768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318286.839844:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318286.839884:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225024
00000100:00100000:2.0:1767318286.839889:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225024
00000100:00100000:2.0:1767318286.839928:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224768
00000100:00100000:2.0:1767318286.839931:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224768
00000100:00100000:2.0:1767318286.839955:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795
00000100:00100000:2.0:1767318286.839965:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940225024:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318286.840022:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940225024:12345-0@lo:400:kworker.0 Request processed in 59us (327us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318286.840029:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795
00000100:00100000:2.0:1767318286.840045:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796
00000100:00100000:2.0:1767318286.840051:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940224768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318286.840078:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940224768:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318286.840083:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796
00000100:00100000:2.0:1767318286.840148:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940224768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318286.840159:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940225024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318286.841880:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318286.841960:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224512
00000100:00100000:1.0:1767318286.841967:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224512
00000100:00100000:3.0:1767318286.842063:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318286.842102:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940224384:0@lo:38:kworker.0
00000100:00100000:3.0:1767318286.842136:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318286.842154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940224896:0@lo:38:kworker.0
00000100:00100000:3.0:1767318286.842176:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318286.842194:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940225152:0@lo:38:kworker.0
00000100:00100000:3.0:1767318286.842216:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318286.842249:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224384
00000100:00100000:3.0:1767318286.842253:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224384
00000100:00100000:3.0:1767318286.842279:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917
00000100:00100000:3.0:1767318286.842286:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940224384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318286.842306:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318286.842345:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940224384:12345-0@lo:38:kworker.0 Request processed in 57us (207us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318286.842352:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917
00000100:00100000:3.0:1767318286.842377:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224256
00000100:00100000:3.0:1767318286.842381:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224256
00000100:00100000:3.0:1767318286.842422:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940224896
00000100:00100000:3.0:1767318286.842425:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940224896
00000100:00100000:3.0:1767318286.842439:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225152
00000100:00100000:3.0:1767318286.842442:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225152
00000100:00100000:3.0:1767318286.842451:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16137
00000100:00100000:3.0:1767318286.842455:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940224256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318286.842465:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318286.842490:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940224256:12345-0@lo:38:kworker.0 Request processed in 34us (427us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318286.842496:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16137
00000100:00100000:3.0:1767318286.842506:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16138
00000100:00100000:3.0:1767318286.842509:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940224896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318286.842517:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318286.842540:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940224896:12345-0@lo:38:kworker.0 Request processed in 28us (363us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318286.842545:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16138
00000100:00100000:3.0:1767318286.842555:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16139
00000100:00100000:3.0:1767318286.842558:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940225152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318286.842566:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318286.842586:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940225152:12345-0@lo:38:kworker.0 Request processed in 26us (369us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318286.842590:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16139
00000100:00080000:3.0:1767318286.842634:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318286.842638:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318286.842642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940224256:0@lo:38:kworker.0
00000100:00080000:3.0:1767318286.842670:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318286.842674:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318286.842677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940224384:0@lo:38:kworker.0
00000100:00080000:3.0:1767318286.842683:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318286.842686:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318286.842688:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940224896:0@lo:38:kworker.0
00000100:00080000:3.0:1767318286.842695:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318286.842698:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318286.842700:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940225152:0@lo:38:kworker.0
00000100:00080000:3.0:1767318286.842743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318286.842747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318286.842750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318286.843207:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503
00000100:00100000:0.0:1767318286.843222:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940224640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318286.843274:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940224640:12345-0@lo:400:kworker.0 Request processed in 58us (3693us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318286.845817:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940224640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318286.847096:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504
00000100:00100000:1.0:1767318286.847118:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940224512:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318286.847220:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940224512:12345-0@lo:400:kworker.0 Request processed in 114us (5353us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318286.847227:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504
00000100:00100000:3.0:1767318286.847312:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940224512:0@lo:400:kworker.0
00000100:00100000:0.0:1767318286.850526:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503
00000100:00100000:1.0:1767318287.340913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318287.789020:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318288.364967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318288.365149:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318288.365172:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940225280:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318288.365236:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318288.365454:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225280
00000100:00100000:3.0:1767318288.365461:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225280
00000100:00100000:3.0:1767318288.365525:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018
00000100:00100000:3.0:1767318288.365537:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940225280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318288.365568:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318288.365628:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940225280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (392us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318288.365636:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018
00000100:00100000:3.0:1767318288.365683:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940225280:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318288.365805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318288.813067:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318289.389494:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318289.389662:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318289.389681:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940225408:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318289.389747:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318289.389963:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225408
00000100:00100000:1.0:1767318289.389980:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225408
00000100:00100000:1.0:1767318289.390054:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019
00000100:00100000:1.0:1767318289.390063:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940225408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318289.390094:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318289.390140:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940225408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318289.390146:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019
00000100:00100000:0.0:1767318289.390538:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940225408:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318289.391695:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318289.481544:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318289.481628:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253824
00000100:00100000:1.0:1767318289.481648:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253824
00000100:00100000:3.0:1767318289.481830:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318289.481909:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253696
00000100:00100000:0.0:1767318289.481914:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253696
00000100:00100000:0.0:1767318289.481958:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16140
00000100:00100000:0.0:1767318289.481966:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894253696:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318289.481989:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318289.482045:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894253696:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 80us (215us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318289.482053:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16140
00000100:00100000:1.0:1767318289.482519:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3797
00000100:00100000:1.0:1767318289.482528:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894253824:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318289.482579:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894253824:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 53us (1046us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318289.482585:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3797
00000100:00080000:2.0:1767318289.487376:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318289.837137:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318290.413140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318290.861714:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318291.436912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318291.885013:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318291.949597:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318291.949608:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318291.949611:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318291.949615:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318291.949627:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318291.949635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3536
00000100:00080000:1.0:1767318291.949639:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318291.949647:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318291.949696:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940225536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318291.949726:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318291.949730:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318291.949732:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318291.949735:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3536
00000100:00080000:1.0:1767318291.949738:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318291.949742:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318291.949757:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa300 x1853163940225664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318291.949846:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318291.949850:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318291.949851:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318291.949855:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3536
00000100:00080000:1.0:1767318291.949868:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318291.949871:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318291.949882:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940226176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318291.949897:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318291.949899:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318291.949901:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318291.949905:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3536
00000100:00080000:1.0:1767318291.949907:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318291.949910:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318291.949920:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1880 x1853163940226432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318291.949996:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940225536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950065:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940225664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950163:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940226176:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950225:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940226432:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950271:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950311:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225664
00000100:00100000:0.0:1767318291.950318:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225664
00000100:00100000:0.0:1767318291.950353:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918
00000100:00100000:0.0:1767318291.950360:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940225664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318291.950380:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318291.950420:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940225664:12345-0@lo:38:kworker.0 Request processed in 58us (255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318291.950426:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918
00000100:00080000:0.0:1767318291.950471:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318291.950476:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318291.950479:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940225664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950504:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225536
00000100:00100000:0.0:1767318291.950507:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225536
00000100:00100000:0.0:1767318291.950527:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226176
00000100:00100000:0.0:1767318291.950529:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226176
00000100:00100000:0.0:1767318291.950541:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226432
00000100:00100000:0.0:1767318291.950543:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226432
00000100:00100000:0.0:1767318291.950558:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16141
00000100:00100000:0.0:1767318291.950563:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940225536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318291.950571:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318291.950599:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940225536:12345-0@lo:38:kworker.0 Request processed in 35us (534us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318291.950605:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16141
00000100:00100000:0.0:1767318291.950616:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16142
00000100:00100000:0.0:1767318291.950619:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940226176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318291.950628:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318291.950648:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940226176:12345-0@lo:38:kworker.0 Request processed in 27us (423us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318291.950653:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16142
00000100:00100000:0.0:1767318291.950663:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16143
00000100:00100000:0.0:1767318291.950666:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940226432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318291.950674:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318291.950692:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940226432:12345-0@lo:38:kworker.0 Request processed in 25us (421us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318291.950697:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16143
00000100:00080000:0.0:1767318291.950724:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318291.950727:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318291.950730:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940225536:0@lo:38:kworker.0
00000100:00080000:0.0:1767318291.950736:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318291.950739:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318291.950741:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940226176:0@lo:38:kworker.0
00000100:00080000:0.0:1767318291.950747:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318291.950750:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318291.950752:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940226432:0@lo:38:kworker.0
00000100:00100000:0.0:1767318291.950802:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940226048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318291.950825:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950845:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318291.950851:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940226304:0@lo:400:kworker.0
00000100:00100000:0.0:1767318291.950885:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318291.950907:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226048
00000100:00100000:0.0:1767318291.950911:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226048
00000100:00100000:0.0:1767318291.950947:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226304
00000100:00100000:0.0:1767318291.950951:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226304
00000100:00100000:0.0:1767318291.950970:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767318291.950976:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940226048:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318291.951016:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940226048:12345-0@lo:400:kworker.0 Request processed in 41us (189us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318291.951023:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767318291.951034:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799
00000100:00100000:0.0:1767318291.951039:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940226304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318291.951063:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940226304:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318291.951068:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799
00000100:00080000:0.0:1767318291.951084:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318291.951106:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940226304:0@lo:400:kworker.0
00000100:00100000:0.0:1767318291.951116:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940226048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951501:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940225920:0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951536:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318291.951571:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318291.951578:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940225792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951599:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318291.951649:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225920
00000100:00100000:3.0:1767318291.951652:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225920
00000100:00100000:3.0:1767318291.951684:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940225792
00000100:00100000:3.0:1767318291.951687:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940225792
00000100:00100000:3.0:1767318291.951708:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505
00000100:00100000:3.0:1767318291.951714:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940225920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951748:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940225920:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318291.951758:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505
00000100:00100000:3.0:1767318291.951791:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506
00000100:00100000:3.0:1767318291.951798:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940225792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951826:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940225792:12345-0@lo:400:kworker.0 Request processed in 29us (226us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318291.951832:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506
00000100:00080000:3.0:1767318291.951846:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318291.951849:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318291.951877:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940225792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318291.951887:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940225920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.460923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318292.910102:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318293.485244:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318293.485271:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940226560:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318293.485342:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318293.485477:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318293.485554:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226560
00000100:00100000:1.0:1767318293.485562:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226560
00000100:00100000:1.0:1767318293.485645:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020
00000100:00100000:1.0:1767318293.485654:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940226560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318293.485694:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318293.485743:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940226560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318293.485750:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020
00000100:00080000:3.0:1767318293.485966:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318293.486053:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940226560:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318293.933021:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318294.508914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318294.509112:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940226688:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318294.509193:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318294.509323:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226688
00000100:00100000:1.0:1767318294.509332:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226688
00000100:00100000:1.0:1767318294.509448:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021
00000100:00100000:1.0:1767318294.509458:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940226688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318294.509486:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318294.509521:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318294.509548:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940226688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (354us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318294.509555:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021
00000100:00100000:0.0:1767318294.511249:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940226688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318294.600349:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318294.600456:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318294.603895:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254080
00000100:00100000:1.0:1767318294.603910:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254080
00000100:00080000:3.0:1767318294.604212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318294.604272:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894253952
00000100:00100000:0.0:1767318294.604277:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894253952
00000100:00100000:0.0:1767318294.604319:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3800
00000100:00100000:0.0:1767318294.604331:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894254080:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318294.604422:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894254080:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (4083us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318294.604430:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3800
00000100:00100000:0.0:1767318294.604451:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16144
00000100:00100000:0.0:1767318294.604456:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894253952:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318294.604477:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318294.604506:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894253952:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (4050us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318294.604513:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16144
00010000:00010000:2.0:1767318294.957520:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318295.532975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318295.981147:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318296.556903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318297.008482:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318297.069367:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318297.069378:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318297.069381:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318297.069385:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318297.069389:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318297.069397:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3541
00000100:00080000:1.0:1767318297.069402:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318297.069409:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318297.069449:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3800 x1853163940226816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318297.069475:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318297.069479:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318297.069607:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318297.069612:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3541
00000100:00080000:1.0:1767318297.069615:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318297.069619:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318297.069636:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940226944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318297.069698:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318297.069702:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318297.069704:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318297.069708:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3541
00000100:00080000:1.0:1767318297.069710:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318297.069714:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318297.069721:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227072:0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.069725:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940227456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318297.069740:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318297.069743:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318297.069745:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318297.069748:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3541
00000100:00080000:1.0:1767318297.069750:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318297.069753:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318297.069762:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940227712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318297.069797:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940227328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.069849:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318297.069908:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318297.069915:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940227584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318297.069934:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318297.069937:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318297.069959:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318297.069963:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227328
00000100:00100000:2.0:1767318297.069964:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.069970:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227328
00000100:00100000:2.0:1767318297.069985:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318297.070012:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227072
00000100:00100000:1.0:1767318297.070015:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227584
00000100:00100000:2.0:1767318297.070016:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227072
00000100:00100000:1.0:1767318297.070018:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227584
00000100:00100000:1.0:1767318297.070038:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801
00000100:00100000:2.0:1767318297.070040:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227200
00000100:00100000:2.0:1767318297.070042:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227200
00000100:00100000:1.0:1767318297.070046:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940227328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318297.070058:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507
00000100:00100000:2.0:1767318297.070063:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.070091:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940227328:12345-0@lo:400:kworker.0 Request processed in 45us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318297.070091:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227072:12345-0@lo:400:kworker.0 Request processed in 26us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318297.070098:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801
00000100:00100000:2.0:1767318297.070098:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507
00000100:00100000:1.0:1767318297.070113:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802
00000100:00100000:2.0:1767318297.070113:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508
00000100:00100000:1.0:1767318297.070119:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940227584:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318297.070119:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.070142:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940227584:12345-0@lo:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318297.070142:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227200:12345-0@lo:400:kworker.0 Request processed in 23us (156us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318297.070148:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802
00000100:00100000:2.0:1767318297.070148:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508
00000100:00080000:1.0:1767318297.070163:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318297.070166:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318297.070168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318297.070185:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940227584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318297.070185:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318297.070194:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940227328:0@lo:400:kworker.0
00000100:00100000:2.0:1767318297.070194:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227072:0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.070446:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940226816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318297.070476:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318297.070513:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940226944:0@lo:38:kworker.0
00000100:00100000:2.0:1767318297.070533:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226816
00000100:00100000:0.0:1767318297.070535:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318297.070537:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226816
00000100:00100000:2.0:1767318297.070555:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16145
00000100:00100000:0.0:1767318297.070560:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940227456:0@lo:38:kworker.0
00000100:00100000:2.0:1767318297.070561:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940226816:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318297.070579:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767318297.070579:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318297.070594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940227712:0@lo:38:kworker.0
00000100:00100000:2.0:1767318297.070606:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940226816:12345-0@lo:38:kworker.0 Request processed in 45us (130us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318297.070612:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16145
00000100:00100000:0.0:1767318297.070613:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318297.070624:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227456
00000100:00100000:2.0:1767318297.070627:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227456
00000100:00080000:0.0:1767318297.070637:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318297.070639:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227712
00000100:00100000:2.0:1767318297.070641:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227712
00000100:00080000:0.0:1767318297.070642:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318297.070645:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940226816:0@lo:38:kworker.0
00000100:00100000:2.0:1767318297.070649:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16146
00000100:00100000:2.0:1767318297.070652:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940227456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318297.070661:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318297.070666:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16147
00000100:00100000:0.0:1767318297.070670:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940227712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318297.070679:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318297.070687:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940227456:12345-0@lo:38:kworker.0 Request processed in 33us (108us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318297.070693:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16146
00000100:00100000:0.0:1767318297.070697:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940227712:12345-0@lo:38:kworker.0 Request processed in 26us (83us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318297.070702:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16147
00000100:00080000:0.0:1767318297.070722:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318297.070726:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318297.070729:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940227456:0@lo:38:kworker.0
00000100:00080000:0.0:1767318297.070736:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318297.070739:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318297.070742:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940227712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318297.070943:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940226944
00000100:00100000:3.0:1767318297.070948:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940226944
00000100:00100000:3.0:1767318297.070985:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919
00000100:00100000:3.0:1767318297.070991:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940226944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318297.071003:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318297.071048:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940226944:12345-0@lo:38:kworker.0 Request processed in 56us (511us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318297.071058:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919
00000100:00080000:2.0:1767318297.071127:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318297.071132:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318297.071135:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940226944:0@lo:38:kworker.0
00000100:00100000:3.0:1767318297.581136:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318298.029130:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318298.606651:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318298.606674:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940227840:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318298.606752:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318298.606837:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318298.610491:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227840
00000100:00100000:1.0:1767318298.610506:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227840
00000100:00100000:1.0:1767318298.610599:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022
00000100:00100000:1.0:1767318298.610609:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940227840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318298.610648:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318298.610751:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940227840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (3997us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318298.610759:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022
00000100:00100000:3.0:1767318298.611215:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940227840:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318299.053376:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318299.629396:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318299.629948:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318299.629967:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318299.630058:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318299.630204:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940227968
00000100:00100000:0.0:1767318299.630212:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940227968
00000100:00100000:0.0:1767318299.630284:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023
00000100:00100000:0.0:1767318299.630294:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318299.630323:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318299.630373:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940227968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318299.630381:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023
00000100:00100000:0.0:1767318299.630425:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940227968:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318299.630490:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318299.718738:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318299.718865:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318299.718956:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254336
00000100:00100000:1.0:1767318299.718966:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254336
00000100:00100000:1.0:1767318299.719047:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254208
00000100:00100000:1.0:1767318299.719051:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254208
00000100:00100000:1.0:1767318299.719070:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3803
00000100:00100000:1.0:1767318299.719080:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894254336:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318299.719152:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894254336:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (424us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318299.719161:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3803
00000100:00100000:1.0:1767318299.719179:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16148
00000100:00100000:1.0:1767318299.719184:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894254208:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318299.719205:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318299.719231:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894254208:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (366us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318299.719238:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16148
00000100:00080000:3.0:1767318299.719447:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318299.725450:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894254464 offset 0 length 520: 4
00010000:00010000:2.0:1767318300.076987:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318300.655995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318301.108298:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318301.676946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318302.125079:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318302.189028:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318302.189038:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318302.189041:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318302.189045:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318302.189050:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318302.189057:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3547
00000100:00080000:2.0:1767318302.189062:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318302.189069:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318302.189110:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940228096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318302.189138:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318302.189151:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318302.189153:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318302.189157:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3547
00000100:00080000:2.0:1767318302.189160:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318302.189163:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318302.189177:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940228224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318302.189242:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318302.189245:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318302.189247:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318302.189250:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3547
00000100:00080000:2.0:1767318302.189252:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318302.189256:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318302.189267:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940228736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318302.189283:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318302.189285:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318302.189287:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318302.189290:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3547
00000100:00080000:2.0:1767318302.189292:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318302.189294:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318302.189305:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940228992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318302.189330:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940228864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189392:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318302.189451:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318302.189457:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940228608:0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189480:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318302.189510:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228864
00000100:00100000:2.0:1767318302.189517:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228864
00000100:00100000:1.0:1767318302.189525:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940228352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.189561:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318302.189562:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228608
00000100:00100000:2.0:1767318302.189565:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228608
00000100:00100000:1.0:1767318302.189585:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318302.189586:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804
00000100:00100000:1.0:1767318302.189590:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940228480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189594:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940228864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.189610:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318302.189640:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228352
00000100:00100000:1.0:1767318302.189644:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228352
00000100:00100000:2.0:1767318302.189650:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940228864:12345-0@lo:400:kworker.0 Request processed in 57us (258us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318302.189657:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804
00000100:00100000:2.0:1767318302.189673:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805
00000100:00100000:2.0:1767318302.189679:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940228608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.189682:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228480
00000100:00100000:1.0:1767318302.189685:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228480
00000100:00100000:2.0:1767318302.189705:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940228608:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318302.189706:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509
00000100:00100000:1.0:1767318302.189712:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940228352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189722:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805
00000100:00080000:2.0:1767318302.189743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318302.189747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318302.189750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318302.189756:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940228352:12345-0@lo:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318302.189761:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509
00000100:00100000:2.0:1767318302.189801:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940228608:0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189812:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940228864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189854:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510
00000100:00100000:2.0:1767318302.189861:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940228480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318302.189888:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940228480:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318302.189893:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510
00000100:00100000:1.0:1767318302.190038:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940228480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.190047:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940228352:0@lo:400:kworker.0
00000100:00100000:0.0:1767318302.190404:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940228096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318302.190437:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.190462:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940228224:0@lo:38:kworker.0
00000100:00100000:0.0:1767318302.190485:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.190510:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940228736:0@lo:38:kworker.0
00000100:00100000:0.0:1767318302.190528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.190545:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940228992:0@lo:38:kworker.0
00000100:00100000:0.0:1767318302.190562:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.190595:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228096
00000100:00100000:0.0:1767318302.190611:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228096
00000100:00100000:0.0:1767318302.190633:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228736
00000100:00100000:0.0:1767318302.190635:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228736
00000100:00100000:0.0:1767318302.190646:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228992
00000100:00100000:0.0:1767318302.190649:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228992
00000100:00100000:0.0:1767318302.190658:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16149
00000100:00100000:0.0:1767318302.190662:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318302.190681:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318302.190725:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228096:12345-0@lo:38:kworker.0 Request processed in 61us (286us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318302.190730:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16149
00000100:00100000:0.0:1767318302.190743:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16150
00000100:00100000:0.0:1767318302.190746:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318302.190756:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318302.190808:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228736:12345-0@lo:38:kworker.0 Request processed in 59us (278us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318302.190814:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16150
00000100:00100000:0.0:1767318302.190825:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16151
00000100:00100000:0.0:1767318302.190828:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318302.190836:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318302.190856:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940228992:12345-0@lo:38:kworker.0 Request processed in 26us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318302.190861:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16151
00000100:00080000:0.0:1767318302.190897:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318302.190902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318302.190905:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940228096:0@lo:38:kworker.0
00000100:00080000:0.0:1767318302.190913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318302.190916:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318302.190918:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940228736:0@lo:38:kworker.0
00000100:00080000:0.0:1767318302.190923:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318302.190926:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318302.190928:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940228992:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.191192:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940228224
00000100:00100000:1.0:1767318302.191197:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940228224
00000100:00100000:1.0:1767318302.191231:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920
00000100:00100000:1.0:1767318302.191236:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940228224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318302.191246:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318302.191291:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940228224:12345-0@lo:38:kworker.0 Request processed in 53us (805us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318302.191297:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920
00000100:00080000:2.0:1767318302.191406:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318302.191411:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318302.191414:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940228224:0@lo:38:kworker.0
00000100:00100000:0.0:1767318302.700966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318303.149074:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318303.725887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318303.727027:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940229120:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318303.727099:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318303.727372:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229120
00000100:00100000:2.0:1767318303.727381:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229120
00000100:00100000:2.0:1767318303.727438:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024
00000100:00100000:2.0:1767318303.727446:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940229120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318303.727487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318303.727550:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940229120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (450us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318303.727556:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024
00000100:00100000:3.0:1767318303.727696:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940229120:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318304.172988:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318304.750086:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318304.750439:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318304.750457:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940229248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318304.750514:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318304.750699:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229248
00000100:00100000:1.0:1767318304.750707:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229248
00000100:00100000:1.0:1767318304.750877:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025
00000100:00100000:1.0:1767318304.750887:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940229248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318304.750919:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318304.751037:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940229248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (521us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318304.751045:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025
00000100:00100000:0.0:1767318304.751236:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940229248:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318304.751290:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318304.840613:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318304.840681:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318304.841402:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254720
00000100:00100000:1.0:1767318304.841413:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254720
00000100:00100000:1.0:1767318304.841486:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254592
00000100:00100000:1.0:1767318304.841490:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254592
00000100:00100000:1.0:1767318304.841514:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3806
00000100:00100000:1.0:1767318304.841585:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894254720:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318304.841660:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894254720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 137us (1058us total) trans 0 rc 0/0
00000100:00080000:3.0:1767318304.841717:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318304.842420:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16152
00000100:00100000:0.0:1767318304.842429:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894254592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318304.842452:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318304.842504:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894254592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 73us (1821us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318304.842511:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16152
00000100:00100000:1.0:1767318304.862258:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3806
00010000:00010000:2.0:1767318305.197247:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318305.772950:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318306.226803:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318306.285669:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318281/real 1767318281]  req@ffff93cf49a02680 x1853163940222848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318306 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318306.285701:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf49a02680 x1853163940222848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318306 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318306.285719:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318306.285757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318306.285762:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940222848:0@lo:250:kworker.0
00000100:00080000:2.0:1767318306.287800:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318306.287809:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318306.287814:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318306.287821:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3531
00000100:00080000:2.0:1767318306.287825:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318306.287832:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318306.287869:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940229376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318306.287906:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318306.287910:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318306.287912:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318306.287916:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3552
00000100:00080000:2.0:1767318306.287919:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318306.287923:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318306.287937:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a680 x1853163940229504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318306.287946:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318306.287949:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318306.287951:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318306.287955:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3552
00000100:00080000:2.0:1767318306.287957:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318306.287960:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318306.287971:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019f80 x1853163940229632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318306.288042:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318306.288045:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318306.288047:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318306.288051:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3552
00000100:00080000:2.0:1767318306.288053:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318306.288057:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318306.288068:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940230144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318306.288081:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318306.288084:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318306.288086:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318306.288089:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3552
00000100:00080000:2.0:1767318306.288091:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318306.288094:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318306.288099:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940229760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318306.288103:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3800 x1853163940230400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318306.288172:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318306.288198:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940229888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318306.288226:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318306.288267:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229760
00000100:00100000:1.0:1767318306.288275:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229760
00000100:00100000:1.0:1767318306.288335:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229888
00000100:00100000:1.0:1767318306.288339:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229888
00000100:00100000:1.0:1767318306.288361:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511
00000100:00100000:1.0:1767318306.288369:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940229760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318306.288419:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940229760:12345-0@lo:400:kworker.0 Request processed in 50us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318306.288426:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511
00000100:00100000:1.0:1767318306.288442:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512
00000100:00100000:1.0:1767318306.288448:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940229888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318306.288479:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940229888:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318306.288486:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512
00000100:00100000:1.0:1767318306.288531:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940229760:0@lo:400:kworker.0
00000100:00080000:3.0:1767318306.288637:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318306.288641:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318306.288659:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940229888:0@lo:400:kworker.0
00000100:00100000:0.0:1767318306.289236:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940230016:0@lo:400:kworker.0
00000100:00100000:0.0:1767318306.289282:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289561:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318306.289568:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940230272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318306.289591:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289639:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940229376:0@lo:250:kworker.0
00000400:00000100:0.0:1767318306.289660:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940229376 offset 0 length 520: 4
00000100:00100000:0.0:1767318306.289681:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940229504:0@lo:38:kworker.0
00000100:00100000:0.0:1767318306.289699:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289739:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940229632:0@lo:38:kworker.0
00000100:00100000:0.0:1767318306.289801:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289820:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940230144:0@lo:38:kworker.0
00000100:00100000:0.0:1767318306.289839:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289853:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940230400:0@lo:38:kworker.0
00000100:00100000:0.0:1767318306.289871:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318306.289901:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229632
00000100:00100000:0.0:1767318306.289907:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229632
00000100:00100000:0.0:1767318306.289937:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921
00000100:00100000:0.0:1767318306.289943:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940229632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318306.289964:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318306.290002:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940229632:12345-0@lo:38:kworker.0 Request processed in 57us (227us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318306.290009:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921
00000100:00100000:0.0:1767318306.290029:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230016
00000100:00100000:0.0:1767318306.290033:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230016
00000100:00100000:0.0:1767318306.290067:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230272
00000100:00100000:0.0:1767318306.290070:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230272
00000100:00100000:0.0:1767318306.290085:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807
00000100:00100000:0.0:1767318306.290090:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940230016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318306.290127:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940230016:12345-0@lo:400:kworker.0 Request processed in 36us (845us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318306.290189:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940229504
00000100:00100000:3.0:1767318306.290193:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940229504
00000100:00100000:3.0:1767318306.290208:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230144
00000100:00100000:3.0:1767318306.290210:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230144
00000100:00100000:3.0:1767318306.290216:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230400
00000100:00100000:3.0:1767318306.290218:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230400
00000100:00100000:3.0:1767318306.290226:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808
00000100:00100000:3.0:1767318306.290235:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940230272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318306.290267:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940230272:12345-0@lo:400:kworker.0 Request processed in 36us (675us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318306.290273:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808
00000100:00100000:3.0:1767318306.290286:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16153
00000100:00100000:3.0:1767318306.290289:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940229504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318306.290300:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318306.290322:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940229504:12345-0@lo:38:kworker.0 Request processed in 31us (621us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318306.290327:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16153
00000100:00100000:3.0:1767318306.290341:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16154
00000100:00100000:3.0:1767318306.290344:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940230144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318306.290353:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318306.290375:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940230144:12345-0@lo:38:kworker.0 Request processed in 29us (535us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318306.290380:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16154
00000100:00100000:3.0:1767318306.290391:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16155
00000100:00100000:3.0:1767318306.290394:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940230400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318306.290403:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318306.290425:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940230400:12345-0@lo:38:kworker.0 Request processed in 29us (553us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318306.290430:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16155
00000100:00080000:3.0:1767318306.290444:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318306.290486:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318306.290491:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318306.290495:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940229504:0@lo:38:kworker.0
00000100:00080000:3.0:1767318306.290503:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318306.290507:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318306.290509:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940229632:0@lo:38:kworker.0
00000100:00080000:3.0:1767318306.290516:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318306.290518:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318306.290521:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940230144:0@lo:38:kworker.0
00000100:00080000:3.0:1767318306.290528:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318306.290531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318306.290534:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940230400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318306.290577:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940230272:0@lo:400:kworker.0
00000100:00100000:2.0:1767318306.290589:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940230016:0@lo:400:kworker.0
00000100:00100000:0.0:1767318306.290894:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807
00000100:00100000:1.0:1767318306.799490:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318307.248119:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318307.821179:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318308.271033:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318308.844936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318308.844981:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940230528:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318308.845054:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318308.846130:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230528
00000100:00100000:3.0:1767318308.846139:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230528
00000100:00100000:3.0:1767318308.846221:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026
00000100:00100000:3.0:1767318308.846233:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940230528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318308.846263:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318308.846327:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940230528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (1273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318308.846334:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026
00000100:00080000:0.0:1767318308.846857:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318308.847841:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940230528:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318309.301180:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318309.870066:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940230656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318309.870140:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318309.870358:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230656
00000100:00100000:2.0:1767318309.870367:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230656
00000100:00100000:2.0:1767318309.870438:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027
00000100:00100000:2.0:1767318309.870449:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940230656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318309.870478:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318309.870547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318309.870890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318309.872344:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940230656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1890us (2196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318309.872357:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027
00000100:00100000:0.0:1767318309.872707:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940230656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318309.959313:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318309.959467:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318309.960431:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254976
00000100:00100000:1.0:1767318309.960452:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254976
00000100:00080000:0.0:1767318309.960550:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318309.960641:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894254848
00000100:00100000:1.0:1767318309.960646:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894254848
00000100:00100000:2.0:1767318309.960680:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3809
00000100:00100000:2.0:1767318309.960692:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894254976:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318309.960816:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894254976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 126us (1514us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318309.960824:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3809
00000100:00100000:2.0:1767318309.960845:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16156
00000100:00100000:2.0:1767318309.960849:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894254848:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318309.960872:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318309.960897:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894254848:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (1431us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318309.960903:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16156
00010000:00010000:2.0:1767318310.318012:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318310.893827:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318311.341112:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318311.405106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318311.405118:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318311.405121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318311.405125:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318311.405130:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318311.405138:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3556
00000100:00080000:3.0:1767318311.405142:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318311.405150:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318311.405190:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046addc00 x1853163940230784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318311.405207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318311.405210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318311.405212:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318311.405215:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3556
00000100:00080000:3.0:1767318311.405218:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318311.405221:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318311.405234:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046add880 x1853163940230912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318311.405300:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940231040:0@lo:400:kworker.0
00000100:00100000:2.0:1767318311.405370:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318311.405493:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231040
00000100:00100000:1.0:1767318311.405501:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231040
00000100:00100000:1.0:1767318311.405561:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513
00000100:00100000:1.0:1767318311.405571:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940231040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.405709:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940230784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318311.405743:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318311.405765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940230912:0@lo:38:kworker.0
00000100:00100000:0.0:1767318311.405808:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318311.405836:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318311.405847:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231168:0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.405871:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318311.405931:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230912
00000100:00100000:0.0:1767318311.405936:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230912
00000100:00100000:0.0:1767318311.405959:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922
00000100:00100000:0.0:1767318311.405964:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940230912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318311.405984:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318311.406020:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940230912:12345-0@lo:38:kworker.0 Request processed in 53us (211us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318311.406027:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922
00000100:00100000:0.0:1767318311.406049:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231168
00000100:00100000:0.0:1767318311.406053:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231168
00000100:00100000:0.0:1767318311.406082:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514
00000100:00100000:0.0:1767318311.406088:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.406120:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231168:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318311.406125:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514
00000100:00080000:0.0:1767318311.406143:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318311.406168:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231168:0@lo:400:kworker.0
00000100:00080000:0.0:1767318311.406193:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318311.406197:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318311.406200:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940230912:0@lo:38:kworker.0
00000100:00100000:0.0:1767318311.406242:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940230784
00000100:00100000:0.0:1767318311.406246:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940230784
00000100:00100000:0.0:1767318311.406268:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16157
00000100:00100000:0.0:1767318311.406272:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940230784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318311.406281:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318311.406309:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940230784:12345-0@lo:38:kworker.0 Request processed in 35us (565us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318311.406315:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16157
00000100:00080000:0.0:1767318311.406335:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318311.406338:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318311.406340:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940230784:0@lo:38:kworker.0
00000100:00100000:1.0:1767318311.406571:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940231040:12345-0@lo:400:kworker.0 Request processed in 1001us (1200us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318311.406578:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513
00000100:00080000:3.0:1767318311.408808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318311.408814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318311.408817:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318311.408824:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3556
00000100:00080000:3.0:1767318311.408829:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318311.408835:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318311.408855:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046aded80 x1853163940231424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318311.408974:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940231296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318311.409037:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318311.409096:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231296
00000100:00100000:1.0:1767318311.409103:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231296
00000100:00100000:1.0:1767318311.409156:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810
00000100:00100000:1.0:1767318311.409166:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940231296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318311.409212:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940231296:12345-0@lo:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318311.409220:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810
00000100:00080000:1.0:1767318311.409240:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318311.409270:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940231296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318311.409311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940231424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318311.409336:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318311.409365:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231424
00000100:00100000:1.0:1767318311.409369:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231424
00000100:00100000:1.0:1767318311.409389:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16158
00000100:00100000:1.0:1767318311.409393:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940231424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318311.409411:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318311.409446:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940231424:12345-0@lo:38:kworker.0 Request processed in 51us (109us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318311.409452:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16158
00000100:00080000:1.0:1767318311.409477:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318311.409481:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318311.409484:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940231424:0@lo:38:kworker.0
00000100:00080000:3.0:1767318311.409555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318311.409558:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318311.409561:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318311.409566:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3556
00000100:00080000:3.0:1767318311.409568:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318311.409572:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318311.409585:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046add500 x1853163940231680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318311.409724:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940231552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.409758:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318311.409808:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231552
00000100:00100000:0.0:1767318311.409812:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231552
00000100:00100000:0.0:1767318311.409842:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811
00000100:00100000:0.0:1767318311.409848:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940231552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.409879:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940231552:12345-0@lo:400:kworker.0 Request processed in 31us (121us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318311.409977:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940231680:0@lo:38:kworker.0
00000100:00100000:3.0:1767318311.410003:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318311.410034:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231680
00000100:00100000:3.0:1767318311.410038:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231680
00000100:00100000:3.0:1767318311.410062:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16159
00000100:00100000:3.0:1767318311.410067:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940231680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318311.410080:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318311.410109:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940231680:12345-0@lo:38:kworker.0 Request processed in 40us (104us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318311.410115:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16159
00000100:00080000:3.0:1767318311.410144:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318311.410148:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318311.410151:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940231680:0@lo:38:kworker.0
00000100:00080000:3.0:1767318311.410175:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318311.410258:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940231552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318311.410302:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811
00000100:00100000:2.0:1767318311.411576:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940231040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318311.917495:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318312.365177:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318312.940894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318313.392593:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318313.964919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318313.966502:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318313.966530:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231808:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318313.966602:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318313.967232:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231808
00000100:00100000:2.0:1767318313.967241:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231808
00000100:00100000:2.0:1767318313.967322:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028
00000100:00100000:2.0:1767318313.967331:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318313.967363:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318313.967423:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (820us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318313.967429:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028
00000100:00080000:3.0:1767318313.967542:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318313.967623:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231808:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318314.412984:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318314.989633:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318314.993216:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318314.993284:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318314.993330:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940231936
00000100:00100000:3.0:1767318314.993339:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940231936
00000100:00100000:3.0:1767318314.993420:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029
00000100:00100000:3.0:1767318314.993432:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318314.993465:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318314.993513:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940231936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (227us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318314.993521:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029
00000100:00080000:1.0:1767318314.993566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318314.993622:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940231936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318315.079523:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318315.079613:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318315.079737:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255232
00000100:00100000:2.0:1767318315.079748:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255232
00000100:00100000:2.0:1767318315.079858:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255104
00000100:00100000:2.0:1767318315.079862:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255104
00000100:00100000:2.0:1767318315.079883:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3812
00000100:00100000:2.0:1767318315.079892:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894255232:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318315.079938:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16160
00000100:00100000:0.0:1767318315.079946:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894255104:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318315.079967:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318315.079983:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894255232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318315.079991:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3812
00000100:00100000:0.0:1767318315.079998:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894255104:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (383us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318315.080007:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16160
00000100:00080000:3.0:1767318315.080282:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318315.439885:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318316.012838:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318316.462171:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318316.528550:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318316.528560:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318316.528563:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318316.528567:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318316.528571:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318316.528579:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3561
00000100:00080000:2.0:1767318316.528584:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318316.528591:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318316.528661:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940232064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318316.528694:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318316.528699:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318316.528701:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318316.528705:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3561
00000100:00080000:2.0:1767318316.528707:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318316.528711:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318316.528726:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1f80 x1853163940232192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318316.528811:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318316.528814:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318316.528816:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318316.528823:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3561
00000100:00080000:2.0:1767318316.528826:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318316.528831:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318316.528841:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940232320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318316.528847:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3800 x1853163940232704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318316.528866:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318316.528869:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318316.528871:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318316.528874:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3561
00000100:00080000:2.0:1767318316.528876:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318316.528879:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318316.528891:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519a8e00 x1853163940232960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318316.528914:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940232832:0@lo:400:kworker.0
00000100:00100000:2.0:1767318316.528976:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318316.529047:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318316.529054:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940232576:0@lo:400:kworker.0
00000100:00100000:2.0:1767318316.529077:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318316.529110:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232832
00000100:00100000:2.0:1767318316.529117:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232832
00000100:00100000:1.0:1767318316.529138:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318316.529174:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318316.529181:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940232448:0@lo:400:kworker.0
00000100:00100000:1.0:1767318316.529204:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318316.529243:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232576
00000100:00100000:1.0:1767318316.529246:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232320
00000100:00100000:2.0:1767318316.529247:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232576
00000100:00100000:1.0:1767318316.529254:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232320
00000100:00100000:2.0:1767318316.529283:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813
00000100:00100000:1.0:1767318316.529293:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232448
00000100:00100000:2.0:1767318316.529294:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940232832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318316.529299:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232448
00000100:00100000:1.0:1767318316.529332:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1767318316.529340:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940232320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318316.529353:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940232832:12345-0@lo:400:kworker.0 Request processed in 61us (375us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318316.529364:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813
00000100:00100000:0.0:1767318316.529376:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516
00000100:00100000:2.0:1767318316.529381:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814
00000100:00100000:1.0:1767318316.529391:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940232320:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318316.529391:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940232576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318316.529392:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940232448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318316.529406:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515
00000100:00080000:3.0:1767318316.529473:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318316.529477:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318316.529480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318316.529537:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940232576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318316.529546:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940232832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318316.529578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940232064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318316.530700:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940232448:0@lo:400:kworker.0
00000100:00100000:1.0:1767318316.530729:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940232320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318316.542356:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940232576:12345-0@lo:400:kworker.0 Request processed in 12956us (13265us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318316.542371:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814
00000100:00100000:0.0:1767318316.543747:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940232448:12345-0@lo:400:kworker.0 Request processed in 14357us (14535us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318316.543758:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516
00000100:00100000:3.0:1767318316.552781:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318316.552863:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940232192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318316.552904:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232064
00000100:00100000:2.0:1767318316.552916:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232064
00000100:00100000:3.0:1767318316.552916:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318316.552951:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940232704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318316.552978:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318316.553103:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232192
00000100:00100000:0.0:1767318316.553108:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232192
00000100:00100000:0.0:1767318316.553150:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923
00000100:00100000:0.0:1767318316.553158:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940232192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318316.553185:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318316.553231:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940232192:12345-0@lo:38:kworker.0 Request processed in 73us (313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318316.553238:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923
00000100:00100000:2.0:1767318316.553307:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232704
00000100:00100000:2.0:1767318316.553311:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232704
00000100:00100000:1.0:1767318316.553342:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16161
00000100:00100000:3.0:1767318316.553345:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940232960:0@lo:38:kworker.0
00000100:00100000:1.0:1767318316.553348:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940232064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318316.553359:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318316.553367:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318316.553385:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940232064:12345-0@lo:38:kworker.0 Request processed in 36us (626us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318316.553390:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16161
00000100:00100000:1.0:1767318316.553403:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940232960
00000100:00080000:3.0:1767318316.553403:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318316.553406:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940232960
00000100:00080000:3.0:1767318316.553407:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318316.553411:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940232064:0@lo:38:kworker.0
00000100:00080000:3.0:1767318316.553419:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318316.553422:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318316.553424:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16162
00000100:00100000:3.0:1767318316.553425:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940232192:0@lo:38:kworker.0
00000100:00100000:1.0:1767318316.553428:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940232704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318316.553436:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318316.553461:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940232704:12345-0@lo:38:kworker.0 Request processed in 32us (482us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318316.553466:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16162
00000100:00100000:3.0:1767318316.553470:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16163
00000100:00100000:3.0:1767318316.553474:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940232960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318316.553484:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318316.553509:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940232960:12345-0@lo:38:kworker.0 Request processed in 33us (140us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318316.553514:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16163
00000100:00080000:3.0:1767318316.554785:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318316.554797:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318316.554802:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940232704:0@lo:38:kworker.0
00000100:00080000:3.0:1767318316.554823:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318316.554827:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318316.554830:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940232960:0@lo:38:kworker.0
00000100:00100000:1.0:1767318317.037002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318317.487216:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318318.060906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318318.509214:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318319.086091:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318319.086557:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318319.086591:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940233088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318319.086666:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318319.086843:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233088
00000100:00100000:2.0:1767318319.086854:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233088
00000100:00100000:2.0:1767318319.086923:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030
00000100:00100000:2.0:1767318319.086933:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940233088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318319.086962:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318319.087013:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940233088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318319.087019:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030
00000100:00100000:2.0:1767318319.087062:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940233088:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318319.087199:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318319.542879:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318320.108973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318320.109321:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318320.109341:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940233216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318320.109408:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318320.109526:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233216
00000100:00100000:0.0:1767318320.109534:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233216
00000100:00100000:0.0:1767318320.109609:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031
00000100:00100000:0.0:1767318320.109619:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940233216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318320.109661:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318320.109707:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940233216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (299us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318320.109714:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031
00000100:00080000:3.0:1767318320.109803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318320.109837:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940233216:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318320.200032:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318320.200086:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318320.200170:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255488
00000100:00100000:2.0:1767318320.200179:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255488
00000100:00100000:2.0:1767318320.200255:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255360
00000100:00100000:2.0:1767318320.200260:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255360
00000100:00100000:2.0:1767318320.200284:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3815
00000100:00100000:2.0:1767318320.200292:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894255488:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318320.200362:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894255488:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318320.200370:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3815
00000100:00100000:2.0:1767318320.200389:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16164
00000100:00100000:2.0:1767318320.200394:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894255360:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318320.200415:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318320.200439:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894255360:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (352us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318320.200446:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16164
00000100:00080000:0.0:1767318320.200848:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318320.557123:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318321.133066:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318321.581853:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318321.647291:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318321.647302:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318321.647304:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318321.647308:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318321.647312:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318321.647320:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3566
00000100:00080000:2.0:1767318321.647324:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318321.647331:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318321.647371:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519afb80 x1853163940233344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318321.647397:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318321.647402:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318321.647403:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318321.647407:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3566
00000100:00080000:2.0:1767318321.647410:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318321.647414:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318321.647427:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940233472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318321.647489:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318321.647493:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318321.647495:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318321.647498:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3566
00000100:00080000:2.0:1767318321.647500:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318321.647503:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318321.647514:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940233984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318321.647530:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318321.647533:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318321.647535:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318321.647538:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3566
00000100:00080000:2.0:1767318321.647540:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318321.647543:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318321.647559:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940234240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318321.647601:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940233856:0@lo:400:kworker.0
00000100:00100000:2.0:1767318321.647682:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318321.647754:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318321.647762:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940234112:0@lo:400:kworker.0
00000100:00100000:2.0:1767318321.647808:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318321.647850:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233856
00000100:00100000:2.0:1767318321.647860:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233856
00000100:00100000:2.0:1767318321.647915:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234112
00000100:00100000:2.0:1767318321.647917:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234112
00000100:00100000:2.0:1767318321.647934:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816
00000100:00100000:2.0:1767318321.647940:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940233856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318321.647979:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940233856:12345-0@lo:400:kworker.0 Request processed in 39us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318321.647985:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816
00000100:00100000:2.0:1767318321.647997:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817
00000100:00100000:2.0:1767318321.648000:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940234112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318321.648014:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940234112:12345-0@lo:400:kworker.0 Request processed in 14us (206us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318321.648017:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817
00000100:00080000:2.0:1767318321.648029:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318321.648054:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940234112:0@lo:400:kworker.0
00000100:00100000:2.0:1767318321.648059:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940233856:0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648264:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940233600:0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648289:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318321.648316:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318321.648319:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940233728:0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648332:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318321.648362:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233600
00000100:00100000:1.0:1767318321.648366:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233600
00000100:00100000:1.0:1767318321.648397:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233728
00000100:00100000:1.0:1767318321.648400:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233728
00000100:00100000:1.0:1767318321.648417:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767318321.648421:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940233600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648444:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940233600:12345-0@lo:400:kworker.0 Request processed in 23us (154us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318321.648450:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767318321.648459:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518
00000100:00100000:1.0:1767318321.648462:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940233728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648476:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940233728:12345-0@lo:400:kworker.0 Request processed in 14us (143us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318321.648479:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518
00000100:00080000:1.0:1767318321.648492:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318321.648503:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940233728:0@lo:400:kworker.0
00000100:00100000:1.0:1767318321.648508:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940233600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318321.648578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940233344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318321.648618:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318321.648645:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940233472:0@lo:38:kworker.0
00000100:00100000:3.0:1767318321.648679:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318321.648700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940233984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318321.648722:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318321.648740:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940234240:0@lo:38:kworker.0
00000100:00100000:3.0:1767318321.648763:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318321.648813:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233344
00000100:00100000:3.0:1767318321.648817:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233344
00000100:00100000:3.0:1767318321.648832:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233984
00000100:00100000:3.0:1767318321.648834:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233984
00000100:00100000:3.0:1767318321.648844:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234240
00000100:00100000:3.0:1767318321.648846:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234240
00000100:00100000:3.0:1767318321.648857:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16165
00000100:00100000:3.0:1767318321.648861:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940233344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318321.648883:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318321.648920:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940233344:12345-0@lo:38:kworker.0 Request processed in 58us (301us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318321.648925:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16165
00000100:00100000:3.0:1767318321.648937:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166
00000100:00100000:3.0:1767318321.648940:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940233984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318321.648948:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318321.648965:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940233984:12345-0@lo:38:kworker.0 Request processed in 23us (242us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318321.648969:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166
00000100:00100000:3.0:1767318321.648977:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167
00000100:00100000:3.0:1767318321.648980:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940234240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318321.648987:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318321.649000:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940234240:12345-0@lo:38:kworker.0 Request processed in 19us (237us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318321.649004:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167
00000100:00080000:3.0:1767318321.649033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318321.649037:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318321.649040:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940233344:0@lo:38:kworker.0
00000100:00080000:3.0:1767318321.649046:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318321.649049:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318321.649051:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940233984:0@lo:38:kworker.0
00000100:00080000:3.0:1767318321.649057:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318321.649060:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318321.649062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940234240:0@lo:38:kworker.0
00000100:00100000:0.0:1767318321.649302:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940233472
00000100:00100000:0.0:1767318321.649306:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940233472
00000100:00100000:0.0:1767318321.649331:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924
00000100:00100000:0.0:1767318321.649334:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940233472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318321.649341:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318321.649383:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940233472:12345-0@lo:38:kworker.0 Request processed in 48us (714us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318321.649390:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924
00000100:00080000:3.0:1767318321.651319:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318321.651328:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318321.651332:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940233472:0@lo:38:kworker.0
00000100:00100000:2.0:1767318322.164437:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318322.606399:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318323.180970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318323.629075:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318324.206178:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318324.206203:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940234368:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318324.206275:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318324.206363:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234368
00000100:00100000:2.0:1767318324.206372:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234368
00000100:00100000:2.0:1767318324.206440:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032
00000100:00100000:2.0:1767318324.206450:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940234368:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318324.206456:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767318324.206483:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318324.206539:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940234368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318324.206549:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032
00000100:00100000:1.0:1767318324.206649:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318324.206736:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940234368:0@lo:13:osp-pre-1-1.0
00000400:00000100:2.0:1767318324.300589:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894255616 offset 0 length 520: 4
00000100:00100000:2.0:1767318324.301036:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318324.301265:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318324.301596:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255744
00000100:00100000:1.0:1767318324.301607:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255744
00000100:00100000:1.0:1767318324.301711:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894255872
00000100:00100000:1.0:1767318324.301715:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894255872
00000100:00080000:0.0:1767318324.301836:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318324.302730:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3818
00000100:00100000:2.0:1767318324.302747:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894255872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318324.302858:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894255872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 116us (1592us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318324.302929:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3818
00000100:00100000:2.0:1767318324.302954:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16168
00000100:00100000:2.0:1767318324.302959:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894255744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318324.302979:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318324.303006:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894255744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (2363us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318324.303012:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16168
00010000:00010000:1.0:1767318324.654444:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318325.229880:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318325.229905:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940234496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318325.229910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318325.229978:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318325.230107:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234496
00000100:00100000:2.0:1767318325.230116:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234496
00000100:00100000:2.0:1767318325.230185:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033
00000100:00100000:2.0:1767318325.230193:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940234496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318325.230223:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318325.230272:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940234496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (294us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318325.230280:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033
00000100:00100000:2.0:1767318325.230326:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940234496:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318325.230402:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318325.677110:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318326.252894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318326.701414:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318326.765715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318326.765726:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318326.765729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318326.765733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318326.765738:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318326.765745:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3571
00000100:00080000:0.0:1767318326.765751:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318326.765759:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318326.765823:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838000 x1853163940234624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318326.765849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318326.765856:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318326.765858:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318326.765862:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3571
00000100:00080000:0.0:1767318326.765864:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318326.765869:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318326.765882:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839180 x1853163940234752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318326.765955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767318326.765957:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940234880:0@lo:400:kworker.0
00000100:00080000:0.0:1767318326.765961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318326.765965:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318326.765971:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3571
00000100:00080000:0.0:1767318326.765974:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318326.765977:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318326.765990:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940235264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318326.766005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318326.766008:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318326.766010:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318326.766013:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3571
00000100:00080000:0.0:1767318326.766015:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318326.766018:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318326.766027:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940235520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318326.766038:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318326.766064:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940235392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318326.766101:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318326.766108:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318326.766118:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318326.766125:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318326.766135:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940235136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318326.766149:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318326.766247:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235392
00000100:00100000:1.0:1767318326.766255:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235392
00000100:00100000:1.0:1767318326.766306:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819
00000100:00100000:1.0:1767318326.766316:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940235392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318326.766418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940234624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318326.766960:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318326.767014:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234880
00000100:00100000:0.0:1767318326.767019:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234880
00000100:00100000:0.0:1767318326.767053:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235008
00000100:00100000:0.0:1767318326.767056:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235008
00000100:00100000:0.0:1767318326.767075:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519
00000100:00100000:0.0:1767318326.767081:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940234880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318326.767124:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940234880:12345-0@lo:400:kworker.0 Request processed in 43us (1088us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318326.767132:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519
00000100:00100000:0.0:1767318326.767149:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520
00000100:00100000:0.0:1767318326.767155:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318326.767183:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235008:12345-0@lo:400:kworker.0 Request processed in 28us (1033us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318326.767188:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520
00000100:00100000:0.0:1767318326.767250:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235136
00000100:00100000:0.0:1767318326.767254:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235136
00000100:00100000:0.0:1767318326.767285:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820
00000100:00100000:0.0:1767318326.767292:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940235136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318326.767330:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940235136:12345-0@lo:400:kworker.0 Request processed in 38us (370us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318326.767336:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820
00000100:00100000:0.0:1767318326.767383:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940235136:0@lo:400:kworker.0
00000100:00080000:0.0:1767318326.767421:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318326.767426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318326.767623:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235008:0@lo:400:kworker.0
00000100:00100000:2.0:1767318326.767634:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940234880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318326.769343:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940235392:12345-0@lo:400:kworker.0 Request processed in 3020us (3232us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318326.769357:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819
00000100:00100000:0.0:1767318326.771083:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940235392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318326.771326:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318326.771358:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940234752:0@lo:38:kworker.0
00000100:00100000:3.0:1767318326.771400:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318326.771430:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940235264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318326.771452:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318326.771483:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940235520:0@lo:38:kworker.0
00000100:00100000:3.0:1767318326.771499:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318326.771531:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234624
00000100:00100000:3.0:1767318326.771537:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234624
00000100:00100000:3.0:1767318326.771591:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235264
00000100:00100000:3.0:1767318326.771595:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235264
00000100:00100000:3.0:1767318326.771608:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235520
00000100:00100000:3.0:1767318326.771610:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235520
00000100:00100000:3.0:1767318326.771621:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16169
00000100:00100000:3.0:1767318326.771626:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940234624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318326.771645:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318326.771676:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940234624:12345-0@lo:38:kworker.0 Request processed in 49us (352us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318326.771680:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16169
00000100:00100000:3.0:1767318326.771693:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16170
00000100:00100000:3.0:1767318326.771695:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940235264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318326.771701:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318326.771714:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940235264:12345-0@lo:38:kworker.0 Request processed in 18us (262us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318326.771717:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16170
00000100:00100000:3.0:1767318326.771723:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16171
00000100:00100000:3.0:1767318326.771725:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940235520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318326.771731:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318326.771741:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940235520:12345-0@lo:38:kworker.0 Request processed in 15us (241us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318326.771744:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16171
00000100:00080000:3.0:1767318326.771768:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318326.771786:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318326.771788:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940234624:0@lo:38:kworker.0
00000100:00080000:3.0:1767318326.771794:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318326.771796:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318326.771798:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940235264:0@lo:38:kworker.0
00000100:00080000:3.0:1767318326.771802:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318326.771804:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318326.771805:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940235520:0@lo:38:kworker.0
00000100:00100000:0.0:1767318326.771872:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940234752
00000100:00100000:0.0:1767318326.771877:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940234752
00000100:00100000:0.0:1767318326.771910:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925
00000100:00100000:0.0:1767318326.771914:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940234752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318326.771925:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318326.771952:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940234752:12345-0@lo:38:kworker.0 Request processed in 37us (552us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318326.771956:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925
00000100:00080000:3.0:1767318326.772249:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318326.772253:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318326.772256:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940234752:0@lo:38:kworker.0
00000100:00100000:2.0:1767318327.280117:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318327.727270:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318328.300891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318328.749002:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318329.325584:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235648:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318329.325670:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318329.325843:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318329.325864:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235648
00000100:00100000:1.0:1767318329.325873:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235648
00000100:00080000:3.0:1767318329.325936:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318329.325951:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034
00000100:00100000:1.0:1767318329.325962:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318329.325995:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318329.326050:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318329.326057:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034
00000100:00100000:3.0:1767318329.326352:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235648:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318329.416367:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318329.416541:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318329.417378:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256128
00000100:00100000:1.0:1767318329.417390:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256128
00000100:00100000:1.0:1767318329.417538:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256000
00000100:00100000:1.0:1767318329.417542:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256000
00000100:00100000:1.0:1767318329.417565:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3821
00000100:00100000:1.0:1767318329.417576:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894256128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318329.417666:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894256128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (1310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318329.417673:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3821
00000100:00100000:1.0:1767318329.417704:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16172
00000100:00100000:1.0:1767318329.417709:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894256000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318329.417728:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318329.417766:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894256000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 55us (1224us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318329.417794:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16172
00000100:00080000:3.0:1767318329.426671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318329.773114:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318330.348988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318330.349289:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318330.349306:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318330.349361:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318330.349634:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235776
00000100:00100000:1.0:1767318330.349642:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235776
00000100:00100000:1.0:1767318330.349716:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035
00000100:00100000:1.0:1767318330.349725:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318330.349756:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318330.349817:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940235776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (454us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318330.349824:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035
00000100:00080000:3.0:1767318330.349887:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318330.349932:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940235776:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318330.797072:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318331.372930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318331.825068:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318331.884918:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767318331.884921:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318306/real 1767318306]  req@ffff93d044018e00 x1853163940229376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318331.884926:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318331.884932:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318331.884940:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318331.884945:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318331.884950:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3576
00000100:00080000:1.0:1767318331.884955:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318331.884963:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318331.884964:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d044018e00 x1853163940229376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318331.884987:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318331.885013:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318331.885016:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2680 x1853163940235904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318331.885019:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940229376:0@lo:250:kworker.0
00000100:00080000:1.0:1767318331.885037:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318331.885041:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318331.885044:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318331.885048:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3576
00000100:00100000:0.0:1767318331.885051:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940235904:0@lo:38:kworker.0
00000100:00080000:1.0:1767318331.885052:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318331.885060:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318331.885074:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940236032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318331.885131:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318331.885153:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318331.885157:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318331.885159:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318331.885163:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3576
00000100:00080000:1.0:1767318331.885165:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318331.885170:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318331.885185:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940236544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318331.885192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940236032:0@lo:38:kworker.0
00000100:00080000:1.0:1767318331.885208:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318331.885211:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318331.885214:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318331.885217:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3576
00000100:00080000:1.0:1767318331.885219:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318331.885225:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318331.885229:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318331.885239:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9880 x1853163940236800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318331.885253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940236544:0@lo:38:kworker.0
00000100:00080000:1.0:1767318331.885254:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318331.885260:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318331.885263:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318331.885266:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3556
00000100:00080000:1.0:1767318331.885269:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318331.885272:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318331.885284:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940236928/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318331.885286:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318331.885308:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940236672:0@lo:400:kworker.0
00000100:00100000:0.0:1767318331.885311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940236800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318331.885353:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318331.885361:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940236288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318331.885384:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318331.885391:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940236416:0@lo:400:kworker.0
00000100:00100000:0.0:1767318331.885397:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318331.885425:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318331.885433:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318331.885441:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940236160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318331.885458:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940235904
00000100:00100000:1.0:1767318331.885466:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940235904
00000100:00100000:0.0:1767318331.885469:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318331.885507:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236544
00000100:00100000:1.0:1767318331.885511:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236544
00000100:00100000:0.0:1767318331.885518:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236672
00000100:00100000:0.0:1767318331.885524:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236672
00000100:00100000:1.0:1767318331.885528:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236416
00000100:00100000:1.0:1767318331.885532:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236416
00000100:00100000:1.0:1767318331.885563:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822
00000100:00100000:0.0:1767318331.885570:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823
00000100:00100000:1.0:1767318331.885574:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940236416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318331.885583:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940236672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318331.885632:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940236672:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318331.885645:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823
00000100:00100000:0.0:1767318331.885664:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16173
00000100:00100000:0.0:1767318331.885670:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940235904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318331.885688:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318331.885705:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16174
00000100:00100000:2.0:1767318331.885712:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940236544:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318331.885718:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940235904:12345-0@lo:38:kworker.0 Request processed in 45us (585us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318331.885725:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16173
00010000:00020000:2.0:1767318331.885727:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318331.885751:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236288
00000100:00100000:0.0:1767318331.885756:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236288
00000100:00100000:2.0:1767318331.885761:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940236544:12345-0@lo:38:kworker.0 Request processed in 48us (478us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318331.885769:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16174
00000100:00100000:3.0:1767318331.885874:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236032
00000100:00100000:3.0:1767318331.885879:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236032
00000100:00100000:0.0:1767318331.885888:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236160
00000100:00100000:0.0:1767318331.885893:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236160
00000100:00100000:3.0:1767318331.885906:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926
00000100:00100000:3.0:1767318331.885912:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940236032:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318331.885925:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318331.885926:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521
00000100:00100000:0.0:1767318331.885936:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940236288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318331.885959:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940236032:12345-0@lo:38:kworker.0 Request processed in 45us (733us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318331.885966:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926
00000100:00100000:0.0:1767318331.885982:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940236288:12345-0@lo:400:kworker.0 Request processed in 46us (587us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318331.885990:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521
00000100:00100000:0.0:1767318331.886007:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522
00000100:00080000:3.0:1767318331.886012:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318331.886014:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940236160:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318331.886018:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318331.886053:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940236160:12345-0@lo:400:kworker.0 Request processed in 40us (585us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318331.886061:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522
00000100:00100000:3.0:1767318331.886072:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318331.886102:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318331.886105:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940236160:0@lo:400:kworker.0
00000100:00080000:3.0:1767318331.886108:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318331.886115:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940236032:0@lo:38:kworker.0
00000100:00100000:0.0:1767318331.886126:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940236288:0@lo:400:kworker.0
00000100:00080000:3.0:1767318331.886128:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318331.886133:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318331.886138:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940235904:0@lo:38:kworker.0
00000100:00100000:3.0:1767318331.886157:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940236928:0@lo:250:kworker.0
00000100:00100000:0.0:1767318331.886161:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940236800
00000100:00100000:0.0:1767318331.886166:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940236800
00000400:00000100:3.0:1767318331.886181:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940236928 offset 0 length 520: 4
00000100:00100000:0.0:1767318331.886190:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16175
00000100:00100000:0.0:1767318331.886196:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940236800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318331.886207:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318331.886208:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318331.886214:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318331.886218:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940236544:0@lo:38:kworker.0
00000100:00080000:3.0:1767318331.886251:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318331.886255:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318331.886258:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940236800:0@lo:38:kworker.0
00000100:00100000:0.0:1767318331.886266:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940236800:12345-0@lo:38:kworker.0 Request processed in 67us (194us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318331.886273:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16175
00000100:00100000:1.0:1767318331.889925:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940236416:12345-0@lo:400:kworker.0 Request processed in 4343us (4490us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318331.889941:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822
00000100:00100000:3.0:1767318331.891149:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940236416:0@lo:400:kworker.0
00000100:00100000:3.0:1767318331.891166:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940236672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318332.397030:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318332.846328:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318333.420971:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318333.869143:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318334.444927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318334.445407:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940237056:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318334.445487:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318334.445814:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237056
00000100:00100000:2.0:1767318334.445822:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237056
00000100:00080000:3.0:1767318334.445899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318334.445931:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036
00000100:00100000:2.0:1767318334.445941:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940237056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318334.445969:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318334.446027:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940237056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (539us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318334.446034:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036
00000100:00100000:0.0:1767318334.446110:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940237056:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318334.543226:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318334.543291:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318334.545034:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256384
00000100:00100000:0.0:1767318334.545047:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256384
00000100:00100000:0.0:1767318334.545129:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256256
00000100:00100000:0.0:1767318334.545137:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256256
00000100:00100000:0.0:1767318334.545159:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3824
00000100:00100000:0.0:1767318334.545168:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894256384:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318334.545247:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894256384:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (2031us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318334.545256:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3824
00000100:00100000:0.0:1767318334.545274:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16176
00000100:00100000:0.0:1767318334.545278:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894256256:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318334.545298:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318334.545323:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894256256:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (2032us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318334.545330:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16176
00000100:00080000:3.0:1767318334.546534:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318334.893082:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318335.469664:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318335.469691:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940237184:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318335.469796:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318335.469944:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237184
00000100:00100000:2.0:1767318335.469952:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237184
00000100:00100000:2.0:1767318335.470012:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037
00000100:00100000:2.0:1767318335.470021:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940237184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318335.470050:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318335.470110:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940237184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318335.470117:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037
00000100:00080000:3.0:1767318335.470242:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318335.470276:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940237184:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318335.917127:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318336.494614:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318336.942846:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318337.005263:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318337.005274:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318337.005277:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318337.005281:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318337.005285:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318337.005295:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3581
00000100:00080000:1.0:1767318337.005302:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318337.005311:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318337.005354:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb800 x1853163940237312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318337.005378:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318337.005382:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318337.005384:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318337.005388:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3581
00000100:00080000:1.0:1767318337.005391:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318337.005397:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318337.005400:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940237312:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.005412:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f8700 x1853163940237440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318337.005493:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318337.005500:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1767318337.005501:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318337.005504:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318337.005509:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3581
00000100:00080000:1.0:1767318337.005512:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318337.005518:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318337.005533:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940237952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318337.005552:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318337.005554:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318337.005556:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318337.005559:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3581
00000100:00080000:1.0:1767318337.005562:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318337.005566:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318337.005580:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012680 x1853163940238208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318337.005595:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940237440:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.005619:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940237824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318337.005627:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318337.005659:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318337.005683:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318337.005689:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940238080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318337.005691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940237952:0@lo:38:kworker.0
00000100:00100000:0.0:1767318337.005722:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318337.005810:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237312
00000100:00100000:2.0:1767318337.005818:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237312
00000100:00100000:2.0:1767318337.005851:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237824
00000100:00100000:2.0:1767318337.005854:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237824
00000100:00100000:2.0:1767318337.005885:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237952
00000100:00100000:2.0:1767318337.005888:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237952
00000100:00100000:2.0:1767318337.005906:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825
00000100:00100000:2.0:1767318337.005917:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940237824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318337.006251:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16177
00000100:00100000:1.0:1767318337.006257:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940237312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318337.006277:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318337.006368:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940237568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.014968:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940237824:12345-0@lo:400:kworker.0 Request processed in 9027us (9282us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318337.014985:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825
00000100:00100000:2.0:1767318337.015024:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16178
00000100:00100000:2.0:1767318337.015030:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940237952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318337.015052:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318337.015092:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940237952:12345-0@lo:38:kworker.0 Request processed in 61us (9371us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318337.015099:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16178
00000100:00100000:2.0:1767318337.015163:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237440
00000100:00100000:2.0:1767318337.015170:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237440
00000100:00100000:2.0:1767318337.015206:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927
00000100:00100000:2.0:1767318337.015211:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940237440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318337.015222:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318337.015249:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940237440:12345-0@lo:38:kworker.0 Request processed in 38us (9622us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318337.015256:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927
00000100:00100000:2.0:1767318337.015285:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940237696:0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.015326:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318337.015387:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318337.015420:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318337.015641:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940237824:0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.015672:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238080
00000100:00100000:2.0:1767318337.015676:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238080
00000100:00100000:2.0:1767318337.015838:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826
00000100:00100000:2.0:1767318337.015845:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940238080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.015885:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940238080:12345-0@lo:400:kworker.0 Request processed in 41us (464us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318337.015892:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826
00000100:00080000:2.0:1767318337.015906:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318337.015924:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940238080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.015950:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237696
00000100:00100000:2.0:1767318337.015953:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237696
00000100:00100000:2.0:1767318337.016061:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523
00000100:00100000:2.0:1767318337.016068:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940237696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.016105:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940237696:12345-0@lo:400:kworker.0 Request processed in 38us (779us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318337.016111:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523
00000100:00080000:2.0:1767318337.016126:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318337.016143:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940237696:0@lo:400:kworker.0
00000100:00100000:1.0:1767318337.016267:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940237312:12345-0@lo:38:kworker.0 Request processed in 10007us (10768us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318337.016274:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16177
00000100:00100000:3.0:1767318337.016587:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318337.016871:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940237568
00000100:00100000:2.0:1767318337.016876:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940237568
00000100:00100000:2.0:1767318337.016919:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524
00000100:00100000:2.0:1767318337.016925:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940237568:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318337.017092:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318337.017180:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940237568:12345-0@lo:400:kworker.0 Request processed in 254us (593us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318337.017187:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524
00000100:00100000:3.0:1767318337.017255:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940237568:0@lo:400:kworker.0
00000100:00080000:0.0:1767318337.024851:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318337.024864:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318337.024869:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940237952:0@lo:38:kworker.0
00000100:00100000:0.0:1767318337.024881:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940238208:0@lo:38:kworker.0
00000100:00100000:0.0:1767318337.024944:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318337.024984:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318337.024989:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318337.024992:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940237312:0@lo:38:kworker.0
00000100:00080000:0.0:1767318337.025025:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318337.025028:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318337.025031:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940237440:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.025118:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238208
00000100:00100000:1.0:1767318337.025126:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238208
00000100:00100000:1.0:1767318337.025198:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16179
00000100:00100000:1.0:1767318337.025205:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940238208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318337.025227:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318337.025280:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940238208:12345-0@lo:38:kworker.0 Request processed in 75us (336us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318337.025288:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16179
00000100:00080000:0.0:1767318337.027873:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318337.027885:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318337.027890:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940238208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318337.517747:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318337.965055:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318338.541878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318338.989451:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318339.565178:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318339.565380:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318339.565402:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940238336:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318339.565515:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318339.565658:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238336
00000100:00100000:1.0:1767318339.565668:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238336
00000100:00100000:1.0:1767318339.565756:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038
00000100:00100000:1.0:1767318339.565766:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940238336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318339.565824:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318339.565871:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940238336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318339.565879:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038
00000100:00100000:0.0:1767318339.566222:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940238336:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318339.566408:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318339.659375:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318339.659424:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318339.661525:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256512
00000100:00100000:0.0:1767318339.661547:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256512
00000100:00100000:0.0:1767318339.661612:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256640
00000100:00100000:0.0:1767318339.661616:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256640
00000100:00100000:0.0:1767318339.661694:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3827
00000100:00100000:0.0:1767318339.661704:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894256640:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318339.661804:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894256640:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (2378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318339.661812:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3827
00000100:00100000:0.0:1767318339.661830:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16180
00000100:00100000:0.0:1767318339.661834:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894256512:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318339.661855:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318339.661882:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894256512:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (2517us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318339.661889:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16180
00000100:00080000:1.0:1767318339.662827:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318340.013159:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318340.588918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318340.589150:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940238464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318340.589233:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318340.590168:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238464
00000100:00100000:2.0:1767318340.590178:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238464
00000100:00100000:2.0:1767318340.590259:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039
00000100:00100000:2.0:1767318340.590270:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940238464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318340.590306:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318340.590384:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940238464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1150us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318340.590392:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039
00000100:00080000:1.0:1767318340.590594:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318340.593114:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940238464:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318341.037073:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318341.617930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318342.062572:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318342.125868:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318342.125879:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318342.125881:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318342.125885:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318342.125890:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318342.125897:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3587
00000100:00080000:2.0:1767318342.125902:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318342.125909:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318342.125950:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223100 x1853163940238592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318342.125978:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318342.125982:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318342.125983:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318342.125987:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3587
00000100:00080000:2.0:1767318342.125989:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318342.125992:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318342.126005:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940238720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318342.126306:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940238592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318342.126376:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318342.126478:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940238720:0@lo:38:kworker.0
00000100:00100000:3.0:1767318342.126506:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318342.126561:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238720
00000100:00100000:3.0:1767318342.126568:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238720
00000100:00100000:3.0:1767318342.126602:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928
00000100:00100000:3.0:1767318342.126609:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940238720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318342.126629:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318342.126666:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940238720:12345-0@lo:38:kworker.0 Request processed in 56us (158us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318342.126672:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928
00000100:00080000:3.0:1767318342.126819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318342.126823:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318342.126826:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940238720:0@lo:38:kworker.0
00000100:00100000:1.0:1767318342.126901:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940238848:0@lo:400:kworker.0
00000100:00100000:1.0:1767318342.126932:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.127002:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238592
00000100:00100000:0.0:1767318342.127007:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238592
00000100:00100000:0.0:1767318342.127032:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16181
00000100:00100000:0.0:1767318342.127047:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940238592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318342.127057:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318342.127101:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940238592:12345-0@lo:38:kworker.0 Request processed in 63us (725us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318342.127107:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16181
00000100:00100000:3.0:1767318342.127311:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238848
00000100:00100000:3.0:1767318342.127316:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238848
00000100:00100000:3.0:1767318342.127358:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525
00000100:00100000:3.0:1767318342.127367:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940238848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.128222:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940238976:0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.128266:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.128322:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940238976
00000100:00100000:0.0:1767318342.128327:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940238976
00000100:00100000:0.0:1767318342.128362:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526
00000100:00100000:0.0:1767318342.128370:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940238976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.128431:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940238976:12345-0@lo:400:kworker.0 Request processed in 61us (164us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318342.128437:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526
00000100:00100000:0.0:1767318342.128479:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940238976:0@lo:400:kworker.0
00000100:00080000:0.0:1767318342.128533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318342.128539:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318342.128542:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940238592:0@lo:38:kworker.0
00000100:00080000:0.0:1767318342.128566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318342.128570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318342.136351:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318342.136359:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318342.136363:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318342.136370:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3587
00000100:00080000:2.0:1767318342.136375:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318342.136381:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318342.136413:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940239232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318342.136440:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318342.136443:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318342.136445:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318342.136448:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3587
00000100:00080000:2.0:1767318342.136450:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318342.136454:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318342.136463:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222300 x1853163940239488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318342.136501:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940239360:0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.136575:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318342.136620:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318342.136626:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940239104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.136649:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318342.136682:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239360
00000100:00100000:2.0:1767318342.136690:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239360
00000100:00100000:2.0:1767318342.136755:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239104
00000100:00100000:2.0:1767318342.136758:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239104
00000100:00100000:2.0:1767318342.137180:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828
00000100:00100000:2.0:1767318342.137191:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940239360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.137249:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940239360:12345-0@lo:400:kworker.0 Request processed in 60us (673us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318342.137257:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828
00000100:00100000:2.0:1767318342.137272:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829
00000100:00100000:2.0:1767318342.137279:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940239104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.137305:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940239104:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318342.137310:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829
00000100:00100000:2.0:1767318342.137352:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940239104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.137364:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940239360:0@lo:400:kworker.0
00000100:00080000:2.0:1767318342.137387:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318342.137414:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940239232:0@lo:38:kworker.0
00000100:00100000:2.0:1767318342.137443:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318342.137458:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940239488:0@lo:38:kworker.0
00000100:00100000:2.0:1767318342.137476:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318342.137501:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239232
00000100:00100000:2.0:1767318342.137505:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239232
00000100:00100000:2.0:1767318342.137525:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239488
00000100:00100000:2.0:1767318342.137528:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239488
00000100:00100000:2.0:1767318342.137539:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16182
00000100:00100000:2.0:1767318342.137543:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940239232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318342.137562:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318342.137593:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940239232:12345-0@lo:38:kworker.0 Request processed in 48us (151us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318342.137599:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16182
00000100:00100000:2.0:1767318342.137612:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16183
00000100:00100000:2.0:1767318342.137616:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940239488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318342.137625:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318342.137648:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940239488:12345-0@lo:38:kworker.0 Request processed in 30us (171us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318342.137653:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16183
00000100:00080000:2.0:1767318342.137683:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318342.137687:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318342.137690:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940239232:0@lo:38:kworker.0
00000100:00080000:2.0:1767318342.137698:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318342.137701:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318342.137703:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940239488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318342.142588:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940238848:12345-0@lo:400:kworker.0 Request processed in 15214us (15645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318342.142603:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525
00000100:00100000:1.0:1767318342.145902:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940238848:0@lo:400:kworker.0
00000100:00100000:3.0:1767318342.637497:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318343.090661:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318343.660947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318344.110912:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318344.685157:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318344.688298:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318344.688322:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940239616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318344.688404:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318344.688540:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239616
00000100:00100000:3.0:1767318344.688548:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239616
00000100:00100000:3.0:1767318344.688616:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040
00000100:00100000:3.0:1767318344.688625:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940239616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318344.688655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318344.688703:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940239616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318344.688709:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040
00000100:00100000:3.0:1767318344.688755:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940239616:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318344.689214:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318344.774749:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318344.774872:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256896
00000100:00100000:2.0:1767318344.774882:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256896
00000100:00100000:2.0:1767318344.774954:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3830
00000100:00100000:2.0:1767318344.774962:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894256896:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318344.775030:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894256896:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318344.775038:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3830
00000100:00080000:0.0:1767318344.775280:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318344.776537:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318344.776654:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894256768
00000100:00100000:2.0:1767318344.776663:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894256768
00000100:00100000:2.0:1767318344.776711:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16184
00000100:00100000:2.0:1767318344.776718:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894256768:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318344.776741:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318344.776833:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894256768:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 113us (302us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318344.776841:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16184
00010000:00010000:1.0:1767318345.133680:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318345.709022:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318345.709393:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940239744:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318345.709480:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318345.709623:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239744
00000100:00100000:0.0:1767318345.709632:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239744
00000100:00100000:0.0:1767318345.709705:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041
00000100:00100000:0.0:1767318345.709716:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940239744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318345.709745:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318345.709820:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940239744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (340us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318345.709831:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041
00000100:00100000:3.0:1767318345.709925:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940239744:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318345.710347:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318346.157089:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318346.732886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318347.181011:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318347.245439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318347.245448:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318347.245451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318347.245455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318347.245460:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318347.245468:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3592
00000100:00080000:0.0:1767318347.245474:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318347.245481:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318347.245523:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940239872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318347.245550:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318347.245554:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318347.245555:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318347.245559:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3592
00000100:00080000:0.0:1767318347.245561:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318347.245564:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318347.245580:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838000 x1853163940240000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318347.245645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318347.245649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318347.245651:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318347.245654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3592
00000100:00080000:0.0:1767318347.245657:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318347.245661:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318347.245675:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838e00 x1853163940240512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318347.245692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318347.245695:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318347.245697:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318347.245700:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3592
00000100:00080000:0.0:1767318347.245702:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318347.245705:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318347.245714:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5880 x1853163940240768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318347.245738:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940240384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318347.245823:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.245953:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940240256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.245988:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.246046:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318347.246052:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940240128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.246073:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.246116:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240256
00000100:00100000:1.0:1767318347.246123:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240256
00000100:00100000:1.0:1767318347.246175:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240128
00000100:00100000:1.0:1767318347.246178:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240128
00000100:00100000:1.0:1767318347.246204:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527
00000100:00100000:1.0:1767318347.246212:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940240256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.246260:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940240256:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.246271:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527
00000100:00100000:1.0:1767318347.246287:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528
00000100:00100000:1.0:1767318347.246292:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940240128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.246317:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940240128:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.246323:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528
00000100:00080000:1.0:1767318347.246338:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318347.246341:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318347.246390:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940240128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.246402:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940240256:0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.246490:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940239872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318347.246527:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940240640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.246677:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240384
00000100:00100000:1.0:1767318347.246681:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240384
00000100:00100000:1.0:1767318347.246717:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831
00000100:00100000:1.0:1767318347.246723:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940240384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.260216:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318347.260311:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240640
00000100:00100000:3.0:1767318347.260320:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240640
00000100:00100000:3.0:1767318347.260385:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832
00000100:00100000:3.0:1767318347.260396:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940240640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.260471:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940240640:12345-0@lo:400:kworker.0 Request processed in 78us (262us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318347.260490:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832
00000100:00100000:3.0:1767318347.260555:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940240640:0@lo:400:kworker.0
00000100:00080000:3.0:1767318347.260591:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318347.266869:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940240384:12345-0@lo:400:kworker.0 Request processed in 20136us (21036us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.266883:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831
00000100:00100000:0.0:1767318347.270047:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940240384:0@lo:400:kworker.0
00000100:00100000:2.0:1767318347.271932:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318347.272063:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940240000:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.272130:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318347.272157:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940240512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.272182:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318347.272239:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240000
00000100:00100000:3.0:1767318347.272247:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240000
00000100:00100000:3.0:1767318347.272294:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929
00000100:00100000:3.0:1767318347.272300:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940240000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318347.272323:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318347.272372:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940240000:12345-0@lo:38:kworker.0 Request processed in 71us (241us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318347.272380:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929
00000100:00100000:2.0:1767318347.281282:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940240768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.281366:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.281527:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940239872
00000100:00100000:1.0:1767318347.281538:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940239872
00000100:00100000:3.0:1767318347.281659:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240512
00000100:00100000:3.0:1767318347.281665:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240512
00000100:00100000:3.0:1767318347.281724:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16185
00000100:00100000:3.0:1767318347.281732:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940240512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318347.281755:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318347.281826:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940240512:12345-0@lo:38:kworker.0 Request processed in 93us (9641us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318347.281835:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16185
00000100:00100000:3.0:1767318347.281894:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16186
00000100:00100000:3.0:1767318347.281900:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940239872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318347.281913:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318347.281964:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940239872:12345-0@lo:38:kworker.0 Request processed in 62us (10037us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318347.281971:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16186
00000100:00080000:2.0:1767318347.295425:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.295439:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.295444:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940239872:0@lo:38:kworker.0
00000100:00080000:2.0:1767318347.295460:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.295464:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.295466:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940240000:0@lo:38:kworker.0
00000100:00080000:2.0:1767318347.295477:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.295479:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.295482:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940240512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318347.297462:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240768
00000100:00100000:3.0:1767318347.298014:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240768
00000100:00100000:3.0:1767318347.298426:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16187
00000100:00100000:3.0:1767318347.298435:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940240768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318347.298459:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318347.299229:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940240768:12345-0@lo:38:kworker.0 Request processed in 790us (17869us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318347.299237:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16187
00000100:00080000:2.0:1767318347.299386:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.299392:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.299396:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940240768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.756897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318348.205102:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318348.781437:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318349.229085:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318349.806248:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940240896:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318349.806315:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318349.806471:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940240896
00000100:00100000:2.0:1767318349.806480:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940240896
00000100:00100000:2.0:1767318349.806541:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042
00000100:00100000:2.0:1767318349.806550:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940240896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318349.806580:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318349.806623:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940240896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318349.806631:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042
00000100:00080000:0.0:1767318349.806706:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318349.806743:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940240896:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318349.806828:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318349.895410:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767318349.895446:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894257280 offset 0 length 520: 4
00000100:00100000:2.0:1767318349.895472:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318349.895561:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257024
00000100:00100000:0.0:1767318349.895571:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257024
00000100:00100000:0.0:1767318349.895625:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257152
00000100:00100000:0.0:1767318349.895628:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257152
00000100:00100000:0.0:1767318349.895684:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3833
00000100:00100000:0.0:1767318349.895694:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894257152:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318349.895769:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894257152:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318349.895817:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3833
00000100:00100000:0.0:1767318349.895835:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16188
00000100:00100000:0.0:1767318349.895840:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894257024:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318349.895860:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318349.895886:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894257024:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (487us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318349.895893:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16188
00000100:00080000:2.0:1767318349.896109:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318350.253068:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318350.830587:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940241024:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318350.830657:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318350.831975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318350.835101:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241024
00000100:00100000:2.0:1767318350.835113:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241024
00000100:00100000:2.0:1767318350.835228:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043
00000100:00100000:2.0:1767318350.835238:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940241024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318350.835270:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318350.835386:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940241024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (4729us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318350.835393:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043
00000100:00100000:1.0:1767318350.835857:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940241024:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318350.842664:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318351.278050:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318351.854084:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318352.301089:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318352.369055:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.369065:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318352.369068:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.369072:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.369076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.369084:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3597
00000100:00080000:1.0:1767318352.369088:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.369095:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318352.369152:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011f80 x1853163940241152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318352.369188:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.369192:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.369194:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.369197:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3597
00000100:00080000:1.0:1767318352.369200:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.369204:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318352.369219:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940241280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318352.369288:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.369291:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.369293:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.369296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3597
00000100:00080000:1.0:1767318352.369298:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.369302:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318352.369369:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940241792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318352.369377:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940241536:0@lo:400:kworker.0
00000100:00080000:1.0:1767318352.369402:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.369405:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.369407:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.369411:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3597
00000100:00080000:1.0:1767318352.369414:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.369418:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318352.369431:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940242048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318352.369445:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.369463:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940241920:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369503:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318352.369508:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318352.369511:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940241408:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369534:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.369542:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318352.369552:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940241664:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369565:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241536
00000100:00100000:3.0:1767318352.369571:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241536
00000100:00100000:1.0:1767318352.369578:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.369611:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241920
00000100:00100000:3.0:1767318352.369613:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241408
00000100:00100000:1.0:1767318352.369616:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241920
00000100:00100000:3.0:1767318352.369617:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241408
00000100:00100000:1.0:1767318352.369655:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241664
00000100:00100000:3.0:1767318352.369659:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529
00000100:00100000:1.0:1767318352.369660:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241664
00000100:00100000:3.0:1767318352.369674:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940241536:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.369688:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834
00000100:00100000:1.0:1767318352.369697:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940241920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369735:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940241536:12345-0@lo:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318352.369743:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529
00000100:00100000:1.0:1767318352.369749:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940241920:12345-0@lo:400:kworker.0 Request processed in 50us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318352.369757:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834
00000100:00100000:3.0:1767318352.369769:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1767318352.369810:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835
00000100:00100000:3.0:1767318352.369814:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940241408:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.369823:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940241664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369841:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940241408:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318352.369845:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1767318352.369863:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940241664:12345-0@lo:400:kworker.0 Request processed in 43us (284us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318352.369870:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835
00000100:00100000:3.0:1767318352.369889:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940241408:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.369897:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940241536:0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.369923:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940241664:0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.369934:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940241920:0@lo:400:kworker.0
00000100:00100000:2.0:1767318352.370205:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940241152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.370238:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.370263:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940241280:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.370286:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.370321:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940241792:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.370342:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.370364:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241152
00000100:00100000:2.0:1767318352.370368:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241152
00000100:00100000:2.0:1767318352.370388:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241792
00000100:00100000:2.0:1767318352.370391:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241792
00000100:00100000:2.0:1767318352.370406:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16189
00000100:00100000:2.0:1767318352.370410:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940241152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318352.370429:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318352.370458:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940241152:12345-0@lo:38:kworker.0 Request processed in 47us (221us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318352.370464:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16189
00000100:00100000:2.0:1767318352.370477:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16190
00000100:00100000:2.0:1767318352.370481:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940241792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318352.370489:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318352.370511:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940241792:12345-0@lo:38:kworker.0 Request processed in 29us (168us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318352.370516:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16190
00000100:00080000:2.0:1767318352.370549:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318352.370554:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318352.370558:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940241792:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.370567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940242048:0@lo:38:kworker.0
00000100:00100000:3.0:1767318352.370569:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940241280
00000100:00100000:3.0:1767318352.370575:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940241280
00000100:00100000:2.0:1767318352.370598:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318352.370605:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930
00000100:00100000:3.0:1767318352.370610:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940241280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318352.370620:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318352.370623:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242048
00000100:00100000:2.0:1767318352.370627:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242048
00000100:00100000:3.0:1767318352.370646:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940241280:12345-0@lo:38:kworker.0 Request processed in 36us (360us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318352.370654:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16191
00000100:00100000:3.0:1767318352.370654:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930
00000100:00100000:2.0:1767318352.370665:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940242048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318352.370676:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318352.370701:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318352.370707:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318352.370711:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940242048:12345-0@lo:38:kworker.0 Request processed in 45us (112us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318352.370714:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940241152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.370724:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16191
00000100:00080000:3.0:1767318352.370731:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318352.370735:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318352.370738:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940241280:0@lo:38:kworker.0
00000100:00080000:3.0:1767318352.370746:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318352.370750:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318352.370753:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940242048:0@lo:38:kworker.0
00000100:00080000:0.0:1767318352.370891:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318352.370897:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318352.370899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318352.880154:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318353.325030:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318353.901590:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318354.351806:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318354.925104:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318354.926817:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940242176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318354.926897:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318354.927027:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242176
00000100:00100000:2.0:1767318354.927037:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242176
00000100:00100000:2.0:1767318354.927106:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044
00000100:00100000:2.0:1767318354.927115:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940242176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318354.927146:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318354.927193:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940242176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318354.927200:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044
00000100:00080000:0.0:1767318354.927399:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318354.927445:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940242176:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318355.017771:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318355.018447:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257536
00000100:00100000:1.0:1767318355.018458:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257536
00000100:00100000:1.0:1767318355.018540:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3836
00000100:00100000:1.0:1767318355.018552:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894257536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318355.018570:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318355.018636:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894257536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (874us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318355.018639:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257408
00000100:00100000:3.0:1767318355.018646:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257408
00000100:00100000:1.0:1767318355.018647:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3836
00000100:00100000:1.0:1767318355.018672:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16192
00000100:00100000:1.0:1767318355.018680:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894257408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318355.018701:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318355.018728:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894257408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (160us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318355.018734:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16192
00000100:00080000:0.0:1767318355.018920:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318355.373001:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318355.951429:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318355.951916:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318355.951938:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940242304:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318355.952001:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318355.952599:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242304
00000100:00100000:2.0:1767318355.952609:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242304
00000100:00080000:0.0:1767318355.953389:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318355.953569:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045
00000100:00100000:2.0:1767318355.953583:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940242304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318355.953617:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318355.953835:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940242304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 257us (1833us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318355.953843:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045
00000100:00100000:0.0:1767318355.953940:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940242304:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318356.397059:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318356.461237:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318331/real 1767318331]  req@ffff93d0737f9f80 x1853163940236928/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318356.461271:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0737f9f80 x1853163940236928/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318356 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318356.461321:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318356.461414:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318356.461418:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940236928:0@lo:250:kworker.0
00000100:00080000:1.0:1767318356.462601:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318356.462608:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318356.462612:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318356.462618:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3581
00000100:00080000:1.0:1767318356.462622:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318356.462628:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318356.462672:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011180 x1853163940242432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318356.462706:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318356.462710:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318356.462712:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318356.462716:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3602
00000100:00080000:1.0:1767318356.462718:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318356.462721:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318356.462736:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940242560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318356.462745:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318356.462748:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318356.462749:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318356.462752:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3602
00000100:00080000:1.0:1767318356.462754:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318356.462757:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318356.462767:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940242688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318356.463043:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940242816:0@lo:400:kworker.0
00000100:00100000:0.0:1767318356.463113:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318356.463233:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242816
00000100:00100000:2.0:1767318356.463241:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242816
00000100:00100000:2.0:1767318356.463310:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531
00000100:00100000:2.0:1767318356.463319:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940242816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318356.463414:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940242432:0@lo:250:kworker.0
00000400:00000100:3.0:1767318356.463438:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940242432 offset 0 length 520: 4
00000100:00100000:3.0:1767318356.463456:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940242560:0@lo:38:kworker.0
00000100:00100000:3.0:1767318356.463479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318356.463497:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940242688:0@lo:38:kworker.0
00000100:00100000:3.0:1767318356.463515:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318356.463544:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242688
00000100:00100000:3.0:1767318356.463548:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242688
00000100:00100000:3.0:1767318356.463569:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931
00000100:00100000:3.0:1767318356.463574:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940242688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318356.463593:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318356.463626:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940242688:12345-0@lo:38:kworker.0 Request processed in 51us (110us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318356.463633:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931
00000100:00080000:3.0:1767318356.463671:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318356.463675:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318356.463693:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940242688:0@lo:38:kworker.0
00000100:00100000:3.0:1767318356.463735:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242560
00000100:00100000:3.0:1767318356.463738:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242560
00000100:00100000:3.0:1767318356.463759:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16193
00000100:00100000:3.0:1767318356.463763:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940242560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318356.463790:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318356.463832:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940242560:12345-0@lo:38:kworker.0 Request processed in 66us (351us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318356.463838:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16193
00000100:00080000:3.0:1767318356.463860:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318356.463876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318356.463879:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940242560:0@lo:38:kworker.0
00000100:00080000:3.0:1767318356.463906:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318356.464558:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940242944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318356.464604:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318356.464636:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940242944
00000100:00100000:3.0:1767318356.464640:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940242944
00000100:00100000:3.0:1767318356.464667:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532
00000100:00100000:3.0:1767318356.464672:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940242944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318356.465363:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940242944:12345-0@lo:400:kworker.0 Request processed in 689us (771us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318356.465371:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532
00000100:00100000:3.0:1767318356.465410:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940242944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.471670:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940242816:12345-0@lo:400:kworker.0 Request processed in 8342us (8546us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318356.471695:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531
00000100:00080000:1.0:1767318356.473266:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318356.473282:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318356.473286:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318356.473294:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3602
00000100:00080000:1.0:1767318356.473300:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318356.473306:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318356.473330:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940243200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318356.473371:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318356.473374:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318356.473376:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318356.473380:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3602
00000100:00080000:1.0:1767318356.473382:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318356.473386:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318356.473396:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011f80 x1853163940243456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318356.473440:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940243200:0@lo:38:kworker.0
00000100:00100000:1.0:1767318356.473498:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318356.473533:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940243456:0@lo:38:kworker.0
00000100:00100000:1.0:1767318356.473554:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318356.473592:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243200
00000100:00100000:1.0:1767318356.473600:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243200
00000100:00100000:1.0:1767318356.473628:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243456
00000100:00100000:1.0:1767318356.473631:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243456
00000100:00100000:1.0:1767318356.473663:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16194
00000100:00100000:1.0:1767318356.473670:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940243200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318356.473697:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318356.473736:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940243200:12345-0@lo:38:kworker.0 Request processed in 65us (236us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318356.473746:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16194
00000100:00100000:1.0:1767318356.473762:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16195
00000100:00100000:1.0:1767318356.473766:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940243456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318356.473792:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318356.473825:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940243456:12345-0@lo:38:kworker.0 Request processed in 58us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318356.473830:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16195
00000100:00080000:1.0:1767318356.473882:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318356.473886:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318356.473890:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940243200:0@lo:38:kworker.0
00000100:00080000:1.0:1767318356.473899:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318356.473902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318356.473905:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940243456:0@lo:38:kworker.0
00000100:00100000:2.0:1767318356.474659:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940243072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.474707:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318356.474743:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318356.474749:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940243328:0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.474770:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318356.475210:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243072
00000100:00100000:2.0:1767318356.475215:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243072
00000100:00100000:2.0:1767318356.475262:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243328
00000100:00100000:2.0:1767318356.475265:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243328
00000100:00100000:2.0:1767318356.475298:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837
00000100:00100000:2.0:1767318356.475305:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940243072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.475367:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940243072:12345-0@lo:400:kworker.0 Request processed in 62us (659us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318356.475374:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837
00000100:00100000:2.0:1767318356.475388:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838
00000100:00100000:2.0:1767318356.475393:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940243328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.475419:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940243328:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318356.475424:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838
00000100:00100000:2.0:1767318356.475456:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940243328:0@lo:400:kworker.0
00000100:00100000:2.0:1767318356.475466:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940243072:0@lo:400:kworker.0
00000100:00080000:3.0:1767318356.475838:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318356.479580:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940242816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318356.972965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318357.421004:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318357.996936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318358.445979:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318359.020915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318359.469498:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318360.044891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318360.045209:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940243584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318360.045309:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318360.045446:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243584
00000100:00100000:3.0:1767318360.045454:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243584
00000100:00100000:3.0:1767318360.045516:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046
00000100:00100000:3.0:1767318360.045527:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940243584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318360.045558:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318360.045802:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318360.046083:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940243584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 558us (773us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318360.046091:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046
00000100:00100000:0.0:1767318360.046166:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940243584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318360.139434:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318360.139554:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257664
00000100:00100000:2.0:1767318360.139563:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257664
00000100:00100000:2.0:1767318360.139614:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16196
00000100:00100000:2.0:1767318360.139622:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894257664:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318360.139645:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318360.139716:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894257664:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 93us (292us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318360.139723:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16196
00000100:00100000:2.0:1767318360.169961:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318360.170052:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257792
00000100:00100000:3.0:1767318360.170062:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257792
00000100:00100000:3.0:1767318360.170145:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3839
00000100:00100000:3.0:1767318360.170158:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894257792:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318360.170248:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894257792:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318360.170256:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3839
00000100:00080000:1.0:1767318360.170707:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318360.494389:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318361.068898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318361.069164:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940243712:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318361.069245:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318361.069350:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243712
00000100:00100000:0.0:1767318361.069358:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243712
00000100:00100000:0.0:1767318361.069426:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047
00000100:00100000:0.0:1767318361.069436:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940243712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318361.069464:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318361.069495:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318361.069692:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940243712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 257us (457us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318361.069701:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047
00000100:00100000:3.0:1767318361.069768:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940243712:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318361.517302:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318361.581102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318361.581113:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318361.581116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318361.581120:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318361.581125:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318361.581132:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3606
00000100:00080000:2.0:1767318361.581136:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318361.581143:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318361.581182:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2300 x1853163940243840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318361.581208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318361.581211:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318361.581213:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318361.581216:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3606
00000100:00080000:2.0:1767318361.581218:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318361.581221:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318361.581242:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1f80 x1853163940243968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318361.581265:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940243840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318361.581313:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940244096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318361.581335:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318361.581390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940243968:0@lo:38:kworker.0
00000100:00100000:1.0:1767318361.581415:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318361.581451:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243968
00000100:00100000:1.0:1767318361.581458:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243968
00000100:00100000:1.0:1767318361.581506:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932
00000100:00100000:1.0:1767318361.581513:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940243968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318361.581532:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318361.581581:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940243968:12345-0@lo:38:kworker.0 Request processed in 67us (164us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318361.581587:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932
00000100:00080000:1.0:1767318361.581626:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318361.581631:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318361.581634:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940243968:0@lo:38:kworker.0
00000100:00100000:1.0:1767318361.581676:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940243840
00000100:00100000:1.0:1767318361.581680:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940243840
00000100:00100000:1.0:1767318361.581702:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16197
00000100:00100000:1.0:1767318361.581706:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940243840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318361.581717:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318361.581747:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940243840:12345-0@lo:38:kworker.0 Request processed in 39us (412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318361.581753:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16197
00000100:00080000:1.0:1767318361.581791:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318361.581795:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318361.581796:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318361.581798:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940243840:0@lo:38:kworker.0
00000100:00100000:1.0:1767318361.581822:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244096
00000100:00100000:1.0:1767318361.581825:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244096
00000100:00100000:1.0:1767318361.581912:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533
00000100:00100000:1.0:1767318361.581919:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940244096:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318361.581993:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940244224:0@lo:400:kworker.0
00000100:00100000:0.0:1767318361.582023:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318361.582053:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244224
00000100:00100000:0.0:1767318361.582056:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244224
00000100:00100000:0.0:1767318361.582090:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840
00000100:00100000:0.0:1767318361.582096:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940244224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318361.582127:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940244224:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318361.582132:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840
00000100:00080000:0.0:1767318361.582148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318361.582167:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940244224:0@lo:400:kworker.0
00000100:00080000:2.0:1767318361.586175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318361.586188:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318361.586193:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318361.586201:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3606
00000100:00080000:2.0:1767318361.586206:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318361.586213:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318361.586267:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940244352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318361.586321:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318361.586325:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318361.586337:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318361.586341:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3606
00000100:00080000:2.0:1767318361.586344:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318361.586349:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318361.586363:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3b80 x1853163940244608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318361.586405:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940244480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318361.586471:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318361.586721:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244480
00000100:00100000:0.0:1767318361.586740:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244480
00000100:00100000:0.0:1767318361.586828:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841
00000100:00100000:0.0:1767318361.586837:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940244480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318361.586893:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940244480:12345-0@lo:400:kworker.0 Request processed in 58us (422us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318361.586901:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841
00000100:00080000:0.0:1767318361.586922:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318361.586955:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940244352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318361.586983:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318361.587003:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940244608:0@lo:38:kworker.0
00000100:00100000:0.0:1767318361.587025:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318361.587053:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244352
00000100:00100000:0.0:1767318361.587057:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244352
00000100:00100000:0.0:1767318361.587077:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244608
00000100:00100000:0.0:1767318361.587079:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244608
00000100:00100000:0.0:1767318361.587095:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16198
00000100:00100000:0.0:1767318361.587100:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318361.587120:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318361.587154:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244352:12345-0@lo:38:kworker.0 Request processed in 53us (170us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318361.587160:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16198
00000100:00100000:0.0:1767318361.587173:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16199
00000100:00100000:0.0:1767318361.587176:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318361.587185:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318361.587207:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244608:12345-0@lo:38:kworker.0 Request processed in 29us (181us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318361.587216:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16199
00000100:00080000:0.0:1767318361.587257:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318361.587261:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318361.587264:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940244352:0@lo:38:kworker.0
00000100:00080000:0.0:1767318361.587272:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318361.587275:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318361.587277:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940244608:0@lo:38:kworker.0
00000100:00100000:2.0:1767318361.587804:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940244480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318361.588606:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940244096:12345-0@lo:400:kworker.0 Request processed in 6683us (6805us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318361.588617:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533
00000100:00100000:3.0:1767318361.589316:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940244096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318362.092946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318362.542013:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318363.117970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318363.565856:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318364.140900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318364.589146:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318365.166593:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940244736:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318365.166665:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318365.166903:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244736
00000100:00100000:2.0:1767318365.166912:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244736
00000100:00100000:2.0:1767318365.166975:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048
00000100:00100000:2.0:1767318365.166984:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940244736:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318365.167014:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318365.167064:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940244736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (398us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318365.167080:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048
00000100:00100000:2.0:1767318365.167126:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940244736:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318365.167252:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318365.169838:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318365.258937:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318365.258988:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318365.259080:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894257920
00000100:00100000:1.0:1767318365.259091:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894257920
00000100:00100000:1.0:1767318365.259140:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258048
00000100:00100000:1.0:1767318365.259143:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258048
00000100:00100000:1.0:1767318365.259209:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3842
00000100:00100000:1.0:1767318365.259219:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894258048:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318365.259296:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894258048:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318365.259304:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3842
00000100:00080000:3.0:1767318365.259327:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318365.259337:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16200
00000100:00100000:1.0:1767318365.259344:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894257920:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318365.259363:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318365.259387:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894257920:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (460us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318365.259393:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16200
00010000:00010000:1.0:1767318365.613766:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318366.188914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318366.189286:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318366.206567:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940244864:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318366.206641:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318366.207591:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244864
00000100:00100000:2.0:1767318366.207601:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244864
00000100:00100000:2.0:1767318366.207675:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049
00000100:00100000:2.0:1767318366.207686:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940244864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318366.207716:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318366.207827:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940244864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (1185us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318366.207834:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049
00000100:00100000:1.0:1767318366.207963:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940244864:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318366.208291:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318366.637469:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318366.701215:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318366.701227:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318366.701230:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318366.701233:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318366.701237:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318366.701245:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3611
00000100:00080000:2.0:1767318366.701249:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318366.701256:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318366.701310:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2d80 x1853163940244992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318366.701327:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318366.701330:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318366.701331:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318366.701335:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3611
00000100:00080000:2.0:1767318366.701337:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318366.701340:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318366.701356:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0a80 x1853163940245120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318366.701409:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318366.701412:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318366.701414:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318366.701417:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3611
00000100:00080000:2.0:1767318366.701420:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318366.701424:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318366.701435:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940245504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318366.701450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318366.701452:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318366.701454:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318366.701457:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3611
00000100:00080000:2.0:1767318366.701459:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318366.701462:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318366.701472:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0e00 x1853163940245760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318366.701497:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940245632:0@lo:400:kworker.0
00000100:00100000:2.0:1767318366.701567:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318366.701627:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318366.701634:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940245376:0@lo:400:kworker.0
00000100:00100000:2.0:1767318366.701655:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318366.701676:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318366.701684:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940245248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318366.701709:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318366.701801:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940244992:0@lo:38:kworker.0
00000100:00100000:0.0:1767318366.701831:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318366.701856:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940245120:0@lo:38:kworker.0
00000100:00100000:0.0:1767318366.701877:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318366.701892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940245504:0@lo:38:kworker.0
00000100:00100000:0.0:1767318366.701910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318366.701923:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940245760:0@lo:38:kworker.0
00000100:00100000:0.0:1767318366.701941:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318366.701986:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245632
00000100:00100000:0.0:1767318366.701993:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245632
00000100:00100000:0.0:1767318366.702042:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245376
00000100:00100000:0.0:1767318366.702045:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245376
00000100:00100000:0.0:1767318366.702061:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940244992
00000100:00100000:0.0:1767318366.702063:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940244992
00000100:00100000:0.0:1767318366.702071:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245504
00000100:00100000:0.0:1767318366.702073:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245504
00000100:00100000:0.0:1767318366.702080:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245760
00000100:00100000:0.0:1767318366.702082:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245760
00000100:00100000:0.0:1767318366.702095:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843
00000100:00100000:0.0:1767318366.702103:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940245632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318366.702153:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940245632:12345-0@lo:400:kworker.0 Request processed in 51us (586us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318366.702160:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843
00000100:00100000:0.0:1767318366.702177:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844
00000100:00100000:0.0:1767318366.702192:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940245376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318366.702217:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940245376:12345-0@lo:400:kworker.0 Request processed in 27us (561us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318366.702223:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844
00000100:00100000:0.0:1767318366.702234:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16201
00000100:00100000:0.0:1767318366.702238:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318366.702255:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318366.702283:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940244992:12345-0@lo:38:kworker.0 Request processed in 44us (451us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318366.702289:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16201
00000100:00100000:0.0:1767318366.702300:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16202
00000100:00100000:0.0:1767318366.702303:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940245504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318366.702312:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318366.702333:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940245504:12345-0@lo:38:kworker.0 Request processed in 29us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318366.702338:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16202
00000100:00100000:0.0:1767318366.702348:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16203
00000100:00100000:0.0:1767318366.702352:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940245760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318366.702361:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318366.702382:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940245760:12345-0@lo:38:kworker.0 Request processed in 29us (440us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318366.702388:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16203
00000100:00080000:0.0:1767318366.702407:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318366.702432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318366.702437:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318366.702440:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940244992:0@lo:38:kworker.0
00000100:00080000:0.0:1767318366.702448:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318366.702451:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318366.702453:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940245504:0@lo:38:kworker.0
00000100:00080000:0.0:1767318366.702460:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318366.702463:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318366.702465:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940245760:0@lo:38:kworker.0
00000100:00100000:0.0:1767318366.702497:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940245376:0@lo:400:kworker.0
00000100:00100000:0.0:1767318366.702506:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940245632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318366.702975:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245248
00000100:00100000:1.0:1767318366.702981:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245248
00000100:00100000:1.0:1767318366.703023:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534
00000100:00100000:1.0:1767318366.703030:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940245248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318366.703075:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940245248:12345-0@lo:400:kworker.0 Request processed in 45us (1364us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318366.703081:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534
00000100:00100000:1.0:1767318366.703101:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245120
00000100:00100000:1.0:1767318366.703105:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245120
00000100:00100000:1.0:1767318366.703123:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933
00000100:00100000:1.0:1767318366.703127:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940245120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318366.703137:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318366.703166:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940245120:12345-0@lo:38:kworker.0 Request processed in 37us (1288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318366.703172:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933
00000100:00080000:1.0:1767318366.703214:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318366.703218:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318366.703221:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940245120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318366.703252:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940245248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.213695:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318367.662428:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318368.237986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318368.693349:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318369.261281:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318369.709512:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318370.286360:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940245888:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318370.286433:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318370.286550:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940245888
00000100:00100000:2.0:1767318370.286557:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940245888
00000100:00100000:2.0:1767318370.286615:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050
00000100:00100000:2.0:1767318370.286622:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940245888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318370.286649:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318370.286686:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940245888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (253us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318370.286694:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050
00000100:00100000:1.0:1767318370.286866:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940245888:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318370.287809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318370.288087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318370.375060:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318370.375124:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318370.375280:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258304
00000100:00100000:3.0:1767318370.375290:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258304
00000100:00100000:3.0:1767318370.375376:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258176
00000100:00100000:3.0:1767318370.375380:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258176
00000100:00100000:3.0:1767318370.375398:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3845
00000100:00100000:3.0:1767318370.375409:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894258304:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318370.375486:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894258304:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (436us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318370.375493:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3845
00000100:00100000:3.0:1767318370.375514:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16204
00000100:00100000:3.0:1767318370.375518:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894258176:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318370.375540:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318370.375564:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894258176:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (451us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318370.375570:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16204
00000100:00080000:0.0:1767318370.375982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318370.732989:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318371.309226:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318371.309679:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940246016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318371.309758:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.309909:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246016
00000100:00100000:1.0:1767318371.309917:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246016
00000100:00100000:1.0:1767318371.309987:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051
00000100:00100000:1.0:1767318371.309996:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940246016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318371.310025:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318371.310119:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318371.311501:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940246016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1500us (1737us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318371.311513:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051
00000100:00100000:0.0:1767318371.321005:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940246016:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318371.756933:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318371.821230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318371.821242:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318371.821245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318371.821249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318371.821253:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318371.821260:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3616
00000100:00080000:0.0:1767318371.821265:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318371.821272:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318371.821327:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940246144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318371.821357:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318371.821361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318371.821362:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318371.821366:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3616
00000100:00080000:0.0:1767318371.821368:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318371.821371:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318371.821388:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210000 x1853163940246272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318371.821463:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940246400:0@lo:400:kworker.0
00000100:00100000:3.0:1767318371.821531:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.821666:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940246144:0@lo:38:kworker.0
00000100:00100000:1.0:1767318371.821700:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.821719:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940246272:0@lo:38:kworker.0
00000100:00100000:1.0:1767318371.821739:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.821769:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246144
00000100:00100000:1.0:1767318371.821795:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246144
00000100:00100000:1.0:1767318371.821842:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16205
00000100:00100000:1.0:1767318371.821849:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940246144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318371.821870:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318371.821909:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940246144:12345-0@lo:38:kworker.0 Request processed in 59us (208us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318371.821916:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16205
00000100:00100000:1.0:1767318371.821938:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246272
00000100:00100000:1.0:1767318371.821941:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246272
00000100:00100000:1.0:1767318371.821960:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934
00000100:00100000:1.0:1767318371.821964:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940246272:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318371.821973:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318371.822000:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940246272:12345-0@lo:38:kworker.0 Request processed in 35us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318371.822006:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934
00000100:00080000:1.0:1767318371.822044:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318371.822048:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318371.822051:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940246144:0@lo:38:kworker.0
00000100:00080000:1.0:1767318371.822059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318371.822061:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318371.822063:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940246272:0@lo:38:kworker.0
00000100:00100000:1.0:1767318371.822096:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940246528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318371.822119:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.822154:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246528
00000100:00100000:1.0:1767318371.822158:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246528
00000100:00100000:1.0:1767318371.822195:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846
00000100:00100000:1.0:1767318371.822201:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940246528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318371.822238:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940246528:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318371.822243:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846
00000100:00100000:1.0:1767318371.822268:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940246528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318371.822517:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246400
00000100:00100000:2.0:1767318371.822521:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246400
00000100:00100000:2.0:1767318371.822557:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535
00000100:00100000:2.0:1767318371.822564:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940246400:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318371.822637:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318371.824545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318371.824554:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318371.824558:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318371.824565:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3616
00000100:00080000:0.0:1767318371.824569:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318371.824575:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318371.824605:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210700 x1853163940246656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318371.824648:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318371.824652:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318371.824654:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318371.824657:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3616
00000100:00080000:0.0:1767318371.824659:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318371.824662:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318371.824672:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211f80 x1853163940246912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318371.824705:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940246784:0@lo:400:kworker.0
00000100:00100000:0.0:1767318371.824763:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318371.824921:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940246400:12345-0@lo:400:kworker.0 Request processed in 2356us (3387us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318371.824930:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535
00000100:00100000:1.0:1767318371.825040:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940246656:0@lo:38:kworker.0
00000100:00100000:1.0:1767318371.825068:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.825094:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940246912:0@lo:38:kworker.0
00000100:00100000:1.0:1767318371.825122:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318371.825187:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246784
00000100:00100000:1.0:1767318371.825193:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246784
00000100:00100000:1.0:1767318371.825241:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246656
00000100:00100000:1.0:1767318371.825245:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246656
00000100:00100000:1.0:1767318371.825260:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940246912
00000100:00100000:1.0:1767318371.825262:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940246912
00000100:00100000:1.0:1767318371.825276:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847
00000100:00100000:1.0:1767318371.825283:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940246784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318371.825454:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16206
00000100:00100000:2.0:1767318371.825459:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940246656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318371.825480:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318371.825518:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940246656:12345-0@lo:38:kworker.0 Request processed in 57us (449us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318371.825524:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16206
00000100:00100000:2.0:1767318371.825538:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16207
00000100:00100000:2.0:1767318371.825541:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940246912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318371.825549:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318371.825569:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940246912:12345-0@lo:38:kworker.0 Request processed in 27us (446us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318371.825575:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16207
00000100:00080000:2.0:1767318371.825606:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318371.825611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318371.825615:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940246656:0@lo:38:kworker.0
00000100:00080000:2.0:1767318371.825624:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318371.825628:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318371.825631:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940246912:0@lo:38:kworker.0
00000100:00080000:2.0:1767318371.825672:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318371.825932:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940246784:12345-0@lo:400:kworker.0 Request processed in 649us (1168us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318371.825939:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847
00000100:00100000:0.0:1767318371.826010:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940246784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318371.826489:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940246400:0@lo:400:kworker.0
00000100:00100000:1.0:1767318372.333257:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318372.781087:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318373.357473:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318373.805009:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318374.380900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318374.830356:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318375.406268:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318375.406295:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940247040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318375.406371:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318375.406497:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247040
00000100:00100000:2.0:1767318375.406506:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247040
00000100:00100000:2.0:1767318375.406567:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052
00000100:00100000:2.0:1767318375.406576:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940247040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318375.406609:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318375.406654:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940247040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (282us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318375.406661:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052
00000100:00080000:0.0:1767318375.406763:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318375.406823:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940247040:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318375.406902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318375.494683:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318375.494761:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894258432 offset 0 length 520: 4
00000100:00100000:3.0:1767318375.494845:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318375.499695:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258688
00000100:00100000:1.0:1767318375.499714:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258688
00000100:00100000:1.0:1767318375.499823:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258560
00000100:00100000:1.0:1767318375.499826:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258560
00000100:00100000:1.0:1767318375.499848:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3848
00000100:00100000:1.0:1767318375.499856:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894258688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318375.499925:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894258688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (5255us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318375.499931:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3848
00000100:00100000:1.0:1767318375.499945:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16208
00000100:00100000:1.0:1767318375.499948:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894258560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318375.499964:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318375.499987:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894258560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 36us (5143us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318375.499993:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16208
00000100:00080000:0.0:1767318375.500362:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318375.853010:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318376.429187:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318376.429212:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940247168:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318376.429285:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318376.429414:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247168
00000100:00100000:2.0:1767318376.429424:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247168
00000100:00100000:2.0:1767318376.429503:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053
00000100:00100000:2.0:1767318376.429513:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940247168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318376.429542:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318376.429589:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940247168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318376.429597:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053
00000100:00080000:0.0:1767318376.429655:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318376.432470:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940247168:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318376.435122:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318376.878326:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318376.940954:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318376.940967:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318376.940969:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318376.940973:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318376.940987:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318376.940996:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3621
00000100:00080000:0.0:1767318376.941000:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318376.941007:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318376.941049:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213480 x1853163940247296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318376.941083:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318376.941112:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318376.941114:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318376.941117:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3621
00000100:00080000:0.0:1767318376.941120:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318376.941123:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318376.941138:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940247424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318376.941198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318376.941201:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318376.941203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318376.941206:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3621
00000100:00080000:0.0:1767318376.941208:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318376.941211:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318376.941222:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211f80 x1853163940247808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318376.941238:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318376.941241:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318376.941242:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318376.941245:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3621
00000100:00080000:0.0:1767318376.941248:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318376.941251:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318376.941262:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210a80 x1853163940248064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318376.941289:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940247552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318376.941306:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940247680:0@lo:400:kworker.0
00000100:00100000:1.0:1767318376.941398:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940247296:0@lo:38:kworker.0
00000100:00100000:2.0:1767318376.941514:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940247936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318376.944850:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318376.944980:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247552
00000100:00100000:3.0:1767318376.944988:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247552
00000100:00100000:3.0:1767318376.945045:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1767318376.945054:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940247552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318376.945232:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940247552:12345-0@lo:400:kworker.0 Request processed in 179us (389us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318376.945240:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1767318376.945397:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940247552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318376.947403:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318376.947466:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940247424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318376.947521:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318376.947557:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247424
00000100:00100000:1.0:1767318376.947564:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247424
00000100:00100000:1.0:1767318376.947599:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935
00000100:00100000:1.0:1767318376.947605:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940247424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318376.947625:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318376.947660:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940247424:12345-0@lo:38:kworker.0 Request processed in 54us (138us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318376.947668:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935
00000100:00080000:1.0:1767318376.947965:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318376.947971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318376.947975:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940247424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318376.948114:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940247808:0@lo:38:kworker.0
00000100:00100000:1.0:1767318376.948147:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318376.948164:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940248064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318376.948183:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318376.948203:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247296
00000100:00100000:1.0:1767318376.948207:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247296
00000100:00100000:1.0:1767318376.948224:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247808
00000100:00100000:1.0:1767318376.948227:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247808
00000100:00100000:1.0:1767318376.948239:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248064
00000100:00100000:1.0:1767318376.948241:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248064
00000100:00100000:1.0:1767318376.948256:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16209
00000100:00100000:1.0:1767318376.948261:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940247296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318376.948272:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318376.948297:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940247296:12345-0@lo:38:kworker.0 Request processed in 35us (902us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318376.948302:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16209
00000100:00100000:1.0:1767318376.948314:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16210
00000100:00100000:1.0:1767318376.948318:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940247808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318376.948327:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318376.948351:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940247808:12345-0@lo:38:kworker.0 Request processed in 32us (204us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318376.948357:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16210
00000100:00100000:1.0:1767318376.948367:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16211
00000100:00100000:1.0:1767318376.948371:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940248064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318376.948380:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318376.948401:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940248064:12345-0@lo:38:kworker.0 Request processed in 28us (217us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318376.948406:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16211
00000100:00080000:1.0:1767318376.948433:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318376.948438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318376.948489:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318376.948509:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247936
00000100:00100000:0.0:1767318376.948516:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318376.948516:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247936
00000100:00100000:2.0:1767318376.948569:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940247680
00000100:00100000:0.0:1767318376.948573:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849
00000100:00100000:2.0:1767318376.948574:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940247680
00000100:00100000:0.0:1767318376.948586:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940247936:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318376.948602:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318376.948617:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850
00000100:00100000:2.0:1767318376.948628:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940247680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318376.948636:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940247936:12345-0@lo:400:kworker.0 Request processed in 54us (148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318376.948644:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849
00000100:00100000:3.0:1767318376.948670:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940247936:0@lo:400:kworker.0
00000100:00100000:2.0:1767318376.948678:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940247680:12345-0@lo:400:kworker.0 Request processed in 51us (163us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318376.948688:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850
00000100:00100000:0.0:1767318376.948706:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940247680:0@lo:400:kworker.0
00000100:00100000:1.0:1767318376.950190:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940248064:0@lo:38:kworker.0
00000100:00080000:1.0:1767318376.950247:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318376.950252:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318376.950255:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940247296:0@lo:38:kworker.0
00000100:00080000:1.0:1767318376.950265:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318376.950269:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318376.950272:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940247808:0@lo:38:kworker.0
00000100:00100000:2.0:1767318377.453008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318377.904975:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318378.477692:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318378.927241:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318379.500986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318379.949121:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318380.525065:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318380.525524:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940248192:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318380.525594:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318380.525884:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248192
00000100:00100000:1.0:1767318380.525892:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248192
00000100:00100000:1.0:1767318380.526046:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054
00000100:00100000:1.0:1767318380.526066:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940248192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318380.526098:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318380.526162:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940248192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (567us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318380.526170:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054
00000100:00100000:0.0:1767318380.526246:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940248192:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318380.526701:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318380.614179:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318380.614225:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318380.614292:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258944
00000100:00100000:0.0:1767318380.614302:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258944
00000100:00100000:3.0:1767318380.614326:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894258816
00000100:00100000:3.0:1767318380.614333:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894258816
00000100:00080000:2.0:1767318380.614390:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318380.614437:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3851
00000100:00100000:3.0:1767318380.614450:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894258944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318380.614533:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894258944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (352us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318380.614542:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3851
00000100:00100000:3.0:1767318380.614560:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16212
00000100:00100000:3.0:1767318380.614564:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894258816:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318380.614583:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318380.614608:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894258816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (382us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318380.614614:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16212
00010000:00010000:1.0:1767318380.973040:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318381.037497:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318356/real 1767318356]  req@ffff93cf52011180 x1853163940242432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318381.037531:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf52011180 x1853163940242432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318381 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318381.037549:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318381.037577:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318381.037581:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940242432:0@lo:250:kworker.0
00000100:00080000:0.0:1767318381.037661:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318381.037666:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318381.037670:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318381.037675:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3606
00000100:00080000:0.0:1767318381.037679:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318381.037684:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318381.037716:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940248320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318381.037737:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318381.037741:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318381.037743:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318381.037746:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3626
00000100:00080000:0.0:1767318381.037749:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318381.037752:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318381.037769:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211f80 x1853163940248448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318381.037816:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318381.037819:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318381.037821:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318381.037824:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3626
00000100:00080000:0.0:1767318381.037826:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318381.037829:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318381.037842:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213480 x1853163940248576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318381.037898:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318381.037901:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318381.037903:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318381.037907:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3626
00000100:00080000:0.0:1767318381.037910:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318381.037914:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318381.037923:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211880 x1853163940249088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318381.037940:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318381.037954:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318381.037956:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318381.037959:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3626
00000100:00080000:0.0:1767318381.037962:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318381.037965:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318381.037975:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430f480 x1853163940249344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318381.038015:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940248832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318381.038079:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318381.038128:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318381.038251:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248832
00000100:00100000:3.0:1767318381.038260:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248832
00000100:00100000:3.0:1767318381.038320:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537
00000100:00100000:3.0:1767318381.038332:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940248832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038377:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940248832:12345-0@lo:400:kworker.0 Request processed in 48us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318381.038384:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537
00000100:00100000:3.0:1767318381.038420:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940249216:0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038446:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318381.038467:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318381.038472:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940248704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038491:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318381.038512:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248704
00000100:00100000:3.0:1767318381.038515:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248704
00000100:00100000:3.0:1767318381.038537:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538
00000100:00100000:3.0:1767318381.038544:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940248704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038575:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940248704:12345-0@lo:400:kworker.0 Request processed in 32us (83us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318381.038581:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538
00000100:00100000:3.0:1767318381.038616:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940248704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038636:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249216
00000100:00100000:3.0:1767318381.038640:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249216
00000100:00100000:3.0:1767318381.038664:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852
00000100:00100000:3.0:1767318381.038671:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940249216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.038702:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940249216:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318381.038708:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852
00000100:00100000:3.0:1767318381.038730:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940249216:0@lo:400:kworker.0
00000100:00100000:0.0:1767318381.038801:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940248960:0@lo:400:kworker.0
00000100:00100000:0.0:1767318381.038824:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318381.038854:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940248832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.039095:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248960
00000100:00100000:3.0:1767318381.039098:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248960
00000100:00100000:3.0:1767318381.039128:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853
00000100:00100000:3.0:1767318381.039140:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940248960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318381.039176:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940248960:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318381.039181:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853
00000100:00080000:2.0:1767318381.039455:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318381.039461:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318381.039473:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940248320:0@lo:250:kworker.0
00000400:00000100:2.0:1767318381.039498:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940248320 offset 0 length 520: 4
00000100:00100000:2.0:1767318381.039518:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940248448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318381.039540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318381.039631:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940248576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318381.039654:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318381.039679:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940249088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318381.039699:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318381.039737:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248576
00000100:00100000:3.0:1767318381.039742:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248576
00000100:00100000:3.0:1767318381.039765:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936
00000100:00100000:3.0:1767318381.039770:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940248576:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318381.039812:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318381.039841:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940248576:12345-0@lo:38:kworker.0 Request processed in 70us (186us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318381.039848:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936
00000100:00100000:3.0:1767318381.039892:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940248960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318381.052487:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940249344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318381.052551:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318381.058740:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249088
00000100:00100000:0.0:1767318381.058756:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249088
00000100:00100000:0.0:1767318381.058841:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16213
00000100:00100000:0.0:1767318381.058850:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940249088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318381.058872:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318381.058958:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940249088:12345-0@lo:38:kworker.0 Request processed in 107us (19257us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318381.058965:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16213
00000100:00080000:2.0:1767318381.059566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318381.059573:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318381.059578:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940248576:0@lo:38:kworker.0
00000100:00080000:2.0:1767318381.059589:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318381.059592:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318381.059595:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940249088:0@lo:38:kworker.0
00000100:00100000:0.0:1767318381.060570:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249344
00000100:00100000:0.0:1767318381.060580:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249344
00000100:00100000:0.0:1767318381.060620:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16214
00000100:00100000:0.0:1767318381.060626:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940249344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318381.060645:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318381.060715:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940249344:12345-0@lo:38:kworker.0 Request processed in 87us (8163us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318381.060721:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16214
00000100:00080000:2.0:1767318381.060815:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318381.060820:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318381.060824:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940249344:0@lo:38:kworker.0
00000100:00100000:1.0:1767318381.070088:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940248448
00000100:00100000:1.0:1767318381.070104:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940248448
00000100:00100000:1.0:1767318381.070180:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16215
00000100:00100000:1.0:1767318381.070190:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940248448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318381.070213:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318381.070313:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940248448:12345-0@lo:38:kworker.0 Request processed in 123us (30770us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318381.070332:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16215
00000100:00080000:2.0:1767318381.070562:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318381.070568:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318381.070572:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940248448:0@lo:38:kworker.0
00000100:00100000:3.0:1767318381.548992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318381.549246:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940249472:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318381.549315:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318381.549544:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249472
00000100:00100000:2.0:1767318381.549553:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249472
00000100:00100000:2.0:1767318381.549607:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055
00000100:00100000:2.0:1767318381.549617:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940249472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318381.549648:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318381.549699:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940249472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318381.549706:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055
00000100:00100000:1.0:1767318381.549811:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940249472:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318381.997242:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318382.574682:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318383.026417:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318383.597556:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318384.048181:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318384.622260:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318385.074997:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318385.644891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318385.645050:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940249600:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318385.645133:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318385.645428:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249600
00000100:00100000:2.0:1767318385.645436:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249600
00000100:00100000:2.0:1767318385.645504:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056
00000100:00100000:2.0:1767318385.645514:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940249600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318385.645545:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318385.645595:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940249600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (463us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318385.645603:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056
00000100:00080000:0.0:1767318385.645703:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318385.645824:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940249600:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318385.738550:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318385.738601:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318385.738704:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259072
00000100:00100000:1.0:1767318385.738715:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259072
00000100:00100000:1.0:1767318385.738758:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259200
00000100:00100000:1.0:1767318385.738762:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259200
00000100:00100000:1.0:1767318385.738855:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3854
00000100:00100000:1.0:1767318385.738864:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894259200:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767318385.738926:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318385.738945:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894259200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318385.738954:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3854
00000100:00100000:2.0:1767318385.738966:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16216
00000100:00100000:2.0:1767318385.738974:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894259072:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318385.738995:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318385.739037:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894259072:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 62us (495us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318385.739044:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16216
00010000:00010000:1.0:1767318386.097358:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318386.157206:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318386.157217:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318386.157220:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318386.157224:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318386.157227:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318386.157235:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3631
00000100:00080000:3.0:1767318386.157239:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318386.157258:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318386.157304:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5180 x1853163940249728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318386.157332:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318386.157336:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318386.157338:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318386.157341:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3631
00000100:00080000:3.0:1767318386.157343:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318386.157347:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318386.157359:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4e00 x1853163940249856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318386.157421:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318386.157425:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318386.157427:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318386.157430:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3631
00000100:00080000:3.0:1767318386.157432:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318386.157436:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318386.157446:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7b80 x1853163940250368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318386.157460:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318386.157463:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318386.157465:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318386.157468:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3631
00000100:00080000:3.0:1767318386.157470:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318386.157474:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318386.157488:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6680 x1853163940250624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318386.157513:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940250112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318386.157578:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318386.157633:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318386.157639:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940250240:0@lo:400:kworker.0
00000100:00100000:2.0:1767318386.157664:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940249728:0@lo:38:kworker.0
00000100:00100000:3.0:1767318386.157665:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318386.157697:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318386.157698:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250112
00000100:00100000:3.0:1767318386.157705:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250112
00000100:00100000:2.0:1767318386.157723:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250240
00000100:00100000:2.0:1767318386.157727:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250240
00000100:00100000:2.0:1767318386.157759:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249728
00000100:00100000:2.0:1767318386.157762:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249728
00000100:00100000:3.0:1767318386.157763:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539
00000100:00100000:2.0:1767318386.157792:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855
00000100:00100000:3.0:1767318386.157795:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940250112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318386.157801:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940250240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318386.157885:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940250496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318386.157925:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940250112:12345-0@lo:400:kworker.0 Request processed in 153us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318386.157932:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539
00000100:00100000:3.0:1767318386.157957:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16217
00000100:00100000:3.0:1767318386.157962:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940249728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318386.157991:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318386.158247:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940249984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318386.158500:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.158534:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250496
00000100:00100000:1.0:1767318386.158538:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250496
00000100:00100000:1.0:1767318386.158567:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856
00000100:00100000:1.0:1767318386.158573:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940250496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318386.158604:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940250496:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318386.158610:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856
00000100:00100000:1.0:1767318386.158649:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940250496:0@lo:400:kworker.0
00000100:00080000:1.0:1767318386.158687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318386.158691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318386.158703:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940249856:0@lo:38:kworker.0
00000100:00100000:1.0:1767318386.158726:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.158741:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940250368:0@lo:38:kworker.0
00000100:00100000:1.0:1767318386.158788:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.158805:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250368
00000100:00100000:1.0:1767318386.158808:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250368
00000100:00100000:1.0:1767318386.158825:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16218
00000100:00100000:1.0:1767318386.158829:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940250368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318386.158840:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318386.158864:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940250368:12345-0@lo:38:kworker.0 Request processed in 33us (92us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318386.158870:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16218
00000100:00080000:1.0:1767318386.158892:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318386.158896:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318386.158899:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940250368:0@lo:38:kworker.0
00000100:00100000:1.0:1767318386.158905:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940250624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318386.158925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.158941:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250624
00000100:00100000:1.0:1767318386.158945:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250624
00000100:00100000:1.0:1767318386.158961:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16219
00000100:00100000:1.0:1767318386.158964:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940250624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318386.158988:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318386.159022:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940250624:12345-0@lo:38:kworker.0 Request processed in 55us (96us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318386.159028:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16219
00000100:00080000:1.0:1767318386.159051:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318386.159055:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318386.159058:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940250624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318386.159418:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940250240:12345-0@lo:400:kworker.0 Request processed in 1617us (1752us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318386.159426:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855
00000100:00100000:2.0:1767318386.159461:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249856
00000100:00100000:2.0:1767318386.159464:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249856
00000100:00100000:1.0:1767318386.159486:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940250240:0@lo:400:kworker.0
00000100:00100000:2.0:1767318386.159490:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937
00000100:00100000:2.0:1767318386.159498:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940249856:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318386.159503:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940250112:0@lo:400:kworker.0
00010000:00020000:2.0:1767318386.159513:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318386.159553:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940249856:12345-0@lo:38:kworker.0 Request processed in 54us (825us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318386.159561:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937
00000100:00080000:1.0:1767318386.159566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318386.159572:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318386.159576:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940249856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318386.159697:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940249728:12345-0@lo:38:kworker.0 Request processed in 1732us (1997us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318386.159705:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16217
00000100:00080000:1.0:1767318386.159801:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318386.159807:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318386.159811:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940249728:0@lo:38:kworker.0
00000100:00100000:0.0:1767318386.159955:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.160107:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940249984
00000100:00100000:1.0:1767318386.160112:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940249984
00000100:00100000:1.0:1767318386.160158:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540
00000100:00100000:1.0:1767318386.160166:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940249984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318386.160426:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940249984:12345-0@lo:400:kworker.0 Request processed in 261us (470us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318386.160433:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540
00000100:00100000:0.0:1767318386.160503:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940249984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318386.669086:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318386.673572:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318386.673601:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940250752:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318386.673678:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318386.673759:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250752
00000100:00100000:1.0:1767318386.673766:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250752
00000100:00100000:1.0:1767318386.673827:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057
00000100:00100000:1.0:1767318386.673835:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940250752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318386.673863:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318386.673916:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940250752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318386.673923:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057
00000100:00100000:1.0:1767318386.673972:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940250752:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318387.117674:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318387.695326:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318388.141045:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318388.717080:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318389.165120:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318389.740871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318390.189011:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318390.765284:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318390.767341:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940250880:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318390.767418:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318390.767697:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940250880
00000100:00100000:2.0:1767318390.767705:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940250880
00000100:00100000:2.0:1767318390.767769:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058
00000100:00100000:2.0:1767318390.767793:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940250880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318390.767834:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318390.767878:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940250880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (459us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318390.767886:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058
00000100:00080000:1.0:1767318390.768221:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318390.768260:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940250880:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318390.857984:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318390.858105:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318390.858341:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259456
00000100:00100000:2.0:1767318390.858353:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259456
00000100:00100000:2.0:1767318390.858424:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259328
00000100:00100000:2.0:1767318390.858428:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259328
00000100:00100000:2.0:1767318390.858447:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3857
00000100:00100000:2.0:1767318390.858457:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894259456:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318390.858538:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894259456:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (1265us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318390.858547:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3857
00000100:00100000:2.0:1767318390.858566:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16220
00000100:00100000:2.0:1767318390.858570:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894259328:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318390.858590:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318390.858615:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894259328:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (511us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318390.858621:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16220
00000100:00080000:1.0:1767318390.858838:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318391.217308:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318391.276932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318391.276945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318391.276985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318391.276989:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318391.276994:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318391.277002:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3636
00000100:00080000:0.0:1767318391.277007:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318391.277017:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318391.277064:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940251008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318391.277090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318391.277094:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318391.277096:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318391.277099:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3636
00000100:00080000:0.0:1767318391.277102:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318391.277105:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318391.277119:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d880 x1853163940251136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318391.277189:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318391.277193:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318391.277195:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318391.277199:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3636
00000100:00080000:0.0:1767318391.277202:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318391.277206:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318391.277217:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ea00 x1853163940251648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318391.277236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318391.277240:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318391.277241:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318391.277245:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3636
00000100:00080000:0.0:1767318391.277247:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318391.277251:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318391.277263:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ebb80 x1853163940251904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318391.277315:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940251520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318391.277384:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318391.277443:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318391.277450:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940251392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318391.277476:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318391.277683:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940251264:0@lo:400:kworker.0
00000100:00100000:3.0:1767318391.277716:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318391.277761:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251520
00000100:00100000:3.0:1767318391.277768:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251520
00000100:00100000:3.0:1767318391.277829:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858
00000100:00100000:3.0:1767318391.277841:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940251520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318391.277890:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940251520:12345-0@lo:400:kworker.0 Request processed in 54us (506us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318391.277898:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858
00000100:00100000:3.0:1767318391.277919:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251392
00000100:00100000:3.0:1767318391.277923:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251392
00000100:00100000:1.0:1767318391.278027:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940251776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318391.278057:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318391.278089:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251264
00000100:00100000:1.0:1767318391.278093:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251264
00000100:00100000:1.0:1767318391.278121:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541
00000100:00100000:2.0:1767318391.278542:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940251008:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.278572:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318391.278593:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940251136:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.278617:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318391.278634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940251648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.278651:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318391.278665:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940251904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.278681:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318391.278695:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940251264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318391.278711:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251776
00000100:00100000:2.0:1767318391.278716:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251776
00000100:00100000:1.0:1767318391.278742:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940251264:12345-0@lo:400:kworker.0 Request processed in 53us (1025us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318391.278749:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541
00000100:00100000:2.0:1767318391.278760:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251008
00000100:00100000:2.0:1767318391.278765:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251008
00000100:00080000:1.0:1767318391.278771:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318391.278791:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251648
00000100:00100000:2.0:1767318391.278796:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251648
00000100:00100000:2.0:1767318391.278808:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251904
00000100:00100000:2.0:1767318391.278812:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251904
00000100:00100000:1.0:1767318391.278815:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859
00000100:00100000:1.0:1767318391.278826:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940251776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318391.278831:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16221
00000100:00100000:2.0:1767318391.278838:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940251008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318391.278856:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318391.278869:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940251776:12345-0@lo:400:kworker.0 Request processed in 45us (810us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318391.278876:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859
00000100:00100000:2.0:1767318391.278894:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940251008:12345-0@lo:38:kworker.0 Request processed in 53us (319us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318391.278897:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16222
00000100:00100000:1.0:1767318391.278907:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940251648:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.278908:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16221
00000100:00100000:2.0:1767318391.278927:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16223
00000100:00100000:2.0:1767318391.278932:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940251904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318391.278942:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318391.278984:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940251904:12345-0@lo:38:kworker.0 Request processed in 50us (301us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318391.278989:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16223
00000100:00100000:2.0:1767318391.279008:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940251136
00000100:00100000:2.0:1767318391.279011:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940251136
00000100:00100000:2.0:1767318391.279031:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938
00000100:00100000:2.0:1767318391.279035:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940251136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318391.279044:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318391.279066:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940251136:12345-0@lo:38:kworker.0 Request processed in 29us (448us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318391.279071:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938
00000100:00080000:2.0:1767318391.279111:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318391.279116:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318391.279119:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940251008:0@lo:38:kworker.0
00000100:00080000:2.0:1767318391.279128:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318391.279144:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318391.279146:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940251136:0@lo:38:kworker.0
00000100:00080000:2.0:1767318391.279155:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318391.279157:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318391.279160:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940251904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.279222:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940251520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318391.279257:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940251264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318391.279322:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940251776:0@lo:400:kworker.0
00000100:00080000:0.0:1767318391.280742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318391.282309:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542
00000100:00100000:3.0:1767318391.282330:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940251392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318391.282430:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940251392:12345-0@lo:400:kworker.0 Request processed in 112us (4952us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318391.282437:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542
00010000:00020000:1.0:1767318391.282535:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318391.282590:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940251648:12345-0@lo:38:kworker.0 Request processed in 3683us (3937us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318391.282598:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16222
00000100:00080000:3.0:1767318391.284294:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318391.284306:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318391.284311:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940251648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318391.285838:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940251392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318391.789346:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318391.797560:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940252032:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318391.798276:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318391.798480:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252032
00000100:00100000:1.0:1767318391.798489:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252032
00000100:00100000:1.0:1767318391.798552:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059
00000100:00100000:1.0:1767318391.798561:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940252032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318391.798592:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318391.798654:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940252032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318391.798660:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059
00000100:00100000:3.0:1767318391.799005:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940252032:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318392.236995:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318392.815186:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318393.261002:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318393.838443:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318394.285079:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318394.861294:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318395.311570:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318395.887034:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940252160:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318395.887108:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318395.887218:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252160
00000100:00100000:2.0:1767318395.887226:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252160
00000100:00100000:2.0:1767318395.887396:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060
00000100:00100000:2.0:1767318395.887406:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940252160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318395.887438:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318395.887489:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940252160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318395.887496:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060
00000100:00080000:0.0:1767318395.887547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318395.888115:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940252160:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318395.888280:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318395.975395:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318395.975844:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318395.975950:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259584
00000100:00100000:2.0:1767318395.975960:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259584
00000100:00100000:2.0:1767318395.976011:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259712
00000100:00100000:2.0:1767318395.976014:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259712
00000100:00100000:2.0:1767318395.976076:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3860
00000100:00100000:2.0:1767318395.976087:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894259712:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318395.976110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318395.976151:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16224
00000100:00100000:1.0:1767318395.976159:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894259584:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:2.0:1767318395.976170:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894259712:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318395.976179:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3860
00010000:00020000:1.0:1767318395.976185:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318395.976221:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894259584:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (836us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318395.976228:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16224
00010000:00010000:1.0:1767318396.333233:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318396.397650:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318396.397662:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318396.397665:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318396.397669:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318396.397673:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318396.397681:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3641
00000100:00080000:3.0:1767318396.397686:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318396.397692:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318396.397731:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeadf80 x1853163940252288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318396.397766:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318396.397770:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318396.397790:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318396.397795:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3641
00000100:00080000:3.0:1767318396.397797:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318396.397801:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318396.397814:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeace00 x1853163940252416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318396.397884:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318396.397944:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940252288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318396.398015:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318396.398080:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940252416:0@lo:38:kworker.0
00000100:00100000:2.0:1767318396.398135:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318396.398173:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252416
00000100:00100000:2.0:1767318396.398190:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252416
00000100:00100000:2.0:1767318396.398226:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939
00000100:00100000:2.0:1767318396.398233:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940252416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318396.398255:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318396.398294:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940252416:12345-0@lo:38:kworker.0 Request processed in 61us (158us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318396.398301:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939
00000100:00080000:2.0:1767318396.398338:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318396.398343:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318396.398347:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940252416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318396.398443:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252288
00000100:00100000:1.0:1767318396.398448:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252288
00000100:00100000:1.0:1767318396.398482:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16225
00000100:00100000:1.0:1767318396.398487:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940252288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318396.398498:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318396.398538:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940252288:12345-0@lo:38:kworker.0 Request processed in 50us (523us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318396.398545:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16225
00000100:00080000:3.0:1767318396.398754:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318396.398758:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318396.398760:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318396.398764:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3641
00000100:00080000:3.0:1767318396.398766:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318396.398790:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318396.398803:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940252928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318396.398861:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940252928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318396.398885:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318396.398922:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318396.398926:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318396.398929:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940252288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318396.398948:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252928
00000100:00100000:2.0:1767318396.398952:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252928
00000100:00100000:2.0:1767318396.398968:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16226
00000100:00100000:2.0:1767318396.398972:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940252928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318396.398982:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318396.399010:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940252928:12345-0@lo:38:kworker.0 Request processed in 37us (124us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318396.399017:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16226
00000100:00080000:2.0:1767318396.399036:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318396.399039:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318396.399041:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940252928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318396.399063:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940252800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.399086:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318396.399102:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318396.399107:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940252672:0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.399128:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318396.399159:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252672
00000100:00100000:2.0:1767318396.399162:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252672
00000100:00100000:2.0:1767318396.399216:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543
00000100:00100000:2.0:1767318396.399223:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940252672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.399261:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940252672:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318396.399267:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543
00000100:00080000:2.0:1767318396.399282:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318396.399291:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252800
00000100:00100000:2.0:1767318396.399294:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252800
00000100:00100000:2.0:1767318396.399319:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861
00000100:00100000:2.0:1767318396.399325:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940252800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.399351:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940252800:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318396.399356:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861
00000100:00080000:2.0:1767318396.399368:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318396.399384:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940252672:0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.399392:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940252800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318396.400132:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940253056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318396.400172:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318396.400215:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940252544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318396.400238:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318396.400389:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253056
00000100:00100000:1.0:1767318396.400394:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253056
00000100:00100000:1.0:1767318396.400444:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862
00000100:00100000:1.0:1767318396.400451:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940253056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318396.400488:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940253056:12345-0@lo:400:kworker.0 Request processed in 38us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318396.400494:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862
00000100:00080000:0.0:1767318396.400627:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318396.400651:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940253056:0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.400717:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940252544
00000100:00100000:2.0:1767318396.400722:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940252544
00000100:00100000:2.0:1767318396.400755:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544
00000100:00100000:2.0:1767318396.400762:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940252544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318396.400824:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940252544:12345-0@lo:400:kworker.0 Request processed in 63us (584us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318396.400830:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544
00000100:00100000:1.0:1767318396.401026:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940252544:0@lo:400:kworker.0
00000100:00080000:3.0:1767318396.401107:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318396.401112:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318396.401116:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318396.401120:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3641
00000100:00080000:3.0:1767318396.401123:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318396.401128:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318396.401153:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf480 x1853163940253184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318396.401272:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940253184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318396.401300:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318396.401363:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253184
00000100:00100000:1.0:1767318396.401368:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253184
00000100:00100000:1.0:1767318396.401389:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16227
00000100:00100000:1.0:1767318396.401393:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940253184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318396.401411:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318396.405216:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940253184:12345-0@lo:38:kworker.0 Request processed in 3811us (3904us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318396.405236:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16227
00000100:00080000:0.0:1767318396.409006:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318396.409021:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318396.409027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940253184:0@lo:38:kworker.0
00000100:00100000:3.0:1767318396.909090:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318396.909350:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940253312:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318396.909424:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318396.909704:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253312
00000100:00100000:3.0:1767318396.909712:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253312
00000100:00100000:3.0:1767318396.909790:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061
00000100:00100000:3.0:1767318396.909810:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940253312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318396.909852:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318396.914197:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940253312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4388us (4762us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318396.914213:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061
00000100:00100000:1.0:1767318396.916702:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940253312:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318397.361538:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318397.933088:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318398.382024:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318398.956919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318399.406469:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318399.980962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318400.075824:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318400.075932:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260096
00000100:00100000:1.0:1767318400.075942:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260096
00000100:00100000:1.0:1767318400.076017:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3863
00000100:00100000:1.0:1767318400.076027:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894260096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318400.076109:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894260096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318400.076117:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3863
00000100:00080000:0.0:1767318400.076266:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318400.080278:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894259840 offset 0 length 520: 4
00000100:00100000:0.0:1767318400.080321:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318400.080615:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894259968
00000100:00100000:2.0:1767318400.080627:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894259968
00000100:00100000:2.0:1767318400.080741:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16228
00000100:00100000:2.0:1767318400.080749:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894259968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318400.080823:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318400.080904:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894259968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 153us (581us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318400.080912:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16228
00010000:00010000:2.0:1767318400.429082:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318401.004921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318401.005727:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940253440:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318401.005853:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318401.009420:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253440
00000100:00100000:3.0:1767318401.009436:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253440
00000100:00100000:3.0:1767318401.009516:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062
00000100:00100000:3.0:1767318401.009529:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940253440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318401.009569:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767318401.009585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318401.009662:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940253440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (3809us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318401.009669:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062
00000100:00100000:1.0:1767318401.009758:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940253440:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318401.461206:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318401.521366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318401.521377:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318401.521381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318401.521385:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318401.521390:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318401.521397:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3646
00000100:00080000:1.0:1767318401.521402:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318401.521410:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318401.521453:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4e00 x1853163940253568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318401.521531:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940253568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318401.521604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318401.522013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318401.522018:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318401.522020:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318401.522024:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3646
00000100:00080000:1.0:1767318401.522027:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318401.522031:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318401.522049:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940253696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318401.522099:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253568
00000100:00100000:3.0:1767318401.522106:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253568
00000100:00100000:3.0:1767318401.522145:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16229
00000100:00100000:3.0:1767318401.522153:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940253568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318401.522172:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318401.522382:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940253696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318401.522417:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318401.522485:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253696
00000100:00100000:0.0:1767318401.522490:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253696
00000100:00100000:0.0:1767318401.522517:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940
00000100:00100000:0.0:1767318401.522522:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940253696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318401.522534:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318401.522568:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940253696:12345-0@lo:38:kworker.0 Request processed in 44us (150us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318401.522575:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940
00000100:00080000:1.0:1767318401.522677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318401.522681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318401.522683:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318401.522687:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3646
00000100:00080000:1.0:1767318401.522690:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318401.522695:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318401.522708:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7b80 x1853163940254080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318401.522726:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318401.522730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318401.522732:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318401.522735:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3646
00000100:00080000:1.0:1767318401.522737:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318401.522742:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318401.522755:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2d80 x1853163940254336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318401.522886:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940253824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.522917:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318401.522963:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253824
00000100:00100000:0.0:1767318401.522967:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253824
00000100:00100000:0.0:1767318401.523014:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545
00000100:00100000:0.0:1767318401.523021:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940253824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523065:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940253824:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318401.523072:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545
00000100:00080000:0.0:1767318401.523088:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318401.523118:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940253824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523158:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940254208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523184:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318401.523204:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318401.523209:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940253952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523231:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318401.523255:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254208
00000100:00100000:0.0:1767318401.523258:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254208
00000100:00100000:0.0:1767318401.523302:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940253952
00000100:00100000:0.0:1767318401.523306:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940253952
00000100:00100000:0.0:1767318401.523330:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864
00000100:00100000:0.0:1767318401.523336:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940254208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523368:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940254208:12345-0@lo:400:kworker.0 Request processed in 31us (183us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318401.523373:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864
00000100:00100000:0.0:1767318401.523384:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865
00000100:00100000:0.0:1767318401.523389:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940253952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523415:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940253952:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318401.523421:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865
00000100:00080000:0.0:1767318401.523434:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318401.523451:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940253952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318401.523461:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940254208:0@lo:400:kworker.0
00000100:00100000:3.0:1767318401.524138:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940253568:12345-0@lo:38:kworker.0 Request processed in 1982us (2530us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318401.524147:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16229
00000100:00080000:2.0:1767318401.524272:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318401.524351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318401.524355:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940253568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318401.524376:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940254080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318401.524414:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318401.524484:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940254336:0@lo:38:kworker.0
00000100:00100000:2.0:1767318401.524506:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318401.524614:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318401.524618:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318401.524622:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940253696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318401.524704:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254080
00000100:00100000:3.0:1767318401.524709:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254080
00000100:00100000:3.0:1767318401.525273:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254336
00000100:00100000:3.0:1767318401.525286:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254336
00000100:00100000:0.0:1767318401.525343:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16230
00000100:00100000:0.0:1767318401.525349:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318401.525368:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318401.525411:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254080:12345-0@lo:38:kworker.0 Request processed in 61us (997us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318401.525417:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16230
00000100:00100000:0.0:1767318401.525430:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16231
00000100:00100000:0.0:1767318401.525435:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318401.525443:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318401.525459:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254336:12345-0@lo:38:kworker.0 Request processed in 23us (952us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318401.525464:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16231
00000100:00080000:1.0:1767318401.525520:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318401.525524:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318401.525527:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940254080:0@lo:38:kworker.0
00000100:00080000:1.0:1767318401.525534:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318401.525537:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318401.525540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940254336:0@lo:38:kworker.0
00000100:00100000:3.0:1767318402.029228:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318402.029463:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940254464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318402.029536:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318402.030007:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254464
00000100:00100000:2.0:1767318402.030015:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254464
00000100:00100000:2.0:1767318402.030069:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063
00000100:00100000:2.0:1767318402.030079:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940254464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318402.030110:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318402.030177:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940254464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (641us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318402.030185:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063
00000100:00100000:1.0:1767318402.030271:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940254464:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318402.477181:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318403.055844:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318403.506025:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318404.077585:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318404.525931:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318405.100912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318405.194334:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318405.194382:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318405.194661:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260352
00000100:00100000:2.0:1767318405.194672:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260352
00000100:00100000:2.0:1767318405.194756:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260224
00000100:00100000:2.0:1767318405.194760:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260224
00000100:00100000:2.0:1767318405.194807:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3866
00000100:00100000:2.0:1767318405.194817:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318405.194925:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (601us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318405.194933:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3866
00000100:00100000:2.0:1767318405.194953:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16232
00000100:00100000:2.0:1767318405.194957:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894260224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318405.194977:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318405.195002:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894260224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (620us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318405.195022:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16232
00000100:00080000:3.0:1767318405.196708:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318405.550704:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318406.124935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318406.125407:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940254592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318406.125485:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318406.130740:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254592
00000100:00100000:0.0:1767318406.130758:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254592
00000100:00100000:0.0:1767318406.130941:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064
00000100:00100000:0.0:1767318406.130951:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940254592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318406.130994:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318406.131106:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940254592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (5620us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318406.131113:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064
00000100:00100000:1.0:1767318406.131377:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940254592:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318406.136748:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318406.573394:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318406.637012:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318381/real 1767318381]  req@ffff93d071213b80 x1853163940248320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318406.637048:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d071213b80 x1853163940248320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318406.637065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318406.637090:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318406.637094:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940248320:0@lo:250:kworker.0
00000100:00080000:0.0:1767318406.637174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318406.637179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318406.637183:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318406.637188:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3631
00000100:00080000:0.0:1767318406.637200:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318406.637206:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318406.637235:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173480 x1853163940254720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318406.637257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318406.637261:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318406.637263:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318406.637266:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3651
00000100:00080000:0.0:1767318406.637268:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318406.637271:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318406.637283:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173b80 x1853163940254848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318406.637291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318406.637294:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318406.637296:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318406.637299:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3651
00000100:00080000:0.0:1767318406.637301:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318406.637303:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318406.637312:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171c00 x1853163940254976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318406.637353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318406.637356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318406.637358:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318406.637361:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3651
00000100:00080000:0.0:1767318406.637363:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318406.637367:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318406.637374:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47172300 x1853163940255360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318406.637392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318406.637395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318406.637397:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318406.637400:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3651
00000100:00080000:0.0:1767318406.637402:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318406.637405:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318406.637412:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171f80 x1853163940255616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318406.637551:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940255232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318406.637614:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318406.637674:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318406.637679:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940255104:0@lo:400:kworker.0
00000100:00100000:3.0:1767318406.637705:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318406.637742:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255104
00000100:00100000:3.0:1767318406.637749:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255104
00000100:00100000:3.0:1767318406.637834:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546
00000100:00100000:3.0:1767318406.637845:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940255104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318406.637895:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940255104:12345-0@lo:400:kworker.0 Request processed in 53us (189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318406.637902:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546
00000100:00080000:3.0:1767318406.637928:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318406.637952:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940255104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318406.638160:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940254720:0@lo:250:kworker.0
00000400:00000100:2.0:1767318406.638185:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940254720 offset 0 length 520: 4
00000100:00100000:2.0:1767318406.638216:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940254848:0@lo:38:kworker.0
00000100:00100000:2.0:1767318406.638237:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318406.638262:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940254976:0@lo:38:kworker.0
00000100:00100000:2.0:1767318406.638281:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318406.638297:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940255360:0@lo:38:kworker.0
00000100:00100000:2.0:1767318406.638315:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318406.638331:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940255616:0@lo:38:kworker.0
00000100:00100000:2.0:1767318406.638351:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318406.638380:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254976
00000100:00100000:2.0:1767318406.638384:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254976
00000100:00100000:2.0:1767318406.638406:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941
00000100:00100000:2.0:1767318406.638411:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940254976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318406.638429:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318406.638459:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940254976:12345-0@lo:38:kworker.0 Request processed in 48us (177us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318406.638465:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941
00000100:00100000:2.0:1767318406.638482:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255232
00000100:00100000:2.0:1767318406.638485:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255232
00000100:00100000:2.0:1767318406.638514:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940254848
00000100:00100000:2.0:1767318406.638518:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940254848
00000100:00100000:2.0:1767318406.638528:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255360
00000100:00100000:2.0:1767318406.638530:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255360
00000100:00100000:2.0:1767318406.638537:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255616
00000100:00100000:2.0:1767318406.638539:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255616
00000100:00100000:2.0:1767318406.638547:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867
00000100:00100000:2.0:1767318406.638552:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940255232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318406.638599:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940255232:12345-0@lo:400:kworker.0 Request processed in 46us (984us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318406.638606:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867
00000100:00100000:2.0:1767318406.638618:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16233
00000100:00100000:2.0:1767318406.638621:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318406.638631:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318406.638653:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940254848:12345-0@lo:38:kworker.0 Request processed in 30us (414us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318406.638659:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16233
00000100:00100000:2.0:1767318406.638671:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16234
00000100:00100000:2.0:1767318406.638674:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940255360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318406.638683:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318406.638703:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940255360:12345-0@lo:38:kworker.0 Request processed in 28us (387us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318406.638708:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16234
00000100:00100000:2.0:1767318406.638718:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16235
00000100:00100000:2.0:1767318406.638721:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940255616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318406.638729:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318406.638750:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940255616:12345-0@lo:38:kworker.0 Request processed in 27us (398us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318406.638755:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16235
00000100:00080000:2.0:1767318406.638799:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318406.638830:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318406.638834:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318406.638837:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940254848:0@lo:38:kworker.0
00000100:00080000:2.0:1767318406.638846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318406.638849:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318406.638852:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940254976:0@lo:38:kworker.0
00000100:00080000:2.0:1767318406.638859:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318406.638861:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318406.638864:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940255360:0@lo:38:kworker.0
00000100:00080000:2.0:1767318406.638871:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318406.638874:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318406.638876:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940255616:0@lo:38:kworker.0
00000100:00100000:3.0:1767318406.639233:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940255232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318406.639612:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940255488:0@lo:400:kworker.0
00000100:00100000:1.0:1767318406.639653:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318406.639795:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255488
00000100:00100000:3.0:1767318406.639800:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255488
00000100:00100000:3.0:1767318406.639860:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868
00000100:00100000:3.0:1767318406.639867:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940255488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318406.639916:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940255488:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318406.639922:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868
00000100:00100000:1.0:1767318406.640019:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940255488:0@lo:400:kworker.0
00000100:00080000:2.0:1767318406.641325:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318407.148938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318407.149207:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940255744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318407.149370:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318407.149524:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255744
00000100:00100000:2.0:1767318407.149533:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255744
00000100:00100000:2.0:1767318407.149594:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065
00000100:00100000:2.0:1767318407.149603:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940255744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318407.149643:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318407.150499:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940255744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 892us (1124us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318407.150509:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065
00000100:00100000:1.0:1767318407.151604:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940255744:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318407.597470:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318408.172979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318408.624039:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318409.196923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318409.651479:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318410.220889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318410.314161:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318410.314283:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260480
00000100:00100000:0.0:1767318410.314293:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260480
00000100:00100000:0.0:1767318410.314377:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16236
00000100:00100000:0.0:1767318410.314387:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894260480:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318410.314413:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318410.314482:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894260480:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (329us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318410.314492:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16236
00000100:00100000:2.0:1767318410.314953:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318410.316395:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260608
00000100:00100000:3.0:1767318410.316406:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260608
00000100:00100000:3.0:1767318410.316478:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3869
00000100:00100000:3.0:1767318410.316490:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260608:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318410.316562:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (1609us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318410.316569:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3869
00000100:00080000:2.0:1767318410.317474:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318410.669658:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318411.244909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:1.0:1767318411.245278:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940255872:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318411.245453:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.245589:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940255872
00000100:00100000:2.0:1767318411.245598:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940255872
00000100:00100000:2.0:1767318411.245652:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066
00000100:00100000:2.0:1767318411.245661:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940255872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318411.245690:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318411.245741:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940255872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (289us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318411.245748:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066
00000100:00080000:3.0:1767318411.245814:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318411.245910:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940255872:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318411.693210:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318411.757186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318411.757202:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318411.757206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318411.757210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318411.757216:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318411.757236:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3656
00000100:00080000:3.0:1767318411.757242:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318411.757250:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318411.757305:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf800 x1853163940256000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318411.757331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318411.757335:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318411.757337:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318411.757341:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3656
00000100:00080000:3.0:1767318411.757343:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318411.757346:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318411.757359:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac000 x1853163940256128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318411.757434:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940256256:0@lo:400:kworker.0
00000100:00100000:0.0:1767318411.757525:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318411.757645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318411.757648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318411.757650:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318411.757654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3656
00000100:00080000:3.0:1767318411.757657:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318411.757660:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318411.757672:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeadf80 x1853163940256512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318411.757687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318411.757702:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318411.757703:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318411.757707:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3656
00000100:00080000:3.0:1767318411.757709:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318411.757713:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318411.757727:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940256768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318411.757751:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940256384:0@lo:400:kworker.0
00000100:00100000:3.0:1767318411.757818:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318411.757843:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318411.757849:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940256640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318411.757885:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318411.757930:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256384
00000100:00100000:3.0:1767318411.757937:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256384
00000100:00100000:3.0:1767318411.757987:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256640
00000100:00100000:3.0:1767318411.757990:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256640
00000100:00100000:3.0:1767318411.758018:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870
00000100:00100000:3.0:1767318411.758027:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940256384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318411.758083:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940256384:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318411.758091:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870
00000100:00100000:3.0:1767318411.758110:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871
00000100:00100000:3.0:1767318411.758116:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940256640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318411.758143:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940256640:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318411.758149:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871
00000100:00080000:3.0:1767318411.758166:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318411.758200:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940256640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318411.758211:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940256384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318411.758493:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256256
00000100:00100000:1.0:1767318411.758498:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256256
00000100:00100000:1.0:1767318411.758540:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547
00000100:00100000:1.0:1767318411.758548:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940256256:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318411.759070:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318411.759432:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940256000:0@lo:38:kworker.0
00000100:00100000:2.0:1767318411.759472:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.759498:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940256128:0@lo:38:kworker.0
00000100:00100000:2.0:1767318411.759520:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.759537:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940256512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318411.759558:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.759574:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940256768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318411.759593:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.759638:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256000
00000100:00100000:2.0:1767318411.759644:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256000
00000100:00100000:2.0:1767318411.759665:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256512
00000100:00100000:2.0:1767318411.759668:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256512
00000100:00100000:2.0:1767318411.759689:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256768
00000100:00100000:2.0:1767318411.759692:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256768
00000100:00100000:2.0:1767318411.759704:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16237
00000100:00100000:2.0:1767318411.759709:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318411.759728:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318411.759762:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256000:12345-0@lo:38:kworker.0 Request processed in 52us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318411.759768:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16237
00000100:00100000:2.0:1767318411.759812:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16238
00000100:00100000:2.0:1767318411.759816:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318411.759827:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318411.759847:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256512:12345-0@lo:38:kworker.0 Request processed in 30us (288us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318411.759852:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16238
00000100:00100000:2.0:1767318411.759862:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16239
00000100:00100000:2.0:1767318411.759865:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318411.759873:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318411.759891:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940256768:12345-0@lo:38:kworker.0 Request processed in 24us (297us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318411.759896:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16239
00000100:00100000:2.0:1767318411.759910:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256128
00000100:00100000:2.0:1767318411.759913:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256128
00000100:00100000:2.0:1767318411.759929:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942
00000100:00100000:2.0:1767318411.759933:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940256128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318411.759941:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318411.759962:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940256128:12345-0@lo:38:kworker.0 Request processed in 28us (442us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318411.759968:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942
00000100:00080000:2.0:1767318411.760008:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318411.760013:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318411.760016:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940256000:0@lo:38:kworker.0
00000100:00080000:2.0:1767318411.760024:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318411.760027:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318411.760030:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940256128:0@lo:38:kworker.0
00000100:00080000:2.0:1767318411.760039:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318411.760042:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318411.760044:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940256512:0@lo:38:kworker.0
00000100:00080000:2.0:1767318411.760050:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318411.760053:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318411.760055:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940256768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318411.763966:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940256256:12345-0@lo:400:kworker.0 Request processed in 5406us (6426us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318411.763985:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547
00000100:00100000:0.0:1767318411.764325:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940256256:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.268924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318412.269115:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318412.269135:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940256896:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318412.269210:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318412.269366:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940256896
00000100:00100000:2.0:1767318412.269375:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940256896
00000100:00100000:2.0:1767318412.269425:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067
00000100:00100000:2.0:1767318412.269434:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940256896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318412.269468:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318412.269520:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940256896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318412.269528:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067
00000100:00100000:0.0:1767318412.270171:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940256896:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318412.717023:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318413.297021:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318413.747036:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318414.319099:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318414.766017:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318415.345265:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318415.436259:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318415.436297:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318415.436396:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260864
00000100:00100000:0.0:1767318415.436406:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260864
00000100:00100000:0.0:1767318415.436485:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260736
00000100:00100000:0.0:1767318415.436489:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260736
00000100:00100000:0.0:1767318415.436508:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3872
00000100:00100000:0.0:1767318415.436518:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260864:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318415.436525:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16240
00000100:00100000:1.0:1767318415.436531:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894260736:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318415.436551:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318415.436664:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318415.436712:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894260864:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 195us (459us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318415.436721:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3872
00000100:00100000:0.0:1767318415.439025:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894260736:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 2482us (2716us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318415.439038:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16240
00010000:00010000:2.0:1767318415.790040:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318416.364997:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318416.365063:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940257024:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318416.365140:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318416.365423:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257024
00000100:00100000:2.0:1767318416.365432:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257024
00000100:00100000:2.0:1767318416.365506:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068
00000100:00100000:2.0:1767318416.365516:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940257024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318416.365546:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318416.365598:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940257024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (467us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318416.365608:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068
00000100:00080000:3.0:1767318416.365675:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318416.367982:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940257024:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318416.812992:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318416.879472:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318416.879484:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318416.879487:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318416.879491:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318416.879495:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318416.879503:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3661
00000100:00080000:3.0:1767318416.879508:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318416.879514:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318416.879553:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940257152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318416.879584:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318416.879588:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318416.879589:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318416.879593:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3661
00000100:00080000:3.0:1767318416.879595:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318416.879599:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318416.879614:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964000 x1853163940257280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318416.879666:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318416.879669:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318416.879671:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318416.879674:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3661
00000100:00080000:3.0:1767318416.879677:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318416.879680:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318416.879689:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940257664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318416.879711:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318416.879715:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318416.879717:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318416.879719:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3661
00000100:00080000:3.0:1767318416.879722:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318416.879737:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318416.879748:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966680 x1853163940257920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318416.879790:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940257536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318416.879793:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940257152:0@lo:38:kworker.0
00000100:00100000:1.0:1767318416.879877:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940257408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318416.879909:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940257792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318416.881146:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318416.881414:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257536
00000100:00100000:3.0:1767318416.881422:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257536
00000100:00100000:3.0:1767318416.881475:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873
00000100:00100000:3.0:1767318416.881486:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940257536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318416.881536:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940257536:12345-0@lo:400:kworker.0 Request processed in 53us (393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318416.881542:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873
00000100:00080000:3.0:1767318416.881566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318416.881595:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940257536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318416.890543:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318416.890612:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940257280:0@lo:38:kworker.0
00000100:00100000:0.0:1767318416.890652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318416.890668:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940257664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318416.890684:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318416.890699:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940257920:0@lo:38:kworker.0
00000100:00100000:0.0:1767318416.890715:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318416.890788:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257152
00000100:00100000:0.0:1767318416.890795:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257152
00000100:00100000:0.0:1767318416.890835:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257664
00000100:00100000:0.0:1767318416.890838:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257664
00000100:00100000:0.0:1767318416.890851:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257920
00000100:00100000:0.0:1767318416.890854:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257920
00000100:00100000:0.0:1767318416.890871:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16241
00000100:00100000:0.0:1767318416.890878:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318416.890899:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318416.890942:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257152:12345-0@lo:38:kworker.0 Request processed in 63us (405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318416.890948:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16241
00000100:00100000:0.0:1767318416.890964:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16242
00000100:00100000:0.0:1767318416.890968:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318416.890977:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318416.891001:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257664:12345-0@lo:38:kworker.0 Request processed in 31us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318416.891006:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16242
00000100:00100000:0.0:1767318416.891016:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16243
00000100:00100000:0.0:1767318416.891020:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318416.891028:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318416.891051:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940257920:12345-0@lo:38:kworker.0 Request processed in 29us (335us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318416.891056:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16243
00000100:00080000:0.0:1767318416.891088:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318416.891093:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318416.891096:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940257152:0@lo:38:kworker.0
00000100:00080000:0.0:1767318416.891105:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318416.891108:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318416.891111:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940257664:0@lo:38:kworker.0
00000100:00080000:0.0:1767318416.891117:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318416.891120:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318416.891123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940257920:0@lo:38:kworker.0
00000100:00100000:0.0:1767318416.891188:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257280
00000100:00100000:0.0:1767318416.891192:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257280
00000100:00100000:0.0:1767318416.891213:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943
00000100:00100000:0.0:1767318416.891217:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940257280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318416.891225:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318416.891253:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940257280:12345-0@lo:38:kworker.0 Request processed in 35us (600us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318416.891259:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943
00000100:00080000:0.0:1767318416.891279:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318416.891283:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318416.891286:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940257280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318416.894479:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318416.894929:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257408
00000100:00100000:3.0:1767318416.894940:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257408
00000100:00100000:3.0:1767318416.895255:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548
00000100:00100000:3.0:1767318416.895268:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940257408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318416.895336:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940257408:12345-0@lo:400:kworker.0 Request processed in 73us (864us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318416.895343:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548
00000100:00100000:1.0:1767318416.895409:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940257408:0@lo:400:kworker.0
00000100:00080000:0.0:1767318416.895516:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318416.895549:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318416.895633:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940257792
00000100:00100000:3.0:1767318416.895721:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940257792
00000100:00100000:2.0:1767318416.895979:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874
00000100:00100000:2.0:1767318416.895989:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940257792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318416.896039:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940257792:12345-0@lo:400:kworker.0 Request processed in 53us (490us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318416.896046:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874
00000100:00100000:1.0:1767318416.896153:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940257792:0@lo:400:kworker.0
00000100:00080000:0.0:1767318416.899981:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318417.388905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318417.388998:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940258048:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318417.389092:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318417.389533:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258048
00000100:00100000:0.0:1767318417.389542:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258048
00000100:00100000:0.0:1767318417.389643:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069
00000100:00100000:0.0:1767318417.389652:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940258048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318417.389683:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318417.389747:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940258048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (655us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318417.389754:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069
00000100:00100000:3.0:1767318417.390078:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940258048:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318417.837183:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318418.412970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318418.861683:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318419.436916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318419.886570:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318420.460871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318420.551248:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318420.551297:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318420.551363:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894260992
00000100:00100000:2.0:1767318420.551373:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894260992
00000100:00100000:0.0:1767318420.551406:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261120
00000100:00100000:0.0:1767318420.551413:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261120
00000100:00100000:2.0:1767318420.551425:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16244
00000100:00100000:2.0:1767318420.551434:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894260992:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318420.551457:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318420.551486:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3875
00000100:00100000:0.0:1767318420.551496:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894261120:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318420.551517:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894260992:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 82us (278us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318420.551525:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16244
00000100:00100000:0.0:1767318420.551552:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894261120:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 57us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318420.551561:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3875
00000100:00080000:3.0:1767318420.552414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318420.909457:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318421.485078:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940258176:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318421.485170:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318421.485942:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258176
00000100:00100000:0.0:1767318421.485961:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258176
00000100:00100000:0.0:1767318421.486031:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070
00000100:00100000:0.0:1767318421.486040:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940258176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318421.486079:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318421.486139:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940258176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (957us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318421.486146:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070
00000100:00100000:3.0:1767318421.486359:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00080000:1.0:1767318421.487884:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318421.494383:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940258176:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318421.938273:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318422.001124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318422.001134:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318422.001137:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318422.001141:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318422.001145:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318422.001152:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3666
00000100:00080000:0.0:1767318422.001157:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318422.001164:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318422.001205:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170000 x1853163940258304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318422.001221:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318422.001225:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318422.001226:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318422.001230:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3666
00000100:00080000:0.0:1767318422.001232:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318422.001235:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318422.001247:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170e00 x1853163940258432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318422.001317:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318422.001321:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318422.001322:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318422.001325:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3666
00000100:00080000:0.0:1767318422.001328:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318422.001331:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318422.001341:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940258944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318422.001356:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318422.001358:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318422.001360:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318422.001363:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3666
00000100:00080000:0.0:1767318422.001365:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318422.001368:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318422.001377:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba25c00 x1853163940259200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318422.001590:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940259072:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.001652:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318422.001734:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318422.001740:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940258560:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.001801:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318422.001841:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258560
00000100:00100000:1.0:1767318422.001848:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258560
00000100:00100000:1.0:1767318422.001905:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549
00000100:00100000:1.0:1767318422.001912:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940258560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.001960:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940258560:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318422.001967:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549
00000100:00100000:1.0:1767318422.002012:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940258560:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002034:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940258688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002057:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318422.002079:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318422.002085:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940258816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002105:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318422.002129:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259072
00000100:00100000:1.0:1767318422.002133:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259072
00000100:00100000:1.0:1767318422.002165:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258816
00000100:00100000:1.0:1767318422.002168:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258816
00000100:00100000:1.0:1767318422.002189:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876
00000100:00100000:1.0:1767318422.002195:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940259072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002229:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940259072:12345-0@lo:400:kworker.0 Request processed in 34us (576us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318422.002235:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876
00000100:00100000:1.0:1767318422.002247:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877
00000100:00100000:1.0:1767318422.002253:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940258816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002285:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940258816:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318422.002291:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877
00000100:00100000:1.0:1767318422.002307:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258688
00000100:00100000:1.0:1767318422.002311:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258688
00000100:00100000:1.0:1767318422.002332:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550
00000100:00100000:1.0:1767318422.002338:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940258688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002367:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940258688:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318422.002373:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550
00000100:00080000:1.0:1767318422.002389:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318422.002393:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318422.002413:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940259072:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002434:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940258816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318422.002442:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940258688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.002724:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940258304:0@lo:38:kworker.0
00000100:00100000:2.0:1767318422.002754:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.002807:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940258432:0@lo:38:kworker.0
00000100:00100000:2.0:1767318422.002831:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.002846:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940258944:0@lo:38:kworker.0
00000100:00100000:2.0:1767318422.002878:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.002894:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940259200:0@lo:38:kworker.0
00000100:00100000:2.0:1767318422.002912:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.002940:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258304
00000100:00100000:2.0:1767318422.002944:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258304
00000100:00100000:2.0:1767318422.002958:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258944
00000100:00100000:2.0:1767318422.002961:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258944
00000100:00100000:2.0:1767318422.002968:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259200
00000100:00100000:2.0:1767318422.002970:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259200
00000100:00100000:2.0:1767318422.002978:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245
00000100:00100000:2.0:1767318422.002982:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940258304:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318422.003000:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318422.003032:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940258304:12345-0@lo:38:kworker.0 Request processed in 48us (276us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318422.003038:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245
00000100:00100000:2.0:1767318422.003050:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246
00000100:00100000:2.0:1767318422.003053:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940258944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318422.003061:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318422.003081:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940258944:12345-0@lo:38:kworker.0 Request processed in 27us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318422.003086:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246
00000100:00100000:2.0:1767318422.003095:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16247
00000100:00100000:2.0:1767318422.003099:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940259200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318422.003109:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318422.003129:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940259200:12345-0@lo:38:kworker.0 Request processed in 29us (215us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318422.003135:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16247
00000100:00080000:2.0:1767318422.003159:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318422.003164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318422.003167:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940258304:0@lo:38:kworker.0
00000100:00080000:2.0:1767318422.003174:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318422.003177:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318422.003180:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940258944:0@lo:38:kworker.0
00000100:00080000:2.0:1767318422.003186:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318422.003190:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318422.003192:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940259200:0@lo:38:kworker.0
00000100:00100000:3.0:1767318422.003536:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940258432
00000100:00100000:3.0:1767318422.003541:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940258432
00000100:00100000:3.0:1767318422.003574:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944
00000100:00100000:3.0:1767318422.003580:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940258432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318422.003591:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318422.003627:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940258432:12345-0@lo:38:kworker.0 Request processed in 46us (795us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318422.003633:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944
00000100:00080000:3.0:1767318422.003658:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318422.003662:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318422.003665:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940258432:0@lo:38:kworker.0
00000100:00100000:1.0:1767318422.512209:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318422.512235:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940259328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318422.512317:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.512905:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259328
00000100:00100000:2.0:1767318422.512915:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259328
00000100:00100000:2.0:1767318422.512971:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071
00000100:00100000:2.0:1767318422.512980:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940259328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318422.513013:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318422.513081:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940259328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (764us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318422.513088:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071
00000100:00100000:2.0:1767318422.513138:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940259328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318422.514586:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318422.956947:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318423.532975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318423.981502:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318424.557112:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318425.009521:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318425.581670:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318425.672007:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767318425.672054:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894261248 offset 0 length 520: 4
00000100:00100000:2.0:1767318425.672080:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318425.672173:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261504
00000100:00100000:0.0:1767318425.672183:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261504
00000100:00100000:0.0:1767318425.672264:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3878
00000100:00100000:0.0:1767318425.672275:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894261504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318425.672347:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894261504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318425.672356:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3878
00000100:00100000:0.0:1767318425.672373:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261376
00000100:00100000:0.0:1767318425.672376:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261376
00000100:00100000:0.0:1767318425.672395:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16248
00000100:00100000:0.0:1767318425.672413:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894261376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318425.672435:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318425.672461:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894261376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318425.672468:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16248
00000100:00080000:2.0:1767318425.675964:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318426.031971:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318426.604919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318426.605232:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940259456:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318426.605322:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318426.605354:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259456
00000100:00100000:3.0:1767318426.605364:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259456
00000100:00100000:3.0:1767318426.605436:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072
00000100:00100000:3.0:1767318426.605449:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940259456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318426.605485:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318426.605544:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940259456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (221us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318426.605551:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072
00000100:00080000:1.0:1767318426.605622:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318426.605732:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940259456:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318427.053034:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318427.117689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318427.117700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318427.117703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318427.117707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318427.117711:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318427.117727:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3672
00000100:00080000:2.0:1767318427.117732:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318427.117738:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318427.117794:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3100 x1853163940259584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318427.117819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318427.117823:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318427.117824:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318427.117828:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3672
00000100:00080000:2.0:1767318427.117830:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318427.117833:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318427.117849:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1500 x1853163940259712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318427.117916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318427.117919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318427.117921:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318427.117924:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3672
00000100:00080000:2.0:1767318427.117926:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318427.117929:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318427.117939:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0700 x1853163940260224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318427.117952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318427.117955:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318427.117956:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318427.117959:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3672
00000100:00080000:2.0:1767318427.117962:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318427.117965:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318427.117975:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3480 x1853163940260480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318427.117999:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940259968:0@lo:400:kworker.0
00000100:00100000:2.0:1767318427.118060:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318427.118137:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318427.118144:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940260096:0@lo:400:kworker.0
00000100:00100000:2.0:1767318427.118167:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318427.118250:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259968
00000100:00100000:1.0:1767318427.118257:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259968
00000100:00100000:1.0:1767318427.118320:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551
00000100:00100000:1.0:1767318427.118329:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940259968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118380:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940259968:12345-0@lo:400:kworker.0 Request processed in 53us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318427.118387:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551
00000100:00100000:1.0:1767318427.118445:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940259968:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118465:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940260352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118489:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318427.118508:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318427.118514:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940259840:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118553:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318427.118578:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260096
00000100:00100000:1.0:1767318427.118582:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260096
00000100:00100000:1.0:1767318427.118611:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260352
00000100:00100000:1.0:1767318427.118614:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260352
00000100:00100000:1.0:1767318427.118645:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879
00000100:00100000:1.0:1767318427.118652:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940260096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118687:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940260096:12345-0@lo:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318427.118693:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879
00000100:00100000:1.0:1767318427.118705:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880
00000100:00100000:1.0:1767318427.118711:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940260352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118741:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940260352:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318427.118747:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880
00000100:00100000:1.0:1767318427.118790:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259840
00000100:00100000:1.0:1767318427.118794:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259840
00000100:00100000:1.0:1767318427.118815:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767318427.118821:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940259840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118863:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940259840:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318427.118869:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767318427.118897:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940260096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118919:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940259840:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.118927:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940260352:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.119090:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940259584:0@lo:38:kworker.0
00000100:00100000:3.0:1767318427.119121:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.119149:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940259712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318427.119175:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.119195:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940260224:0@lo:38:kworker.0
00000100:00100000:3.0:1767318427.119216:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.119230:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940260480:0@lo:38:kworker.0
00000100:00100000:3.0:1767318427.119248:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.119276:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259712
00000100:00100000:3.0:1767318427.119280:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259712
00000100:00100000:3.0:1767318427.119302:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945
00000100:00100000:3.0:1767318427.119307:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940259712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318427.119324:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318427.119355:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940259712:12345-0@lo:38:kworker.0 Request processed in 46us (179us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318427.119361:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945
00000100:00100000:3.0:1767318427.119382:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940259584
00000100:00100000:3.0:1767318427.119386:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940259584
00000100:00100000:3.0:1767318427.119403:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260224
00000100:00100000:3.0:1767318427.119406:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260224
00000100:00100000:3.0:1767318427.119418:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260480
00000100:00100000:3.0:1767318427.119420:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260480
00000100:00100000:3.0:1767318427.119434:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16249
00000100:00100000:3.0:1767318427.119438:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940259584:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318427.119447:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318427.119472:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940259584:12345-0@lo:38:kworker.0 Request processed in 33us (350us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318427.119477:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16249
00000100:00100000:3.0:1767318427.119488:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16250
00000100:00100000:3.0:1767318427.119491:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940260224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318427.119500:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318427.119520:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940260224:12345-0@lo:38:kworker.0 Request processed in 27us (303us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318427.119526:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16250
00000100:00100000:3.0:1767318427.119537:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16251
00000100:00100000:3.0:1767318427.119556:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940260480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318427.119564:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318427.119587:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940260480:12345-0@lo:38:kworker.0 Request processed in 31us (338us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318427.119593:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16251
00000100:00080000:3.0:1767318427.119624:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318427.119629:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318427.119642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940259584:0@lo:38:kworker.0
00000100:00080000:3.0:1767318427.119651:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318427.119654:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318427.119656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940259712:0@lo:38:kworker.0
00000100:00080000:3.0:1767318427.119663:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318427.119665:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318427.119667:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940260224:0@lo:38:kworker.0
00000100:00080000:3.0:1767318427.119674:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318427.119677:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318427.119679:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940260480:0@lo:38:kworker.0
00000100:00080000:2.0:1767318427.120113:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318427.120289:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318427.628952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318427.633804:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940260608:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318427.633877:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.634300:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260608
00000100:00100000:3.0:1767318427.634308:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260608
00000100:00100000:3.0:1767318427.634373:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073
00000100:00100000:3.0:1767318427.634383:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940260608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318427.634412:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318427.634463:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940260608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (584us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318427.634470:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073
00000100:00100000:0.0:1767318427.634724:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940260608:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318428.081597:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318428.654125:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318429.101077:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318429.678393:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318430.128644:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318430.700975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318430.792702:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318430.793105:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261760
00000100:00100000:0.0:1767318430.793117:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261760
00000100:00100000:0.0:1767318430.793236:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3881
00000100:00100000:0.0:1767318430.793245:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894261760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318430.793328:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894261760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (645us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318430.793337:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3881
00000100:00080000:2.0:1767318430.793418:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318430.803055:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318430.803267:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261632
00000100:00100000:1.0:1767318430.803288:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261632
00000100:00100000:1.0:1767318430.803356:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16252
00000100:00100000:1.0:1767318430.803365:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894261632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318430.803389:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318430.803472:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894261632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 106us (426us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318430.803479:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16252
00010000:00010000:2.0:1767318431.152666:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318431.212944:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318406/real 1767318406]  req@ffff93cf47173480 x1853163940254720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318431.212980:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47173480 x1853163940254720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318431.213001:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318431.213023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318431.213027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940254720:0@lo:250:kworker.0
00000100:00080000:1.0:1767318431.213153:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318431.213159:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318431.213162:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318431.213167:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3656
00000100:00080000:1.0:1767318431.213170:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318431.213176:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318431.213207:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940260736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318431.213232:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318431.213236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318431.213238:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318431.213241:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3677
00000100:00080000:1.0:1767318431.213244:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318431.213247:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318431.213263:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3100 x1853163940260864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318431.213286:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318431.213289:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318431.213291:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318431.213295:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3677
00000100:00080000:1.0:1767318431.213297:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318431.213301:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318431.213316:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940260992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318431.213383:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318431.213387:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318431.213388:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318431.213392:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3677
00000100:00080000:1.0:1767318431.213394:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318431.213398:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318431.213409:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170e00 x1853163940261504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318431.213426:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318431.213429:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318431.213431:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318431.213435:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3677
00000100:00080000:1.0:1767318431.213437:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318431.213441:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318431.213451:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170700 x1853163940261760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318431.213477:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940261376:0@lo:400:kworker.0
00000100:00100000:1.0:1767318431.213539:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318431.213592:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318431.213629:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940261632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318431.213667:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318431.213702:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261376
00000100:00100000:1.0:1767318431.213709:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261376
00000100:00100000:1.0:1767318431.213753:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261632
00000100:00100000:1.0:1767318431.213757:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261632
00000100:00100000:1.0:1767318431.213798:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882
00000100:00100000:1.0:1767318431.213807:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940261376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318431.213857:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940261376:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318431.213864:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882
00000100:00100000:1.0:1767318431.213882:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883
00000100:00100000:1.0:1767318431.213889:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940261632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318431.213916:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940261632:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318431.213922:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883
00000100:00100000:1.0:1767318431.213956:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940261632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318431.213965:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940261376:0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214157:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214189:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318431.214224:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318431.214229:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261120:0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214250:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318431.214274:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261248
00000100:00100000:2.0:1767318431.214278:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261248
00000100:00100000:2.0:1767318431.214306:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261120
00000100:00100000:2.0:1767318431.214310:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261120
00000100:00100000:2.0:1767318431.214334:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553
00000100:00100000:2.0:1767318431.214354:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214387:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261248:12345-0@lo:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318431.214392:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553
00000100:00100000:2.0:1767318431.214403:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554
00000100:00100000:2.0:1767318431.214408:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214431:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261120:12345-0@lo:400:kworker.0 Request processed in 23us (180us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318431.214437:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554
00000100:00080000:2.0:1767318431.214459:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318431.214463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318431.214466:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318431.214483:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261120:0@lo:400:kworker.0
00000100:00100000:2.0:1767318431.214492:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318431.215957:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940260736:0@lo:250:kworker.0
00000400:00000100:3.0:1767318431.216002:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940260736 offset 0 length 520: 4
00000100:00100000:3.0:1767318431.216032:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940260864:0@lo:38:kworker.0
00000100:00100000:3.0:1767318431.216069:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318431.216099:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940260992:0@lo:38:kworker.0
00000100:00100000:3.0:1767318431.216120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318431.216136:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940261504:0@lo:38:kworker.0
00000100:00100000:3.0:1767318431.216153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318431.216167:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940261760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318431.216187:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318431.216219:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260992
00000100:00100000:3.0:1767318431.216225:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260992
00000100:00100000:3.0:1767318431.216254:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946
00000100:00100000:3.0:1767318431.216260:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940260992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318431.216291:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318431.216327:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940260992:12345-0@lo:38:kworker.0 Request processed in 66us (205us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318431.216334:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946
00000100:00100000:3.0:1767318431.216369:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940260864
00000100:00100000:3.0:1767318431.216373:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940260864
00000100:00100000:3.0:1767318431.216392:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261504
00000100:00100000:3.0:1767318431.216395:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261504
00000100:00100000:3.0:1767318431.216406:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261760
00000100:00100000:3.0:1767318431.216408:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261760
00000100:00100000:3.0:1767318431.216422:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16253
00000100:00100000:3.0:1767318431.216425:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940260864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318431.216435:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318431.216460:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940260864:12345-0@lo:38:kworker.0 Request processed in 33us (390us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318431.216466:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16253
00000100:00100000:3.0:1767318431.216478:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16254
00000100:00100000:3.0:1767318431.216481:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940261504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318431.216490:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318431.216512:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940261504:12345-0@lo:38:kworker.0 Request processed in 29us (358us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318431.216517:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16254
00000100:00100000:3.0:1767318431.216527:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16255
00000100:00100000:3.0:1767318431.216530:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940261760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318431.216538:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318431.216557:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940261760:12345-0@lo:38:kworker.0 Request processed in 26us (370us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318431.216562:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16255
00000100:00080000:3.0:1767318431.216608:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318431.216614:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318431.216617:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940260864:0@lo:38:kworker.0
00000100:00080000:3.0:1767318431.216626:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318431.216630:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318431.216632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940260992:0@lo:38:kworker.0
00000100:00080000:3.0:1767318431.216649:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318431.216653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318431.216656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940261504:0@lo:38:kworker.0
00000100:00080000:3.0:1767318431.216663:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318431.216665:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318431.216668:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940261760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318431.727314:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318431.730476:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318431.733496:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261888:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318431.733948:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318431.738517:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940261888
00000100:00100000:2.0:1767318431.738535:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940261888
00000100:00100000:2.0:1767318431.738628:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074
00000100:00100000:2.0:1767318431.738639:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318431.738678:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318431.738771:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940261888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (4823us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318431.738795:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074
00000100:00100000:0.0:1767318431.739414:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940261888:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318432.173178:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318432.748953:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318432.749345:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940262016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318432.749416:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318432.749858:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262016
00000100:00100000:2.0:1767318432.749867:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262016
00000100:00100000:2.0:1767318432.750057:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075
00000100:00100000:2.0:1767318432.750067:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940262016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318432.750096:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318432.750151:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940262016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (734us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318432.750160:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075
00000100:00100000:3.0:1767318432.750524:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940262016:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318433.198698:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318433.772996:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318434.221231:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318434.796978:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318435.245808:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318435.820937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318435.915312:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318435.915412:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262016
00000100:00100000:3.0:1767318435.915420:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318435.915426:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262016
00000100:00100000:0.0:1767318435.915511:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894261888
00000100:00100000:0.0:1767318435.915515:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894261888
00000100:00100000:0.0:1767318435.915535:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3884
00000100:00100000:0.0:1767318435.915543:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894262016:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318435.915633:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894262016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318435.915641:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3884
00000100:00100000:0.0:1767318435.915660:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16256
00000100:00100000:0.0:1767318435.915665:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894261888:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:2.0:1767318435.915806:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767318435.915982:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318435.916041:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894261888:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 374us (622us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318435.916045:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16256
00010000:00010000:2.0:1767318436.271685:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318436.332908:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318436.332921:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318436.332924:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318436.332929:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318436.332933:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318436.332941:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3681
00000100:00080000:1.0:1767318436.332947:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318436.332955:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318436.332999:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7c000 x1853163940262144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318436.333024:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318436.333028:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318436.333030:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318436.333034:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3681
00000100:00080000:1.0:1767318436.333036:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318436.333041:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318436.333059:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940262272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318436.333071:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940262144:0@lo:38:kworker.0
00000100:00100000:3.0:1767318436.333145:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318436.333147:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318436.333152:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318436.333155:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318436.333161:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3681
00000100:00080000:1.0:1767318436.333163:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318436.333168:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318436.333181:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7c700 x1853163940262784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318436.333200:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318436.333204:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318436.333206:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318436.333210:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3681
00000100:00080000:1.0:1767318436.333212:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318436.333216:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318436.333222:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940262272:0@lo:38:kworker.0
00000100:00100000:1.0:1767318436.333229:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7e680 x1853163940263040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318436.333258:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940262912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333291:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318436.333313:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318436.333319:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940262656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333342:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318436.333376:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940262528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333391:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262144
00000100:00100000:1.0:1767318436.333400:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262144
00000100:00100000:0.0:1767318436.333413:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318436.333443:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262912
00000100:00100000:1.0:1767318436.333447:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262912
00000100:00100000:0.0:1767318436.333450:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318436.333458:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940262400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318436.333484:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318436.333490:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262656
00000100:00100000:1.0:1767318436.333495:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262656
00000100:00100000:0.0:1767318436.333516:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262528
00000100:00100000:0.0:1767318436.333521:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262528
00000100:00100000:1.0:1767318436.333525:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885
00000100:00100000:1.0:1767318436.333536:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940262912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318436.333568:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262400
00000100:00100000:0.0:1767318436.333572:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262400
00000100:00100000:0.0:1767318436.333598:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555
00000100:00100000:0.0:1767318436.333607:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940262528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333620:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940262912:12345-0@lo:400:kworker.0 Request processed in 84us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318436.333628:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885
00000100:00100000:1.0:1767318436.333650:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886
00000100:00100000:0.0:1767318436.333654:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940262528:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318436.333661:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940262656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318436.333667:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555
00000100:00100000:0.0:1767318436.333696:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556
00000100:00100000:1.0:1767318436.333702:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940262656:12345-0@lo:400:kworker.0 Request processed in 43us (359us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318436.333707:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940262400:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333714:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886
00000100:00100000:1.0:1767318436.333731:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16257
00000100:00100000:1.0:1767318436.333737:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940262144:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318436.333745:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940262400:12345-0@lo:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318436.333753:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556
00010000:00020000:1.0:1767318436.333756:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318436.333812:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940262144:12345-0@lo:38:kworker.0 Request processed in 72us (665us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318436.333819:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16257
00000100:00100000:0.0:1767318436.333830:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940262400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318436.333843:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940262528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333858:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940262656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318436.333870:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940262912:0@lo:400:kworker.0
00000100:00080000:2.0:1767318436.334231:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318436.334236:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318436.334238:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318436.334347:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318436.334379:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940262784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318436.334405:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318436.334434:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318436.334438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318436.334441:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940262144:0@lo:38:kworker.0
00000100:00100000:3.0:1767318436.334454:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940263040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318436.334475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318436.334564:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262272
00000100:00100000:0.0:1767318436.334570:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262272
00000100:00100000:1.0:1767318436.334571:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940262784
00000100:00100000:1.0:1767318436.334577:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940262784
00000100:00100000:1.0:1767318436.334603:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263040
00000100:00100000:0.0:1767318436.334607:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947
00000100:00100000:1.0:1767318436.334607:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263040
00000100:00100000:0.0:1767318436.334616:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940262272:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318436.334626:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16258
00010000:00020000:0.0:1767318436.334631:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318436.334634:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940262784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318436.334648:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318436.334672:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940262272:12345-0@lo:38:kworker.0 Request processed in 54us (324us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318436.334685:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940262784:12345-0@lo:38:kworker.0 Request processed in 51us (278us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318436.334692:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947
00000100:00100000:1.0:1767318436.334695:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16258
00000100:00100000:1.0:1767318436.334715:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16259
00000100:00100000:1.0:1767318436.334719:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940263040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318436.334910:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318436.334935:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940263040:12345-0@lo:38:kworker.0 Request processed in 215us (459us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318436.334941:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16259
00000100:00080000:3.0:1767318436.335564:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318436.335570:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318436.335574:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940263040:0@lo:38:kworker.0
00000100:00080000:3.0:1767318436.335584:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318436.335588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318436.335590:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940262272:0@lo:38:kworker.0
00000100:00080000:3.0:1767318436.335598:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318436.335601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318436.335604:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940262784:0@lo:38:kworker.0
00000100:00100000:1.0:1767318436.847235:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318436.847260:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940263168:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318436.847341:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318436.847451:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263168
00000100:00100000:3.0:1767318436.847461:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263168
00000100:00100000:3.0:1767318436.847521:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076
00000100:00100000:3.0:1767318436.847531:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940263168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318436.847574:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318436.847617:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940263168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (275us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318436.847624:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076
00000100:00100000:1.0:1767318436.873060:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940263168:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318436.883668:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318437.293428:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318437.869460:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318437.869484:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940263296:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318437.869568:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318437.870181:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263296
00000100:00100000:2.0:1767318437.870189:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263296
00000100:00100000:2.0:1767318437.870243:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077
00000100:00100000:2.0:1767318437.870252:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940263296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318437.870285:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318437.870350:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940263296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (783us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318437.870358:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077
00000100:00100000:0.0:1767318437.870446:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940263296:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318437.932909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318438.317591:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318438.957217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318439.345604:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318439.980970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318440.365007:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318441.005908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318441.037168:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318441.037316:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318441.039535:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262272
00000100:00100000:1.0:1767318441.039550:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262272
00000100:00100000:1.0:1767318441.040016:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262144
00000100:00100000:1.0:1767318441.040021:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262144
00000100:00100000:1.0:1767318441.040046:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3887
00000100:00100000:1.0:1767318441.040057:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894262272:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318441.040154:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894262272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (3001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318441.040163:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3887
00000100:00100000:1.0:1767318441.040184:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16260
00000100:00100000:1.0:1767318441.040188:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894262144:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318441.040210:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318441.040239:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894262144:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (2924us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318441.040245:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16260
00000100:00080000:3.0:1767318441.040362:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318441.389005:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318441.453151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318441.453158:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318441.453160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318441.453163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318441.453167:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318441.453173:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3686
00000100:00080000:0.0:1767318441.453178:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318441.453184:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318441.453223:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2d80 x1853163940263424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318441.453241:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318441.453244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318441.453246:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318441.453250:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3686
00000100:00080000:0.0:1767318441.453260:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318441.453263:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318441.453277:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046adc380 x1853163940263552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318441.453338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318441.453342:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318441.453344:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318441.453347:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3686
00000100:00080000:0.0:1767318441.453350:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318441.453354:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318441.453365:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90700 x1853163940264064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318441.453380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318441.453382:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318441.453384:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318441.453388:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3686
00000100:00080000:0.0:1767318441.453390:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318441.453393:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318441.453402:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93800 x1853163940264320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318441.453430:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940263936:0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453514:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318441.453582:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318441.453588:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940264192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453615:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318441.453648:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263936
00000100:00100000:2.0:1767318441.453648:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940263808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453656:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263936
00000100:00100000:2.0:1767318441.453681:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318441.453704:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264192
00000100:00100000:2.0:1767318441.453705:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318441.453707:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264192
00000100:00100000:2.0:1767318441.453709:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940263680:0@lo:400:kworker.0
00000100:00100000:2.0:1767318441.453730:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318441.453731:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888
00000100:00100000:0.0:1767318441.453738:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940263936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318441.453789:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263808
00000100:00100000:2.0:1767318441.453793:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263808
00000100:00100000:0.0:1767318441.453801:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940263936:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318441.453808:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888
00000100:00100000:2.0:1767318441.453818:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263680
00000100:00100000:2.0:1767318441.453820:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263680
00000100:00100000:0.0:1767318441.453823:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889
00000100:00100000:0.0:1767318441.453828:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940264192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318441.453838:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557
00000100:00100000:2.0:1767318441.453843:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940263808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453853:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940264192:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318441.453858:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889
00000100:00100000:2.0:1767318441.453872:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940263808:12345-0@lo:400:kworker.0 Request processed in 29us (190us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318441.453878:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558
00000100:00100000:0.0:1767318441.453883:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940263680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318441.453892:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557
00000100:00080000:2.0:1767318441.453908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318441.453910:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940263680:12345-0@lo:400:kworker.0 Request processed in 28us (180us total) trans 0 rc 0/0
00000100:00080000:2.0:1767318441.453911:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318441.453914:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318441.453916:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558
00000100:00100000:2.0:1767318441.453939:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940263680:0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453944:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940264192:0@lo:400:kworker.0
00000100:00100000:2.0:1767318441.453948:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940263808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318441.453952:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940263936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318441.454176:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940263424:0@lo:38:kworker.0
00000100:00100000:3.0:1767318441.454205:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318441.454273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940263552:0@lo:38:kworker.0
00000100:00100000:3.0:1767318441.454295:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318441.454318:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940264064:0@lo:38:kworker.0
00000100:00100000:3.0:1767318441.454337:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318441.454379:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263552
00000100:00100000:0.0:1767318441.454384:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263552
00000100:00100000:0.0:1767318441.454417:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948
00000100:00100000:0.0:1767318441.454423:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940263552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318441.454441:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318441.454474:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940263552:12345-0@lo:38:kworker.0 Request processed in 50us (177us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318441.454480:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948
00000100:00100000:3.0:1767318441.454639:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940264320:0@lo:38:kworker.0
00000100:00100000:3.0:1767318441.454663:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318441.454710:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940263424
00000100:00100000:1.0:1767318441.454714:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940263424
00000100:00100000:1.0:1767318441.454742:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264064
00000100:00100000:1.0:1767318441.454745:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264064
00000100:00100000:1.0:1767318441.454764:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16261
00000100:00100000:1.0:1767318441.454768:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940263424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318441.454799:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318441.454830:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940263424:12345-0@lo:38:kworker.0 Request processed in 60us (623us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318441.454836:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16261
00000100:00100000:1.0:1767318441.454849:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16262
00000100:00100000:1.0:1767318441.454852:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940264064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318441.454860:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318441.454882:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940264064:12345-0@lo:38:kworker.0 Request processed in 28us (544us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318441.454888:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16262
00000100:00080000:3.0:1767318441.455053:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318441.455059:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318441.455062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940263424:0@lo:38:kworker.0
00000100:00080000:3.0:1767318441.455070:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318441.455073:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318441.455076:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940263552:0@lo:38:kworker.0
00000100:00080000:3.0:1767318441.455082:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318441.455085:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318441.455087:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940264064:0@lo:38:kworker.0
00000100:00100000:0.0:1767318441.455526:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264320
00000100:00100000:0.0:1767318441.455531:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264320
00000100:00100000:0.0:1767318441.455563:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16263
00000100:00100000:0.0:1767318441.455568:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940264320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318441.455578:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318441.455621:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940264320:12345-0@lo:38:kworker.0 Request processed in 52us (958us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318441.455627:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16263
00000100:00080000:3.0:1767318441.456307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318441.456312:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318441.456316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940264320:0@lo:38:kworker.0
00000100:00100000:2.0:1767318441.965214:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318441.965241:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940264448:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318441.965323:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318441.965450:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264448
00000100:00100000:3.0:1767318441.965460:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264448
00000100:00100000:3.0:1767318441.965524:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078
00000100:00100000:3.0:1767318441.965534:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940264448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318441.965563:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318441.965616:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940264448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318441.965636:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078
00000100:00100000:1.0:1767318441.965849:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940264448:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318442.028904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318442.414188:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318443.003027:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940264576:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318443.003107:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318443.003299:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264576
00000100:00100000:2.0:1767318443.003307:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264576
00000100:00100000:2.0:1767318443.003387:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079
00000100:00100000:2.0:1767318443.003397:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940264576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318443.003427:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318443.003477:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940264576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318443.003484:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079
00000100:00100000:2.0:1767318443.003542:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940264576:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318443.003638:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318443.053659:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318443.436988:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318444.077337:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318444.461608:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318445.100892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318445.487606:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318446.124878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318446.155167:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318446.155217:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318446.155428:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262528
00000100:00100000:1.0:1767318446.155437:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262528
00000100:00100000:1.0:1767318446.155531:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262400
00000100:00100000:1.0:1767318446.155534:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262400
00000100:00100000:1.0:1767318446.155560:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3890
00000100:00100000:1.0:1767318446.155569:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894262528:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318446.155643:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894262528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (487us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318446.155651:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3890
00000100:00100000:1.0:1767318446.155673:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16264
00000100:00100000:1.0:1767318446.155678:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894262400:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318446.155703:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318446.155725:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894262400:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (509us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318446.155729:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16264
00000100:00080000:2.0:1767318446.156291:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318446.509117:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318446.576440:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318446.576451:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318446.576482:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318446.576487:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318446.576491:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318446.576499:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3691
00000100:00080000:1.0:1767318446.576504:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318446.576511:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318446.576550:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7c700 x1853163940264704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318446.576580:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318446.576583:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318446.576584:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318446.576586:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3691
00000100:00080000:1.0:1767318446.576588:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318446.576590:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318446.576601:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940264832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318446.576684:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318446.576759:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940264704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318446.576835:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318446.576878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940264832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318446.576894:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318446.576926:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264832
00000100:00100000:3.0:1767318446.576933:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264832
00000100:00100000:3.0:1767318446.576962:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949
00000100:00100000:3.0:1767318446.576967:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940264832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318446.576988:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318446.577022:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940264832:12345-0@lo:38:kworker.0 Request processed in 54us (126us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318446.577038:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949
00000100:00100000:3.0:1767318446.577065:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264704
00000100:00100000:3.0:1767318446.577067:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264704
00000100:00100000:3.0:1767318446.577084:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16265
00000100:00100000:3.0:1767318446.577087:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940264704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318446.577095:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318446.577111:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940264704:12345-0@lo:38:kworker.0 Request processed in 24us (276us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318446.577116:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16265
00000100:00080000:3.0:1767318446.577149:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318446.577154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318446.577158:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940264704:0@lo:38:kworker.0
00000100:00080000:3.0:1767318446.577166:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318446.577168:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318446.577171:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940264832:0@lo:38:kworker.0
00000100:00100000:0.0:1767318446.577324:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318446.577333:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940265088:0@lo:400:kworker.0
00000100:00100000:0.0:1767318446.577358:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318446.577575:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265088
00000100:00100000:3.0:1767318446.577578:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265088
00000100:00100000:3.0:1767318446.577618:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559
00000100:00100000:3.0:1767318446.577627:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940265088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318446.577666:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940265088:12345-0@lo:400:kworker.0 Request processed in 43us (306us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318446.577673:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559
00000100:00080000:0.0:1767318446.577718:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318446.577738:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940265088:0@lo:400:kworker.0
00000100:00100000:2.0:1767318446.584482:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940264960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318446.584561:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318446.584749:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940264960
00000100:00100000:3.0:1767318446.584756:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940264960
00000100:00100000:3.0:1767318446.584828:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560
00000100:00100000:3.0:1767318446.584836:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940264960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318446.584879:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940264960:12345-0@lo:400:kworker.0 Request processed in 46us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318446.584884:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560
00000100:00080000:0.0:1767318446.584939:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318446.585060:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940264960:0@lo:400:kworker.0
00000100:00080000:1.0:1767318446.585344:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318446.585347:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318446.585350:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318446.585354:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3691
00000100:00080000:1.0:1767318446.585357:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318446.585360:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318446.585375:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7fb80 x1853163940265344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318446.585391:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318446.585393:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318446.585394:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318446.585396:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3691
00000100:00080000:1.0:1767318446.585398:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318446.585400:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318446.585408:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7e680 x1853163940265600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318446.585427:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940265216:0@lo:400:kworker.0
00000100:00100000:1.0:1767318446.585470:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318446.585491:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318446.585496:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940265472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318446.585518:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318446.585537:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940265344:0@lo:38:kworker.0
00000100:00100000:1.0:1767318446.585552:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318446.585561:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940265600:0@lo:38:kworker.0
00000100:00100000:1.0:1767318446.585572:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318446.585590:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265216
00000100:00100000:1.0:1767318446.585592:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265216
00000100:00100000:1.0:1767318446.585617:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265472
00000100:00100000:1.0:1767318446.585620:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265472
00000100:00100000:1.0:1767318446.585636:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265344
00000100:00100000:1.0:1767318446.585638:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265344
00000100:00100000:1.0:1767318446.585645:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265600
00000100:00100000:1.0:1767318446.585647:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265600
00000100:00100000:1.0:1767318446.585656:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891
00000100:00100000:1.0:1767318446.585663:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940265216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318446.585694:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940265216:12345-0@lo:400:kworker.0 Request processed in 32us (223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318446.585698:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891
00000100:00100000:1.0:1767318446.585709:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892
00000100:00100000:1.0:1767318446.585713:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940265472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318446.585727:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940265472:12345-0@lo:400:kworker.0 Request processed in 15us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318446.585731:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892
00000100:00100000:1.0:1767318446.585737:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16266
00000100:00100000:1.0:1767318446.585739:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940265344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318446.585755:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318446.585791:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940265344:12345-0@lo:38:kworker.0 Request processed in 50us (238us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318446.585794:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16266
00000100:00100000:1.0:1767318446.585802:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16267
00000100:00100000:1.0:1767318446.585805:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940265600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318446.585810:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318446.585823:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940265600:12345-0@lo:38:kworker.0 Request processed in 18us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318446.585826:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16267
00000100:00100000:1.0:1767318446.585846:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940265472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318446.585852:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940265216:0@lo:400:kworker.0
00000100:00080000:1.0:1767318446.585865:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318446.585868:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318446.585870:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940265344:0@lo:38:kworker.0
00000100:00080000:1.0:1767318446.585874:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318446.585876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318446.585878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940265600:0@lo:38:kworker.0
00000100:00080000:0.0:1767318446.585946:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318447.085016:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940265728:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318447.085094:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318447.085250:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265728
00000100:00100000:3.0:1767318447.085259:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265728
00000100:00100000:3.0:1767318447.085316:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080
00000100:00100000:3.0:1767318447.085337:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940265728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318447.085377:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318447.087651:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940265728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2305us (2545us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318447.087669:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080
00000100:00100000:0.0:1767318447.097973:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940265728:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318447.148948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318447.533155:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318448.109009:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940265856:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318448.109081:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318448.109326:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265856
00000100:00100000:3.0:1767318448.109336:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265856
00000100:00100000:3.0:1767318448.109411:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081
00000100:00100000:3.0:1767318448.109421:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940265856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318448.109530:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318448.109596:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318448.109657:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940265856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 236us (574us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318448.109666:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081
00000100:00100000:0.0:1767318448.109700:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940265856:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318448.172873:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318448.557561:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318449.197230:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318449.581034:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318450.220900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000400:00000100:3.0:1767318450.247599:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894262656 offset 0 length 520: 4
00000100:00100000:3.0:1767318450.247655:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318450.247697:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318450.247733:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262912
00000100:00100000:0.0:1767318450.247744:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262912
00000100:00100000:0.0:1767318450.247834:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894262784
00000100:00100000:0.0:1767318450.247837:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894262784
00000100:00100000:0.0:1767318450.247851:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3893
00000100:00100000:0.0:1767318450.247860:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894262912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318450.247880:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16268
00000100:00100000:1.0:1767318450.247888:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894262784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318450.247910:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318450.247940:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894262912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318450.247947:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894262784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (247us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318450.247950:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3893
00000100:00100000:1.0:1767318450.247961:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16268
00000100:00080000:2.0:1767318450.248870:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318450.605146:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318451.245200:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318451.629094:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318451.693223:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318451.693234:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318451.693237:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318451.693240:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318451.693243:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318451.693250:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3696
00000100:00080000:1.0:1767318451.693253:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318451.693260:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318451.693295:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173480 x1853163940265984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318451.693314:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318451.693317:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318451.693319:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318451.693322:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3696
00000100:00080000:1.0:1767318451.693324:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318451.693328:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318451.693340:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170000 x1853163940266112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318451.693418:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318451.693421:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318451.693423:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318451.693426:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3696
00000100:00080000:1.0:1767318451.693428:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318451.693432:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318451.693443:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ca80 x1853163940266624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318451.693457:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318451.693460:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318451.693462:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318451.693465:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3696
00000100:00080000:1.0:1767318451.693467:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318451.693470:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318451.693484:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f9880 x1853163940266880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318451.693510:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940266368:0@lo:400:kworker.0
00000100:00100000:1.0:1767318451.693576:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318451.693642:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318451.693648:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940266240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318451.693671:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318451.693713:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940266496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318451.693739:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318451.693763:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940266752:0@lo:400:kworker.0
00000100:00100000:0.0:1767318451.693818:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318451.693975:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266496
00000100:00100000:1.0:1767318451.693985:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266496
00000100:00100000:3.0:1767318451.694009:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266368
00000100:00100000:3.0:1767318451.694015:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266368
00000100:00100000:3.0:1767318451.694054:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266240
00000100:00100000:3.0:1767318451.694058:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266240
00000100:00100000:3.0:1767318451.694079:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561
00000100:00100000:3.0:1767318451.694088:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940266368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318451.694141:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940266368:12345-0@lo:400:kworker.0 Request processed in 54us (564us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318451.694148:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561
00000100:00100000:3.0:1767318451.694166:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562
00000100:00100000:3.0:1767318451.694173:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940266240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318451.694198:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940266240:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318451.694203:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562
00000100:00100000:3.0:1767318451.694220:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266752
00000100:00100000:3.0:1767318451.694224:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266752
00000100:00100000:2.0:1767318451.694304:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940265984:0@lo:38:kworker.0
00000100:00100000:2.0:1767318451.694334:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318451.694353:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940266112:0@lo:38:kworker.0
00000100:00100000:2.0:1767318451.694374:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318451.694392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940266624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318451.694422:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318451.694437:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940266880:0@lo:38:kworker.0
00000100:00100000:2.0:1767318451.694458:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318451.694491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318451.694495:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318451.694497:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318451.694507:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940265984
00000100:00100000:2.0:1767318451.694510:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940265984
00000100:00100000:2.0:1767318451.694529:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266624
00000100:00100000:2.0:1767318451.694532:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266624
00000100:00100000:2.0:1767318451.694538:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266880
00000100:00100000:2.0:1767318451.694540:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266880
00000100:00100000:2.0:1767318451.694548:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16269
00000100:00100000:2.0:1767318451.694553:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940265984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318451.694571:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318451.694602:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940265984:12345-0@lo:38:kworker.0 Request processed in 48us (267us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318451.694608:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16269
00000100:00100000:2.0:1767318451.694623:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894
00000100:00100000:1.0:1767318451.694636:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16270
00000100:00100000:2.0:1767318451.694636:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940266496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318451.694647:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940266624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318451.694660:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318451.694672:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940266496:12345-0@lo:400:kworker.0 Request processed in 42us (931us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318451.694696:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940266624:12345-0@lo:38:kworker.0 Request processed in 49us (272us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318451.694696:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894
00000100:00100000:1.0:1767318451.694706:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16270
00000100:00100000:0.0:1767318451.694792:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16271
00000100:00100000:0.0:1767318451.694797:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940266880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318451.694807:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318451.694834:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940266880:12345-0@lo:38:kworker.0 Request processed in 36us (375us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318451.694840:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16271
00000100:00100000:0.0:1767318451.694867:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940266112
00000100:00100000:0.0:1767318451.694871:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940266112
00000100:00100000:0.0:1767318451.694895:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950
00000100:00100000:0.0:1767318451.694899:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940266112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318451.694909:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318451.694934:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940266112:12345-0@lo:38:kworker.0 Request processed in 34us (558us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318451.694939:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950
00000100:00100000:0.0:1767318451.694978:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940266496:0@lo:400:kworker.0
00000100:00100000:0.0:1767318451.695039:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940266240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318451.695049:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940266368:0@lo:400:kworker.0
00000100:00080000:0.0:1767318451.695095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318451.695100:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318451.695103:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940265984:0@lo:38:kworker.0
00000100:00080000:0.0:1767318451.695111:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318451.695115:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318451.695118:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940266112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318451.695125:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318451.695128:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318451.695131:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940266624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318451.695138:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318451.695141:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318451.695143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940266880:0@lo:38:kworker.0
00000100:00100000:3.0:1767318451.700889:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895
00000100:00100000:3.0:1767318451.700915:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940266752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318451.701004:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940266752:12345-0@lo:400:kworker.0 Request processed in 106us (7187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318451.701009:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895
00000100:00100000:0.0:1767318451.701298:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940266752:0@lo:400:kworker.0
00000100:00100000:0.0:1767318452.206072:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940267008:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318452.206158:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318452.207935:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267008
00000100:00100000:3.0:1767318452.207952:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267008
00000100:00100000:3.0:1767318452.208039:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082
00000100:00100000:3.0:1767318452.208049:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940267008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318452.208090:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318452.208182:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940267008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (2024us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318452.208189:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082
00000100:00100000:0.0:1767318452.208584:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940267008:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318452.269388:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318452.653264:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318453.230071:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318453.230093:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940267136:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318453.230160:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318453.230347:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267136
00000100:00100000:2.0:1767318453.230356:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267136
00000100:00100000:2.0:1767318453.230433:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083
00000100:00100000:2.0:1767318453.230443:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940267136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318453.230474:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318453.230516:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940267136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (355us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318453.230526:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083
00000100:00100000:1.0:1767318453.230678:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940267136:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318453.230878:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318453.293063:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318453.678450:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318454.316907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318454.701115:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318455.341124:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318455.367704:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318455.368106:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263168
00000100:00100000:2.0:1767318455.368119:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263168
00000100:00100000:2.0:1767318455.368209:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3896
00000100:00100000:2.0:1767318455.368221:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894263168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318455.368301:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894263168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (624us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318455.368309:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3896
00000100:00080000:0.0:1767318455.369125:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318455.369878:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318455.370155:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263040
00000100:00100000:1.0:1767318455.370164:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263040
00000100:00100000:1.0:1767318455.370210:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16272
00000100:00100000:1.0:1767318455.370218:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894263040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318455.370240:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318455.370288:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894263040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (414us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318455.370295:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16272
00010000:00010000:2.0:1767318455.727668:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318456.367221:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318456.749446:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318456.813470:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318431/real 1767318431]  req@ffff93d07aeb1f80 x1853163940260736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318456 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318456.813510:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d07aeb1f80 x1853163940260736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318456 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318456.813530:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318456.813550:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318456.813554:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940260736:0@lo:250:kworker.0
00000100:00080000:1.0:1767318456.813834:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318456.813839:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318456.813842:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318456.813847:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3681
00000100:00080000:1.0:1767318456.813851:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318456.813858:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318456.813887:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f1500 x1853163940267264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318456.813912:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318456.813916:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318456.813917:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318456.813921:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3701
00000100:00080000:1.0:1767318456.813924:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318456.813927:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318456.813944:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f0e00 x1853163940267392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318456.813953:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318456.813956:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318456.813957:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318456.813960:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3701
00000100:00080000:1.0:1767318456.813962:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318456.813966:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318456.813975:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f1c00 x1853163940267520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318456.814021:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318456.814024:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318456.814026:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318456.814030:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3701
00000100:00080000:1.0:1767318456.814032:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318456.814036:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318456.814046:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f0700 x1853163940268032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318456.814063:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318456.814067:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318456.814068:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318456.814071:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3701
00000100:00080000:1.0:1767318456.814074:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318456.814077:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318456.814085:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399ea00 x1853163940268288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318456.814167:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940267904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.814231:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318456.814295:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318456.814302:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940268160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.814323:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318456.814352:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267904
00000100:00100000:1.0:1767318456.814359:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267904
00000100:00100000:1.0:1767318456.814418:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268160
00000100:00100000:1.0:1767318456.814422:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268160
00000100:00100000:1.0:1767318456.814443:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897
00000100:00100000:1.0:1767318456.814451:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940267904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.814708:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940267904:12345-0@lo:400:kworker.0 Request processed in 257us (476us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318456.814717:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897
00000100:00100000:1.0:1767318456.814736:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898
00000100:00100000:1.0:1767318456.814742:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940268160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.814767:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940268160:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318456.814797:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898
00000100:00100000:1.0:1767318456.814832:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940268160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.814841:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940267904:0@lo:400:kworker.0
00000100:00100000:2.0:1767318456.815392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940267264:0@lo:250:kworker.0
00000400:00000100:2.0:1767318456.815424:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940267264 offset 0 length 520: 4
00000100:00100000:2.0:1767318456.815445:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940267392:0@lo:38:kworker.0
00000100:00100000:2.0:1767318456.815491:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318456.815517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940267520:0@lo:38:kworker.0
00000100:00100000:2.0:1767318456.815541:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318456.815556:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940268032:0@lo:38:kworker.0
00000100:00100000:2.0:1767318456.815575:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318456.815592:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940268288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318456.815610:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318456.815638:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267392
00000100:00100000:2.0:1767318456.815643:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267392
00000100:00100000:2.0:1767318456.815662:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268032
00000100:00100000:2.0:1767318456.815665:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268032
00000100:00100000:2.0:1767318456.815672:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268288
00000100:00100000:2.0:1767318456.815674:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268288
00000100:00100000:2.0:1767318456.815683:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16273
00000100:00100000:2.0:1767318456.815688:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940267392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318456.815707:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318456.815737:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940267392:12345-0@lo:38:kworker.0 Request processed in 48us (246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318456.815744:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16273
00000100:00100000:2.0:1767318456.815757:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16274
00000100:00100000:2.0:1767318456.815761:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940268032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318456.815769:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318456.815811:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940268032:12345-0@lo:38:kworker.0 Request processed in 48us (234us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318456.815817:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16274
00000100:00100000:2.0:1767318456.815828:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16275
00000100:00100000:2.0:1767318456.815832:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940268288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318456.815841:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318456.815861:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940268288:12345-0@lo:38:kworker.0 Request processed in 28us (250us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318456.815866:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16275
00000100:00080000:2.0:1767318456.815891:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318456.815895:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318456.815898:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940267392:0@lo:38:kworker.0
00000100:00080000:2.0:1767318456.815907:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318456.815910:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318456.815912:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940268032:0@lo:38:kworker.0
00000100:00080000:2.0:1767318456.815918:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318456.815920:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318456.815923:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940268288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318456.816163:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940267648:0@lo:400:kworker.0
00000100:00100000:0.0:1767318456.816194:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318456.816227:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318456.816233:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940267776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318456.816256:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318456.816296:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318456.816312:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267520
00000100:00100000:0.0:1767318456.816316:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267520
00000100:00100000:0.0:1767318456.816338:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951
00000100:00100000:0.0:1767318456.816342:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940267520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318456.816352:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318456.816390:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940267520:12345-0@lo:38:kworker.0 Request processed in 46us (848us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318456.816395:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951
00000100:00100000:0.0:1767318456.816419:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267648
00000100:00100000:0.0:1767318456.816422:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267648
00000100:00100000:0.0:1767318456.816468:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940267776
00000100:00100000:0.0:1767318456.816472:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940267776
00000100:00080000:1.0:1767318456.816722:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318456.816739:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563
00000100:00100000:1.0:1767318456.816749:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940267648:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318456.816812:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940267648:12345-0@lo:400:kworker.0 Request processed in 66us (617us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318456.816819:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563
00000100:00100000:1.0:1767318456.816856:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940267648:0@lo:400:kworker.0
00000100:00100000:0.0:1767318456.816944:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564
00000100:00100000:0.0:1767318456.816951:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940267776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318456.816996:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940267776:12345-0@lo:400:kworker.0 Request processed in 46us (739us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318456.817002:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564
00000100:00080000:1.0:1767318456.819402:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318456.820565:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940267776:0@lo:400:kworker.0
00000100:00080000:2.0:1767318456.821432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318456.821440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318456.821445:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940267520:0@lo:38:kworker.0
00000100:00100000:2.0:1767318457.325109:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940268416:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318457.325184:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318457.325283:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268416
00000100:00100000:1.0:1767318457.325291:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268416
00000100:00100000:1.0:1767318457.325348:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084
00000100:00100000:1.0:1767318457.325366:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940268416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318457.325398:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318457.325461:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940268416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318457.325469:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084
00000100:00100000:3.0:1767318457.325646:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940268416:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318457.389576:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318457.773151:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318458.349562:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318458.349586:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940268544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318458.349652:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318458.349762:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268544
00000100:00100000:2.0:1767318458.349770:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268544
00000100:00100000:2.0:1767318458.349855:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085
00000100:00100000:2.0:1767318458.349864:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940268544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318458.349894:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318458.349935:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940268544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (281us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318458.349942:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085
00000100:00080000:3.0:1767318458.350291:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318458.350338:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940268544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318458.412913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318458.798416:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318459.436957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318459.821015:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318460.460947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318460.486870:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318460.486980:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263296
00000100:00100000:1.0:1767318460.486990:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263296
00000100:00100000:1.0:1767318460.487044:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16276
00000100:00100000:1.0:1767318460.487053:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894263296:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318460.487074:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318460.487138:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894263296:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 86us (278us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318460.487145:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16276
00000100:00100000:0.0:1767318460.498987:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318460.503047:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263424
00000100:00100000:2.0:1767318460.503063:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263424
00000100:00100000:2.0:1767318460.503242:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3899
00000100:00100000:2.0:1767318460.503262:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894263424:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318460.503371:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894263424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (4392us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318460.503379:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3899
00000100:00080000:3.0:1767318460.507833:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318460.845168:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318461.485254:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318461.869078:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318461.933145:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318461.933155:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318461.933158:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318461.933162:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318461.933166:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318461.933173:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3706
00000100:00080000:2.0:1767318461.933178:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318461.933185:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318461.933224:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940268672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318461.933253:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318461.933257:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318461.933259:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318461.933262:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3706
00000100:00080000:2.0:1767318461.933265:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318461.933268:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318461.933286:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ce00 x1853163940268800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318461.933379:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318461.933382:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318461.933384:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318461.933387:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3706
00000100:00080000:2.0:1767318461.933389:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318461.933393:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318461.933404:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e680 x1853163940269312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318461.933419:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318461.933421:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318461.933423:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318461.933426:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3706
00000100:00080000:2.0:1767318461.933428:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318461.933432:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318461.933441:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ea00 x1853163940269568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318461.933465:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940269184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318461.933525:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318461.933588:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318461.933594:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940269440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318461.933615:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318461.933644:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269184
00000100:00100000:2.0:1767318461.933651:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269184
00000100:00100000:2.0:1767318461.933703:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269440
00000100:00100000:2.0:1767318461.933706:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269440
00000100:00100000:2.0:1767318461.933731:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900
00000100:00100000:2.0:1767318461.933739:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940269184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318461.933805:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940269184:12345-0@lo:400:kworker.0 Request processed in 67us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318461.933813:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900
00000100:00100000:2.0:1767318461.933830:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901
00000100:00100000:2.0:1767318461.933836:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940269440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318461.933863:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940269440:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318461.933869:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901
00000100:00080000:2.0:1767318461.933885:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318461.933920:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940269440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318461.933931:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940269184:0@lo:400:kworker.0
00000100:00100000:0.0:1767318461.934036:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940268672:0@lo:38:kworker.0
00000100:00100000:0.0:1767318461.934066:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318461.934096:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940268800:0@lo:38:kworker.0
00000100:00100000:0.0:1767318461.934120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318461.934135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940269312:0@lo:38:kworker.0
00000100:00100000:0.0:1767318461.934154:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318461.934166:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940269568:0@lo:38:kworker.0
00000100:00100000:0.0:1767318461.934183:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318461.934262:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940269056:0@lo:400:kworker.0
00000100:00100000:3.0:1767318461.934293:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318461.934335:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318461.934341:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940268928:0@lo:400:kworker.0
00000100:00100000:3.0:1767318461.934360:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318461.934425:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268672
00000100:00100000:2.0:1767318461.934430:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268672
00000100:00100000:2.0:1767318461.934459:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269312
00000100:00100000:2.0:1767318461.934462:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269312
00000100:00100000:2.0:1767318461.934474:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269568
00000100:00100000:2.0:1767318461.934477:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269568
00000100:00100000:2.0:1767318461.934487:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16277
00000100:00100000:2.0:1767318461.934491:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940268672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318461.934508:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318461.934543:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940268672:12345-0@lo:38:kworker.0 Request processed in 50us (476us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318461.934549:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16277
00000100:00100000:2.0:1767318461.934560:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16278
00000100:00100000:2.0:1767318461.934563:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940269312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318461.934571:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318461.934590:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940269312:12345-0@lo:38:kworker.0 Request processed in 27us (436us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318461.934595:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16278
00000100:00100000:2.0:1767318461.934604:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16279
00000100:00100000:2.0:1767318461.934607:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940269568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318461.934615:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318461.934634:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940269568:12345-0@lo:38:kworker.0 Request processed in 26us (451us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318461.934639:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16279
00000100:00080000:2.0:1767318461.934668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318461.934673:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318461.934676:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940268672:0@lo:38:kworker.0
00000100:00080000:2.0:1767318461.934685:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318461.934688:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318461.934690:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940269312:0@lo:38:kworker.0
00000100:00080000:2.0:1767318461.934697:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318461.934700:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318461.934703:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940269568:0@lo:38:kworker.0
00000100:00100000:1.0:1767318461.934811:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268800
00000100:00100000:1.0:1767318461.934815:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268800
00000100:00100000:1.0:1767318461.934836:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767318461.934842:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940268800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318461.934852:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318461.934885:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940268800:12345-0@lo:38:kworker.0 Request processed in 42us (764us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318461.934891:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767318461.934911:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269056
00000100:00100000:1.0:1767318461.934915:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269056
00000100:00100000:1.0:1767318461.934945:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940268928
00000100:00100000:1.0:1767318461.934948:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940268928
00000100:00100000:1.0:1767318461.934969:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565
00000100:00100000:1.0:1767318461.934975:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940269056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318461.935006:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940269056:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318461.935011:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565
00000100:00100000:1.0:1767318461.935023:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566
00000100:00100000:1.0:1767318461.935029:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940268928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318461.935058:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940268928:12345-0@lo:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318461.935063:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566
00000100:00080000:1.0:1767318461.935077:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318461.935080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318461.935094:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318461.935097:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318461.935100:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940268800:0@lo:38:kworker.0
00000100:00100000:3.0:1767318461.935208:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940268928:0@lo:400:kworker.0
00000100:00100000:3.0:1767318461.935218:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940269056:0@lo:400:kworker.0
00000100:00100000:2.0:1767318462.445254:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940269696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318462.445340:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.445590:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269696
00000100:00100000:1.0:1767318462.445599:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269696
00000100:00100000:1.0:1767318462.445655:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086
00000100:00100000:1.0:1767318462.445664:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940269696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318462.445706:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318462.445764:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940269696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (423us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318462.445771:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086
00000100:00100000:0.0:1767318462.445933:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940269696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318462.511511:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318462.893031:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318463.471620:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318463.471647:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940269824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318463.471731:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318463.472007:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269824
00000100:00100000:2.0:1767318463.472016:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269824
00000100:00100000:2.0:1767318463.472082:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087
00000100:00100000:2.0:1767318463.472092:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940269824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318463.472124:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318463.472176:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940269824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (445us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318463.472183:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087
00000100:00100000:0.0:1767318463.472294:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940269824:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318463.472644:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318463.533085:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318463.917132:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318464.556989:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318464.941031:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318465.580900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:3.0:1767318465.607656:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318465.608547:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263680
00000100:00100000:0.0:1767318465.608557:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263680
00000100:00100000:0.0:1767318465.608639:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3902
00000100:00100000:0.0:1767318465.608650:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894263680:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318465.608747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318465.609494:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894263680:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 846us (1849us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318465.609501:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3902
00000100:00100000:0.0:1767318465.624603:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318465.626489:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263552
00000100:00100000:3.0:1767318465.626505:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263552
00000100:00100000:3.0:1767318465.626573:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16280
00000100:00100000:3.0:1767318465.626581:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894263552:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318465.626619:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318465.626699:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894263552:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 117us (2107us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318465.626708:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16280
00010000:00010000:2.0:1767318465.966252:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318466.604911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318466.991789:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318467.053123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.053144:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318467.053147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.053151:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.053156:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.053165:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3711
00000100:00080000:3.0:1767318467.053169:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.053176:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318467.053217:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2d80 x1853163940269952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318467.053252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.053256:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.053258:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.053261:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3711
00000100:00080000:3.0:1767318467.053263:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.053267:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318467.053313:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2a00 x1853163940270080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318467.053382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.053386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.053388:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.053391:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3711
00000100:00080000:3.0:1767318467.053394:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.053397:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318467.053408:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940270592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318467.053423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.053426:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.053428:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.053431:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3711
00000100:00080000:3.0:1767318467.053434:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.053447:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318467.053459:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddf80 x1853163940270848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318467.053486:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940270720:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.053553:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.053615:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318467.053622:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940270464:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.053644:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.053680:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270720
00000100:00100000:3.0:1767318467.053687:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270720
00000100:00100000:3.0:1767318467.053984:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270464
00000100:00100000:3.0:1767318467.053989:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270464
00000100:00100000:3.0:1767318467.054013:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903
00000100:00100000:3.0:1767318467.054023:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940270720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.054072:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940270720:12345-0@lo:400:kworker.0 Request processed in 51us (519us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318467.054079:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903
00000100:00100000:3.0:1767318467.054096:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904
00000100:00100000:3.0:1767318467.054102:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940270464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.054128:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940270464:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318467.054133:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904
00000100:00100000:3.0:1767318467.054168:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940270464:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.054179:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940270720:0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054284:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054318:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318467.054355:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318467.054361:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054381:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318467.054411:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270336
00000100:00100000:0.0:1767318467.054415:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270336
00000100:00100000:0.0:1767318467.054454:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270208
00000100:00100000:0.0:1767318467.054457:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270208
00000100:00100000:0.0:1767318467.054477:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567
00000100:00100000:0.0:1767318467.054482:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054514:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270336:12345-0@lo:400:kworker.0 Request processed in 32us (196us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318467.054520:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567
00000100:00100000:0.0:1767318467.054531:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568
00000100:00100000:0.0:1767318467.054536:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054559:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270208:12345-0@lo:400:kworker.0 Request processed in 22us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318467.054563:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568
00000100:00100000:0.0:1767318467.054589:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.054597:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318467.054970:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940269952:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.055006:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.055031:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940270080:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.055057:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.055077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940270592:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.055099:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.055116:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940270848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.055136:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.055168:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940269952
00000100:00100000:1.0:1767318467.055171:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940269952
00000100:00100000:1.0:1767318467.055192:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270592
00000100:00100000:1.0:1767318467.055195:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270592
00000100:00100000:1.0:1767318467.055206:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270848
00000100:00100000:1.0:1767318467.055209:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270848
00000100:00100000:1.0:1767318467.055219:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16281
00000100:00100000:1.0:1767318467.055225:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940269952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318467.055255:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318467.055299:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940269952:12345-0@lo:38:kworker.0 Request processed in 72us (292us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318467.055306:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16281
00000100:00100000:1.0:1767318467.055319:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282
00000100:00100000:1.0:1767318467.055323:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940270592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318467.055333:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318467.055355:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940270592:12345-0@lo:38:kworker.0 Request processed in 31us (256us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318467.055361:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282
00000100:00100000:1.0:1767318467.055371:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16283
00000100:00100000:1.0:1767318467.055374:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940270848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318467.055383:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318467.055406:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940270848:12345-0@lo:38:kworker.0 Request processed in 30us (269us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318467.055411:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16283
00000100:00080000:1.0:1767318467.055426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318467.055431:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318467.055434:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318467.055620:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270080
00000100:00100000:2.0:1767318467.055624:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270080
00000100:00100000:2.0:1767318467.055647:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953
00000100:00100000:2.0:1767318467.055652:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940270080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318467.055661:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318467.055686:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940270080:12345-0@lo:38:kworker.0 Request processed in 34us (629us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318467.055691:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953
00000100:00080000:2.0:1767318467.055742:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318467.055747:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318467.055751:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940269952:0@lo:38:kworker.0
00000100:00080000:2.0:1767318467.055760:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318467.055763:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318467.055765:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940270080:0@lo:38:kworker.0
00000100:00080000:2.0:1767318467.055788:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318467.055791:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318467.055794:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940270592:0@lo:38:kworker.0
00000100:00080000:2.0:1767318467.055802:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318467.055804:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318467.055806:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940270848:0@lo:38:kworker.0
00000100:00100000:0.0:1767318467.565186:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318467.565212:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270976:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318467.565292:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.565540:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940270976
00000100:00100000:3.0:1767318467.565549:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940270976
00000100:00100000:3.0:1767318467.565607:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088
00000100:00100000:3.0:1767318467.565617:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318467.565648:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318467.565702:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940270976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318467.565709:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088
00000100:00100000:1.0:1767318467.565870:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940270976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318467.628947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318468.014626:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318468.589158:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940271104:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318468.589240:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318468.589394:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271104
00000100:00100000:0.0:1767318468.589403:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271104
00000100:00100000:0.0:1767318468.589448:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089
00000100:00100000:0.0:1767318468.589457:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940271104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318468.589485:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318468.589535:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940271104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318468.589543:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089
00000100:00100000:1.0:1767318468.589621:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940271104:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318468.653002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318469.036997:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318469.676924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318470.062482:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318470.700956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318470.726906:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318470.726953:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318470.727683:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263808
00000100:00100000:3.0:1767318470.727695:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263808
00000100:00100000:3.0:1767318470.727748:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894263936
00000100:00100000:3.0:1767318470.727751:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894263936
00000100:00100000:3.0:1767318470.727844:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3905
00000100:00100000:3.0:1767318470.727855:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894263936:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318470.727934:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894263936:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (980us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318470.727943:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3905
00000100:00080000:1.0:1767318470.728063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318470.732002:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16284
00000100:00100000:0.0:1767318470.732017:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894263808:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318470.732042:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318470.732115:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894263808:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (5220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318470.732123:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16284
00010000:00010000:2.0:1767318471.085180:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318471.725133:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318472.108994:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318472.173091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318472.173102:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318472.173105:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318472.173109:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318472.173113:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318472.173120:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3717
00000100:00080000:3.0:1767318472.173124:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318472.173132:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318472.173180:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940271232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318472.173205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318472.173208:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318472.173210:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318472.173214:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3717
00000100:00080000:3.0:1767318472.173216:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318472.173219:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318472.173243:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940271360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318472.173314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318472.173318:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318472.173320:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318472.173323:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3717
00000100:00080000:3.0:1767318472.173326:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318472.173329:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318472.173340:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de680 x1853163940271872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318472.173354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318472.173356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318472.173358:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318472.173361:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3717
00000100:00080000:3.0:1767318472.173363:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318472.173367:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318472.173380:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3d6d80 x1853163940272128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318472.173402:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940271744:0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.173477:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.173524:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940271616:0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.173543:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318472.173549:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940272000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.173567:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.173568:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.173593:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318472.173599:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271744
00000100:00100000:3.0:1767318472.173607:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271744
00000100:00100000:1.0:1767318472.173608:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940271488:0@lo:400:kworker.0
00000100:00100000:1.0:1767318472.173630:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.173655:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272000
00000100:00100000:1.0:1767318472.173658:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272000
00000100:00100000:3.0:1767318472.173670:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906
00000100:00100000:3.0:1767318472.173678:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940271744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318472.173683:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907
00000100:00100000:1.0:1767318472.173688:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940272000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318472.173796:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271616
00000100:00100000:0.0:1767318472.173801:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271616
00000100:00100000:0.0:1767318472.173830:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271488
00000100:00100000:0.0:1767318472.173833:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271488
00000100:00100000:0.0:1767318472.173852:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569
00000100:00100000:0.0:1767318472.173859:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940271616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.174003:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570
00000100:00100000:2.0:1767318472.174011:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940271488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318472.179875:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940272000:12345-0@lo:400:kworker.0 Request processed in 5043us (5163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318472.179891:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907
00000100:00100000:0.0:1767318472.179923:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940271616:12345-0@lo:400:kworker.0 Request processed in 6064us (6362us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318472.179932:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569
00000100:00080000:0.0:1767318472.179994:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318472.180000:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318472.180003:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318472.180049:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940271616:0@lo:400:kworker.0
00000100:00100000:1.0:1767318472.180096:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940271232:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.180139:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.180170:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940271360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.180193:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.180211:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940271872:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.180243:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.180261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940272128:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.180283:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.180314:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271232
00000100:00100000:1.0:1767318472.180319:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271232
00000100:00100000:1.0:1767318472.180345:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271872
00000100:00100000:1.0:1767318472.180348:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271872
00000100:00100000:1.0:1767318472.180360:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272128
00000100:00100000:1.0:1767318472.180362:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272128
00000100:00100000:1.0:1767318472.180374:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285
00000100:00100000:1.0:1767318472.180379:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940271232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318472.180399:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318472.182723:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940271232:12345-0@lo:38:kworker.0 Request processed in 1215us (1456us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318472.182747:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285
00000100:00100000:1.0:1767318472.183537:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16286
00000100:00100000:1.0:1767318472.183546:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940271872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318472.183572:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318472.183927:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16287
00000100:00100000:0.0:1767318472.183934:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940272128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318472.183946:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318472.184009:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940272128:12345-0@lo:38:kworker.0 Request processed in 73us (3723us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318472.184019:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16287
00000100:00080000:0.0:1767318472.184107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318472.184112:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318472.184116:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940271232:0@lo:38:kworker.0
00000100:00080000:0.0:1767318472.184129:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318472.184133:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318472.184136:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940272128:0@lo:38:kworker.0
00000100:00100000:0.0:1767318472.184202:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940271360
00000100:00100000:0.0:1767318472.184210:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940271360
00000100:00100000:0.0:1767318472.184262:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954
00000100:00100000:0.0:1767318472.184267:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940271360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318472.184278:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318472.184589:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940271360:12345-0@lo:38:kworker.0 Request processed in 319us (4392us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318472.184596:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954
00000100:00080000:0.0:1767318472.184623:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318472.184627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318472.184630:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940271360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.184752:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940271872:12345-0@lo:38:kworker.0 Request processed in 1204us (4506us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318472.184759:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16286
00000100:00080000:1.0:1767318472.185462:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318472.185468:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318472.185472:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940271872:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.185545:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940271488:12345-0@lo:400:kworker.0 Request processed in 11533us (11911us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318472.185556:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570
00000100:00100000:0.0:1767318472.185627:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940272000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.185871:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940271744:12345-0@lo:400:kworker.0 Request processed in 12191us (12390us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318472.185880:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906
00000100:00100000:0.0:1767318472.185975:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940271744:0@lo:400:kworker.0
00000100:00100000:1.0:1767318472.186107:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940271488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318472.687052:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940272256:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318472.687130:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.687433:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272256
00000100:00100000:1.0:1767318472.687442:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272256
00000100:00100000:1.0:1767318472.687499:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090
00000100:00100000:1.0:1767318472.687509:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940272256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318472.687542:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318472.687601:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940272256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (470us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318472.687608:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090
00000100:00100000:3.0:1767318472.689438:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940272256:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318472.748906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318473.137951:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318473.709979:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940272384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318473.710056:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318473.713087:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272384
00000100:00100000:0.0:1767318473.713103:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272384
00000100:00100000:0.0:1767318473.713602:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091
00000100:00100000:0.0:1767318473.713614:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940272384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318473.713649:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318473.715204:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940272384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1585us (5140us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318473.715226:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091
00000100:00100000:1.0:1767318473.718935:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940272384:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318473.774272:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318474.159016:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318474.798826:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318475.181543:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318475.822682:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318475.847149:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318475.847197:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318475.847285:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264192
00000100:00100000:1.0:1767318475.847295:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264192
00000100:00100000:1.0:1767318475.847370:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264064
00000100:00100000:1.0:1767318475.847373:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264064
00000100:00100000:1.0:1767318475.847391:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3908
00000100:00100000:1.0:1767318475.847400:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894264192:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318475.847468:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894264192:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318475.847475:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3908
00000100:00100000:1.0:1767318475.847492:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16288
00000100:00100000:1.0:1767318475.847497:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894264064:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318475.847516:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318475.847549:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894264064:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (359us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318475.847555:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16288
00000100:00080000:0.0:1767318475.848038:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318475.857046:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894264320 offset 0 length 520: 4
00010000:00010000:2.0:1767318476.206114:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318476.845730:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318477.229570:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318477.293220:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318477.293236:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318477.293239:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318477.293244:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318477.293249:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318477.293257:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3722
00000100:00080000:1.0:1767318477.293262:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318477.293269:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318477.293315:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3c700 x1853163940272512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318477.293348:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318477.293352:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318477.293354:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318477.293357:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3722
00000100:00080000:1.0:1767318477.293360:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318477.293363:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318477.293376:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3fb80 x1853163940272640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318477.293442:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318477.293445:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318477.293447:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318477.293450:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3722
00000100:00080000:1.0:1767318477.293452:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318477.293455:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318477.293466:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940273152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318477.293481:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318477.293486:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318477.293487:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318477.293490:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3722
00000100:00080000:1.0:1767318477.293492:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318477.293496:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318477.293504:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433f800 x1853163940273408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318477.293531:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940273024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.293606:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.293668:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318477.293674:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940273280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.293695:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.293728:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273024
00000100:00100000:1.0:1767318477.293735:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273024
00000100:00100000:1.0:1767318477.293816:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273280
00000100:00100000:1.0:1767318477.293820:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273280
00000100:00100000:1.0:1767318477.293849:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909
00000100:00100000:1.0:1767318477.293857:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940273024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.293906:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940273024:12345-0@lo:400:kworker.0 Request processed in 49us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318477.293913:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909
00000100:00100000:1.0:1767318477.293931:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910
00000100:00100000:1.0:1767318477.293937:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940273280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.293965:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940273280:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318477.293970:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910
00000100:00100000:1.0:1767318477.294010:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940273280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.294020:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940273024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294099:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940272768:0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294134:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318477.294167:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318477.294172:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940272896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294204:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318477.294235:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272768
00000100:00100000:0.0:1767318477.294239:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272768
00000100:00100000:0.0:1767318477.294268:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272896
00000100:00100000:0.0:1767318477.294271:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272896
00000100:00100000:0.0:1767318477.294292:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571
00000100:00100000:0.0:1767318477.294298:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940272768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294331:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940272768:12345-0@lo:400:kworker.0 Request processed in 33us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318477.294337:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571
00000100:00100000:0.0:1767318477.294348:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572
00000100:00100000:0.0:1767318477.294353:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940272896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294381:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940272896:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318477.294387:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572
00000100:00080000:0.0:1767318477.294412:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318477.294416:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318477.294418:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318477.294435:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940272896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318477.294444:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940272768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318477.294959:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940272512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318477.294994:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318477.295023:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940272640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318477.295046:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318477.295120:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272512
00000100:00100000:0.0:1767318477.295124:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272512
00000100:00100000:0.0:1767318477.295156:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16289
00000100:00100000:0.0:1767318477.295161:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940272512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318477.295191:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318477.295224:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940272512:12345-0@lo:38:kworker.0 Request processed in 62us (229us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318477.295230:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16289
00000100:00100000:2.0:1767318477.295885:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940273152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318477.295912:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318477.295933:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940273408:0@lo:38:kworker.0
00000100:00100000:2.0:1767318477.295952:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318477.295983:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318477.295987:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318477.295990:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940272512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318477.296017:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273152
00000100:00100000:2.0:1767318477.296021:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273152
00000100:00100000:2.0:1767318477.296042:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273408
00000100:00100000:2.0:1767318477.296044:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273408
00000100:00100000:2.0:1767318477.296058:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16290
00000100:00100000:2.0:1767318477.296062:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940273152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318477.296074:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318477.296101:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940273152:12345-0@lo:38:kworker.0 Request processed in 37us (188us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318477.296107:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16290
00000100:00100000:2.0:1767318477.296117:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16291
00000100:00100000:2.0:1767318477.296121:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940273408:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318477.296129:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318477.296146:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940273408:12345-0@lo:38:kworker.0 Request processed in 24us (194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318477.296151:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16291
00000100:00080000:2.0:1767318477.296228:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318477.296232:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318477.296235:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940273152:0@lo:38:kworker.0
00000100:00080000:2.0:1767318477.296243:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318477.296246:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318477.296248:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940273408:0@lo:38:kworker.0
00000100:00100000:3.0:1767318477.300277:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940272640
00000100:00100000:3.0:1767318477.300294:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940272640
00000100:00100000:3.0:1767318477.300359:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955
00000100:00100000:3.0:1767318477.300367:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940272640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318477.300392:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318477.300861:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940272640:12345-0@lo:38:kworker.0 Request processed in 492us (5810us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318477.300870:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955
00000100:00080000:2.0:1767318477.302289:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318477.302302:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318477.302307:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940272640:0@lo:38:kworker.0
00000100:00100000:3.0:1767318477.805035:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318477.805059:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940273536:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318477.805138:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318477.805212:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273536
00000100:00100000:0.0:1767318477.805221:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273536
00000100:00100000:0.0:1767318477.805268:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092
00000100:00100000:0.0:1767318477.805278:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940273536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318477.805307:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318477.805361:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940273536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318477.805368:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092
00000100:00100000:3.0:1767318477.805451:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940273536:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318477.869814:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318478.253364:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318478.832766:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318478.832833:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940273664:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318478.832905:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318478.833074:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273664
00000100:00100000:2.0:1767318478.833082:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273664
00000100:00100000:2.0:1767318478.833128:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093
00000100:00100000:2.0:1767318478.833136:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940273664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318478.833177:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318478.833229:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940273664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318478.833236:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093
00000100:00100000:0.0:1767318478.833416:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940273664:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318478.893530:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318479.278963:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318479.917012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318480.303765:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318480.941506:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318480.966679:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318480.966726:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318480.966798:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264448
00000100:00100000:0.0:1767318480.966808:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264448
00000100:00100000:0.0:1767318480.966852:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264576
00000100:00100000:0.0:1767318480.966855:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264576
00000100:00100000:0.0:1767318480.966907:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3911
00000100:00100000:0.0:1767318480.966917:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894264576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318480.966999:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894264576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (273us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318480.967007:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3911
00000100:00100000:0.0:1767318480.967034:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16292
00000100:00100000:0.0:1767318480.967039:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894264448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318480.967061:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318480.967085:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894264448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (416us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318480.967092:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16292
00000100:00080000:3.0:1767318480.967359:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318481.325610:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318481.389450:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318456/real 1767318456]  req@ffff93d0711f1500 x1853163940267264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318481.389487:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0711f1500 x1853163940267264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318481.389508:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318481.389531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318481.389535:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940267264:0@lo:250:kworker.0
00000100:00080000:2.0:1767318481.389858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318481.389863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318481.389866:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318481.389872:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3706
00000100:00080000:2.0:1767318481.389876:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318481.389881:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318481.389915:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b800 x1853163940273792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318481.389942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318481.389947:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318481.389949:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318481.389952:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3727
00000100:00080000:2.0:1767318481.389954:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318481.389957:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318481.389972:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019180 x1853163940273920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318481.389981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318481.389984:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318481.389986:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318481.389990:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3727
00000100:00080000:2.0:1767318481.389992:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318481.389995:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318481.390006:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b480 x1853163940274048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318481.390077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318481.390080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318481.390082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318481.390085:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3727
00000100:00080000:2.0:1767318481.390087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318481.390091:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318481.390101:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940274560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318481.390116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318481.390118:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318481.390120:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318481.390123:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3727
00000100:00080000:2.0:1767318481.390125:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318481.390128:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318481.390152:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940274816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318481.390180:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940274688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318481.390244:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318481.390303:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318481.390320:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940274432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318481.390344:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318481.390379:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274688
00000100:00100000:2.0:1767318481.390386:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274688
00000100:00100000:2.0:1767318481.390437:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274432
00000100:00100000:2.0:1767318481.390440:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274432
00000100:00100000:2.0:1767318481.390463:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912
00000100:00100000:2.0:1767318481.390472:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940274688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318481.390521:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940274688:12345-0@lo:400:kworker.0 Request processed in 50us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318481.390528:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912
00000100:00100000:2.0:1767318481.390545:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913
00000100:00100000:2.0:1767318481.390551:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940274432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318481.390578:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940274432:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318481.390584:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913
00000100:00100000:2.0:1767318481.390624:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940274432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318481.390634:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940274688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.390947:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.390982:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318481.391029:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318481.391035:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274304:0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.391057:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318481.391099:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274176
00000100:00100000:1.0:1767318481.391103:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274176
00000100:00100000:1.0:1767318481.391129:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274304
00000100:00100000:1.0:1767318481.391133:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274304
00000100:00100000:1.0:1767318481.391165:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1767318481.391171:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.391205:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274176:12345-0@lo:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318481.391212:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1767318481.391225:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767318481.391230:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.391256:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274304:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318481.391261:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767318481.391289:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274304:0@lo:400:kworker.0
00000100:00100000:1.0:1767318481.391298:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274176:0@lo:400:kworker.0
00000100:00080000:3.0:1767318481.392416:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318481.392423:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318481.392426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318481.392844:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940273792:0@lo:250:kworker.0
00000400:00000100:0.0:1767318481.392893:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940273792 offset 0 length 520: 4
00000100:00100000:0.0:1767318481.392929:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940273920:0@lo:38:kworker.0
00000100:00100000:0.0:1767318481.392957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318481.392974:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940274048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318481.392999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318481.393029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940274560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318481.393047:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318481.393065:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940274816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318481.393082:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318481.393116:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940273920
00000100:00100000:0.0:1767318481.393124:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940273920
00000100:00100000:0.0:1767318481.393160:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274560
00000100:00100000:0.0:1767318481.393163:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274560
00000100:00100000:0.0:1767318481.393174:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274816
00000100:00100000:0.0:1767318481.393175:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274816
00000100:00100000:0.0:1767318481.393189:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16293
00000100:00100000:0.0:1767318481.393195:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940273920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318481.393217:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318481.393256:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940273920:12345-0@lo:38:kworker.0 Request processed in 60us (298us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318481.393264:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16293
00000100:00100000:0.0:1767318481.393281:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16294
00000100:00100000:0.0:1767318481.393285:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940274560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318481.393295:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318481.393332:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940274560:12345-0@lo:38:kworker.0 Request processed in 45us (283us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318481.393339:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16294
00000100:00100000:0.0:1767318481.393350:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16295
00000100:00100000:0.0:1767318481.393354:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940274816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318481.393362:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318481.393384:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940274816:12345-0@lo:38:kworker.0 Request processed in 28us (301us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318481.393390:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16295
00000100:00080000:0.0:1767318481.393421:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318481.393426:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318481.393430:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940273920:0@lo:38:kworker.0
00000100:00080000:0.0:1767318481.393438:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318481.393441:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318481.393443:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940274560:0@lo:38:kworker.0
00000100:00080000:0.0:1767318481.393449:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318481.393452:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318481.393455:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940274816:0@lo:38:kworker.0
00000100:00100000:3.0:1767318481.393852:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274048
00000100:00100000:3.0:1767318481.393858:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274048
00000100:00100000:3.0:1767318481.393890:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956
00000100:00100000:3.0:1767318481.393895:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940274048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318481.393906:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318481.393940:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940274048:12345-0@lo:38:kworker.0 Request processed in 44us (939us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318481.393946:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956
00000100:00080000:0.0:1767318481.396870:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318481.396884:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318481.396888:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940274048:0@lo:38:kworker.0
00000100:00100000:2.0:1767318481.964925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318482.349016:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318482.925676:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274944:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318482.925755:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318482.926101:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940274944
00000100:00100000:1.0:1767318482.926110:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940274944
00000100:00100000:1.0:1767318482.929548:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094
00000100:00100000:1.0:1767318482.929574:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318482.929609:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318482.929686:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940274944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (3930us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318482.929694:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094
00000100:00100000:3.0:1767318482.929731:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940274944:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318482.988916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318483.373235:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318483.949918:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940275072:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318483.950024:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318483.953446:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275072
00000100:00100000:1.0:1767318483.953463:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275072
00000100:00100000:1.0:1767318483.953621:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095
00000100:00100000:1.0:1767318483.953631:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940275072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318483.953674:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318483.953930:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940275072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 300us (3904us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318483.953938:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095
00000100:00080000:3.0:1767318483.954011:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318483.954136:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940275072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318484.012894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318484.397349:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318485.036920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318485.421840:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318486.062313:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318486.095759:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318486.095845:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264704
00000100:00100000:2.0:1767318486.095857:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264704
00000100:00100000:0.0:1767318486.095876:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318486.098976:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264832
00000100:00100000:2.0:1767318486.098990:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264832
00000100:00100000:2.0:1767318486.099151:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3914
00000100:00100000:2.0:1767318486.099162:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894264832:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318486.099254:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894264832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (3378us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318486.099262:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3914
00000100:00100000:2.0:1767318486.099284:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16296
00000100:00100000:2.0:1767318486.099291:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894264704:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318486.099315:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318486.099342:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894264704:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (3593us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318486.099349:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16296
00000100:00080000:1.0:1767318486.100646:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318486.445178:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318486.509598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318486.509609:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318486.509612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318486.509616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318486.509620:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318486.509628:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1767318486.509635:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318486.509641:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318486.509685:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add880 x1853163940275200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318486.509711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318486.509716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318486.509718:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318486.509721:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1767318486.509724:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318486.509728:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318486.509740:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940275328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318486.509829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318486.509833:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318486.509835:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318486.509838:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1767318486.509841:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318486.509845:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318486.509854:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712db800 x1853163940275840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318486.509871:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318486.509874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318486.509876:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318486.509879:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1767318486.509882:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318486.509885:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318486.509894:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183bb80 x1853163940276096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318486.509955:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940275456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318486.510037:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318486.510126:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318486.510133:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940275584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318486.510155:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510312:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940275200:0@lo:38:kworker.0
00000100:00100000:0.0:1767318486.510344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510370:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940275328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318486.510390:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510403:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940275840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318486.510419:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510433:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940276096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318486.510451:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510479:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940275712:0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.510500:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510518:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318486.510523:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940275968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.510541:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318486.510570:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275456
00000100:00100000:0.0:1767318486.510576:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275456
00000100:00100000:0.0:1767318486.510622:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275584
00000100:00100000:0.0:1767318486.510625:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275584
00000100:00100000:0.0:1767318486.510641:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575
00000100:00100000:0.0:1767318486.510649:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940275456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.510692:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940275456:12345-0@lo:400:kworker.0 Request processed in 44us (655us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318486.510699:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575
00000100:00100000:0.0:1767318486.510713:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576
00000100:00100000:0.0:1767318486.510718:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940275584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.510738:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940275584:12345-0@lo:400:kworker.0 Request processed in 20us (582us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318486.510744:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576
00000100:00100000:0.0:1767318486.510759:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275328
00000100:00100000:0.0:1767318486.510761:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275328
00000100:00100000:0.0:1767318486.510802:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957
00000100:00100000:0.0:1767318486.510807:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940275328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318486.510825:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318486.510852:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940275328:12345-0@lo:38:kworker.0 Request processed in 44us (461us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318486.510858:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957
00000100:00100000:0.0:1767318486.510873:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275200
00000100:00100000:0.0:1767318486.510876:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275200
00000100:00100000:0.0:1767318486.510890:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275840
00000100:00100000:0.0:1767318486.510892:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275840
00000100:00100000:0.0:1767318486.510898:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276096
00000100:00100000:0.0:1767318486.510900:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276096
00000100:00100000:0.0:1767318486.510907:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275712
00000100:00100000:0.0:1767318486.510909:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275712
00000100:00100000:0.0:1767318486.510922:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940275968
00000100:00100000:0.0:1767318486.510924:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940275968
00000100:00100000:0.0:1767318486.510936:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915
00000100:00100000:0.0:1767318486.510941:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940275712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.510967:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940275712:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318486.510973:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915
00000100:00100000:0.0:1767318486.510982:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916
00000100:00100000:0.0:1767318486.510987:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940275968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.511006:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940275968:12345-0@lo:400:kworker.0 Request processed in 19us (464us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318486.511012:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916
00000100:00100000:0.0:1767318486.511021:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16297
00000100:00100000:0.0:1767318486.511025:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940275200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318486.511033:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318486.511055:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940275200:12345-0@lo:38:kworker.0 Request processed in 28us (709us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318486.511075:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16297
00000100:00100000:0.0:1767318486.511088:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16298
00000100:00100000:0.0:1767318486.511101:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940275840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318486.511111:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318486.511133:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940275840:12345-0@lo:38:kworker.0 Request processed in 40us (712us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318486.511138:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16298
00000100:00100000:0.0:1767318486.511148:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16299
00000100:00100000:0.0:1767318486.511152:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940276096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318486.511159:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318486.511179:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940276096:12345-0@lo:38:kworker.0 Request processed in 25us (727us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318486.511184:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16299
00000100:00100000:0.0:1767318486.511238:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940275968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318486.511247:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940275712:0@lo:400:kworker.0
00000100:00080000:0.0:1767318486.511282:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318486.511287:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318486.511290:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940275200:0@lo:38:kworker.0
00000100:00080000:0.0:1767318486.511298:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318486.511301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318486.511304:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940275328:0@lo:38:kworker.0
00000100:00080000:0.0:1767318486.511310:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318486.511313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318486.511315:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940275840:0@lo:38:kworker.0
00000100:00080000:0.0:1767318486.511322:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318486.511324:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318486.511327:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940276096:0@lo:38:kworker.0
00000100:00080000:1.0:1767318486.511432:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318486.511438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318486.511440:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318486.511463:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940275584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318486.511474:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940275456:0@lo:400:kworker.0
00000100:00100000:2.0:1767318487.087932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318487.469723:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318488.045409:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940276224:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318488.045480:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318488.049386:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276224
00000100:00100000:3.0:1767318488.049402:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276224
00000100:00100000:3.0:1767318488.049536:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096
00000100:00100000:3.0:1767318488.049549:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940276224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318488.049580:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318488.049672:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940276224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (4192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318488.049679:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096
00000100:00100000:0.0:1767318488.052099:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940276224:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318488.054463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318488.109140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318488.493453:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318489.069126:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940276352:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318489.069211:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318489.069349:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276352
00000100:00100000:1.0:1767318489.069358:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276352
00000100:00100000:1.0:1767318489.069429:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097
00000100:00100000:1.0:1767318489.069438:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940276352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318489.069468:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318489.069480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318489.074156:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940276352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4709us (4934us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318489.074172:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097
00000100:00100000:0.0:1767318489.074328:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940276352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318489.133607:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318489.523556:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318490.156882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318490.541573:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318491.180900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318491.209341:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318491.209453:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318491.209831:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894264960
00000100:00100000:3.0:1767318491.209841:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894264960
00000100:00100000:3.0:1767318491.209889:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16300
00000100:00100000:3.0:1767318491.209896:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894264960:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318491.209920:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318491.209985:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894264960:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 88us (652us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318491.209993:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16300
00000100:00100000:3.0:1767318491.210013:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265088
00000100:00100000:3.0:1767318491.210016:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265088
00000100:00100000:3.0:1767318491.210067:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3917
00000100:00100000:3.0:1767318491.210076:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894265088:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318491.210113:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894265088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (660us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318491.210121:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3917
00000100:00080000:3.0:1767318491.210154:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318491.565727:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318491.629203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318491.629213:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318491.629216:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318491.629220:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318491.629224:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318491.629242:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3736
00000100:00080000:2.0:1767318491.629247:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318491.629254:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318491.629298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940276480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318491.629324:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318491.629328:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318491.629330:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318491.629334:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3736
00000100:00080000:2.0:1767318491.629336:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318491.629340:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318491.629357:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940276608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318491.629413:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318491.629417:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318491.629419:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318491.629422:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3736
00000100:00080000:2.0:1767318491.629424:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318491.629428:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318491.629438:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf480 x1853163940277120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318491.629454:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318491.629457:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318491.629459:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318491.629461:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3736
00000100:00080000:2.0:1767318491.629463:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318491.629467:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318491.629476:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210380 x1853163940277376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318491.629513:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940276736:0@lo:400:kworker.0
00000100:00100000:2.0:1767318491.629591:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318491.629660:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318491.629665:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940276864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318491.629690:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318491.629938:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276736
00000100:00100000:3.0:1767318491.629946:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276736
00000100:00100000:3.0:1767318491.630005:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276864
00000100:00100000:3.0:1767318491.630008:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276864
00000100:00100000:3.0:1767318491.630029:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577
00000100:00100000:3.0:1767318491.630038:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940276736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318491.630108:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940276736:12345-0@lo:400:kworker.0 Request processed in 72us (517us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318491.630115:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577
00000100:00100000:3.0:1767318491.630134:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578
00000100:00100000:3.0:1767318491.630141:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940276864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318491.630168:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940276864:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318491.630173:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578
00000100:00100000:0.0:1767318491.630309:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940277248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630344:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318491.630364:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318491.630368:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940276992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630386:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318491.630413:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940276864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318491.630425:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940276736:0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630434:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277248
00000100:00100000:0.0:1767318491.630437:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277248
00000100:00100000:0.0:1767318491.630465:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276992
00000100:00100000:0.0:1767318491.630468:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276992
00000100:00100000:0.0:1767318491.630488:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918
00000100:00100000:0.0:1767318491.630494:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940277248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630527:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940277248:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318491.630534:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918
00000100:00100000:0.0:1767318491.630546:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919
00000100:00100000:0.0:1767318491.630552:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940276992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630575:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940276992:12345-0@lo:400:kworker.0 Request processed in 24us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318491.630581:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919
00000100:00100000:0.0:1767318491.630603:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940276992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318491.630613:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940277248:0@lo:400:kworker.0
00000100:00100000:1.0:1767318491.632206:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940276480:0@lo:38:kworker.0
00000100:00100000:1.0:1767318491.632268:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318491.632295:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940276608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318491.632319:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318491.632341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940277120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318491.632362:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318491.632382:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940277376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318491.632417:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318491.632460:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276480
00000100:00100000:1.0:1767318491.632466:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276480
00000100:00100000:1.0:1767318491.632493:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277120
00000100:00100000:1.0:1767318491.632495:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277120
00000100:00100000:1.0:1767318491.632505:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277376
00000100:00100000:1.0:1767318491.632508:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277376
00000100:00100000:1.0:1767318491.632518:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16301
00000100:00100000:1.0:1767318491.632524:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940276480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318491.632544:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318491.632580:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940276480:12345-0@lo:38:kworker.0 Request processed in 56us (312us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318491.632587:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16301
00000100:00100000:1.0:1767318491.632603:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16302
00000100:00100000:1.0:1767318491.632606:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940277120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318491.632615:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318491.632637:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940277120:12345-0@lo:38:kworker.0 Request processed in 30us (275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318491.632643:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16302
00000100:00100000:1.0:1767318491.632654:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16303
00000100:00100000:1.0:1767318491.632658:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940277376:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318491.632666:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318491.632683:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940277376:12345-0@lo:38:kworker.0 Request processed in 24us (266us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318491.632689:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16303
00000100:00080000:1.0:1767318491.632727:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318491.632732:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318491.632736:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940276480:0@lo:38:kworker.0
00000100:00080000:1.0:1767318491.632744:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318491.632746:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318491.632749:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940277120:0@lo:38:kworker.0
00000100:00080000:1.0:1767318491.632755:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318491.632758:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318491.632761:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940277376:0@lo:38:kworker.0
00000100:00080000:2.0:1767318491.633383:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318491.633390:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318491.633393:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318491.635166:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940276608
00000100:00100000:3.0:1767318491.635180:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940276608
00000100:00100000:3.0:1767318491.635327:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958
00000100:00100000:3.0:1767318491.635335:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940276608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318491.635357:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318491.635446:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940276608:12345-0@lo:38:kworker.0 Request processed in 110us (3124us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318491.635456:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958
00000100:00080000:2.0:1767318491.635669:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318491.635674:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318491.635677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940276608:0@lo:38:kworker.0
00000100:00100000:2.0:1767318492.205450:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318492.589660:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318493.165306:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318493.165334:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940277504:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318493.165405:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318493.165764:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277504
00000100:00100000:1.0:1767318493.165799:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277504
00000100:00100000:1.0:1767318493.165870:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098
00000100:00100000:1.0:1767318493.165880:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940277504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318493.165910:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318493.165962:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940277504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (556us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318493.165969:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098
00000100:00100000:1.0:1767318493.166016:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940277504:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318493.166093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318493.229015:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318493.613017:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318494.191131:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940277632:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318494.191217:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318494.191515:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277632
00000100:00100000:2.0:1767318494.191523:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277632
00000100:00100000:2.0:1767318494.191588:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099
00000100:00100000:2.0:1767318494.191597:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940277632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318494.191627:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318494.191669:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940277632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (453us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318494.191676:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099
00000100:00100000:1.0:1767318494.191761:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940277632:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318494.192047:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318494.252990:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318494.637057:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318495.277958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318495.660986:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318496.301259:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:0.0:1767318496.336350:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318496.336445:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318496.336583:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265344
00000100:00100000:1.0:1767318496.336593:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265344
00000100:00100000:1.0:1767318496.336662:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265216
00000100:00100000:1.0:1767318496.336665:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265216
00000100:00100000:1.0:1767318496.336685:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3920
00000100:00100000:1.0:1767318496.336694:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894265344:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318496.336815:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894265344:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318496.336825:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3920
00000100:00100000:1.0:1767318496.337035:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16304
00000100:00100000:1.0:1767318496.337040:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894265216:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318496.337073:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318496.337106:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894265216:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 65us (661us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318496.337113:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16304
00000100:00080000:0.0:1767318496.338198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318496.685693:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318496.749719:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318496.749731:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318496.749735:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318496.749739:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318496.749743:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318496.749750:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3741
00000100:00080000:1.0:1767318496.749755:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318496.749762:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318496.749828:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01500 x1853163940277760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318496.749855:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318496.749859:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318496.749860:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318496.749864:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3741
00000100:00080000:1.0:1767318496.749867:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318496.749870:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318496.749884:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019f80 x1853163940277888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318496.749952:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318496.749956:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318496.749957:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318496.749962:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3741
00000100:00080000:1.0:1767318496.749964:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318496.749968:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318496.749978:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940278400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318496.749993:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318496.749996:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318496.750009:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318496.750013:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3741
00000100:00080000:1.0:1767318496.750016:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318496.750019:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318496.750036:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940278656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318496.750064:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940278528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318496.750134:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318496.750195:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318496.750202:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940278272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318496.750226:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318496.750263:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278528
00000100:00100000:1.0:1767318496.750270:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278528
00000100:00100000:1.0:1767318496.750321:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278272
00000100:00100000:1.0:1767318496.750324:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278272
00000100:00100000:1.0:1767318496.750350:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921
00000100:00100000:1.0:1767318496.750359:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940278528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318496.750413:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940278528:12345-0@lo:400:kworker.0 Request processed in 55us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318496.750425:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921
00000100:00100000:1.0:1767318496.750443:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922
00000100:00100000:1.0:1767318496.750449:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940278272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318496.750477:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940278272:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318496.750483:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922
00000100:00100000:1.0:1767318496.750526:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940278272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318496.750538:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940278528:0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750635:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940278016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750674:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318496.750708:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318496.750714:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940278144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750736:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318496.750795:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278016
00000100:00100000:3.0:1767318496.750799:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278016
00000100:00100000:3.0:1767318496.750828:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278144
00000100:00100000:3.0:1767318496.750831:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278144
00000100:00100000:3.0:1767318496.750854:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579
00000100:00100000:3.0:1767318496.750861:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940278016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750898:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940278016:12345-0@lo:400:kworker.0 Request processed in 38us (223us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318496.750904:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579
00000100:00100000:3.0:1767318496.750918:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580
00000100:00100000:3.0:1767318496.750923:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940278144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750949:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940278144:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318496.750954:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580
00000100:00100000:3.0:1767318496.750986:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940278144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318496.750996:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940278016:0@lo:400:kworker.0
00000100:00080000:0.0:1767318496.751094:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318496.751099:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318496.751102:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318496.751452:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940277760:0@lo:38:kworker.0
00000100:00100000:2.0:1767318496.751496:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318496.751526:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940277888:0@lo:38:kworker.0
00000100:00100000:2.0:1767318496.751552:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318496.751589:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940278400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318496.751613:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318496.751632:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940278656:0@lo:38:kworker.0
00000100:00100000:2.0:1767318496.751653:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318496.751687:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277760
00000100:00100000:2.0:1767318496.751692:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277760
00000100:00100000:2.0:1767318496.751718:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278400
00000100:00100000:2.0:1767318496.751721:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278400
00000100:00100000:2.0:1767318496.751735:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278656
00000100:00100000:2.0:1767318496.751738:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278656
00000100:00100000:2.0:1767318496.751754:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16305
00000100:00100000:2.0:1767318496.751759:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940277760:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318496.751804:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318496.751840:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940277760:12345-0@lo:38:kworker.0 Request processed in 79us (344us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318496.751846:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16305
00000100:00100000:2.0:1767318496.751859:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16306
00000100:00100000:2.0:1767318496.751862:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940278400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318496.751872:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318496.752570:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940278400:12345-0@lo:38:kworker.0 Request processed in 702us (953us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318496.752636:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16306
00000100:00100000:2.0:1767318496.752656:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16307
00000100:00100000:2.0:1767318496.752661:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940278656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318496.752675:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318496.752703:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940278656:12345-0@lo:38:kworker.0 Request processed in 41us (1050us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318496.752708:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16307
00000100:00080000:2.0:1767318496.752762:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318496.752768:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318496.752811:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940277760:0@lo:38:kworker.0
00000100:00080000:2.0:1767318496.752824:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318496.752828:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318496.752831:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940278400:0@lo:38:kworker.0
00000100:00080000:2.0:1767318496.752838:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318496.752841:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318496.752843:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940278656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318496.753161:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940277888
00000100:00100000:0.0:1767318496.753168:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940277888
00000100:00100000:0.0:1767318496.753201:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959
00000100:00100000:0.0:1767318496.753210:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940277888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318496.753223:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318496.753264:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940277888:12345-0@lo:38:kworker.0 Request processed in 57us (1710us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318496.753270:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959
00000100:00080000:2.0:1767318496.756391:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318496.756402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318496.756405:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940277888:0@lo:38:kworker.0
00000100:00100000:2.0:1767318497.324914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318497.709490:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318498.284961:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318498.285006:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940278784:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318498.285067:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318498.285267:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278784
00000100:00100000:1.0:1767318498.285276:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278784
00000100:00100000:1.0:1767318498.285338:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100
00000100:00100000:1.0:1767318498.285347:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940278784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318498.285377:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767318498.285512:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318498.285544:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940278784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (476us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318498.285552:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100
00000100:00100000:2.0:1767318498.285661:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940278784:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318498.374150:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318498.733475:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318499.339642:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940278912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318499.339725:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318499.341387:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940278912
00000100:00100000:1.0:1767318499.341398:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940278912
00000100:00100000:1.0:1767318499.341490:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101
00000100:00100000:1.0:1767318499.341502:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940278912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318499.341534:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318499.341631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318499.343531:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940278912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2023us (3796us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318499.343544:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101
00000100:00100000:0.0:1767318499.347326:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940278912:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318499.436901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318499.760436:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318500.435034:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318500.435076:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894265472 offset 0 length 520: 4
00000100:00100000:1.0:1767318500.435106:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318500.435202:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265728
00000100:00100000:2.0:1767318500.435213:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265728
00000100:00100000:2.0:1767318500.435292:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265600
00000100:00100000:2.0:1767318500.435296:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265600
00000100:00100000:2.0:1767318500.435320:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3923
00000100:00100000:2.0:1767318500.435331:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894265728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318500.435404:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894265728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318500.435412:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3923
00000100:00100000:2.0:1767318500.435431:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16308
00000100:00100000:2.0:1767318500.435436:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894265600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318500.435457:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318500.435482:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894265600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (375us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318500.435489:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16308
00000100:00080000:0.0:1767318500.435572:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318500.463139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318500.783720:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318501.485405:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318501.806019:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318501.869827:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318501.869839:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318501.869842:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318501.869845:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318501.869970:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318501.869979:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3746
00000100:00080000:2.0:1767318501.869984:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318501.869991:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318501.870028:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211500 x1853163940279040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318501.870066:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318501.870070:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318501.870072:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318501.870075:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3746
00000100:00080000:2.0:1767318501.870078:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318501.870081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318501.870098:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940279168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318501.870371:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940279040:0@lo:38:kworker.0
00000100:00080000:2.0:1767318501.870532:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318501.870535:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318501.870537:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318501.870541:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3746
00000100:00080000:2.0:1767318501.870544:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318501.870548:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318501.870560:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046add500 x1853163940279680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318501.870576:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318501.870578:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318501.870580:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318501.870583:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3746
00000100:00080000:2.0:1767318501.870586:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318501.870589:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318501.870597:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92680 x1853163940279936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318501.870635:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940279808:0@lo:400:kworker.0
00000100:00100000:1.0:1767318501.870995:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940279296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318501.871028:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318501.871102:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318501.871239:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940279424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318501.871263:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318501.871561:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279296
00000100:00100000:0.0:1767318501.871568:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279296
00000100:00100000:0.0:1767318501.871623:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279424
00000100:00100000:0.0:1767318501.871626:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279424
00000100:00100000:0.0:1767318501.871645:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581
00000100:00100000:0.0:1767318501.871653:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940279296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318501.871832:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940279296:12345-0@lo:400:kworker.0 Request processed in 179us (802us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318501.871839:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581
00000100:00100000:0.0:1767318501.872028:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582
00000100:00100000:0.0:1767318501.872178:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940279424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318501.872213:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940279424:12345-0@lo:400:kworker.0 Request processed in 178us (948us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318501.872219:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582
00000100:00100000:3.0:1767318501.872386:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940279552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318501.872818:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318501.873032:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318501.873087:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318501.873179:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940279168:0@lo:38:kworker.0
00000100:00100000:3.0:1767318501.873207:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318501.873229:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940279680:0@lo:38:kworker.0
00000100:00100000:3.0:1767318501.873252:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318501.873381:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279168
00000100:00100000:0.0:1767318501.873387:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279168
00000100:00100000:0.0:1767318501.873413:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960
00000100:00100000:0.0:1767318501.873418:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940279168:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318501.873589:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279808
00000100:00100000:2.0:1767318501.873594:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279808
00000100:00100000:2.0:1767318501.873625:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279552
00000100:00100000:2.0:1767318501.873628:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279552
00000100:00100000:2.0:1767318501.873645:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279040
00000100:00100000:2.0:1767318501.873647:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279040
00000100:00100000:2.0:1767318501.873654:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279680
00000100:00100000:2.0:1767318501.873656:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279680
00000100:00100000:2.0:1767318501.873665:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924
00000100:00100000:3.0:1767318501.873802:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940279936:0@lo:38:kworker.0
00000100:00100000:3.0:1767318501.873834:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767318501.874013:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318501.874058:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940279168:12345-0@lo:38:kworker.0 Request processed in 638us (850us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318501.874065:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960
00000100:00100000:0.0:1767318501.874090:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940279936
00000100:00100000:0.0:1767318501.874094:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940279936
00000100:00100000:0.0:1767318501.874106:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925
00000100:00080000:1.0:1767318501.874214:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318501.874219:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318501.874222:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318501.874256:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940279552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318501.874307:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940279552:12345-0@lo:400:kworker.0 Request processed in 54us (1276us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318501.874341:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940279808:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318501.874379:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940279808:12345-0@lo:400:kworker.0 Request processed in 708us (3706us total) trans 0 rc 0/0
00000100:00080000:3.0:1767318501.876232:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318501.876240:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318501.876244:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940279168:0@lo:38:kworker.0
00000100:00100000:1.0:1767318501.879260:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16309
00000100:00100000:1.0:1767318501.879282:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318501.879306:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318501.879392:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279040:12345-0@lo:38:kworker.0 Request processed in 111us (6303us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318501.879400:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16309
00000100:00100000:1.0:1767318501.879438:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16310
00000100:00100000:1.0:1767318501.879443:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318501.879452:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318501.879481:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279680:12345-0@lo:38:kworker.0 Request processed in 37us (6228us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318501.879488:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16310
00000100:00100000:1.0:1767318501.879498:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16311
00000100:00100000:1.0:1767318501.879502:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318501.879511:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318501.879534:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940279936:12345-0@lo:38:kworker.0 Request processed in 30us (5700us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318501.879540:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16311
00000100:00100000:1.0:1767318501.879586:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940279424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318501.879600:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940279296:0@lo:400:kworker.0
00000100:00080000:1.0:1767318501.879634:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318501.879639:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318501.879642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940279680:0@lo:38:kworker.0
00000100:00080000:1.0:1767318501.879650:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318501.879653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318501.879656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940279936:0@lo:38:kworker.0
00000100:00080000:1.0:1767318501.879664:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318501.879668:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318501.879671:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940279040:0@lo:38:kworker.0
00000100:00100000:1.0:1767318501.879737:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940279552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318501.879793:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940279808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318501.886041:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925
00000100:00100000:2.0:1767318501.888241:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924
00000100:00100000:2.0:1767318502.508920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318502.834664:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318503.405067:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940280064:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318503.405146:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318503.409384:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280064
00000100:00100000:3.0:1767318503.409400:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280064
00000100:00100000:3.0:1767318503.409580:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102
00000100:00100000:3.0:1767318503.409593:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940280064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318503.409631:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318503.409723:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940280064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (4577us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318503.409731:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102
00000100:00100000:0.0:1767318503.410036:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940280064:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318503.410271:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318503.533009:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318503.855886:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318504.434426:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318504.434582:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940280192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318504.434668:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318504.435167:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280192
00000100:00100000:2.0:1767318504.435370:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280192
00000100:00080000:1.0:1767318504.436626:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318504.437306:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103
00000100:00100000:2.0:1767318504.437320:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940280192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318504.437350:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318504.438141:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940280192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 823us (3469us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318504.438149:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103
00000100:00100000:3.0:1767318504.438568:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940280192:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318504.556899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318504.877471:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318505.543358:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318505.543417:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318505.552413:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265984
00000100:00100000:0.0:1767318505.552430:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265984
00000100:00100000:0.0:1767318505.552512:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894265856
00000100:00100000:0.0:1767318505.552516:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894265856
00000100:00100000:0.0:1767318505.552541:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3926
00000100:00100000:0.0:1767318505.552551:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894265984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318505.552631:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894265984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (9286us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318505.552638:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3926
00000100:00100000:0.0:1767318505.552658:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16312
00000100:00100000:0.0:1767318505.552662:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894265856:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:1.0:1767318505.552807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767318505.554826:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318505.555182:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894265856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 2514us (11762us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318505.555193:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16312
00000100:00100000:2.0:1767318505.580945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318505.904532:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318506.604949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318506.926586:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318506.989209:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.989221:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318506.989224:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.989228:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318506.989233:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318506.989254:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3751
00000100:00080000:2.0:1767318506.989261:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318506.989268:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318506.989314:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d880 x1853163940280320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318506.989341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.989345:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318506.989347:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318506.989351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3751
00000100:00080000:2.0:1767318506.989353:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318506.989357:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318506.989370:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219c700 x1853163940280448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318506.989439:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.989443:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318506.989445:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318506.989448:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3751
00000100:00080000:2.0:1767318506.989451:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318506.989455:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318506.989466:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940280960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318506.989481:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.989484:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318506.989486:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318506.989489:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3751
00000100:00080000:2.0:1767318506.989491:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318506.989494:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318506.989504:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b100 x1853163940281216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318506.989543:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318481/real 1767318481]  req@ffff93d04401b800 x1853163940273792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318506.989570:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04401b800 x1853163940273792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318506.989591:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940280320:0@lo:38:kworker.0
00000100:00100000:2.0:1767318506.989655:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318506.989717:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940280576:0@lo:400:kworker.0
00000100:00100000:1.0:1767318506.989756:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318506.990203:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940280832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318506.990238:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318506.991092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940280448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318506.991129:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318506.991153:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940280960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318506.991178:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318506.991203:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940281216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318506.991216:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940280704:0@lo:400:kworker.0
00000100:00100000:2.0:1767318506.991226:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318506.991257:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318506.991297:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280320
00000100:00100000:0.0:1767318506.991304:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280320
00000100:00080000:2.0:1767318506.991325:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318506.991341:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280832
00000100:00080000:2.0:1767318506.991343:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318506.991346:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280832
00000100:00100000:2.0:1767318506.991351:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940273792:0@lo:250:kworker.0
00000100:00100000:0.0:1767318506.991386:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280960
00000100:00100000:0.0:1767318506.991389:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280960
00000100:00100000:0.0:1767318506.991397:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281216
00000100:00100000:0.0:1767318506.991399:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281216
00000100:00100000:0.0:1767318506.991411:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927
00000100:00100000:0.0:1767318506.991420:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940280832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318506.991468:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940280832:12345-0@lo:400:kworker.0 Request processed in 48us (1228us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318506.991476:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927
00000100:00100000:2.0:1767318506.991484:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940281088:0@lo:400:kworker.0
00000100:00100000:0.0:1767318506.991497:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16313
00000100:00100000:0.0:1767318506.991503:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940280320:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318506.991518:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767318506.991522:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318506.991554:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280448
00000100:00100000:2.0:1767318506.991560:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280448
00000100:00100000:0.0:1767318506.991563:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940280320:12345-0@lo:38:kworker.0 Request processed in 57us (1906us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318506.991571:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16313
00000100:00100000:0.0:1767318506.991581:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281088
00000100:00100000:0.0:1767318506.991585:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281088
00000100:00100000:1.0:1767318506.991587:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16314
00000100:00100000:2.0:1767318506.991594:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961
00000100:00100000:1.0:1767318506.991595:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940280960:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318506.991605:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940280448:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318506.991609:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928
00010000:00020000:1.0:1767318506.991609:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318506.991617:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940281088:12345-0@lo:400:kworker.0
00010000:00020000:2.0:1767318506.991624:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318506.991665:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940281088:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318506.991673:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928
00000100:00100000:2.0:1767318506.991680:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940280448:12345-0@lo:38:kworker.0 Request processed in 75us (548us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318506.991690:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16315
00000100:00100000:2.0:1767318506.991691:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961
00000100:00100000:0.0:1767318506.991699:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940281216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318506.991710:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318506.991721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318506.991727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318506.991730:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318506.991735:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3731
00000100:00080000:2.0:1767318506.991739:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318506.991741:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940281216:12345-0@lo:38:kworker.0 Request processed in 42us (515us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318506.991746:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318506.991752:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16315
00000100:00100000:1.0:1767318506.991767:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940280960:12345-0@lo:38:kworker.0 Request processed in 61us (476us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318506.991791:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16314
00000100:00100000:2.0:1767318506.991800:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb100 x1853163940281344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318506.991808:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318506.991824:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940281088:0@lo:400:kworker.0
00000100:00080000:1.0:1767318506.991836:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318506.991840:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318506.991843:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940280320:0@lo:38:kworker.0
00000100:00080000:1.0:1767318506.991851:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318506.991854:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318506.991857:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940280448:0@lo:38:kworker.0
00000100:00080000:1.0:1767318506.991865:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318506.991867:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280576
00000100:00080000:1.0:1767318506.991868:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318506.991870:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280576
00000100:00100000:1.0:1767318506.991870:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940280960:0@lo:38:kworker.0
00000100:00080000:1.0:1767318506.991877:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318506.991880:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318506.991882:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940281216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318506.991899:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940280704
00000100:00100000:0.0:1767318506.991901:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940280704
00000100:00080000:1.0:1767318506.991916:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318506.991919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318506.991935:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583
00000100:00100000:0.0:1767318506.991941:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940280576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318506.991943:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584
00000100:00100000:1.0:1767318506.991951:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940280704:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318506.991984:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940280576:12345-0@lo:400:kworker.0 Request processed in 42us (2226us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318506.991984:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940280704:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318506.991991:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583
00000100:00100000:1.0:1767318506.991999:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584
00000100:00100000:2.0:1767318506.992010:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940280704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318506.992026:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940281344:0@lo:250:kworker.0
00000100:00100000:0.0:1767318506.992027:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940280576:0@lo:400:kworker.0
00000400:00000100:1.0:1767318506.992047:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940281344 offset 0 length 520: 4
00000100:00100000:3.0:1767318506.996533:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940280832:0@lo:400:kworker.0
00000100:00100000:2.0:1767318507.628995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318507.950236:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318508.529414:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940281472:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318508.529510:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318508.529822:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281472
00000100:00100000:1.0:1767318508.529830:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281472
00000100:00100000:1.0:1767318508.529944:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104
00000100:00100000:1.0:1767318508.529957:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940281472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318508.530005:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767318508.530188:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318508.530395:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940281472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 440us (884us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318508.530403:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104
00000100:00100000:0.0:1767318508.530492:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940281472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318508.652941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318508.973213:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318509.552128:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318509.552158:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940281600:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318509.552238:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318509.552915:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281600
00000100:00100000:2.0:1767318509.552925:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281600
00000100:00100000:2.0:1767318509.553008:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105
00000100:00100000:2.0:1767318509.553018:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940281600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318509.553054:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318509.553131:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940281600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (892us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318509.553138:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105
00000100:00100000:1.0:1767318509.553285:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940281600:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318509.561355:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318509.678109:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318509.998643:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318510.664992:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318510.665090:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318510.665187:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266240
00000100:00100000:0.0:1767318510.665198:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266240
00000100:00100000:0.0:1767318510.665283:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266112
00000100:00100000:0.0:1767318510.665288:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266112
00000100:00100000:0.0:1767318510.665306:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3929
00000100:00100000:0.0:1767318510.665316:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894266240:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318510.665347:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16316
00000100:00100000:3.0:1767318510.665354:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894266112:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318510.665373:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318510.665386:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894266240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (405us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318510.665394:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3929
00000100:00100000:3.0:1767318510.665578:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894266112:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 222us (487us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318510.665585:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16316
00000100:00080000:2.0:1767318510.665622:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318510.702327:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318511.031493:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318511.724972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318512.045129:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318512.109393:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318512.109405:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318512.109408:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318512.109412:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318512.109417:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318512.109427:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3757
00000100:00080000:2.0:1767318512.109433:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318512.109440:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318512.109494:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940281728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318512.109524:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318512.109528:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318512.109530:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318512.109533:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3757
00000100:00080000:2.0:1767318512.109535:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318512.109538:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318512.109557:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a300 x1853163940281856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318512.109626:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318512.109629:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318512.109631:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318512.109634:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3757
00000100:00080000:2.0:1767318512.109636:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318512.109640:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318512.109653:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940282368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318512.109669:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318512.109672:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318512.109674:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318512.109678:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3757
00000100:00080000:2.0:1767318512.109681:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318512.109685:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318512.109696:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940282624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318512.109917:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940282240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318512.109987:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110057:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318512.110064:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940282496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318512.110086:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110122:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282240
00000100:00100000:1.0:1767318512.110129:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282240
00000100:00100000:1.0:1767318512.110181:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282496
00000100:00100000:1.0:1767318512.110184:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282496
00000100:00100000:1.0:1767318512.110225:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930
00000100:00100000:1.0:1767318512.110234:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940282240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318512.110285:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940282240:12345-0@lo:400:kworker.0 Request processed in 52us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318512.110292:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930
00000100:00100000:1.0:1767318512.110308:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931
00000100:00100000:1.0:1767318512.110313:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940282496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318512.110335:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940282496:12345-0@lo:400:kworker.0 Request processed in 22us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318512.110340:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931
00000100:00100000:1.0:1767318512.110362:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940281728:0@lo:38:kworker.0
00000100:00100000:1.0:1767318512.110383:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110404:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940281856:0@lo:38:kworker.0
00000100:00100000:1.0:1767318512.110427:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110442:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940282368:0@lo:38:kworker.0
00000100:00100000:1.0:1767318512.110475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110489:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940282624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318512.110507:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318512.110538:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281728
00000100:00100000:1.0:1767318512.110541:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281728
00000100:00100000:1.0:1767318512.110556:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282368
00000100:00100000:1.0:1767318512.110559:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282368
00000100:00100000:1.0:1767318512.110565:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282624
00000100:00100000:1.0:1767318512.110567:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282624
00000100:00100000:1.0:1767318512.110576:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16317
00000100:00100000:1.0:1767318512.110581:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940281728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318512.110600:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318512.110632:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940281728:12345-0@lo:38:kworker.0 Request processed in 50us (248us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318512.110637:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16317
00000100:00100000:1.0:1767318512.110648:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16318
00000100:00100000:1.0:1767318512.110652:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940282368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318512.110661:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318512.110680:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940282368:12345-0@lo:38:kworker.0 Request processed in 27us (205us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318512.110686:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16318
00000100:00100000:1.0:1767318512.110696:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16319
00000100:00100000:1.0:1767318512.110700:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940282624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318512.110709:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318512.110731:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940282624:12345-0@lo:38:kworker.0 Request processed in 29us (222us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318512.110736:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16319
00000100:00080000:1.0:1767318512.110766:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318512.111217:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318512.111268:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940282496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318512.111280:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940282240:0@lo:400:kworker.0
00000100:00080000:1.0:1767318512.111388:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318512.111393:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940281728:0@lo:38:kworker.0
00000100:00080000:1.0:1767318512.111407:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318512.111411:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318512.111413:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940282368:0@lo:38:kworker.0
00000100:00080000:1.0:1767318512.111420:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318512.111423:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318512.111425:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940282624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318512.111730:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940281984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318512.111804:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318512.111842:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318512.111848:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318512.111881:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318512.112101:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281984
00000100:00100000:3.0:1767318512.112107:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281984
00000100:00100000:3.0:1767318512.112154:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282112
00000100:00100000:3.0:1767318512.112157:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282112
00000100:00100000:3.0:1767318512.112196:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585
00000100:00100000:3.0:1767318512.112216:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940281984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318512.112277:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940281856
00000100:00100000:0.0:1767318512.112282:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940281856
00000100:00100000:0.0:1767318512.112307:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962
00000100:00100000:0.0:1767318512.112312:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940281856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318512.112326:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318512.112359:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940281856:12345-0@lo:38:kworker.0 Request processed in 45us (1931us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318512.112366:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962
00000100:00100000:0.0:1767318512.112405:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586
00000100:00100000:0.0:1767318512.112412:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282112:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318512.112499:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318512.112503:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318512.112506:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940281856:0@lo:38:kworker.0
00000100:00080000:1.0:1767318512.112530:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318512.112543:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318512.124309:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940281984:12345-0@lo:400:kworker.0 Request processed in 12086us (12524us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318512.124324:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585
00000100:00100000:0.0:1767318512.125003:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282112:12345-0@lo:400:kworker.0 Request processed in 12590us (13119us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318512.125012:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586
00000100:00100000:1.0:1767318512.126441:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318512.126470:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940281984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318512.749768:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318513.069028:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318513.647521:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318513.647592:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318513.649813:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282752
00000100:00100000:3.0:1767318513.649825:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282752
00000100:00100000:3.0:1767318513.649913:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106
00000100:00100000:3.0:1767318513.649924:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318513.649971:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318513.650051:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (2458us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318513.650060:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106
00000100:00100000:0.0:1767318513.650490:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318513.772940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318514.093052:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318514.669378:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318514.669402:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282880:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318514.669485:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318514.669801:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940282880
00000100:00100000:2.0:1767318514.669810:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940282880
00000100:00100000:2.0:1767318514.669890:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107
00000100:00100000:2.0:1767318514.669899:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318514.669927:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318514.669971:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940282880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318514.669978:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107
00000100:00080000:1.0:1767318514.670117:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318514.670165:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940282880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318514.796905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318515.117447:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318515.783478:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318515.783591:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266368
00000100:00100000:2.0:1767318515.783601:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266368
00000100:00100000:2.0:1767318515.783696:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16320
00000100:00100000:2.0:1767318515.783704:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894266368:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318515.783730:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318515.783838:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894266368:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 133us (368us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318515.783850:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16320
00000100:00100000:1.0:1767318515.791333:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318515.791460:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266496
00000100:00100000:2.0:1767318515.791470:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266496
00000100:00100000:2.0:1767318515.791563:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3932
00000100:00100000:2.0:1767318515.791574:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894266496:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318515.791759:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318515.792909:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894266496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1325us (1574us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318515.792921:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3932
00000100:00100000:2.0:1767318515.822627:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318516.142213:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318516.845813:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318517.165251:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318517.228920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318517.228933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318517.228937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318517.228942:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318517.228947:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318517.228956:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3762
00000100:00080000:2.0:1767318517.228962:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318517.228970:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318517.229010:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940283008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318517.229045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318517.229049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318517.229052:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318517.229055:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3762
00000100:00080000:2.0:1767318517.229058:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318517.229061:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318517.229076:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940283136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318517.229142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318517.229146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318517.229148:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318517.229153:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3762
00000100:00080000:2.0:1767318517.229155:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318517.229160:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318517.229173:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797b800 x1853163940283648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318517.229173:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940283264:0@lo:400:kworker.0
00000100:00080000:2.0:1767318517.229195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318517.229198:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318517.229200:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318517.229203:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3762
00000100:00080000:2.0:1767318517.229206:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318517.229209:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318517.229221:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940283904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318517.229257:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318517.229300:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940283008:0@lo:38:kworker.0
00000100:00100000:3.0:1767318517.229325:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318517.229334:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940283392:0@lo:400:kworker.0
00000100:00100000:1.0:1767318517.229342:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318517.229360:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940283776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318517.229368:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940283136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318517.229371:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318517.229398:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283264
00000100:00100000:2.0:1767318517.229407:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283264
00000100:00100000:1.0:1767318517.229416:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318517.229419:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318517.229427:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283392
00000100:00100000:3.0:1767318517.229433:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283392
00000100:00100000:1.0:1767318517.229450:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940283648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318517.229462:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318517.229468:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587
00000100:00100000:0.0:1767318517.229475:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940283520:0@lo:400:kworker.0
00000100:00100000:3.0:1767318517.229479:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588
00000100:00100000:1.0:1767318517.229481:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318517.229495:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940283392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318517.229510:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940283904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318517.229516:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318517.229553:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318517.229564:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940283392:12345-0@lo:400:kworker.0 Request processed in 73us (196us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318517.229573:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588
00000100:00080000:1.0:1767318517.229594:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318517.229599:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318517.229615:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283136
00000100:00100000:1.0:1767318517.229620:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283136
00000100:00100000:3.0:1767318517.229622:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940283392:0@lo:400:kworker.0
00000100:00100000:1.0:1767318517.229651:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963
00000100:00100000:1.0:1767318517.229656:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940283136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318517.229675:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318517.229719:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940283136:12345-0@lo:38:kworker.0 Request processed in 62us (307us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318517.229726:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963
00000100:00100000:2.0:1767318517.230247:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940283264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318517.230295:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940283264:12345-0@lo:400:kworker.0 Request processed in 819us (1038us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318517.230303:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587
00000100:00100000:0.0:1767318517.236893:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283008
00000100:00100000:0.0:1767318517.236910:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283008
00000100:00100000:0.0:1767318517.236971:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283776
00000100:00100000:0.0:1767318517.236975:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283776
00000100:00100000:0.0:1767318517.237013:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283648
00000100:00100000:0.0:1767318517.237016:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283648
00000100:00100000:0.0:1767318517.237026:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283520
00000100:00100000:0.0:1767318517.237028:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283520
00000100:00100000:0.0:1767318517.237044:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940283904
00000100:00100000:0.0:1767318517.237046:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940283904
00000100:00100000:0.0:1767318517.237061:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933
00000100:00100000:0.0:1767318517.237071:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940283776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318517.237177:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940283776:12345-0@lo:400:kworker.0 Request processed in 107us (7762us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318517.237184:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933
00000100:00100000:0.0:1767318517.237203:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934
00000100:00100000:0.0:1767318517.237209:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940283520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318517.240576:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16321
00000100:00100000:3.0:1767318517.240589:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940283008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318517.240614:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318517.240699:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940283008:12345-0@lo:38:kworker.0 Request processed in 110us (11358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318517.244004:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940283520:12345-0@lo:400:kworker.0 Request processed in 4433us (12130us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318517.246690:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16321
00000100:00100000:0.0:1767318517.248601:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934
00000100:00100000:3.0:1767318517.248614:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16322
00000100:00100000:3.0:1767318517.248627:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940283648:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318517.248629:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16323
00000100:00100000:1.0:1767318517.248641:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940283904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318517.248658:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318517.248659:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318517.248718:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940283520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318517.248732:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940283776:0@lo:400:kworker.0
00000100:00100000:3.0:1767318517.248910:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940283648:12345-0@lo:38:kworker.0 Request processed in 285us (19432us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318517.248918:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16322
00000100:00080000:0.0:1767318517.248937:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318517.248945:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318517.248948:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940283008:0@lo:38:kworker.0
00000100:00100000:3.0:1767318517.248964:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940283264:0@lo:400:kworker.0
00000100:00080000:0.0:1767318517.248965:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318517.248973:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318517.248977:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940283136:0@lo:38:kworker.0
00000100:00080000:0.0:1767318517.248994:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318517.248997:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318517.249000:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940283648:0@lo:38:kworker.0
00010000:00020000:1.0:1767318517.255846:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318517.255963:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940283904:12345-0@lo:38:kworker.0 Request processed in 7320us (26408us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318517.255978:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16323
00000100:00080000:0.0:1767318517.256874:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318517.256881:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318517.256885:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940283904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318517.868908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318518.189007:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318518.765439:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940284032:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318518.765516:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318518.765697:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284032
00000100:00100000:1.0:1767318518.765706:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284032
00000100:00100000:1.0:1767318518.765761:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108
00000100:00100000:1.0:1767318518.765808:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940284032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318518.765842:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318518.765898:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940284032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (381us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318518.765906:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108
00000100:00100000:3.0:1767318518.765996:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940284032:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318518.893215:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318519.213005:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318519.789087:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318519.789114:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940284160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318519.789203:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318519.789316:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284160
00000100:00100000:1.0:1767318519.789325:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284160
00000100:00100000:1.0:1767318519.789392:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109
00000100:00100000:1.0:1767318519.789401:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940284160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318519.789442:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318519.789483:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940284160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318519.789490:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109
00000100:00080000:2.0:1767318519.789731:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318519.789854:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940284160:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318519.916908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318520.237154:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318520.905848:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318520.906096:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266752
00000100:00100000:2.0:1767318520.906106:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266752
00000100:00100000:2.0:1767318520.906183:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3935
00000100:00100000:2.0:1767318520.906195:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894266752:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318520.906294:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894266752:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (538us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318520.906302:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3935
00000100:00080000:0.0:1767318520.907358:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318520.910561:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318520.910653:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894266624
00000100:00100000:3.0:1767318520.910664:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894266624
00000100:00100000:3.0:1767318520.910713:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16324
00000100:00100000:3.0:1767318520.910723:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894266624:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318520.910759:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318520.911121:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894266624:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 396us (568us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318520.911130:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16324
00000100:00100000:2.0:1767318520.941514:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318521.264009:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318521.965639:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318522.285380:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318522.348937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318522.348949:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318522.348952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318522.348957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318522.348961:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318522.348970:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3767
00000100:00080000:2.0:1767318522.348975:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318522.348982:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318522.349025:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940284288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318522.349050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318522.349054:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318522.349055:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318522.349059:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3767
00000100:00080000:2.0:1767318522.349061:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318522.349064:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318522.349080:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940284416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318522.349131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318522.349134:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318522.349136:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318522.349139:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3767
00000100:00080000:2.0:1767318522.349156:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318522.349160:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318522.349172:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72680 x1853163940284928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318522.349187:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318522.349190:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318522.349192:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318522.349195:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3767
00000100:00080000:2.0:1767318522.349197:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318522.349201:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318522.349224:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70a80 x1853163940285184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318522.349349:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940284544:0@lo:400:kworker.0
00000100:00100000:1.0:1767318522.349426:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349498:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318522.349504:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940284672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318522.349524:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349561:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284544
00000100:00100000:1.0:1767318522.349568:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284544
00000100:00100000:1.0:1767318522.349615:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284672
00000100:00100000:1.0:1767318522.349618:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284672
00000100:00100000:1.0:1767318522.349640:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589
00000100:00100000:1.0:1767318522.349647:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940284544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318522.349696:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940284544:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318522.349703:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589
00000100:00100000:1.0:1767318522.349718:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590
00000100:00100000:1.0:1767318522.349724:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940284672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318522.349750:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940284672:12345-0@lo:400:kworker.0 Request processed in 26us (225us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318522.349756:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590
00000100:00100000:1.0:1767318522.349827:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940284288:0@lo:38:kworker.0
00000100:00100000:1.0:1767318522.349856:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349872:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940284416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318522.349893:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349906:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940284928:0@lo:38:kworker.0
00000100:00100000:1.0:1767318522.349922:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349934:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940285184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318522.349949:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.349986:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940284672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318522.349995:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940284544:0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350182:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284288
00000100:00100000:3.0:1767318522.350187:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284288
00000100:00100000:3.0:1767318522.350225:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284928
00000100:00100000:3.0:1767318522.350228:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284928
00000100:00100000:3.0:1767318522.350240:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285184
00000100:00100000:3.0:1767318522.350242:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285184
00000100:00100000:3.0:1767318522.350256:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16325
00000100:00100000:3.0:1767318522.350261:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940284288:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318522.350279:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318522.350314:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940284288:12345-0@lo:38:kworker.0 Request processed in 52us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318522.350320:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16325
00000100:00100000:3.0:1767318522.350335:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16326
00000100:00100000:3.0:1767318522.350339:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940284928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318522.350347:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318522.350368:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940284928:12345-0@lo:38:kworker.0 Request processed in 28us (445us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318522.350374:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16326
00000100:00100000:3.0:1767318522.350386:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16327
00000100:00100000:3.0:1767318522.350390:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940285184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318522.350399:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318522.350420:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940285184:12345-0@lo:38:kworker.0 Request processed in 29us (470us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318522.350425:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16327
00000100:00100000:3.0:1767318522.350447:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940284800:0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350473:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318522.350492:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318522.350498:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940285056:0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350515:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318522.350535:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284800
00000100:00100000:3.0:1767318522.350538:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284800
00000100:00100000:3.0:1767318522.350558:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285056
00000100:00100000:3.0:1767318522.350560:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285056
00000100:00100000:3.0:1767318522.350575:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936
00000100:00100000:3.0:1767318522.350580:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940284800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350616:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940284800:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318522.350622:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936
00000100:00100000:3.0:1767318522.350634:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937
00000100:00100000:3.0:1767318522.350640:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940285056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350673:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940285056:12345-0@lo:400:kworker.0 Request processed in 34us (157us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318522.350678:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937
00000100:00100000:3.0:1767318522.350705:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940285056:0@lo:400:kworker.0
00000100:00100000:3.0:1767318522.350713:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940284800:0@lo:400:kworker.0
00000100:00080000:0.0:1767318522.350991:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318522.350997:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318522.350999:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318522.351012:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940284416
00000100:00100000:0.0:1767318522.351016:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940284416
00000100:00100000:0.0:1767318522.351044:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964
00000100:00100000:0.0:1767318522.351048:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940284416:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318522.351059:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318522.351090:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940284416:12345-0@lo:38:kworker.0 Request processed in 41us (1196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318522.351096:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964
00000100:00080000:1.0:1767318522.351461:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318522.351466:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318522.351470:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940284288:0@lo:38:kworker.0
00000100:00080000:1.0:1767318522.351479:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318522.351482:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318522.351486:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940284416:0@lo:38:kworker.0
00000100:00080000:1.0:1767318522.351495:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318522.351498:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318522.351501:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940284928:0@lo:38:kworker.0
00000100:00080000:1.0:1767318522.351508:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318522.351511:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318522.351514:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940285184:0@lo:38:kworker.0
00000100:00100000:2.0:1767318522.988903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318523.309063:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318523.885041:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940285312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318523.885116:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318523.885569:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285312
00000100:00100000:3.0:1767318523.885579:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285312
00000100:00100000:3.0:1767318523.885681:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110
00000100:00100000:3.0:1767318523.885691:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940285312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318523.885723:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318523.886374:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940285312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 682us (1256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318523.886382:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110
00000100:00100000:2.0:1767318523.886462:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940285312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318524.012901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318524.333113:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318524.909447:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318524.909472:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940285440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318524.909541:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318524.909669:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285440
00000100:00100000:3.0:1767318524.909678:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285440
00000100:00100000:3.0:1767318524.909794:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111
00000100:00100000:3.0:1767318524.909806:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940285440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318524.909838:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318524.909888:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940285440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318524.909895:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111
00000100:00080000:1.0:1767318524.909967:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318524.910017:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940285440:0@lo:13:osp-pre-0-1.0
00000400:00000100:3.0:1767318525.008858:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894266880 offset 0 length 520: 4
00000100:00100000:3.0:1767318525.008913:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318525.008957:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318525.009288:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267136
00000100:00100000:2.0:1767318525.009300:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267136
00000100:00100000:2.0:1767318525.009381:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267008
00000100:00100000:2.0:1767318525.009385:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267008
00000100:00100000:2.0:1767318525.009406:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3938
00000100:00100000:2.0:1767318525.009416:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894267136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318525.009504:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894267136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (590us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318525.009512:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3938
00000100:00100000:2.0:1767318525.009530:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16328
00000100:00100000:2.0:1767318525.009535:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894267008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318525.009555:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318525.009581:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894267008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (623us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318525.009587:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16328
00000100:00080000:3.0:1767318525.009983:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318525.037120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318525.357139:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318526.060900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318526.380988:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318527.085829:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318527.405021:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318527.468994:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318527.469005:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318527.469008:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318527.469012:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318527.469016:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318527.469024:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3772
00000100:00080000:2.0:1767318527.469029:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318527.469036:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318527.469075:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70700 x1853163940285568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318527.469101:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318527.469104:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318527.469106:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318527.469110:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3772
00000100:00080000:2.0:1767318527.469113:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318527.469116:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318527.469141:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b73480 x1853163940285696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318527.469193:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318527.469196:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318527.469197:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318527.469201:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3772
00000100:00080000:2.0:1767318527.469203:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318527.469206:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318527.469228:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940286208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318527.469242:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318527.469245:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318527.469246:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318527.469249:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3772
00000100:00080000:2.0:1767318527.469252:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318527.469255:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318527.469264:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940286464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318527.469332:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940286080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.469402:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469466:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318527.469472:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940286336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.469494:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469525:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286080
00000100:00100000:1.0:1767318527.469533:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286080
00000100:00100000:1.0:1767318527.469580:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939
00000100:00100000:1.0:1767318527.469590:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940286080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.469655:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940286080:12345-0@lo:400:kworker.0 Request processed in 67us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318527.469663:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939
00000100:00100000:1.0:1767318527.469679:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286336
00000100:00100000:1.0:1767318527.469683:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286336
00000100:00100000:1.0:1767318527.469707:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940
00000100:00100000:1.0:1767318527.469713:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940286336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.469751:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940286336:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318527.469757:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940
00000100:00100000:1.0:1767318527.469805:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940285568:0@lo:38:kworker.0
00000100:00100000:1.0:1767318527.469830:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469852:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940285696:0@lo:38:kworker.0
00000100:00100000:1.0:1767318527.469875:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469891:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940286208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318527.469912:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469925:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940286464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318527.469943:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.469971:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285568
00000100:00100000:1.0:1767318527.469976:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285568
00000100:00100000:1.0:1767318527.469992:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286208
00000100:00100000:1.0:1767318527.469994:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286208
00000100:00100000:1.0:1767318527.470003:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286464
00000100:00100000:1.0:1767318527.470005:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286464
00000100:00100000:1.0:1767318527.470014:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16329
00000100:00100000:1.0:1767318527.470018:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940285568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318527.470037:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318527.470072:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940285568:12345-0@lo:38:kworker.0 Request processed in 51us (240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318527.470078:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16329
00000100:00100000:1.0:1767318527.470090:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16330
00000100:00100000:1.0:1767318527.470093:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940286208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318527.470103:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318527.470128:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940286208:12345-0@lo:38:kworker.0 Request processed in 33us (215us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318527.470134:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16330
00000100:00100000:1.0:1767318527.470146:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16331
00000100:00100000:1.0:1767318527.470149:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940286464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318527.470158:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318527.470179:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940286464:12345-0@lo:38:kworker.0 Request processed in 28us (236us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318527.470187:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16331
00000100:00100000:1.0:1767318527.470205:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285696
00000100:00100000:1.0:1767318527.470208:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285696
00000100:00100000:1.0:1767318527.470226:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965
00000100:00100000:1.0:1767318527.470230:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940285696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318527.470239:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318527.470262:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940285696:12345-0@lo:38:kworker.0 Request processed in 30us (385us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318527.470267:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965
00000100:00080000:1.0:1767318527.470301:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318527.470306:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318527.470309:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940285568:0@lo:38:kworker.0
00000100:00080000:1.0:1767318527.470317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318527.470320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318527.470323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940285696:0@lo:38:kworker.0
00000100:00080000:1.0:1767318527.470330:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318527.470333:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318527.470335:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940286208:0@lo:38:kworker.0
00000100:00080000:1.0:1767318527.470342:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318527.470345:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318527.470347:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940286464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318527.470384:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940286336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.470393:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940286080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318527.470824:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940285952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318527.470861:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318527.470903:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318527.470964:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940285824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318527.470989:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318527.471411:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285952
00000100:00100000:1.0:1767318527.471418:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285952
00000100:00100000:1.0:1767318527.471469:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940285824
00000100:00100000:1.0:1767318527.471472:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940285824
00000100:00100000:1.0:1767318527.471499:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591
00000100:00100000:1.0:1767318527.471507:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940285952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.471553:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940285952:12345-0@lo:400:kworker.0 Request processed in 47us (691us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318527.471559:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591
00000100:00100000:1.0:1767318527.471572:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592
00000100:00100000:1.0:1767318527.471577:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940285824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318527.471604:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940285824:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318527.471610:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592
00000100:00080000:3.0:1767318527.472234:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318527.472239:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318527.472242:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318527.472388:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940285824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318527.472402:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940285952:0@lo:400:kworker.0
00000100:00100000:2.0:1767318528.108910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318528.429224:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318529.005485:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940286592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318529.005575:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318529.005653:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286592
00000100:00100000:2.0:1767318529.005665:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286592
00000100:00080000:3.0:1767318529.005703:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318529.005768:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112
00000100:00100000:2.0:1767318529.005797:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940286592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318529.005829:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318529.005884:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940286592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318529.005892:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112
00000100:00100000:0.0:1767318529.006013:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940286592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318529.133321:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318529.453497:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318530.029971:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318530.029996:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940286720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318530.030074:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318530.030591:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286720
00000100:00100000:2.0:1767318530.030600:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286720
00000100:00100000:2.0:1767318530.030669:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113
00000100:00100000:2.0:1767318530.030681:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940286720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318530.030732:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318530.030804:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318530.030823:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940286720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (747us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318530.030832:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113
00000100:00100000:2.0:1767318530.030908:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940286720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318530.118881:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318530.119086:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267264
00000100:00100000:3.0:1767318530.119098:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267264
00000100:00100000:3.0:1767318530.119145:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16332
00000100:00100000:3.0:1767318530.119153:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894267264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318530.119187:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318530.119326:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894267264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 170us (454us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318530.119334:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16332
00000100:00100000:1.0:1767318530.119486:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318530.119723:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267392
00000100:00100000:0.0:1767318530.119729:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267392
00000100:00100000:0.0:1767318530.119812:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3941
00000100:00100000:0.0:1767318530.119821:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894267392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318530.119872:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894267392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 52us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318530.119879:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3941
00000100:00080000:1.0:1767318530.120149:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318530.156989:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318530.477795:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318531.180992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318531.501036:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318531.565033:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318506/real 1767318506]  req@ffff93cf459fb100 x1853163940281344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318531 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318531.565074:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf459fb100 x1853163940281344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318531 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318531.565095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318531.565115:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318531.565119:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940281344:0@lo:250:kworker.0
00000100:00080000:3.0:1767318531.565216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318531.565222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318531.565226:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318531.565231:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3757
00000100:00080000:3.0:1767318531.565235:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318531.565241:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318531.565272:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940286848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318531.565305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318531.565308:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318531.565310:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318531.565312:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3777
00000100:00080000:3.0:1767318531.565315:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318531.565318:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318531.565333:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7b80 x1853163940286976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318531.565342:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318531.565345:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318531.565347:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318531.565350:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3777
00000100:00080000:3.0:1767318531.565352:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318531.565356:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318531.565368:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409c00 x1853163940287104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318531.565427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318531.565430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318531.565432:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318531.565436:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3777
00000100:00080000:3.0:1767318531.565438:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318531.565442:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318531.565454:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0711f8700 x1853163940287616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318531.565469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318531.565472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318531.565474:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318531.565477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3777
00000100:00080000:3.0:1767318531.565479:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318531.565482:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318531.565492:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940287872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318531.565515:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940287488:0@lo:400:kworker.0
00000100:00100000:3.0:1767318531.565575:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318531.565644:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318531.565650:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940287744:0@lo:400:kworker.0
00000100:00100000:3.0:1767318531.565672:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318531.565717:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287488
00000100:00100000:3.0:1767318531.565725:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287488
00000100:00100000:3.0:1767318531.565790:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287744
00000100:00100000:3.0:1767318531.565793:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287744
00000100:00100000:3.0:1767318531.565815:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942
00000100:00100000:3.0:1767318531.565823:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940287488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318531.565866:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940287488:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318531.565873:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942
00000100:00100000:3.0:1767318531.565890:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943
00000100:00100000:3.0:1767318531.565895:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940287744:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318531.565917:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940287744:12345-0@lo:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318531.565923:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943
00000100:00100000:3.0:1767318531.565953:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940287744:0@lo:400:kworker.0
00000100:00100000:3.0:1767318531.565961:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940287488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566041:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940287232:0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566071:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318531.566104:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318531.566109:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940287360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566128:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318531.566159:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287232
00000100:00100000:0.0:1767318531.566163:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287232
00000100:00100000:0.0:1767318531.566191:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287360
00000100:00100000:0.0:1767318531.566194:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287360
00000100:00100000:0.0:1767318531.566211:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593
00000100:00100000:0.0:1767318531.566216:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940287232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566247:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940287232:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318531.566253:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593
00000100:00100000:0.0:1767318531.566264:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594
00000100:00100000:0.0:1767318531.566269:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940287360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566290:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940287360:12345-0@lo:400:kworker.0 Request processed in 22us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318531.566296:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594
00000100:00100000:0.0:1767318531.566320:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940287360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318531.566328:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940287232:0@lo:400:kworker.0
00000100:00100000:2.0:1767318531.566417:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940286848:0@lo:250:kworker.0
00000400:00000100:2.0:1767318531.566441:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940286848 offset 0 length 520: 4
00000100:00100000:2.0:1767318531.566459:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940286976:0@lo:38:kworker.0
00000100:00100000:2.0:1767318531.566480:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318531.566507:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940287104:0@lo:38:kworker.0
00000100:00100000:2.0:1767318531.566529:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318531.566545:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0711f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940287616:0@lo:38:kworker.0
00000100:00100000:2.0:1767318531.566566:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318531.566583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940287872:0@lo:38:kworker.0
00000100:00100000:2.0:1767318531.566605:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318531.566630:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940286976
00000100:00100000:2.0:1767318531.566633:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940286976
00000100:00100000:2.0:1767318531.566650:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287616
00000100:00100000:2.0:1767318531.566653:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287616
00000100:00100000:2.0:1767318531.566663:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287872
00000100:00100000:2.0:1767318531.566666:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287872
00000100:00100000:2.0:1767318531.566675:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16333
00000100:00100000:2.0:1767318531.566679:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940286976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318531.566713:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318531.566744:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940286976:12345-0@lo:38:kworker.0 Request processed in 63us (263us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318531.566750:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16333
00000100:00100000:2.0:1767318531.566762:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16334
00000100:00100000:2.0:1767318531.566766:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940287616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318531.566794:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318531.566818:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940287616:12345-0@lo:38:kworker.0 Request processed in 51us (251us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318531.566824:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16334
00000100:00100000:2.0:1767318531.566835:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16335
00000100:00100000:2.0:1767318531.566839:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940287872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318531.566848:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318531.566870:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940287872:12345-0@lo:38:kworker.0 Request processed in 29us (264us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318531.566875:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16335
00000100:00080000:2.0:1767318531.566898:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318531.566903:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318531.566906:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940286976:0@lo:38:kworker.0
00000100:00080000:2.0:1767318531.566913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318531.566916:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318531.566919:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0711f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940287616:0@lo:38:kworker.0
00000100:00080000:2.0:1767318531.566926:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318531.566929:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318531.566932:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940287872:0@lo:38:kworker.0
00000100:00100000:0.0:1767318531.567014:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940287104
00000100:00100000:0.0:1767318531.567018:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940287104
00000100:00100000:0.0:1767318531.567051:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966
00000100:00100000:0.0:1767318531.567055:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940287104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318531.567066:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318531.567099:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940287104:12345-0@lo:38:kworker.0 Request processed in 42us (569us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318531.567105:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966
00000100:00080000:0.0:1767318531.567127:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318531.567131:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318531.567134:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940287104:0@lo:38:kworker.0
00000100:00080000:1.0:1767318531.567214:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318531.567220:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318532.204900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318532.535223:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318533.230436:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318533.553404:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318534.126042:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940288000:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318534.126139:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318534.126288:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288000
00000100:00100000:1.0:1767318534.126297:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288000
00000100:00100000:1.0:1767318534.126355:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1767318534.126364:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940288000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318534.126393:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318534.126433:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940288000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318534.126440:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114
00000100:00100000:0.0:1767318534.126642:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940288000:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318534.128646:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318534.253948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318534.573536:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318535.149253:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318535.149289:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940288128:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318535.149370:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318535.150125:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288128
00000100:00100000:2.0:1767318535.150133:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288128
00000100:00080000:3.0:1767318535.150190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318535.150241:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115
00000100:00100000:2.0:1767318535.150252:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940288128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318535.150293:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318535.150362:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940288128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (984us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318535.150369:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115
00000100:00100000:3.0:1767318535.150448:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940288128:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318535.241175:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318535.241313:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267520
00000100:00100000:0.0:1767318535.241327:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267520
00000100:00100000:0.0:1767318535.241392:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16336
00000100:00100000:0.0:1767318535.241400:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894267520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318535.241423:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318535.241495:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894267520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (331us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318535.241503:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16336
00000100:00100000:3.0:1767318535.241924:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318535.242046:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267648
00000100:00100000:1.0:1767318535.242053:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267648
00000100:00100000:1.0:1767318535.242106:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3944
00000100:00100000:1.0:1767318535.242115:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894267648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767318535.243023:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318535.251754:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0711fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894267648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 9627us (9818us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318535.251782:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3944
00000100:00100000:2.0:1767318535.276844:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318535.600181:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318536.304652:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318536.621514:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318536.684917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318536.684929:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318536.684932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318536.684936:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318536.684942:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318536.684950:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3781
00000100:00080000:3.0:1767318536.684955:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318536.684963:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318536.685025:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940288256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318536.685054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318536.685058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318536.685059:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318536.685063:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3781
00000100:00080000:3.0:1767318536.685065:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318536.685069:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318536.685083:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940288384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318536.685180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318536.685185:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318536.685187:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318536.685191:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3781
00000100:00080000:3.0:1767318536.685193:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318536.685199:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318536.685211:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940288896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318536.685228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318536.685231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318536.685232:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318536.685235:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3781
00000100:00080000:3.0:1767318536.685237:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318536.685240:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318536.685251:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940289152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318536.685257:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940288640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.685271:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940288768:0@lo:400:kworker.0
00000100:00100000:0.0:1767318536.685382:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940288256:0@lo:38:kworker.0
00000100:00100000:2.0:1767318536.685400:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318536.685456:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318536.685463:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940288512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318536.685486:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318536.685497:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318536.685517:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318536.685518:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288640
00000100:00100000:2.0:1767318536.685526:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288640
00000100:00100000:3.0:1767318536.685534:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940289024:0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.685566:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318536.685594:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288768
00000100:00100000:3.0:1767318536.685597:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288768
00000100:00100000:3.0:1767318536.685657:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289024
00000100:00100000:3.0:1767318536.685661:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289024
00000100:00100000:3.0:1767318536.685686:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945
00000100:00100000:2.0:1767318536.685691:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288512
00000100:00100000:2.0:1767318536.685694:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288512
00000100:00100000:3.0:1767318536.685696:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940288768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318536.685728:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595
00000100:00100000:3.0:1767318536.685747:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940288768:12345-0@lo:400:kworker.0 Request processed in 53us (249us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318536.685748:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940288640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.685754:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945
00000100:00100000:3.0:1767318536.685797:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946
00000100:00100000:3.0:1767318536.685803:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940289024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.686966:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940289024:12345-0@lo:400:kworker.0 Request processed in 1157us (1393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318536.686976:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946
00000100:00100000:3.0:1767318536.687252:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596
00000100:00100000:3.0:1767318536.687274:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940288512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.687333:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940288512:12345-0@lo:400:kworker.0 Request processed in 72us (1845us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318536.687339:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596
00000100:00100000:3.0:1767318536.687394:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940289024:0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.687819:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940288768:0@lo:400:kworker.0
00000100:00080000:3.0:1767318536.687875:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318536.687882:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318536.687909:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940288512:0@lo:400:kworker.0
00000100:00100000:3.0:1767318536.687923:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940288640:0@lo:400:kworker.0
00000100:00100000:2.0:1767318536.689717:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940288640:12345-0@lo:400:kworker.0 Request processed in 3972us (4307us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318536.689724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318536.689730:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595
00000100:00100000:0.0:1767318536.689770:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940288384:0@lo:38:kworker.0
00000100:00100000:0.0:1767318536.689828:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318536.689852:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940288896:0@lo:38:kworker.0
00000100:00100000:0.0:1767318536.689874:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318536.689890:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288384
00000100:00100000:2.0:1767318536.689897:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288384
00000100:00100000:0.0:1767318536.689898:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288256
00000100:00100000:0.0:1767318536.689900:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288256
00000100:00100000:0.0:1767318536.689922:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940288896
00000100:00100000:0.0:1767318536.689924:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940288896
00000100:00100000:2.0:1767318536.689925:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967
00000100:00100000:2.0:1767318536.689930:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940288384:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318536.689939:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16337
00000100:00100000:0.0:1767318536.689943:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940288256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318536.689949:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767318536.689950:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318536.689981:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940288256:12345-0@lo:38:kworker.0 Request processed in 37us (256us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318536.689981:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940288384:12345-0@lo:38:kworker.0 Request processed in 50us (153us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318536.689988:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16337
00000100:00100000:2.0:1767318536.689989:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967
00000100:00100000:2.0:1767318536.690215:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16338
00000100:00100000:2.0:1767318536.690220:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940288896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318536.690231:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318536.690242:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940289152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318536.690258:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940288896:12345-0@lo:38:kworker.0 Request processed in 36us (383us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318536.690264:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16338
00000100:00100000:0.0:1767318536.690266:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318536.690277:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289152
00000100:00100000:2.0:1767318536.690281:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289152
00000100:00080000:0.0:1767318536.690305:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318536.690311:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318536.690317:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940288256:0@lo:38:kworker.0
00000100:00080000:0.0:1767318536.690326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318536.690329:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318536.690331:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940288384:0@lo:38:kworker.0
00000100:00080000:0.0:1767318536.690338:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318536.690341:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318536.690343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940288896:0@lo:38:kworker.0
00000100:00100000:2.0:1767318536.690448:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16339
00000100:00100000:2.0:1767318536.690452:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940289152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318536.690462:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318536.690493:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940289152:12345-0@lo:38:kworker.0 Request processed in 39us (226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318536.690499:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16339
00000100:00080000:0.0:1767318536.690555:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318536.690560:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318536.690563:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940289152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318537.324985:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318537.647840:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318538.349040:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318538.671540:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318539.245145:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940289280:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318539.245214:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318539.245370:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289280
00000100:00100000:0.0:1767318539.245380:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289280
00000100:00100000:0.0:1767318539.245457:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116
00000100:00100000:0.0:1767318539.245467:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940289280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318539.245500:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318539.245553:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940289280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (337us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318539.245560:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116
00000100:00100000:0.0:1767318539.245625:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940289280:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318539.245943:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318539.373064:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318539.693380:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318540.269351:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318540.269376:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940289408:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318540.269448:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318540.269594:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289408
00000100:00100000:1.0:1767318540.269613:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289408
00000100:00100000:1.0:1767318540.269690:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117
00000100:00100000:1.0:1767318540.269700:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940289408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318540.269738:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318540.269814:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940289408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318540.269832:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117
00000100:00080000:0.0:1767318540.272435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318540.272516:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940289408:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318540.358436:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318540.358569:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318540.367793:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267776
00000100:00100000:2.0:1767318540.367818:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267776
00000100:00100000:2.0:1767318540.367894:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894267904
00000100:00100000:2.0:1767318540.367898:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894267904
00000100:00100000:2.0:1767318540.367956:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3947
00000100:00100000:2.0:1767318540.367967:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894267904:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318540.368052:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894267904:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (9482us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318540.368060:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3947
00000100:00100000:2.0:1767318540.368080:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16340
00000100:00100000:2.0:1767318540.368084:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894267776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318540.368104:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318540.368133:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894267776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (9708us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318540.368140:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16340
00000100:00080000:1.0:1767318540.368345:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318540.396924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318540.717547:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318541.421452:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318541.741268:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318541.804883:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318541.804894:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318541.804897:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318541.804901:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318541.804905:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318541.804913:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3786
00000100:00080000:3.0:1767318541.804918:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318541.804925:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318541.804967:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940289536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318541.804988:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318541.804991:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318541.804992:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318541.804995:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3786
00000100:00080000:3.0:1767318541.804996:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318541.804999:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318541.805010:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ca80 x1853163940289664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318541.805057:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318541.805061:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318541.805063:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318541.805066:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3786
00000100:00080000:3.0:1767318541.805068:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318541.805071:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318541.805085:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01500 x1853163940290176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318541.805101:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318541.805104:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318541.805106:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318541.805109:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3786
00000100:00080000:3.0:1767318541.805111:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318541.805115:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318541.805125:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5500 x1853163940290432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318541.805158:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940290304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.805219:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318541.805265:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318541.805271:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940290048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.805293:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318541.805329:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290304
00000100:00100000:3.0:1767318541.805336:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290304
00000100:00100000:3.0:1767318541.805381:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290048
00000100:00100000:3.0:1767318541.805383:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290048
00000100:00100000:3.0:1767318541.805413:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948
00000100:00100000:3.0:1767318541.805418:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940290304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.805457:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940290304:12345-0@lo:400:kworker.0 Request processed in 39us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318541.805462:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948
00000100:00100000:3.0:1767318541.805475:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949
00000100:00100000:3.0:1767318541.805479:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940290048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.805492:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940290048:12345-0@lo:400:kworker.0 Request processed in 14us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318541.805496:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949
00000100:00100000:3.0:1767318541.805541:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940290048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.805551:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940290304:0@lo:400:kworker.0
00000100:00100000:0.0:1767318541.805828:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940289792:0@lo:400:kworker.0
00000100:00100000:0.0:1767318541.805864:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318541.805891:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318541.805896:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940289920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318541.805936:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318541.806035:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289792
00000100:00100000:3.0:1767318541.806039:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289792
00000100:00100000:3.0:1767318541.806072:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289920
00000100:00100000:3.0:1767318541.806075:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289920
00000100:00100000:3.0:1767318541.806095:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597
00000100:00100000:3.0:1767318541.806102:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940289792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.806137:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940289792:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318541.806143:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597
00000100:00100000:3.0:1767318541.806156:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598
00000100:00100000:3.0:1767318541.806162:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940289920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318541.806187:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940289920:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318541.806193:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598
00000100:00100000:0.0:1767318541.806261:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940289920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318541.806270:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940289792:0@lo:400:kworker.0
00000100:00100000:2.0:1767318541.806377:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940289536:0@lo:38:kworker.0
00000100:00100000:2.0:1767318541.806418:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318541.806434:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940289664:0@lo:38:kworker.0
00000100:00100000:2.0:1767318541.806455:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318541.806480:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940290176:0@lo:38:kworker.0
00000100:00100000:3.0:1767318541.806631:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289664
00000100:00100000:3.0:1767318541.806635:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289664
00000100:00100000:3.0:1767318541.806659:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968
00000100:00100000:3.0:1767318541.806664:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940289664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318541.806683:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318541.806713:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940289664:12345-0@lo:38:kworker.0 Request processed in 47us (257us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318541.806719:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968
00000100:00100000:3.0:1767318541.806753:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940289536
00000100:00100000:3.0:1767318541.806758:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940289536
00000100:00100000:3.0:1767318541.806793:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341
00000100:00100000:3.0:1767318541.806797:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940289536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318541.806807:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318541.806833:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940289536:12345-0@lo:38:kworker.0 Request processed in 34us (414us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318541.806839:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341
00000100:00100000:2.0:1767318541.806979:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318541.807005:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940290432:0@lo:38:kworker.0
00000100:00100000:2.0:1767318541.807028:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318541.807056:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318541.807061:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318541.807064:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940289536:0@lo:38:kworker.0
00000100:00080000:2.0:1767318541.807071:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318541.807074:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318541.807077:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940289664:0@lo:38:kworker.0
00000100:00100000:3.0:1767318541.807114:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290176
00000100:00100000:3.0:1767318541.807119:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290176
00000100:00100000:3.0:1767318541.807138:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290432
00000100:00100000:3.0:1767318541.807140:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290432
00000100:00100000:3.0:1767318541.807155:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16342
00000100:00100000:3.0:1767318541.807159:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b833450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940290176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318541.807170:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318541.807198:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b833450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940290176:12345-0@lo:38:kworker.0 Request processed in 37us (219us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318541.807204:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16342
00000100:00100000:3.0:1767318541.808384:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16343
00000100:00080000:2.0:1767318541.808528:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318541.808533:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318541.808537:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940290176:0@lo:38:kworker.0
00000100:00080000:1.0:1767318541.808705:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318541.808712:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318541.810674:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940290432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318541.810699:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318541.810798:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940290432:12345-0@lo:38:kworker.0 Request processed in 129us (3768us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318541.811004:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318541.811009:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318541.811013:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940290432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318541.824852:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16343
00000100:00100000:2.0:1767318542.445357:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318542.765110:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318543.468929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318543.791502:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318544.367727:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318544.367752:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940290560:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318544.367845:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318544.367923:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290560
00000100:00100000:1.0:1767318544.367931:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290560
00000100:00100000:1.0:1767318544.367987:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118
00000100:00100000:1.0:1767318544.367995:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940290560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318544.368024:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318544.368072:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940290560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (226us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318544.368079:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118
00000100:00080000:1.0:1767318544.368168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318544.368212:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940290560:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318544.493998:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318544.818322:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318545.389370:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940290688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318545.389452:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318545.390187:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290688
00000100:00100000:2.0:1767318545.390196:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290688
00000100:00100000:2.0:1767318545.390275:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119
00000100:00100000:2.0:1767318545.390285:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940290688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318545.390315:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318545.390375:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940290688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (923us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318545.390383:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119
00000100:00100000:3.0:1767318545.390477:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940290688:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318545.390657:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318545.483090:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318545.483141:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318545.483421:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268032
00000100:00100000:1.0:1767318545.483431:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268032
00000100:00100000:1.0:1767318545.483477:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268160
00000100:00100000:1.0:1767318545.483480:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268160
00000100:00100000:1.0:1767318545.483532:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3950
00000100:00100000:1.0:1767318545.483541:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894268160:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318545.483624:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894268160:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (483us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318545.483631:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3950
00000100:00100000:1.0:1767318545.483664:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16344
00000100:00100000:1.0:1767318545.483670:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894268032:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318545.483690:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318545.483717:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894268032:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (636us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318545.483723:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16344
00000100:00080000:3.0:1767318545.486874:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318545.517993:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318545.837234:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318546.541630:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318546.862523:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318546.925607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318546.925617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318546.925620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318546.925624:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318546.925628:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318546.925646:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3791
00000100:00080000:3.0:1767318546.925651:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318546.925657:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318546.925694:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6300 x1853163940290816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318546.925730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318546.925734:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318546.925736:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318546.925739:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3791
00000100:00080000:3.0:1767318546.925741:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318546.925745:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318546.925758:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5f80 x1853163940290944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318546.925811:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940290816:0@lo:38:kworker.0
00000100:00080000:3.0:1767318546.925822:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318546.925825:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318546.925827:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318546.925830:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3791
00000100:00080000:3.0:1767318546.925833:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318546.925836:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318546.925845:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5180 x1853163940291456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318546.925857:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318546.925860:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318546.925861:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318546.925864:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3791
00000100:00080000:3.0:1767318546.925866:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318546.925869:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318546.925874:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318546.925877:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940291712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318546.925903:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291072:0@lo:400:kworker.0
00000100:00100000:3.0:1767318546.925934:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318546.925940:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940290944:0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.925961:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318546.925962:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318546.925966:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318546.925980:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940291456:0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.925985:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318546.926000:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318546.926014:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940291712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.926016:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291072
00000100:00100000:3.0:1767318546.926023:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291072
00000100:00100000:1.0:1767318546.926030:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318546.926054:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290816
00000100:00100000:1.0:1767318546.926057:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290816
00000100:00100000:3.0:1767318546.926066:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291200
00000100:00100000:3.0:1767318546.926069:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291200
00000100:00100000:1.0:1767318546.926074:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291456
00000100:00100000:1.0:1767318546.926076:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291456
00000100:00100000:1.0:1767318546.926085:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291712
00000100:00100000:1.0:1767318546.926087:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291712
00000100:00100000:3.0:1767318546.926091:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599
00000100:00100000:3.0:1767318546.926098:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318546.926099:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16345
00000100:00100000:1.0:1767318546.926103:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940290816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318546.926138:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318546.926142:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291072:12345-0@lo:400:kworker.0 Request processed in 44us (207us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318546.926148:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599
00000100:00100000:3.0:1767318546.926167:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600
00000100:00100000:1.0:1767318546.926168:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940290816:12345-0@lo:38:kworker.0 Request processed in 63us (295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318546.926172:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318546.926174:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16345
00000100:00100000:1.0:1767318546.926186:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16346
00000100:00100000:1.0:1767318546.926190:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940291456:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.926196:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291200:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0
00010000:00020000:1.0:1767318546.926200:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318546.926201:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600
00000100:00100000:1.0:1767318546.926218:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940291456:12345-0@lo:38:kworker.0 Request processed in 26us (218us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318546.926218:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940290944
00000100:00100000:3.0:1767318546.926221:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940290944
00000100:00100000:1.0:1767318546.926238:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16346
00000100:00100000:3.0:1767318546.926239:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969
00000100:00100000:3.0:1767318546.926243:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940290944:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318546.926249:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16347
00000100:00100000:1.0:1767318546.926253:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940291712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318546.926253:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767318546.926260:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318546.926276:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940291712:12345-0@lo:38:kworker.0 Request processed in 22us (244us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318546.926282:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16347
00000100:00100000:3.0:1767318546.926288:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940290944:12345-0@lo:38:kworker.0 Request processed in 44us (326us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318546.926294:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969
00000100:00080000:1.0:1767318546.926316:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318546.926320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318546.926323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940291456:0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.926323:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940291328:0@lo:400:kworker.0
00000100:00080000:1.0:1767318546.926332:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318546.926334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318546.926337:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940291712:0@lo:38:kworker.0
00000100:00080000:1.0:1767318546.926344:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318546.926346:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318546.926347:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318546.926349:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940290816:0@lo:38:kworker.0
00000100:00080000:1.0:1767318546.926357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318546.926360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318546.926362:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940290944:0@lo:38:kworker.0
00000100:00100000:3.0:1767318546.926364:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318546.926368:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940291584:0@lo:400:kworker.0
00000100:00100000:3.0:1767318546.926385:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318546.927726:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318546.929204:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291328
00000100:00100000:2.0:1767318546.929213:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291328
00000100:00100000:2.0:1767318546.929265:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291584
00000100:00100000:2.0:1767318546.929268:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291584
00000100:00100000:2.0:1767318546.929303:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951
00000100:00100000:2.0:1767318546.929311:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940291328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318546.929372:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940291328:12345-0@lo:400:kworker.0 Request processed in 61us (3024us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318546.929379:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951
00000100:00100000:2.0:1767318546.929395:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952
00000100:00100000:2.0:1767318546.929402:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940291584:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318546.929429:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940291584:12345-0@lo:400:kworker.0 Request processed in 28us (3043us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318546.929435:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952
00000100:00080000:2.0:1767318546.929454:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318546.929482:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940291584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318546.929493:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940291328:0@lo:400:kworker.0
00000100:00100000:2.0:1767318546.929535:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318546.929559:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318547.565548:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318547.903587:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318548.589044:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318548.909659:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318549.485553:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291840:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318549.485626:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.485833:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291840
00000100:00100000:0.0:1767318549.485841:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291840
00000100:00100000:0.0:1767318549.485909:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120
00000100:00100000:0.0:1767318549.485919:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318549.485951:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318549.486008:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940291840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (381us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318549.486016:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120
00000100:00100000:3.0:1767318549.486067:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940291840:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318549.487744:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318549.614645:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318549.933385:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318550.509131:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940291968:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318550.509250:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318550.509434:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940291968
00000100:00100000:1.0:1767318550.509460:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940291968
00000100:00100000:1.0:1767318550.509589:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121
00000100:00100000:1.0:1767318550.509599:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940291968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318550.509645:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318550.509722:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318550.510061:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940291968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 462us (808us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318550.510070:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121
00000100:00100000:3.0:1767318550.510090:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940291968:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318550.607815:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318550.609577:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318550.610198:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268416
00000100:00100000:0.0:1767318550.610210:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268416
00000100:00100000:0.0:1767318550.610344:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268288
00000100:00100000:0.0:1767318550.610349:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268288
00000100:00100000:0.0:1767318550.610387:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3953
00000100:00100000:0.0:1767318550.610398:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894268416:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318550.610479:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894268416:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (2706us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318550.610487:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3953
00000100:00100000:0.0:1767318550.610505:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16348
00000100:00100000:0.0:1767318550.610522:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894268288:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318550.610544:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318550.610571:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894268288:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 59us (1002us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318550.610577:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16348
00000100:00080000:2.0:1767318550.610809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767318550.616144:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894268544 offset 0 length 520: 4
00000100:00100000:2.0:1767318550.637036:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318550.957184:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318551.660939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318551.981259:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318552.048490:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318552.048513:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318552.048517:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318552.048524:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318552.048529:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318552.048538:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3796
00000100:00080000:0.0:1767318552.048542:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318552.048549:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318552.048601:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046998380 x1853163940292096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318552.048752:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940292096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318552.048864:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318552.049033:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292096
00000100:00100000:2.0:1767318552.049042:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292096
00000100:00100000:2.0:1767318552.049082:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16349
00000100:00100000:2.0:1767318552.049090:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940292096:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318552.049113:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318552.049182:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318552.049186:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318552.049188:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318552.049192:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3796
00000100:00080000:0.0:1767318552.049195:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318552.049199:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318552.049219:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699a680 x1853163940292224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318552.049269:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940292096:12345-0@lo:38:kworker.0 Request processed in 177us (404us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318552.049276:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16349
00000100:00080000:1.0:1767318552.049554:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318552.049560:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318552.049564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940292096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318552.049587:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940292224:0@lo:38:kworker.0
00000100:00100000:1.0:1767318552.049613:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318552.049715:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292224
00000100:00100000:3.0:1767318552.049720:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292224
00000100:00100000:3.0:1767318552.049755:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970
00000100:00100000:3.0:1767318552.049761:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940292224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318552.049790:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318552.049824:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940292224:12345-0@lo:38:kworker.0 Request processed in 62us (210us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318552.049831:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970
00000100:00080000:1.0:1767318552.049953:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318552.049958:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318552.049961:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940292224:0@lo:38:kworker.0
00000100:00100000:2.0:1767318552.050117:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940292352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318552.050151:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318552.050229:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292352
00000100:00100000:3.0:1767318552.050233:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292352
00000100:00100000:3.0:1767318552.050338:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601
00000100:00100000:3.0:1767318552.050347:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940292352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.050574:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940292480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.050603:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318552.050663:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318552.050677:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292480
00000100:00100000:1.0:1767318552.050681:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292480
00000100:00100000:1.0:1767318552.050714:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602
00000100:00100000:1.0:1767318552.050722:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940292480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.050757:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940292480:12345-0@lo:400:kworker.0 Request processed in 35us (153us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318552.050764:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602
00000100:00080000:1.0:1767318552.050800:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318552.050822:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940292480:0@lo:400:kworker.0
00000100:00100000:3.0:1767318552.051074:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940292352:12345-0@lo:400:kworker.0 Request processed in 729us (921us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318552.051082:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601
00000100:00080000:0.0:1767318552.051191:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318552.051196:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318552.051199:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318552.051203:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3796
00000100:00080000:0.0:1767318552.051207:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318552.051212:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318552.051229:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046999500 x1853163940292736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318552.051254:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318552.051258:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318552.051260:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318552.051263:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3796
00000100:00080000:0.0:1767318552.051266:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318552.051269:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318552.051279:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046998000 x1853163940292992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318552.051526:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940292864:0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.051579:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318552.051600:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318552.051606:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940292608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.051627:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318552.051675:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940292736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318552.051699:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318552.051717:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940292992:0@lo:38:kworker.0
00000100:00100000:1.0:1767318552.051737:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318552.051763:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292864
00000100:00100000:1.0:1767318552.051768:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292864
00000100:00100000:1.0:1767318552.051820:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292608
00000100:00100000:1.0:1767318552.051824:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292608
00000100:00100000:1.0:1767318552.051842:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292736
00000100:00100000:1.0:1767318552.051844:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292736
00000100:00100000:1.0:1767318552.051852:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940292992
00000100:00100000:1.0:1767318552.051854:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940292992
00000100:00100000:1.0:1767318552.051862:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954
00000100:00100000:1.0:1767318552.051868:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940292864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.051916:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940292864:12345-0@lo:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318552.051926:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954
00000100:00100000:1.0:1767318552.051939:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955
00000100:00100000:1.0:1767318552.051945:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940292608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.051973:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940292608:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318552.051978:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955
00000100:00100000:1.0:1767318552.051991:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350
00000100:00100000:1.0:1767318552.051995:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940292736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318552.052021:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318552.052054:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940292736:12345-0@lo:38:kworker.0 Request processed in 57us (355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318552.052059:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350
00000100:00100000:1.0:1767318552.052071:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16351
00000100:00100000:1.0:1767318552.052073:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940292992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318552.052083:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318552.052103:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940292992:12345-0@lo:38:kworker.0 Request processed in 28us (366us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318552.052108:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16351
00000100:00080000:1.0:1767318552.052130:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318552.052151:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940292608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318552.052160:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940292864:0@lo:400:kworker.0
00000100:00080000:1.0:1767318552.052195:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318552.052206:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318552.052210:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940292736:0@lo:38:kworker.0
00000100:00080000:1.0:1767318552.052218:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318552.052221:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318552.052224:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940292992:0@lo:38:kworker.0
00000100:00100000:2.0:1767318552.052992:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940292352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318552.684941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318553.005331:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318553.709101:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318554.029217:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318554.605201:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940293120:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318554.605261:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318554.605557:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293120
00000100:00100000:3.0:1767318554.605564:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293120
00000100:00100000:3.0:1767318554.605618:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122
00000100:00100000:3.0:1767318554.605624:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940293120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318554.605649:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767318554.605764:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318554.606462:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940293120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 836us (1198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318554.606469:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122
00000100:00100000:2.0:1767318554.606610:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940293120:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318554.733081:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318555.052987:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318555.631160:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318555.634573:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940293248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318555.634661:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318555.637652:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293248
00000100:00100000:1.0:1767318555.637667:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293248
00000100:00100000:1.0:1767318555.637880:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123
00000100:00100000:1.0:1767318555.637892:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940293248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318555.637940:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767318555.638295:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318555.638845:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940293248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 955us (4181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318555.638853:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123
00000100:00100000:3.0:1767318555.644857:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940293248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318555.720195:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318555.722487:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268800
00000100:00100000:2.0:1767318555.722501:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268800
00000100:00100000:3.0:1767318555.722551:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318555.722685:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268672
00000100:00100000:2.0:1767318555.722690:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268672
00000100:00100000:2.0:1767318555.722710:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3956
00000100:00100000:2.0:1767318555.722720:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894268800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318555.722817:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894268800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (2637us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318555.722826:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3956
00000100:00100000:2.0:1767318555.722845:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16352
00000100:00100000:2.0:1767318555.722849:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894268672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318555.722870:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318555.722908:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894268672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (361us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318555.722915:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16352
00000100:00080000:0.0:1767318555.723018:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318555.756888:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318556.081095:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318556.141195:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318531/real 1767318531]  req@ffff93cf51ea4a80 x1853163940286848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318556 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318556.141241:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51ea4a80 x1853163940286848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318556.141261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318556.141287:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318556.141291:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940286848:0@lo:250:kworker.0
00000100:00080000:3.0:1767318556.141372:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318556.141377:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318556.141381:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318556.141385:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3781
00000100:00080000:3.0:1767318556.141389:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318556.141395:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318556.141428:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940293376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318556.141453:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318556.141457:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318556.141486:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318556.141490:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3802
00000100:00080000:3.0:1767318556.141493:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318556.141496:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318556.141511:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5180 x1853163940293504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318556.141521:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318556.141524:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318556.141526:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318556.141529:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3802
00000100:00080000:3.0:1767318556.141531:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318556.141534:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318556.141545:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5500 x1853163940293632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318556.141619:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318556.141622:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318556.141623:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318556.141627:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3802
00000100:00080000:3.0:1767318556.141629:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318556.141633:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318556.141644:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0e00 x1853163940294144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318556.141657:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318556.141660:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318556.141661:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318556.141664:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3802
00000100:00080000:3.0:1767318556.141666:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318556.141669:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318556.141694:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940294400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318556.141726:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940294272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318556.141822:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318556.142158:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940293888:0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142194:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318556.142224:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318556.142230:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940293760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142250:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318556.142319:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293888
00000100:00100000:1.0:1767318556.142328:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293888
00000100:00100000:1.0:1767318556.142382:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293760
00000100:00100000:1.0:1767318556.142386:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293760
00000100:00100000:1.0:1767318556.142420:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603
00000100:00100000:1.0:1767318556.142429:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940293888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142490:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940293888:12345-0@lo:400:kworker.0 Request processed in 62us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318556.142498:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603
00000100:00100000:1.0:1767318556.142517:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604
00000100:00100000:1.0:1767318556.142523:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940293760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142549:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940293760:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318556.142555:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604
00000100:00080000:1.0:1767318556.142575:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318556.142607:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940293760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142617:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940293888:0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142661:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294272
00000100:00100000:1.0:1767318556.142665:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294272
00000100:00100000:1.0:1767318556.142714:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957
00000100:00100000:1.0:1767318556.142720:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940294272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318556.142753:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940294272:12345-0@lo:400:kworker.0 Request processed in 33us (931us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318556.142758:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957
00000100:00080000:1.0:1767318556.142795:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318556.143241:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318556.143263:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940294016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318556.143295:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318556.143330:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940294272:0@lo:400:kworker.0
00000100:00100000:2.0:1767318556.143443:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940293376:0@lo:250:kworker.0
00000400:00000100:2.0:1767318556.143479:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940293376 offset 0 length 520: 4
00000100:00100000:2.0:1767318556.143500:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940293504:0@lo:38:kworker.0
00000100:00100000:2.0:1767318556.143522:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318556.143541:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940293632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318556.143563:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318556.143580:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940294144:0@lo:38:kworker.0
00000100:00100000:2.0:1767318556.143600:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318556.143617:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940294400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318556.143638:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318556.143930:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294016
00000100:00100000:2.0:1767318556.143935:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294016
00000100:00100000:2.0:1767318556.143972:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293504
00000100:00100000:2.0:1767318556.143976:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293504
00000100:00100000:2.0:1767318556.144022:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294144
00000100:00100000:2.0:1767318556.144026:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294144
00000100:00100000:2.0:1767318556.144035:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294400
00000100:00100000:2.0:1767318556.144038:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294400
00000100:00100000:2.0:1767318556.144047:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958
00000100:00100000:2.0:1767318556.144054:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940294016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318556.144089:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940294016:12345-0@lo:400:kworker.0 Request processed in 35us (793us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318556.144099:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958
00000100:00100000:2.0:1767318556.144113:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353
00000100:00100000:2.0:1767318556.144117:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940293504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318556.144136:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318556.144167:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940293504:12345-0@lo:38:kworker.0 Request processed in 48us (644us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318556.144173:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353
00000100:00100000:2.0:1767318556.144184:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354
00000100:00100000:2.0:1767318556.144188:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940294144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318556.144197:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318556.144218:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940294144:12345-0@lo:38:kworker.0 Request processed in 28us (617us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318556.144224:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354
00000100:00100000:2.0:1767318556.144234:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16355
00000100:00100000:2.0:1767318556.144238:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940294400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318556.144246:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318556.144266:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940294400:12345-0@lo:38:kworker.0 Request processed in 27us (627us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318556.144271:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16355
00000100:00080000:2.0:1767318556.144293:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318556.144303:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940293632
00000100:00100000:2.0:1767318556.144307:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940293632
00000100:00100000:2.0:1767318556.144330:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971
00000100:00100000:2.0:1767318556.144333:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940293632:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318556.144341:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318556.145601:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318556.145609:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318556.145613:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940293504:0@lo:38:kworker.0
00000100:00080000:0.0:1767318556.145624:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318556.145627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318556.145629:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940294144:0@lo:38:kworker.0
00000100:00080000:0.0:1767318556.145637:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318556.145639:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318556.145642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940294400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318556.146076:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940294016:0@lo:400:kworker.0
00000100:00100000:2.0:1767318556.153645:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940293632:12345-0@lo:38:kworker.0 Request processed in 9301us (10073us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318556.153659:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971
00000100:00080000:0.0:1767318556.154292:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318556.154299:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318556.154303:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940293632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318556.781131:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318557.104938:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318557.804915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318558.124916:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318558.828887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318559.152457:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318559.725134:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318559.725160:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940294528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318559.725227:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318559.725492:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294528
00000100:00100000:1.0:1767318559.725501:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294528
00000100:00080000:2.0:1767318559.725599:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318559.725615:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124
00000100:00100000:1.0:1767318559.725625:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940294528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318559.725654:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318559.725712:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940294528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (484us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318559.725720:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124
00000100:00100000:2.0:1767318559.725888:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940294528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318559.853559:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318560.174388:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318560.751696:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940294656:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318560.751765:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318560.752918:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294656
00000100:00100000:0.0:1767318560.752928:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294656
00000100:00080000:2.0:1767318560.752978:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318560.753012:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125
00000100:00100000:0.0:1767318560.753024:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940294656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318560.753057:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318560.753121:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940294656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318560.753129:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125
00000100:00100000:1.0:1767318560.753158:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940294656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318560.839995:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318560.840100:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318560.840175:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269056
00000100:00100000:1.0:1767318560.840187:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269056
00000100:00100000:1.0:1767318560.840299:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894268928
00000100:00100000:1.0:1767318560.840303:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894268928
00000100:00100000:1.0:1767318560.840331:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3959
00000100:00100000:1.0:1767318560.840342:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894269056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318560.840453:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894269056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 112us (469us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318560.840461:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3959
00000100:00100000:1.0:1767318560.840484:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16356
00000100:00100000:1.0:1767318560.840489:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894268928:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318560.840514:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318560.840549:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894268928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (452us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318560.840555:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16356
00000100:00080000:2.0:1767318560.840796:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318560.876871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318561.201452:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318561.261155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318561.261167:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318561.261170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318561.261173:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318561.261178:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318561.261185:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3806
00000100:00080000:2.0:1767318561.261190:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318561.261197:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318561.261241:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2300 x1853163940294784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318561.261274:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318561.261278:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318561.261279:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318561.261296:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3806
00000100:00080000:2.0:1767318561.261299:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318561.261302:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318561.261318:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3800 x1853163940294912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318561.261375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318561.261378:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318561.261380:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318561.261383:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3806
00000100:00080000:2.0:1767318561.261386:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318561.261390:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318561.261402:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5180 x1853163940295424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318561.261448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318561.261451:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318561.261453:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318561.261456:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3806
00000100:00080000:2.0:1767318561.261459:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318561.261463:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318561.261669:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940294784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318561.261743:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318561.261823:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940294912:0@lo:38:kworker.0
00000100:00100000:0.0:1767318561.261849:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318561.261871:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940295424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318561.261891:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318561.261927:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294784
00000100:00100000:0.0:1767318561.261934:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294784
00000100:00100000:0.0:1767318561.261966:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295424
00000100:00100000:0.0:1767318561.261969:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295424
00000100:00100000:0.0:1767318561.261987:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16357
00000100:00100000:0.0:1767318561.261994:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940294784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318561.262015:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318561.262058:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940294784:12345-0@lo:38:kworker.0 Request processed in 63us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318561.262066:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16357
00000100:00100000:0.0:1767318561.262082:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16358
00000100:00100000:0.0:1767318561.262086:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940295424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318561.262095:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318561.262118:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940295424:12345-0@lo:38:kworker.0 Request processed in 30us (225us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318561.262127:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16358
00000100:00080000:0.0:1767318561.262160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318561.262165:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318561.262169:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940294784:0@lo:38:kworker.0
00000100:00080000:0.0:1767318561.262177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318561.262180:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318561.262183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940295424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318561.262229:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940294912
00000100:00100000:0.0:1767318561.262233:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940294912
00000100:00100000:0.0:1767318561.262252:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972
00000100:00100000:0.0:1767318561.262257:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940294912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318561.262266:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318561.262296:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940294912:12345-0@lo:38:kworker.0 Request processed in 37us (446us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318561.262303:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972
00000100:00080000:0.0:1767318561.262324:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318561.262327:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318561.262330:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940294912:0@lo:38:kworker.0
00000100:00100000:2.0:1767318561.263832:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7480 x1853163940295680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318561.264736:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.264864:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318561.264969:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318561.264978:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265000:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318561.265039:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940295296:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265067:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318561.265091:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318561.265097:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940295552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265117:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318561.265148:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295296
00000100:00100000:3.0:1767318561.265155:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295296
00000100:00100000:3.0:1767318561.265208:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295552
00000100:00100000:3.0:1767318561.265212:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295552
00000100:00100000:3.0:1767318561.265233:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960
00000100:00100000:3.0:1767318561.265242:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940295296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265298:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940295296:12345-0@lo:400:kworker.0 Request processed in 57us (230us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318561.265305:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960
00000100:00100000:3.0:1767318561.265325:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961
00000100:00100000:3.0:1767318561.265331:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940295552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265356:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940295552:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318561.265361:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961
00000100:00080000:3.0:1767318561.265379:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318561.265426:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940295552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.265437:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940295296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318561.265611:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295168
00000100:00100000:2.0:1767318561.265616:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295168
00000100:00100000:2.0:1767318561.265649:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295040
00000100:00100000:2.0:1767318561.265652:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295040
00000100:00100000:2.0:1767318561.265673:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605
00000100:00100000:2.0:1767318561.265679:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318561.265716:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295168:12345-0@lo:400:kworker.0 Request processed in 37us (853us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318561.265722:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605
00000100:00100000:2.0:1767318561.265734:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606
00000100:00100000:2.0:1767318561.265740:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318561.265767:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295040:12345-0@lo:400:kworker.0 Request processed in 28us (766us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318561.265794:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606
00000100:00100000:0.0:1767318561.266401:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940295680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318561.266449:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318561.266802:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318561.266845:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318561.266857:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295168:0@lo:400:kworker.0
00000100:00100000:1.0:1767318561.274094:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295680
00000100:00100000:1.0:1767318561.274114:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295680
00000100:00100000:1.0:1767318561.274255:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16359
00000100:00100000:1.0:1767318561.274267:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940295680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318561.274298:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318561.274398:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940295680:12345-0@lo:38:kworker.0 Request processed in 131us (7946us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318561.274404:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16359
00000100:00080000:0.0:1767318561.274510:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318561.274516:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318561.274520:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940295680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318561.901667:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318562.221146:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318562.924916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318563.246658:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318563.949547:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318564.269707:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318564.846605:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318564.846628:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295808:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318564.846767:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318564.848009:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295808
00000100:00100000:2.0:1767318564.848019:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295808
00000100:00080000:3.0:1767318564.848168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318564.848507:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126
00000100:00100000:2.0:1767318564.848521:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318564.848557:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318564.848639:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (1871us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318564.848646:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126
00000100:00100000:0.0:1767318564.848741:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318564.973756:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318565.295745:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318565.872577:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318565.872648:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318565.872798:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940295936
00000100:00100000:3.0:1767318565.872806:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940295936
00000100:00100000:3.0:1767318565.872853:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127
00000100:00100000:3.0:1767318565.872863:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318565.872893:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318565.872931:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940295936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (282us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318565.872938:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127
00000100:00080000:0.0:1767318565.872995:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318565.873031:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940295936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318565.961095:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318565.961631:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269184
00000100:00100000:1.0:1767318565.961641:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269184
00000100:00100000:1.0:1767318565.961698:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16360
00000100:00100000:1.0:1767318565.961708:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894269184:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318565.961733:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318565.961834:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894269184:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 125us (747us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318565.961842:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16360
00000100:00100000:3.0:1767318565.967062:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318565.973484:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269312
00000100:00100000:1.0:1767318565.973502:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269312
00000100:00080000:0.0:1767318565.973595:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318565.973604:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3962
00000100:00100000:1.0:1767318565.973618:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894269312:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318565.973715:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894269312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (6673us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318565.973722:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3962
00000100:00100000:2.0:1767318565.998443:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318566.318928:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318566.381445:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318566.381459:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318566.381462:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318566.381466:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318566.381471:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318566.381480:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3811
00000100:00080000:0.0:1767318566.381485:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318566.381492:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318566.381531:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046998a80 x1853163940296064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318566.381594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940296064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318566.381721:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318566.381929:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318566.381933:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318566.381935:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318566.381940:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3811
00000100:00080000:0.0:1767318566.381943:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318566.381947:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318566.381964:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699ad80 x1853163940296192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318566.382237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940296192:0@lo:38:kworker.0
00000100:00100000:1.0:1767318566.382270:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318566.382375:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296192
00000100:00100000:2.0:1767318566.382384:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296192
00000100:00100000:2.0:1767318566.382433:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973
00000100:00100000:2.0:1767318566.382441:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940296192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318566.382465:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318566.382510:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940296192:12345-0@lo:38:kworker.0 Request processed in 69us (238us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318566.382518:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973
00000100:00100000:3.0:1767318566.382667:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296064
00000100:00080000:1.0:1767318566.382668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318566.382673:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296064
00000100:00080000:1.0:1767318566.382676:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318566.382682:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940296192:0@lo:38:kworker.0
00000100:00100000:3.0:1767318566.382708:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16361
00000100:00100000:3.0:1767318566.382715:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940296064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318566.382727:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318566.382789:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940296064:12345-0@lo:38:kworker.0 Request processed in 55us (1050us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318566.382796:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16361
00000100:00080000:1.0:1767318566.382813:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318566.382819:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318566.382822:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940296064:0@lo:38:kworker.0
00000100:00080000:0.0:1767318566.383060:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318566.383064:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318566.383066:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318566.383070:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3811
00000100:00080000:0.0:1767318566.383073:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318566.383077:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318566.383092:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046998000 x1853163940296704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318566.383106:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318566.383108:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318566.383109:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318566.383111:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3811
00000100:00080000:0.0:1767318566.383113:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318566.383115:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318566.383121:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699b800 x1853163940296960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318566.383137:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940296448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318566.383163:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318566.383201:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318566.383205:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940296320:0@lo:400:kworker.0
00000100:00100000:0.0:1767318566.383221:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318566.383238:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940296576:0@lo:400:kworker.0
00000100:00100000:0.0:1767318566.383252:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318566.383260:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318566.383263:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940296832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318566.383279:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318566.383306:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296448
00000100:00100000:0.0:1767318566.383310:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296448
00000100:00100000:0.0:1767318566.383340:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296320
00000100:00100000:0.0:1767318566.383344:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296320
00000100:00100000:2.0:1767318566.383437:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607
00000100:00100000:2.0:1767318566.383443:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940296448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318566.383482:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940296448:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318566.383488:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607
00000100:00100000:2.0:1767318566.383505:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767318566.383511:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940296320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318566.383538:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940296320:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318566.383544:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767318566.383574:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940296320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318566.383647:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940296448:0@lo:400:kworker.0
00000100:00100000:2.0:1767318566.383669:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296576
00000100:00100000:2.0:1767318566.383673:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296576
00000100:00100000:1.0:1767318566.383730:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940296704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318566.383754:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318566.383811:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318566.383814:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318566.387960:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296832
00000100:00100000:2.0:1767318566.387976:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296832
00000100:00100000:3.0:1767318566.388005:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296704
00000100:00100000:3.0:1767318566.388013:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296704
00000100:00100000:0.0:1767318566.388074:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963
00000100:00100000:0.0:1767318566.388086:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940296576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318566.388138:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964
00000100:00100000:3.0:1767318566.388149:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940296832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318566.388183:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940296576:12345-0@lo:400:kworker.0 Request processed in 98us (4927us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318566.388193:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963
00000100:00100000:3.0:1767318566.388199:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940296832:12345-0@lo:400:kworker.0 Request processed in 52us (4917us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318566.388207:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964
00000100:00100000:0.0:1767318566.388214:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16362
00000100:00100000:0.0:1767318566.388218:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940296704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318566.388243:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318566.388274:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940296704:12345-0@lo:38:kworker.0 Request processed in 55us (4519us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318566.388280:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16362
00000100:00080000:1.0:1767318566.388449:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318566.388455:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318566.388458:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940296704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318566.388471:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940296960:0@lo:38:kworker.0
00000100:00100000:1.0:1767318566.388515:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318566.388586:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940296960
00000100:00100000:3.0:1767318566.388591:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940296960
00000100:00100000:3.0:1767318566.388609:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16363
00000100:00100000:3.0:1767318566.388614:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940296960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318566.388625:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318566.388660:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940296960:12345-0@lo:38:kworker.0 Request processed in 44us (145us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318566.388666:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940296832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318566.388670:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16363
00000100:00100000:1.0:1767318566.388690:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940296576:0@lo:400:kworker.0
00000100:00080000:1.0:1767318566.388721:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318566.388725:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318566.388726:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318566.388733:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940296960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318567.020979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318567.341111:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318568.048098:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318568.365815:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318569.069053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318569.390247:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318569.965308:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940297088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318569.965624:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318569.966145:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297088
00000100:00100000:1.0:1767318569.966154:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297088
00000100:00100000:1.0:1767318569.966324:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128
00000100:00100000:1.0:1767318569.966332:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940297088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318569.966374:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318569.966508:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318569.966550:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940297088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 218us (926us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318569.966559:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128
00000100:00100000:0.0:1767318569.966595:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940297088:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318570.092905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318570.419279:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318570.993043:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940297216:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318570.993112:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318570.993237:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297216
00000100:00100000:1.0:1767318570.993245:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297216
00000100:00100000:1.0:1767318570.993298:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129
00000100:00100000:1.0:1767318570.993305:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940297216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318570.993374:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318570.993412:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940297216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318570.993419:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129
00000100:00100000:2.0:1767318570.993510:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940297216:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318570.993602:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318571.077734:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318571.079281:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269568
00000100:00100000:1.0:1767318571.079295:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269568
00000100:00100000:1.0:1767318571.079442:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3965
00000100:00100000:1.0:1767318571.079454:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894269568:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318571.079548:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894269568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (1824us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318571.079557:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3965
00000100:00080000:3.0:1767318571.079657:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318571.079672:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318571.091026:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269440
00000100:00100000:2.0:1767318571.091047:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269440
00000100:00100000:2.0:1767318571.092741:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16364
00000100:00100000:2.0:1767318571.092754:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894269440:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318571.092818:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318571.092912:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894269440:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 157us (13240us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318571.092921:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16364
00000100:00100000:2.0:1767318571.116967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318571.437118:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318571.501045:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318571.501064:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318571.501067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318571.501072:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318571.501077:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318571.501085:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3816
00000100:00080000:0.0:1767318571.501089:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318571.501097:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318571.501135:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046999500 x1853163940297344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318571.501163:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318571.501167:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318571.501169:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318571.501173:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3816
00000100:00080000:0.0:1767318571.501176:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318571.501180:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318571.501192:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046998000 x1853163940297472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318571.501216:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940297344:0@lo:38:kworker.0
00000100:00080000:0.0:1767318571.501241:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318571.501245:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318571.501246:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318571.501250:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3816
00000100:00080000:0.0:1767318571.501253:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318571.501256:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318571.501266:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046999c00 x1853163940297856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318571.501310:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318571.501316:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318571.501345:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318571.501346:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318571.501350:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3816
00000100:00080000:0.0:1767318571.501352:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318571.501355:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318571.501368:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2300 x1853163940298112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318571.501376:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940297472:0@lo:38:kworker.0
00000100:00100000:0.0:1767318571.501387:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940297984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318571.501403:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318571.501425:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318571.501427:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940297856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318571.501453:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318571.501471:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940298112:0@lo:38:kworker.0
00000100:00100000:2.0:1767318571.501488:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318571.501497:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297344
00000100:00100000:0.0:1767318571.501504:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297344
00000100:00100000:2.0:1767318571.501523:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297984
00000100:00100000:2.0:1767318571.501528:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297984
00000100:00100000:0.0:1767318571.501532:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16365
00000100:00100000:0.0:1767318571.501537:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940297344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318571.501554:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318571.501570:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297856
00000100:00100000:2.0:1767318571.501574:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297856
00000100:00100000:2.0:1767318571.501585:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298112
00000100:00100000:2.0:1767318571.501587:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298112
00000100:00100000:0.0:1767318571.501592:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940297344:12345-0@lo:38:kworker.0 Request processed in 53us (282us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318571.501597:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966
00000100:00100000:2.0:1767318571.501604:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940297984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318571.501611:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16365
00000100:00100000:0.0:1767318571.501628:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16366
00000100:00100000:0.0:1767318571.501631:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940297856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318571.501648:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318571.501659:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940297984:12345-0@lo:400:kworker.0 Request processed in 55us (236us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318571.501666:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966
00000100:00100000:0.0:1767318571.501682:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940297856:12345-0@lo:38:kworker.0 Request processed in 48us (227us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318571.501683:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16367
00000100:00100000:2.0:1767318571.501691:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940298112:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318571.501694:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16366
00010000:00020000:2.0:1767318571.501705:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318571.501731:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940298112:12345-0@lo:38:kworker.0 Request processed in 40us (242us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318571.501732:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318571.501741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318571.501742:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16367
00000100:00100000:0.0:1767318571.501749:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940297856:0@lo:38:kworker.0
00000100:00080000:0.0:1767318571.501763:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318571.501767:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318571.501770:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940298112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318571.501804:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318571.501805:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940297984:0@lo:400:kworker.0
00000100:00080000:0.0:1767318571.501811:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318571.501815:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940297344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318571.501937:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940297728:0@lo:400:kworker.0
00000100:00100000:3.0:1767318571.501966:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318571.501996:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318571.502001:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940297600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318571.502024:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318571.502060:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297728
00000100:00100000:3.0:1767318571.502063:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297728
00000100:00100000:3.0:1767318571.502090:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967
00000100:00100000:3.0:1767318571.502095:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940297728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318571.502122:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940297728:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318571.502128:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967
00000100:00100000:3.0:1767318571.502150:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940297728:0@lo:400:kworker.0
00000100:00080000:3.0:1767318571.502163:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318571.502576:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297600
00000100:00100000:0.0:1767318571.502580:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297600
00000100:00100000:0.0:1767318571.502631:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609
00000100:00100000:0.0:1767318571.502637:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940297600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318571.502675:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940297600:12345-0@lo:400:kworker.0 Request processed in 38us (649us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318571.502680:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767318571.502895:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940297600:0@lo:400:kworker.0
00000100:00080000:3.0:1767318571.502914:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318571.503606:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940297472
00000100:00100000:1.0:1767318571.503612:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940297472
00000100:00100000:1.0:1767318571.503663:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974
00000100:00100000:1.0:1767318571.503670:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940297472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318571.503690:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318571.503744:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940297472:12345-0@lo:38:kworker.0 Request processed in 74us (2341us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318571.503751:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974
00000100:00080000:0.0:1767318571.505973:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318571.505985:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318571.505991:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940297472:0@lo:38:kworker.0
00000100:00100000:2.0:1767318572.141387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318572.461696:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318573.166558:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318573.485008:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318574.189630:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318574.510509:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318575.085427:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940298240:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318575.085541:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318575.085652:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298240
00000100:00100000:1.0:1767318575.085662:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298240
00000100:00080000:3.0:1767318575.085708:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318575.085731:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130
00000100:00100000:1.0:1767318575.085740:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940298240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318575.085767:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318575.085845:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940298240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318575.085859:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130
00000100:00100000:3.0:1767318575.087956:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940298240:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318575.176554:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318575.176591:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894269696 offset 0 length 520: 4
00000100:00100000:3.0:1767318575.176615:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318575.176701:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269952
00000100:00100000:2.0:1767318575.176710:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269952
00000100:00100000:2.0:1767318575.176823:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894269824
00000100:00100000:2.0:1767318575.176826:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894269824
00000100:00100000:2.0:1767318575.176848:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3968
00000100:00100000:2.0:1767318575.176970:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894269952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318575.177039:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894269952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 182us (496us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318575.177047:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3968
00000100:00100000:2.0:1767318575.177067:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16368
00000100:00100000:2.0:1767318575.177072:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894269824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318575.177093:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318575.177118:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894269824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (501us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318575.177125:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16368
00000100:00080000:3.0:1767318575.177563:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318575.212934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318575.535581:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318576.109647:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318576.112462:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940298368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318576.112565:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.112801:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298368
00000100:00100000:1.0:1767318576.112811:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298368
00000100:00100000:1.0:1767318576.112875:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131
00000100:00100000:1.0:1767318576.112886:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940298368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318576.112920:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318576.112977:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940298368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (412us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318576.112985:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131
00000100:00100000:0.0:1767318576.113310:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940298368:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318576.119426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318576.237041:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318576.557176:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318576.621410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318576.621429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318576.621432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318576.621437:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318576.621441:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318576.621449:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3821
00000100:00080000:2.0:1767318576.621465:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318576.621473:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318576.621851:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940298496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318576.621879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318576.621884:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318576.621886:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318576.621889:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3821
00000100:00080000:2.0:1767318576.621892:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318576.621895:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318576.621911:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5180 x1853163940298624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318576.621966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318576.621969:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318576.621971:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318576.621974:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3821
00000100:00080000:2.0:1767318576.621977:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318576.621982:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318576.621996:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940299008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318576.622012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318576.622015:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318576.622017:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318576.622020:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3821
00000100:00080000:2.0:1767318576.622023:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318576.622027:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318576.622036:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f8700 x1853163940299264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318576.622093:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940299136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318576.622169:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318576.622236:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318576.622253:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940298880:0@lo:400:kworker.0
00000100:00100000:2.0:1767318576.622287:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318576.622331:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299136
00000100:00100000:2.0:1767318576.622341:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299136
00000100:00100000:2.0:1767318576.622399:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298880
00000100:00100000:2.0:1767318576.622402:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298880
00000100:00100000:2.0:1767318576.622431:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969
00000100:00100000:2.0:1767318576.622441:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940299136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318576.622532:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940299136:12345-0@lo:400:kworker.0 Request processed in 91us (361us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318576.622540:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969
00000100:00100000:2.0:1767318576.622562:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970
00000100:00100000:2.0:1767318576.622569:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940298880:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318576.622860:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318576.622923:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940299136:0@lo:400:kworker.0
00000100:00100000:1.0:1767318576.623007:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318576.623019:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940298752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318576.623054:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.623101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940298496:0@lo:38:kworker.0
00000100:00100000:1.0:1767318576.623127:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.623145:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940298624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318576.623168:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.623187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940299008:0@lo:38:kworker.0
00000100:00100000:1.0:1767318576.623209:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.623224:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940299264:0@lo:38:kworker.0
00000100:00100000:1.0:1767318576.623241:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318576.623269:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298624
00000100:00100000:1.0:1767318576.623286:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298624
00000100:00100000:1.0:1767318576.623313:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975
00000100:00100000:1.0:1767318576.623319:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940298624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318576.623346:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318576.623381:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940298624:12345-0@lo:38:kworker.0 Request processed in 61us (211us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318576.623387:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975
00000100:00100000:1.0:1767318576.623406:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298496
00000100:00100000:1.0:1767318576.623410:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298496
00000100:00100000:1.0:1767318576.623429:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299008
00000100:00100000:1.0:1767318576.623432:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299008
00000100:00100000:1.0:1767318576.623440:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299264
00000100:00100000:1.0:1767318576.623442:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299264
00000100:00100000:1.0:1767318576.623464:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16369
00000100:00100000:1.0:1767318576.623469:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940298496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318576.623479:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318576.623503:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940298496:12345-0@lo:38:kworker.0 Request processed in 32us (376us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318576.623508:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16369
00000100:00100000:1.0:1767318576.623520:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370
00000100:00100000:1.0:1767318576.623524:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940299008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318576.623534:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318576.623556:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940299008:12345-0@lo:38:kworker.0 Request processed in 30us (346us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318576.623561:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370
00000100:00100000:1.0:1767318576.623572:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16371
00000100:00100000:1.0:1767318576.623576:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940299264:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318576.623698:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940298752
00000100:00100000:3.0:1767318576.623703:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940298752
00000100:00100000:3.0:1767318576.623734:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610
00000100:00100000:3.0:1767318576.623741:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940298752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318576.623811:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940298752:12345-0@lo:400:kworker.0 Request processed in 71us (756us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318576.623817:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610
00000100:00080000:3.0:1767318576.623886:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318576.623892:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318576.623896:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940298496:0@lo:38:kworker.0
00000100:00080000:3.0:1767318576.623906:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318576.623909:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318576.623912:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940298624:0@lo:38:kworker.0
00000100:00080000:3.0:1767318576.623921:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318576.623923:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318576.623926:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940299008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318576.624058:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940298752:0@lo:400:kworker.0
00010000:00020000:1.0:1767318576.625026:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318576.625110:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940299264:12345-0@lo:38:kworker.0 Request processed in 1531us (1866us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318576.625122:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16371
00000100:00080000:3.0:1767318576.625340:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318576.625346:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318576.625350:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940299264:0@lo:38:kworker.0
00000100:00100000:2.0:1767318576.625409:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940298880:12345-0@lo:400:kworker.0 Request processed in 2839us (3119us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318576.625418:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970
00000100:00100000:0.0:1767318576.625915:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940298880:0@lo:400:kworker.0
00000100:00100000:2.0:1767318577.263866:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318577.582100:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318578.284871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318578.605010:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318579.308930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318579.631663:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318580.206111:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318580.206137:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940299392:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318580.206210:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318580.207296:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299392
00000100:00100000:1.0:1767318580.207311:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299392
00000100:00100000:1.0:1767318580.207414:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132
00000100:00100000:1.0:1767318580.207425:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940299392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318580.207465:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318580.207555:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940299392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (1342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318580.207563:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132
00000100:00100000:1.0:1767318580.207624:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940299392:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318580.208114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318580.294101:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318580.294196:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318580.294327:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270208
00000100:00100000:1.0:1767318580.294338:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270208
00000100:00100000:1.0:1767318580.294424:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270080
00000100:00100000:1.0:1767318580.294427:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270080
00000100:00100000:1.0:1767318580.294449:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3971
00000100:00100000:1.0:1767318580.294459:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894270208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767318580.294484:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318580.294527:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16372
00000100:00100000:1.0:1767318580.294533:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894270208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (441us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.294539:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894270080:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767318580.294546:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3971
00010000:00020000:3.0:1767318580.294568:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318580.294603:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894270080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 68us (406us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318580.294612:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16372
00000100:00100000:2.0:1767318580.332943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318580.653555:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318581.229226:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318581.229259:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940299520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318581.229332:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318581.230763:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299520
00000100:00100000:2.0:1767318581.230821:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299520
00000100:00100000:2.0:1767318581.230919:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133
00000100:00100000:2.0:1767318581.230931:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940299520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318581.230973:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318581.231062:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940299520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (1730us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318581.231069:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133
00000100:00080000:3.0:1767318581.231324:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318581.231467:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940299520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318581.356907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318581.677197:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318581.741841:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318556/real 1767318556]  req@ffff93cf426d7100 x1853163940293376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318581.741880:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf426d7100 x1853163940293376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318581.741902:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318581.741928:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318581.741933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940293376:0@lo:250:kworker.0
00000100:00080000:2.0:1767318581.742350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318581.742357:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318581.742361:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318581.742367:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3806
00000100:00080000:2.0:1767318581.742371:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318581.742379:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318581.742428:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940299648/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318581.742456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318581.742460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318581.742462:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318581.742465:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3826
00000100:00080000:2.0:1767318581.742468:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318581.742473:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318581.742489:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f8700 x1853163940299776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318581.742498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318581.742502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318581.742504:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318581.742508:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3826
00000100:00080000:2.0:1767318581.742510:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318581.742513:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318581.742525:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940299904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318581.742568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318581.742571:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318581.742573:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318581.742576:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3826
00000100:00080000:2.0:1767318581.742579:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318581.742583:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318581.742592:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead500 x1853163940300288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318581.742619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318581.742622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318581.742624:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318581.742628:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3826
00000100:00080000:2.0:1767318581.742630:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318581.742633:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318581.742643:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf100 x1853163940300544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318581.742666:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318581.742683:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940300416:0@lo:400:kworker.0
00000100:00100000:2.0:1767318581.742758:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318581.742854:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300416
00000100:00100000:2.0:1767318581.742862:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300416
00000100:00100000:2.0:1767318581.742913:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972
00000100:00100000:2.0:1767318581.742922:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940300416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318581.742975:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940300416:12345-0@lo:400:kworker.0 Request processed in 54us (216us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318581.742982:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972
00000100:00100000:2.0:1767318581.743039:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940300416:0@lo:400:kworker.0
00000100:00080000:3.0:1767318581.743275:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318581.743289:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940299648:0@lo:250:kworker.0
00000400:00000100:3.0:1767318581.743315:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940299648 offset 0 length 520: 4
00000100:00100000:3.0:1767318581.743334:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940299776:0@lo:38:kworker.0
00000100:00100000:3.0:1767318581.743357:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318581.743392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940299904:0@lo:38:kworker.0
00000100:00100000:3.0:1767318581.743418:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318581.743437:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940300288:0@lo:38:kworker.0
00000100:00100000:3.0:1767318581.743458:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318581.743474:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940300544:0@lo:38:kworker.0
00000100:00100000:3.0:1767318581.743494:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318581.743522:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299904
00000100:00100000:3.0:1767318581.743526:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299904
00000100:00100000:3.0:1767318581.743549:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976
00000100:00100000:3.0:1767318581.743554:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940299904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318581.743576:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318581.743609:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940299904:12345-0@lo:38:kworker.0 Request processed in 54us (190us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318581.743616:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976
00000100:00100000:3.0:1767318581.743638:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940299776
00000100:00100000:3.0:1767318581.743642:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940299776
00000100:00100000:3.0:1767318581.743660:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300288
00000100:00100000:3.0:1767318581.743662:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300288
00000100:00100000:3.0:1767318581.743673:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300544
00000100:00100000:3.0:1767318581.743676:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300544
00000100:00100000:3.0:1767318581.743686:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373
00000100:00100000:3.0:1767318581.743690:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940299776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318581.743700:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318581.743726:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940299776:12345-0@lo:38:kworker.0 Request processed in 34us (368us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318581.743732:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373
00000100:00100000:3.0:1767318581.743743:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16374
00000100:00100000:3.0:1767318581.743747:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940300288:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318581.743755:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318581.743799:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940300288:12345-0@lo:38:kworker.0 Request processed in 50us (340us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318581.743804:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16374
00000100:00100000:3.0:1767318581.743816:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16375
00000100:00100000:3.0:1767318581.743819:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940300544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318581.743828:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318581.743849:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940300544:12345-0@lo:38:kworker.0 Request processed in 29us (355us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318581.743854:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16375
00000100:00080000:3.0:1767318581.743887:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318581.743891:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318581.743894:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940299776:0@lo:38:kworker.0
00000100:00080000:3.0:1767318581.743902:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318581.743905:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318581.743908:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940299904:0@lo:38:kworker.0
00000100:00080000:3.0:1767318581.743930:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318581.743933:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318581.743935:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940300288:0@lo:38:kworker.0
00000100:00080000:3.0:1767318581.743942:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318581.743945:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318581.743947:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940300544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318581.744623:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940300032:0@lo:400:kworker.0
00000100:00100000:0.0:1767318581.744668:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318581.744711:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318581.744717:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940300160:0@lo:400:kworker.0
00000100:00100000:0.0:1767318581.744740:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318581.744812:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300160
00000100:00100000:0.0:1767318581.744818:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300160
00000100:00100000:0.0:1767318581.744868:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973
00000100:00100000:0.0:1767318581.744875:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940300160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318581.744916:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940300160:12345-0@lo:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318581.744923:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973
00000100:00080000:0.0:1767318581.744939:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318581.744961:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940300160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318581.745043:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300032
00000100:00100000:1.0:1767318581.745047:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300032
00000100:00100000:1.0:1767318581.745086:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611
00000100:00100000:1.0:1767318581.745093:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940300032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318581.745130:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940300032:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318581.745135:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611
00000100:00100000:0.0:1767318581.745338:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940300032:0@lo:400:kworker.0
00000100:00100000:2.0:1767318582.381616:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318582.701531:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318583.405400:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318583.725240:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318584.428929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318584.753526:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318585.325261:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318585.325291:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940300672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318585.325378:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318585.325577:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300672
00000100:00100000:1.0:1767318585.325587:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300672
00000100:00080000:0.0:1767318585.325691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318585.325916:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134
00000100:00100000:1.0:1767318585.325927:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940300672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318585.325961:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318585.326017:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940300672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (640us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318585.326024:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134
00000100:00100000:0.0:1767318585.326108:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940300672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318585.415092:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318585.415159:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318585.415237:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270464
00000100:00100000:1.0:1767318585.415249:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270464
00000100:00100000:3.0:1767318585.415291:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270336
00000100:00100000:3.0:1767318585.415296:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270336
00000100:00100000:3.0:1767318585.415337:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3974
00000100:00080000:0.0:1767318585.415348:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318585.415350:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894270464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318585.415442:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894270464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318585.415451:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3974
00000100:00100000:3.0:1767318585.415472:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16376
00000100:00100000:3.0:1767318585.415476:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894270336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318585.415499:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318585.415528:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894270336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (368us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318585.415535:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16376
00000100:00100000:2.0:1767318585.452913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318585.774799:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318586.349609:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318586.349640:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940300800:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318586.349719:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318586.349888:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300800
00000100:00100000:2.0:1767318586.349898:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300800
00000100:00100000:2.0:1767318586.349963:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135
00000100:00100000:2.0:1767318586.349973:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940300800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318586.350004:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318586.350063:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940300800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (345us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318586.350070:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135
00000100:00100000:1.0:1767318586.350176:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940300800:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318586.350249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318586.476962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318586.797420:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318586.863353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318586.863364:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318586.863368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318586.863372:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318586.863376:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318586.863384:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3831
00000100:00080000:2.0:1767318586.863390:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318586.863398:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318586.863445:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae680 x1853163940300928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318586.863482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318586.863486:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318586.863488:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318586.863491:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3831
00000100:00080000:2.0:1767318586.863494:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318586.863497:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318586.863510:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf480 x1853163940301056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318586.863562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318586.863565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318586.863567:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318586.863570:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3831
00000100:00080000:2.0:1767318586.863573:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318586.863577:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318586.863586:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeadf80 x1853163940301440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318586.863606:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318586.863609:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318586.863611:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318586.863614:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3831
00000100:00080000:2.0:1767318586.863616:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318586.863619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318586.863632:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940301696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318586.863656:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318586.863675:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940301184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.863755:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318586.863843:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940301568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.863867:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318586.863885:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318586.863890:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940301312:0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.863910:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318586.863937:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301184
00000100:00100000:2.0:1767318586.863946:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301184
00000100:00100000:2.0:1767318586.863994:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612
00000100:00100000:2.0:1767318586.864002:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940301184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.864051:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940301184:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318586.864059:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612
00000100:00100000:2.0:1767318586.864083:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301568
00000100:00100000:2.0:1767318586.864086:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301568
00000100:00100000:2.0:1767318586.864118:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301312
00000100:00100000:2.0:1767318586.864121:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301312
00000100:00100000:2.0:1767318586.864140:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975
00000100:00100000:2.0:1767318586.864145:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940301568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.864179:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940301568:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318586.864198:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975
00000100:00100000:2.0:1767318586.864211:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976
00000100:00100000:2.0:1767318586.864216:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940301312:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.864243:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940301312:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318586.864248:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976
00000100:00100000:2.0:1767318586.864286:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940301312:0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.864295:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940301568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318586.864320:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940301184:0@lo:400:kworker.0
00000100:00100000:0.0:1767318586.864523:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940300928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318586.864554:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318586.864580:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940301056:0@lo:38:kworker.0
00000100:00100000:0.0:1767318586.864602:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318586.864617:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940301440:0@lo:38:kworker.0
00000100:00100000:0.0:1767318586.864634:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318586.864650:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940301696:0@lo:38:kworker.0
00000100:00100000:0.0:1767318586.864669:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318586.864701:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940300928
00000100:00100000:0.0:1767318586.864704:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940300928
00000100:00100000:0.0:1767318586.864726:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301440
00000100:00100000:0.0:1767318586.864730:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301440
00000100:00100000:0.0:1767318586.864738:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301696
00000100:00100000:0.0:1767318586.864740:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301696
00000100:00100000:0.0:1767318586.864749:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377
00000100:00100000:0.0:1767318586.864753:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940300928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318586.864793:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318586.864826:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940300928:12345-0@lo:38:kworker.0 Request processed in 71us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318586.864832:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377
00000100:00100000:0.0:1767318586.864844:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378
00000100:00100000:0.0:1767318586.864848:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940301440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318586.864856:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318586.864875:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940301440:12345-0@lo:38:kworker.0 Request processed in 25us (239us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318586.864879:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378
00000100:00100000:0.0:1767318586.864891:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379
00000100:00100000:0.0:1767318586.864895:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940301696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318586.864902:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318586.864921:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940301696:12345-0@lo:38:kworker.0 Request processed in 25us (251us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318586.864926:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379
00000100:00080000:0.0:1767318586.864954:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318586.864959:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318586.864962:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940300928:0@lo:38:kworker.0
00000100:00080000:0.0:1767318586.864970:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318586.864973:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318586.864976:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940301440:0@lo:38:kworker.0
00000100:00080000:0.0:1767318586.864984:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318586.864986:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318586.864989:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940301696:0@lo:38:kworker.0
00000100:00100000:1.0:1767318586.865062:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301056
00000100:00100000:1.0:1767318586.865067:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301056
00000100:00100000:1.0:1767318586.865102:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977
00000100:00100000:1.0:1767318586.865108:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940301056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318586.865118:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318586.865153:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940301056:12345-0@lo:38:kworker.0 Request processed in 44us (550us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318586.865159:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977
00000100:00080000:1.0:1767318586.865195:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318586.865200:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318586.865203:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940301056:0@lo:38:kworker.0
00000100:00080000:3.0:1767318586.865565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318587.500903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318587.821636:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318588.525195:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318588.845193:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318589.548922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318589.869100:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318590.445129:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940301824:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318590.445210:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318590.446638:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301824
00000100:00100000:1.0:1767318590.446653:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301824
00000100:00100000:1.0:1767318590.446881:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136
00000100:00100000:1.0:1767318590.446891:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940301824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318590.446928:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318590.447022:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940301824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (1812us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318590.447029:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136
00000100:00100000:0.0:1767318590.447269:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940301824:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318590.447810:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318590.540972:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318590.541073:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318590.541763:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270720
00000100:00100000:2.0:1767318590.541801:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270720
00000100:00100000:2.0:1767318590.541886:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270592
00000100:00100000:2.0:1767318590.541889:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270592
00000100:00100000:2.0:1767318590.541904:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3977
00000100:00100000:2.0:1767318590.541911:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894270720:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318590.541988:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894270720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (1025us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318590.541995:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3977
00000100:00100000:2.0:1767318590.542014:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16380
00000100:00100000:2.0:1767318590.542019:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894270592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318590.542039:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318590.542067:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894270592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (994us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318590.542074:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16380
00000100:00080000:0.0:1767318590.542185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318590.573076:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318590.893112:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318591.469992:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940301952:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318591.470099:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318591.470177:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940301952
00000100:00100000:2.0:1767318591.470187:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940301952
00000100:00100000:2.0:1767318591.470265:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137
00000100:00100000:2.0:1767318591.470275:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940301952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318591.470314:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318591.470368:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940301952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (269us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318591.470375:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137
00000100:00100000:1.0:1767318591.470438:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940301952:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318591.470627:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318591.597530:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318591.917404:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318591.981443:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318591.981455:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318591.981459:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318591.981465:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318591.981471:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318591.981482:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3836
00000100:00080000:3.0:1767318591.981489:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318591.981500:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318591.981561:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058a80 x1853163940302080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318591.981588:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318591.981592:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318591.981594:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318591.981597:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3836
00000100:00080000:3.0:1767318591.981599:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318591.981603:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318591.981616:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940302208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318591.981681:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318591.981684:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318591.981686:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318591.981689:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3836
00000100:00080000:3.0:1767318591.981692:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318591.981696:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318591.981707:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f8700 x1853163940302720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318591.981723:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318591.981726:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318591.981728:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318591.981731:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3836
00000100:00080000:3.0:1767318591.981733:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318591.981737:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318591.981748:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940302976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318591.981825:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940302464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318591.981901:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318591.981998:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318591.982005:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940302336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318591.982038:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318591.982075:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302464
00000100:00100000:2.0:1767318591.982083:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302464
00000100:00100000:2.0:1767318591.982142:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302336
00000100:00100000:2.0:1767318591.982145:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302336
00000100:00100000:2.0:1767318591.982170:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613
00000100:00100000:2.0:1767318591.982179:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940302464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318591.982233:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940302464:12345-0@lo:400:kworker.0 Request processed in 54us (332us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318591.982240:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613
00000100:00100000:2.0:1767318591.982257:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614
00000100:00100000:2.0:1767318591.982263:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940302336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318591.982288:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940302336:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318591.982293:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614
00000100:00100000:2.0:1767318591.982338:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940302336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318591.982348:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940302464:0@lo:400:kworker.0
00000100:00100000:0.0:1767318591.982622:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940302592:0@lo:400:kworker.0
00000100:00100000:0.0:1767318591.982656:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318591.982689:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318591.982694:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940302848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318591.982713:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318591.982872:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302592
00000100:00100000:1.0:1767318591.982878:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302592
00000100:00100000:1.0:1767318591.982915:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302848
00000100:00100000:1.0:1767318591.982918:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302848
00000100:00100000:1.0:1767318591.982959:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978
00000100:00100000:1.0:1767318591.982966:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940302592:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318591.983015:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940302592:12345-0@lo:400:kworker.0 Request processed in 41us (349us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318591.983022:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978
00000100:00100000:1.0:1767318591.983037:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979
00000100:00100000:1.0:1767318591.983045:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940302848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318591.983072:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940302848:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318591.983077:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979
00000100:00100000:1.0:1767318591.983113:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940302080:0@lo:38:kworker.0
00000100:00100000:1.0:1767318591.983149:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318591.983167:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940302208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318591.983192:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318591.983207:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940302720:0@lo:38:kworker.0
00000100:00100000:1.0:1767318591.983227:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318591.983240:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940302976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318591.983260:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318591.983284:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302080
00000100:00100000:1.0:1767318591.983288:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302080
00000100:00100000:1.0:1767318591.983304:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302720
00000100:00100000:1.0:1767318591.983307:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302720
00000100:00100000:1.0:1767318591.983313:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302976
00000100:00100000:1.0:1767318591.983316:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302976
00000100:00100000:1.0:1767318591.983324:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381
00000100:00100000:1.0:1767318591.983328:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318591.983353:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318591.983385:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302080:12345-0@lo:38:kworker.0 Request processed in 55us (236us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318591.983391:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381
00000100:00100000:1.0:1767318591.983401:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382
00000100:00100000:1.0:1767318591.983405:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318591.983413:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318591.983438:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302720:12345-0@lo:38:kworker.0 Request processed in 31us (210us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318591.983443:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382
00000100:00100000:1.0:1767318591.983452:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383
00000100:00100000:1.0:1767318591.983455:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318591.983463:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318591.983481:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940302976:12345-0@lo:38:kworker.0 Request processed in 25us (220us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318591.983485:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383
00000100:00080000:1.0:1767318591.983512:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318591.983517:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318591.983520:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940302080:0@lo:38:kworker.0
00000100:00080000:1.0:1767318591.983529:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318591.983531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318591.983534:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940302720:0@lo:38:kworker.0
00000100:00080000:1.0:1767318591.983540:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318591.983543:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318591.983546:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940302976:0@lo:38:kworker.0
00000100:00080000:0.0:1767318591.983825:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318591.983844:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940302208
00000100:00100000:0.0:1767318591.983848:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940302208
00000100:00100000:0.0:1767318591.983876:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978
00000100:00100000:0.0:1767318591.983881:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940302208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318591.983891:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318591.983921:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940302208:12345-0@lo:38:kworker.0 Request processed in 39us (728us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318591.983927:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978
00000100:00100000:0.0:1767318591.983978:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940302848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318591.983989:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940302592:0@lo:400:kworker.0
00000100:00080000:1.0:1767318591.984330:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318591.984335:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318591.984339:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940302208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318592.621649:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318592.944260:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318593.644938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318593.972222:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318594.668938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318594.989038:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318595.565371:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940303104:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318595.565476:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318595.565618:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303104
00000100:00100000:1.0:1767318595.565627:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303104
00000100:00100000:1.0:1767318595.565692:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138
00000100:00100000:1.0:1767318595.565701:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06e41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940303104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318595.565738:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318595.565818:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06e41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940303104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318595.565825:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138
00000100:00100000:2.0:1767318595.565858:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940303104:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318595.566292:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318595.655539:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318595.655877:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270976
00000100:00100000:2.0:1767318595.655888:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270976
00000100:00100000:2.0:1767318595.655960:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3980
00000100:00100000:2.0:1767318595.655968:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894270976:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318595.656042:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894270976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (516us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318595.656056:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3980
00000100:00100000:1.0:1767318595.656282:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767318595.656344:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318595.656380:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894270848
00000100:00100000:3.0:1767318595.656383:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894270848
00000100:00100000:3.0:1767318595.656407:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16384
00000100:00100000:3.0:1767318595.656412:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894270848:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318595.656432:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318595.656463:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894270848:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (182us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318595.656467:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16384
00000100:00100000:2.0:1767318595.692864:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318596.013138:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318596.589369:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940303232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318596.589440:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318596.589853:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303232
00000100:00100000:1.0:1767318596.589862:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303232
00000100:00100000:1.0:1767318596.589931:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139
00000100:00100000:1.0:1767318596.589942:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940303232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318596.589977:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318596.590058:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940303232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (617us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318596.590066:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139
00000100:00100000:3.0:1767318596.590338:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940303232:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318596.593424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318596.717995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318597.038296:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318597.100933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318597.100946:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318597.100949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318597.100956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318597.100962:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318597.100972:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3842
00000100:00080000:1.0:1767318597.100978:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318597.100986:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318597.101035:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940303360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318597.101069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318597.101073:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318597.101074:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318597.101079:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3842
00000100:00080000:1.0:1767318597.101081:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318597.101085:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318597.101112:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940303488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318597.101175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318597.101178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318597.101180:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318597.101184:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3842
00000100:00080000:1.0:1767318597.101186:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318597.101189:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318597.101201:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966680 x1853163940304000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318597.101215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318597.101219:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318597.101221:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318597.101224:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3842
00000100:00080000:1.0:1767318597.101226:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318597.101229:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318597.101238:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964e00 x1853163940304256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318597.101267:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940303744:0@lo:400:kworker.0
00000100:00100000:1.0:1767318597.101344:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318597.101425:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318597.101432:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940303616:0@lo:400:kworker.0
00000100:00100000:1.0:1767318597.101455:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318597.101559:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303744
00000100:00100000:2.0:1767318597.101570:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303744
00000100:00100000:2.0:1767318597.101633:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303616
00000100:00100000:2.0:1767318597.101637:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303616
00000100:00100000:2.0:1767318597.101680:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615
00000100:00100000:2.0:1767318597.101691:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940303744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318597.101802:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940303872:0@lo:400:kworker.0
00000100:00100000:2.0:1767318597.101804:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940303744:12345-0@lo:400:kworker.0 Request processed in 82us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318597.101815:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615
00000100:00100000:2.0:1767318597.101836:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616
00000100:00100000:2.0:1767318597.101844:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940303616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318597.101851:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318597.101883:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940303616:12345-0@lo:400:kworker.0 Request processed in 39us (425us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318597.101889:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616
00000100:00100000:0.0:1767318597.101946:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318597.101954:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940304128:0@lo:400:kworker.0
00000100:00100000:0.0:1767318597.101990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318597.102010:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940303360:0@lo:38:kworker.0
00000100:00100000:3.0:1767318597.102053:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318597.102076:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940303488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318597.102112:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318597.102133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940304000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318597.102152:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318597.102168:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940304256:0@lo:38:kworker.0
00000100:00100000:3.0:1767318597.102187:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318597.102222:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303872
00000100:00100000:3.0:1767318597.102226:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303872
00000100:00100000:3.0:1767318597.102257:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304128
00000100:00100000:3.0:1767318597.102260:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304128
00000100:00100000:3.0:1767318597.102276:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303360
00000100:00100000:3.0:1767318597.102278:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303360
00000100:00100000:3.0:1767318597.102286:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981
00000100:00100000:3.0:1767318597.102292:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940303872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318597.102326:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940303872:12345-0@lo:400:kworker.0 Request processed in 34us (480us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318597.102332:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981
00000100:00100000:3.0:1767318597.102345:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304000
00000100:00100000:3.0:1767318597.102348:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304000
00000100:00100000:3.0:1767318597.102357:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304256
00000100:00100000:3.0:1767318597.102359:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304256
00000100:00100000:3.0:1767318597.102368:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982
00000100:00100000:3.0:1767318597.102374:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940304128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318597.102401:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940304128:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318597.102406:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982
00000100:00100000:3.0:1767318597.102419:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385
00000100:00100000:3.0:1767318597.102422:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940303360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318597.102443:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318597.102477:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940303360:12345-0@lo:38:kworker.0 Request processed in 52us (424us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318597.102482:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385
00000100:00100000:3.0:1767318597.102492:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386
00000100:00100000:3.0:1767318597.102495:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940304000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318597.102503:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318597.102522:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940304000:12345-0@lo:38:kworker.0 Request processed in 25us (370us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318597.102527:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386
00000100:00100000:3.0:1767318597.102536:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387
00000100:00100000:3.0:1767318597.102540:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940304256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318597.102548:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318597.102565:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940304256:12345-0@lo:38:kworker.0 Request processed in 24us (377us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318597.102571:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387
00000100:00100000:3.0:1767318597.102587:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940303488
00000100:00100000:3.0:1767318597.102590:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940303488
00000100:00100000:3.0:1767318597.102607:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979
00000100:00100000:3.0:1767318597.102611:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940303488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318597.102619:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318597.102640:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940303488:12345-0@lo:38:kworker.0 Request processed in 28us (527us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318597.102646:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979
00000100:00080000:3.0:1767318597.102691:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318597.102696:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318597.102700:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940303360:0@lo:38:kworker.0
00000100:00080000:3.0:1767318597.102709:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318597.102712:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318597.102715:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940303488:0@lo:38:kworker.0
00000100:00080000:3.0:1767318597.102721:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318597.102724:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318597.102727:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940304000:0@lo:38:kworker.0
00000100:00080000:3.0:1767318597.102735:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318597.102738:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318597.102740:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940304256:0@lo:38:kworker.0
00000100:00080000:2.0:1767318597.104688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318597.104701:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318597.104815:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940303616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318597.104835:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940303744:0@lo:400:kworker.0
00000100:00100000:0.0:1767318597.110613:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940304128:0@lo:400:kworker.0
00000100:00100000:0.0:1767318597.110635:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940303872:0@lo:400:kworker.0
00000100:00100000:2.0:1767318597.741367:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318598.060956:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318598.765019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318599.084936:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318599.789580:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318600.109000:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318600.693234:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940304384:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318600.693345:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318600.693627:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304384
00000100:00100000:1.0:1767318600.693638:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304384
00000100:00100000:1.0:1767318600.693757:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140
00000100:00100000:1.0:1767318600.693768:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940304384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318600.693833:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318600.693889:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940304384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (542us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318600.693897:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140
00000100:00100000:0.0:1767318600.693991:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940304384:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318600.694376:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318600.775495:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318600.775544:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318600.775573:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894271360 offset 0 length 520: 4
00000100:00100000:2.0:1767318600.775667:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271104
00000100:00100000:2.0:1767318600.775689:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271104
00000100:00100000:2.0:1767318600.775751:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271232
00000100:00100000:2.0:1767318600.775755:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271232
00000100:00100000:2.0:1767318600.775848:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3983
00000100:00100000:2.0:1767318600.775859:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894271232:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318600.775951:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894271232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (405us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318600.775961:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3983
00000100:00100000:2.0:1767318600.775979:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16388
00000100:00100000:2.0:1767318600.775984:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894271104:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318600.776008:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318600.776032:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894271104:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (551us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318600.776037:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16388
00000100:00080000:1.0:1767318600.776635:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318600.812905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318601.133049:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318601.709351:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318601.709382:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940304512:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318601.709463:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318601.709613:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304512
00000100:00100000:1.0:1767318601.709634:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304512
00000100:00100000:1.0:1767318601.709711:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141
00000100:00100000:1.0:1767318601.709721:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940304512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318601.709767:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318601.709843:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940304512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (380us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318601.709851:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141
00000100:00100000:1.0:1767318601.709904:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940304512:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318601.710599:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318601.836911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318602.157440:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318602.221242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318602.221253:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318602.221256:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318602.221260:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318602.221263:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318602.221272:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3847
00000100:00080000:3.0:1767318602.221276:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318602.221282:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318602.221801:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26d80 x1853163940304640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318602.221827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318602.221831:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318602.221834:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318602.221837:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3847
00000100:00080000:3.0:1767318602.221840:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318602.221844:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318602.221862:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940304768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318602.222091:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940305152:0@lo:400:kworker.0
00000100:00100000:1.0:1767318602.222158:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318602.222235:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940304640:0@lo:38:kworker.0
00000100:00100000:1.0:1767318602.222259:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318602.222281:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940304768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318602.222302:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318602.222359:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940305024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318602.222383:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318602.222404:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318602.222409:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940304896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318602.222425:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318602.222460:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305152
00000100:00100000:1.0:1767318602.222467:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305152
00000100:00100000:1.0:1767318602.222516:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304640
00000100:00100000:1.0:1767318602.222519:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304640
00000100:00100000:1.0:1767318602.222534:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984
00000100:00100000:1.0:1767318602.222545:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940305152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318602.222598:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940305152:12345-0@lo:400:kworker.0 Request processed in 54us (438us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318602.222605:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984
00000100:00100000:1.0:1767318602.222622:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389
00000100:00100000:1.0:1767318602.222625:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940304640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318602.222642:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318602.222668:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940304640:12345-0@lo:38:kworker.0 Request processed in 41us (408us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318602.222674:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389
00000100:00100000:1.0:1767318602.222730:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940305152:0@lo:400:kworker.0
00000100:00080000:1.0:1767318602.222757:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318602.222762:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318602.222765:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940304640:0@lo:38:kworker.0
00000100:00100000:1.0:1767318602.222810:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305024
00000100:00100000:1.0:1767318602.222814:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305024
00000100:00100000:1.0:1767318602.222838:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304896
00000100:00100000:1.0:1767318602.222841:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304896
00000100:00100000:1.0:1767318602.222858:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617
00000100:00100000:1.0:1767318602.222864:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940305024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318602.222897:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940305024:12345-0@lo:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318602.222903:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617
00000100:00100000:1.0:1767318602.222914:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618
00000100:00100000:1.0:1767318602.222920:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940304896:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318602.223300:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318602.223317:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318602.223442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318602.223448:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318602.223451:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318602.223456:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3847
00000100:00080000:3.0:1767318602.223459:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318602.223463:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318602.223488:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940305280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318602.223522:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318602.223525:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318602.223527:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318602.223530:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3847
00000100:00080000:3.0:1767318602.223533:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318602.223536:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318602.223548:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966680 x1853163940305536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318602.223577:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940305408:0@lo:400:kworker.0
00000100:00100000:0.0:1767318602.223830:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940304768
00000100:00100000:0.0:1767318602.223836:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940304768
00000100:00100000:0.0:1767318602.223865:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980
00000100:00100000:0.0:1767318602.223874:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940304768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318602.223891:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318602.224396:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318602.224471:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305408
00000100:00100000:3.0:1767318602.224476:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305408
00000100:00100000:3.0:1767318602.224542:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985
00000100:00100000:3.0:1767318602.224549:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940305408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318602.224595:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940305408:12345-0@lo:400:kworker.0 Request processed in 46us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318602.224601:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985
00000100:00100000:3.0:1767318602.224658:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940305408:0@lo:400:kworker.0
00000100:00080000:2.0:1767318602.224857:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318602.224874:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940305280:0@lo:38:kworker.0
00000100:00100000:2.0:1767318602.224907:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318602.224925:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940305536:0@lo:38:kworker.0
00000100:00100000:2.0:1767318602.224958:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318602.224991:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305280
00000100:00100000:2.0:1767318602.224995:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305280
00000100:00100000:2.0:1767318602.225015:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305536
00000100:00100000:2.0:1767318602.225018:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305536
00000100:00100000:2.0:1767318602.225035:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390
00000100:00100000:2.0:1767318602.225039:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940305280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318602.225062:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318602.225096:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940305280:12345-0@lo:38:kworker.0 Request processed in 55us (187us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318602.225101:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390
00000100:00100000:2.0:1767318602.225112:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391
00000100:00100000:2.0:1767318602.225115:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940305536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318602.225124:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318602.225145:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940305536:12345-0@lo:38:kworker.0 Request processed in 28us (186us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318602.225151:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391
00000100:00080000:2.0:1767318602.225180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318602.225185:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318602.225188:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940305280:0@lo:38:kworker.0
00000100:00080000:2.0:1767318602.225196:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318602.225199:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318602.225202:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940305536:0@lo:38:kworker.0
00000100:00100000:2.0:1767318602.225246:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940305024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318602.225641:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940304768:12345-0@lo:38:kworker.0 Request processed in 1768us (3335us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318602.225649:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980
00000100:00080000:2.0:1767318602.229211:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318602.229225:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318602.229230:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940304768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318602.235390:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940304896:12345-0@lo:400:kworker.0 Request processed in 12458us (12950us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318602.235409:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618
00000100:00100000:2.0:1767318602.235625:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940304896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318602.861164:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318603.181941:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318603.890805:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318604.205295:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318604.908848:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318605.229949:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318605.805256:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318605.805391:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940305664:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318605.805614:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318605.806170:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305664
00000100:00100000:0.0:1767318605.806180:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305664
00000100:00100000:0.0:1767318605.806286:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142
00000100:00100000:0.0:1767318605.806296:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940305664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318605.806327:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318605.806396:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940305664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (781us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318605.806417:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142
00000100:00100000:3.0:1767318605.806614:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940305664:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318605.806897:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318605.899235:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318605.899479:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318605.901614:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271616
00000100:00100000:3.0:1767318605.901634:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271616
00000100:00080000:0.0:1767318605.901827:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318605.902048:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271488
00000100:00100000:0.0:1767318605.902064:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271488
00000100:00100000:1.0:1767318605.902346:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3986
00000100:00100000:1.0:1767318605.902361:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894271616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318605.905161:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16392
00000100:00100000:2.0:1767318605.905181:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894271488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318605.905215:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318605.905311:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894271488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 133us (5832us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318605.905319:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16392
00000100:00100000:1.0:1767318605.912425:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894271616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 10049us (13182us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318605.912443:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3986
00000100:00100000:2.0:1767318605.932978:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318606.254729:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318606.317627:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318581/real 1767318581]  req@ffff93d0737fb100 x1853163940299648/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318606.317668:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0737fb100 x1853163940299648/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318606.317688:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318606.317712:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318606.317716:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940299648:0@lo:250:kworker.0
00000100:00080000:3.0:1767318606.318534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318606.318555:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318606.318558:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318606.318564:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3831
00000100:00080000:3.0:1767318606.318569:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318606.318577:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318606.318619:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940305792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318606.318650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318606.318654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318606.318656:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318606.318660:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3852
00000100:00080000:3.0:1767318606.318663:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318606.318667:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318606.318685:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940305920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318606.318694:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318606.318697:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318606.318699:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318606.318703:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3852
00000100:00080000:3.0:1767318606.318704:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318606.318707:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318606.318718:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964a80 x1853163940306048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318606.318764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318606.318768:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318606.318769:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318606.318790:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3852
00000100:00080000:3.0:1767318606.318792:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318606.318797:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318606.318809:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02680 x1853163940306560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318606.318826:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318606.318829:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318606.318831:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318606.318834:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3852
00000100:00080000:3.0:1767318606.318837:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318606.318840:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318606.318850:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00e00 x1853163940306816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318606.318886:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940306432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318606.318934:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940306176:0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.318995:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318606.318996:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.319081:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940305792:0@lo:250:kworker.0
00000100:00100000:2.0:1767318606.319163:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940306688:0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.319577:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318606.319585:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940306304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.319613:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318606.319767:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306176
00000100:00100000:3.0:1767318606.319809:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306176
00000100:00100000:3.0:1767318606.319870:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306304
00000100:00100000:3.0:1767318606.319873:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306304
00000100:00100000:3.0:1767318606.319913:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619
00000100:00100000:3.0:1767318606.319923:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940306176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.320854:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940306176:12345-0@lo:400:kworker.0 Request processed in 926us (1855us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318606.320865:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619
00000100:00100000:3.0:1767318606.320897:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620
00000100:00100000:3.0:1767318606.320907:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940306304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.320954:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940306304:12345-0@lo:400:kworker.0 Request processed in 50us (1340us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318606.320975:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620
00000100:00100000:3.0:1767318606.321039:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940306304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.321126:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306432
00000100:00100000:3.0:1767318606.321132:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306432
00000100:00100000:3.0:1767318606.321175:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987
00000100:00100000:3.0:1767318606.321183:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940306432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318606.321224:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940306432:12345-0@lo:400:kworker.0 Request processed in 42us (2232us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318606.321230:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987
00000100:00100000:3.0:1767318606.321259:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940306432:0@lo:400:kworker.0
00000100:00080000:3.0:1767318606.321296:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318606.321301:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318606.326503:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940306176:0@lo:400:kworker.0
00000400:00000100:1.0:1767318606.326503:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940305792 offset 0 length 520: 4
00000100:00100000:1.0:1767318606.326572:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940305920:0@lo:38:kworker.0
00000100:00100000:1.0:1767318606.326631:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.326656:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940306048:0@lo:38:kworker.0
00000100:00100000:1.0:1767318606.326680:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.326706:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940306560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318606.326729:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.326754:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940306816:0@lo:38:kworker.0
00000100:00100000:1.0:1767318606.326791:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.326840:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940305920
00000100:00100000:1.0:1767318606.326848:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940305920
00000100:00100000:1.0:1767318606.326886:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306560
00000100:00100000:1.0:1767318606.326889:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306560
00000100:00100000:1.0:1767318606.326904:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306816
00000100:00100000:1.0:1767318606.326907:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306816
00000100:00100000:1.0:1767318606.326929:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393
00000100:00100000:1.0:1767318606.326937:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940305920:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318606.327401:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306048
00000100:00100000:0.0:1767318606.327407:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306048
00000100:00100000:0.0:1767318606.327437:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981
00000100:00100000:0.0:1767318606.327443:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940306048:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318606.327508:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394
00000100:00100000:3.0:1767318606.327515:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940306560:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318606.328192:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318606.328277:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940305920:12345-0@lo:38:kworker.0 Request processed in 1338us (1644us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318606.328285:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393
00000100:00100000:1.0:1767318606.328310:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16395
00000100:00100000:1.0:1767318606.328315:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940306816:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318606.328404:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318606.328433:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306688
00000100:00100000:2.0:1767318606.328438:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306688
00000100:00100000:2.0:1767318606.328494:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988
00000100:00100000:2.0:1767318606.328502:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940306688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318606.328552:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940306688:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318606.328559:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988
00000100:00080000:2.0:1767318606.328576:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318606.328608:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940306688:0@lo:400:kworker.0
00010000:00020000:0.0:1767318606.332543:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318606.332674:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940306048:12345-0@lo:38:kworker.0 Request processed in 5225us (5987us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318606.332690:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981
00000100:00080000:0.0:1767318606.333199:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318606.333206:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318606.333210:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940305920:0@lo:38:kworker.0
00000100:00080000:0.0:1767318606.333225:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318606.333228:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318606.333231:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940306048:0@lo:38:kworker.0
00010000:00020000:3.0:1767318606.333807:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318606.333884:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940306560:12345-0@lo:38:kworker.0 Request processed in 6367us (7152us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318606.333894:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16394
00000100:00080000:0.0:1767318606.333937:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318606.333942:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318606.333946:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940306560:0@lo:38:kworker.0
00010000:00020000:1.0:1767318606.335511:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318606.335807:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940306816:12345-0@lo:38:kworker.0 Request processed in 7486us (9011us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318606.335820:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16395
00000100:00080000:0.0:1767318606.336164:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318606.336171:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318606.336175:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940306816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318606.829189:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940306944:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318606.829273:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318606.829444:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940306944
00000100:00100000:1.0:1767318606.829454:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940306944
00000100:00100000:1.0:1767318606.829514:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143
00000100:00100000:1.0:1767318606.829524:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940306944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318606.829558:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318606.829616:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940306944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318606.829623:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143
00000100:00100000:3.0:1767318606.831051:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940306944:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318606.960140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318607.277099:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318607.981917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318608.301270:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318609.005713:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318609.325459:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318610.029636:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318610.349535:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318610.925272:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318610.925307:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940307072:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318610.925591:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318610.926354:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307072
00000100:00100000:1.0:1767318610.926367:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307072
00000100:00100000:1.0:1767318610.926524:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144
00000100:00100000:1.0:1767318610.926536:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940307072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318610.926578:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318610.926676:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940307072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (1184us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318610.926684:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144
00000100:00100000:0.0:1767318610.926908:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940307072:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318610.927367:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318611.016250:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318611.016336:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318611.020045:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271872
00000100:00100000:2.0:1767318611.020059:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271872
00000100:00100000:2.0:1767318611.020218:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894271744
00000100:00080000:3.0:1767318611.020221:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318611.020223:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894271744
00000100:00100000:2.0:1767318611.020253:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3989
00000100:00100000:2.0:1767318611.020265:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894271872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318611.020266:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16396
00000100:00100000:3.0:1767318611.020279:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894271744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318611.020303:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318611.020629:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894271744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 348us (4290us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318611.020640:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16396
00000100:00100000:2.0:1767318611.020642:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894271872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 375us (4399us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318611.020654:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3989
00000100:00100000:2.0:1767318611.061106:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318611.373170:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318611.437356:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318611.437370:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318611.437373:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318611.437377:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318611.437383:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318611.437392:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3856
00000100:00080000:2.0:1767318611.437397:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318611.437405:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318611.437461:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940307200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318611.437493:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318611.437497:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318611.437499:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318611.437503:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3856
00000100:00080000:2.0:1767318611.437505:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318611.437509:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318611.437526:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeadf80 x1853163940307328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318611.437595:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318611.437599:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318611.437601:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318611.437604:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3856
00000100:00080000:2.0:1767318611.437607:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318611.437612:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318611.437622:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940307840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318611.437638:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318611.437641:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318611.437643:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318611.437647:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3856
00000100:00080000:2.0:1767318611.437649:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318611.437653:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318611.437663:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb480 x1853163940308096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318611.437689:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940307584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318611.437814:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318611.437892:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318611.437898:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940307712:0@lo:400:kworker.0
00000100:00100000:2.0:1767318611.437924:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318611.438605:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940307200:0@lo:38:kworker.0
00000100:00100000:0.0:1767318611.438648:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318611.438738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940307328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318611.438766:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318611.438817:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940307840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318611.438853:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318611.438870:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940308096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318611.438890:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318611.438930:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307328
00000100:00100000:0.0:1767318611.438938:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307328
00000100:00100000:0.0:1767318611.438988:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982
00000100:00100000:0.0:1767318611.438995:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940307328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318611.439019:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318611.439585:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940307328:12345-0@lo:38:kworker.0 Request processed in 587us (816us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318611.439594:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982
00000100:00100000:0.0:1767318611.439629:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307712
00000100:00100000:0.0:1767318611.439633:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307712
00000100:00100000:0.0:1767318611.439675:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307200
00000100:00100000:0.0:1767318611.439678:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307200
00000100:00100000:0.0:1767318611.439691:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307840
00000100:00100000:0.0:1767318611.439694:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307840
00000100:00100000:0.0:1767318611.439702:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308096
00000100:00100000:0.0:1767318611.439704:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308096
00000100:00100000:0.0:1767318611.439818:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990
00000100:00100000:0.0:1767318611.439825:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940307712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.439922:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940307968:0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.439971:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318611.439996:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318611.440003:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940307456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.440031:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318611.440072:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307968
00000100:00100000:1.0:1767318611.440077:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307968
00000100:00100000:1.0:1767318611.440104:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991
00000100:00100000:1.0:1767318611.440110:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940307968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.440159:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940307968:12345-0@lo:400:kworker.0 Request processed in 48us (187us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318611.440165:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991
00000100:00100000:1.0:1767318611.440181:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16397
00000100:00100000:1.0:1767318611.440185:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940307200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318611.440201:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318611.440237:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940307200:12345-0@lo:38:kworker.0 Request processed in 49us (1588us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318611.440242:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16397
00000100:00100000:1.0:1767318611.440255:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16398
00000100:00100000:1.0:1767318611.440259:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940307840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318611.440269:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318611.440291:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940307840:12345-0@lo:38:kworker.0 Request processed in 31us (1438us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318611.440298:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16398
00000100:00100000:1.0:1767318611.440310:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16399
00000100:00100000:1.0:1767318611.440314:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940308096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318611.440324:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318611.440364:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940308096:12345-0@lo:38:kworker.0 Request processed in 48us (1472us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318611.440369:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16399
00000100:00100000:1.0:1767318611.440408:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940307968:0@lo:400:kworker.0
00000100:00080000:1.0:1767318611.440460:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318611.440466:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318611.440470:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940307200:0@lo:38:kworker.0
00000100:00080000:1.0:1767318611.440480:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318611.440483:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318611.440487:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940307328:0@lo:38:kworker.0
00000100:00080000:1.0:1767318611.440496:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318611.440499:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318611.440501:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940307840:0@lo:38:kworker.0
00000100:00080000:1.0:1767318611.440510:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318611.440513:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318611.440516:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940308096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318611.441566:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940307712:12345-0@lo:400:kworker.0 Request processed in 1738us (3637us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318611.441575:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990
00000100:00100000:3.0:1767318611.441698:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307584
00000100:00100000:3.0:1767318611.441716:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307584
00000100:00100000:3.0:1767318611.441765:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940307456
00000100:00100000:3.0:1767318611.441769:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940307456
00000100:00100000:3.0:1767318611.441811:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621
00000100:00100000:3.0:1767318611.441819:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940307584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318611.442176:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940307584:12345-0@lo:400:kworker.0 Request processed in 357us (4361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318611.442184:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621
00000100:00100000:3.0:1767318611.442203:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622
00000100:00100000:3.0:1767318611.442210:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940307456:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318611.442412:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318611.442419:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318611.442671:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940307712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.442692:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940307584:0@lo:400:kworker.0
00000100:00100000:3.0:1767318611.443497:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940307456:12345-0@lo:400:kworker.0 Request processed in 1283us (3461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318611.443509:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622
00000100:00100000:1.0:1767318611.445200:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940307456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318611.949207:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318611.949235:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940308224:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318611.949328:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318611.950397:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308224
00000100:00100000:3.0:1767318611.950408:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308224
00000100:00100000:3.0:1767318611.950475:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145
00000100:00100000:3.0:1767318611.950485:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940308224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318611.950522:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318611.950607:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940308224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1278us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318611.950615:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145
00000100:00100000:2.0:1767318611.950730:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940308224:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318612.078769:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318612.397311:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318613.101855:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318613.427571:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318614.127105:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318614.445211:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318615.148953:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318615.469286:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318616.046289:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318616.046315:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940308352:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318616.046392:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318616.046609:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308352
00000100:00100000:1.0:1767318616.046619:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308352
00000100:00100000:1.0:1767318616.046689:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146
00000100:00100000:1.0:1767318616.046698:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940308352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318616.046726:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318616.046798:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940308352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318616.046805:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146
00000100:00100000:1.0:1767318616.046866:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940308352:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318616.047053:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318616.135215:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318616.135260:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318616.135452:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272000
00000100:00100000:3.0:1767318616.135465:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272000
00000100:00100000:3.0:1767318616.135605:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272128
00000100:00100000:3.0:1767318616.135610:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272128
00000100:00080000:1.0:1767318616.135702:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318616.136274:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3992
00000100:00100000:2.0:1767318616.136289:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318616.136440:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 155us (1177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318616.136455:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3992
00000100:00100000:2.0:1767318616.136481:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16400
00000100:00100000:2.0:1767318616.136486:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894272000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318616.136510:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.136541:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894272000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (1339us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.136548:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16400
00000100:00100000:2.0:1767318616.174729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318616.493372:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318616.557280:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318616.557290:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318616.557292:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318616.557295:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318616.557300:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318616.557308:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3861
00000100:00080000:2.0:1767318616.557313:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318616.557319:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318616.557361:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47172680 x1853163940308480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318616.557375:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318616.557377:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318616.557387:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318616.557390:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3861
00000100:00080000:2.0:1767318616.557391:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318616.557395:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318616.557406:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940308608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318616.557494:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940308736:0@lo:400:kworker.0
00000100:00100000:0.0:1767318616.557573:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318616.557690:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308736
00000100:00100000:3.0:1767318616.557699:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308736
00000100:00100000:3.0:1767318616.557763:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623
00000100:00100000:3.0:1767318616.557771:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940308736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318616.557885:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940308480:0@lo:38:kworker.0
00000100:00100000:1.0:1767318616.557925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318616.557946:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940308608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318616.557974:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318616.558004:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318616.558009:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318616.558011:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318616.558015:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3861
00000100:00100000:1.0:1767318616.558018:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308608
00000100:00080000:2.0:1767318616.558018:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318616.558022:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308608
00000100:00080000:2.0:1767318616.558022:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318616.558034:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171c00 x1853163940308992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318616.558046:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983
00000100:00100000:1.0:1767318616.558052:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940308608:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767318616.558053:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318616.558056:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318616.558058:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318616.558060:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3861
00000100:00080000:2.0:1767318616.558063:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318616.558066:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00010000:00020000:1.0:1767318616.558071:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.558078:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170380 x1853163940309248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318616.558100:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940308608:12345-0@lo:38:kworker.0 Request processed in 47us (125us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.558102:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940308864:0@lo:400:kworker.0
00000100:00100000:1.0:1767318616.558108:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983
00000100:00100000:1.0:1767318616.558127:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940308992:0@lo:38:kworker.0
00000100:00100000:2.0:1767318616.558127:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318616.558145:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318616.558150:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940309120:0@lo:400:kworker.0
00000100:00100000:1.0:1767318616.558161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318616.558178:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308480
00000100:00100000:1.0:1767318616.558179:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940309248:0@lo:38:kworker.0
00000100:00100000:2.0:1767318616.558182:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308480
00000100:00100000:1.0:1767318616.558198:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318616.558528:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318616.558534:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318616.558537:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940308608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318616.558570:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318616.558701:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940308736:12345-0@lo:400:kworker.0 Request processed in 929us (1126us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318616.558710:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623
00000100:00100000:0.0:1767318616.558835:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940308736:0@lo:400:kworker.0
00000100:00100000:2.0:1767318616.562502:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308864
00000100:00100000:2.0:1767318616.562519:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308864
00000100:00100000:2.0:1767318616.563186:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940308992
00000100:00100000:2.0:1767318616.563191:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940308992
00000100:00100000:2.0:1767318616.563202:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309248
00000100:00100000:2.0:1767318616.563204:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309248
00000100:00100000:2.0:1767318616.563218:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993
00000100:00100000:2.0:1767318616.563228:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940308864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318616.563315:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940308864:12345-0@lo:400:kworker.0 Request processed in 89us (5187us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318616.563323:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993
00000100:00100000:2.0:1767318616.563340:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401
00000100:00100000:2.0:1767318616.563345:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940308480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318616.563365:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.563419:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940308480:12345-0@lo:38:kworker.0 Request processed in 72us (5493us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.563425:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401
00000100:00100000:2.0:1767318616.563438:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16402
00000100:00100000:2.0:1767318616.563442:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940308992:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318616.563451:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.563474:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940308992:12345-0@lo:38:kworker.0 Request processed in 31us (5313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.563480:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16402
00000100:00100000:2.0:1767318616.563490:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16403
00000100:00100000:2.0:1767318616.563494:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940309248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318616.563502:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.563524:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940309248:12345-0@lo:38:kworker.0 Request processed in 29us (5325us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.563529:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16403
00000100:00080000:2.0:1767318616.563856:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318616.563862:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318616.563866:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940308992:0@lo:38:kworker.0
00000100:00080000:2.0:1767318616.563876:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318616.563879:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318616.563881:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940309248:0@lo:38:kworker.0
00000100:00080000:2.0:1767318616.563890:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318616.563893:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318616.563895:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940308480:0@lo:38:kworker.0
00000100:00080000:2.0:1767318616.564062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318616.564068:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318616.574438:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309120
00000100:00100000:3.0:1767318616.574457:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309120
00000100:00080000:3.0:1767318616.574512:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318616.574524:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940308864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318616.574577:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994
00000100:00100000:3.0:1767318616.574587:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940309120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318616.574662:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940309120:12345-0@lo:400:kworker.0 Request processed in 76us (16090us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318616.574670:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994
00000100:00100000:1.0:1767318616.575240:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940309120:0@lo:400:kworker.0
00000100:00100000:0.0:1767318617.069167:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318617.069198:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940309376:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318617.069273:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318617.069426:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309376
00000100:00100000:1.0:1767318617.069435:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309376
00000100:00100000:1.0:1767318617.069491:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147
00000100:00100000:1.0:1767318617.069501:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940309376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318617.069536:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318617.069600:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940309376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318617.069608:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147
00000100:00100000:3.0:1767318617.069870:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940309376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318617.199493:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318617.517042:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318618.221641:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318618.541859:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318619.246320:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318619.565090:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318620.272012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318620.589174:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318621.165360:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940309504:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318621.165441:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318621.168665:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309504
00000100:00100000:0.0:1767318621.168681:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309504
00000100:00100000:0.0:1767318621.169173:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148
00000100:00100000:0.0:1767318621.169184:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940309504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318621.169217:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318621.169306:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940309504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (3865us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318621.169314:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148
00000100:00100000:2.0:1767318621.169549:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940309504:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318621.170977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318621.254301:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318621.254350:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318621.254406:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272256
00000100:00100000:0.0:1767318621.254415:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272256
00000100:00100000:0.0:1767318621.254593:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272384
00000100:00100000:0.0:1767318621.254597:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272384
00000100:00080000:3.0:1767318621.254685:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318621.259242:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3995
00000100:00100000:1.0:1767318621.259280:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272384:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318621.259340:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16404
00000100:00100000:1.0:1767318621.259367:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272384:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 103us (5015us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318621.259374:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3995
00000100:00100000:2.0:1767318621.259426:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894272256:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318621.259454:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318621.259488:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894272256:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 138us (5199us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318621.259494:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16404
00000100:00100000:2.0:1767318621.293456:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318621.613188:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318621.678224:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318621.678235:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318621.678238:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318621.678242:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318621.678247:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318621.678255:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3866
00000100:00080000:0.0:1767318621.678260:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318621.678267:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318621.678311:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940309632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318621.678342:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318621.678345:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318621.678347:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318621.678351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3866
00000100:00080000:0.0:1767318621.678353:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318621.678357:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318621.678375:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940309760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318621.678429:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318621.678432:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318621.678434:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318621.678437:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3866
00000100:00080000:0.0:1767318621.678440:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318621.678444:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318621.678455:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b480 x1853163940310144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318621.678472:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940310016:0@lo:400:kworker.0
00000100:00080000:0.0:1767318621.678482:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318621.678486:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318621.678488:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318621.678491:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3866
00000100:00080000:0.0:1767318621.678494:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318621.678497:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318621.678508:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45408380 x1853163940310400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318621.678544:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318621.678623:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318621.678630:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940309888:0@lo:400:kworker.0
00000100:00100000:2.0:1767318621.678652:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940310272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318621.678659:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318621.678690:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318621.678823:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310016
00000100:00100000:0.0:1767318621.678832:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310016
00000100:00100000:0.0:1767318621.678899:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310272
00000100:00100000:0.0:1767318621.678902:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310272
00000100:00100000:0.0:1767318621.678927:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996
00000100:00100000:0.0:1767318621.678936:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940310016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318621.678994:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940310016:12345-0@lo:400:kworker.0 Request processed in 59us (450us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318621.679013:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996
00000100:00100000:0.0:1767318621.679028:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997
00000100:00100000:0.0:1767318621.679032:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940310272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318621.679059:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940310272:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318621.679065:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997
00000100:00100000:0.0:1767318621.679083:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309888
00000100:00100000:0.0:1767318621.679087:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309888
00000100:00100000:0.0:1767318621.679113:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624
00000100:00100000:0.0:1767318621.679118:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940309888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318621.679146:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940309888:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318621.679152:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624
00000100:00100000:0.0:1767318621.679205:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940309888:0@lo:400:kworker.0
00000100:00100000:0.0:1767318621.679217:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940310016:0@lo:400:kworker.0
00000100:00100000:2.0:1767318621.679295:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940310272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318621.679316:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940309632:0@lo:38:kworker.0
00000100:00100000:1.0:1767318621.679350:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318621.679380:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940309760:0@lo:38:kworker.0
00000100:00100000:1.0:1767318621.679403:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318621.679430:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940310144:0@lo:38:kworker.0
00000100:00100000:1.0:1767318621.679451:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318621.679463:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940310400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318621.679479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318621.679509:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318621.679516:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318621.679795:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309632
00000100:00100000:2.0:1767318621.679809:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309632
00000100:00100000:2.0:1767318621.679841:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310144
00000100:00100000:2.0:1767318621.679844:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310144
00000100:00100000:2.0:1767318621.679875:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310400
00000100:00100000:2.0:1767318621.679878:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310400
00000100:00100000:2.0:1767318621.679895:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16405
00000100:00100000:2.0:1767318621.679901:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940309632:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318621.679907:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16406
00000100:00100000:3.0:1767318621.679914:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940310144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318621.679922:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767318621.679928:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318621.679970:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940309632:12345-0@lo:38:kworker.0 Request processed in 68us (619us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318621.679976:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16405
00000100:00100000:2.0:1767318621.679987:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16407
00000100:00100000:2.0:1767318621.679993:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940310400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318621.680000:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318621.680016:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940309760
00000100:00100000:0.0:1767318621.680021:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940309760
00000100:00100000:0.0:1767318621.680050:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984
00000100:00100000:0.0:1767318621.680056:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940309760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318621.680067:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318621.682454:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940310144:12345-0@lo:38:kworker.0 Request processed in 2524us (2986us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318621.682469:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16406
00000100:00100000:2.0:1767318621.687610:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940310400:12345-0@lo:38:kworker.0 Request processed in 7601us (8114us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318621.687727:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16407
00000100:00100000:0.0:1767318621.693220:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940309760:12345-0@lo:38:kworker.0 Request processed in 13150us (13802us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318621.693239:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984
00000100:00080000:1.0:1767318621.693371:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318621.693379:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318621.693384:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940309632:0@lo:38:kworker.0
00000100:00080000:1.0:1767318621.693407:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318621.693411:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318621.693415:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940309760:0@lo:38:kworker.0
00000100:00080000:1.0:1767318621.693426:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318621.693429:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318621.693432:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940310144:0@lo:38:kworker.0
00000100:00080000:1.0:1767318621.693441:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318621.693443:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318621.693446:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940310400:0@lo:38:kworker.0
00000100:00100000:0.0:1767318622.189839:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318622.192489:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940310528:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318622.192939:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318622.193834:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310528
00000100:00100000:1.0:1767318622.193848:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310528
00000100:00100000:1.0:1767318622.193929:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149
00000100:00100000:1.0:1767318622.193940:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940310528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318622.193977:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318622.194060:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940310528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1121us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318622.194067:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149
00000100:00100000:0.0:1767318622.196155:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940310528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318622.316997:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318622.640576:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318623.344800:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318623.664080:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318624.364926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318624.685012:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1767318625.351193:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894272512 offset 0 length 520: 4
00000100:00100000:1.0:1767318625.351255:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318625.351295:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318625.351636:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272640
00000100:00100000:2.0:1767318625.351647:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272640
00000100:00100000:2.0:1767318625.351702:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272768
00000100:00100000:2.0:1767318625.351706:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272768
00000100:00100000:2.0:1767318625.351768:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3998
00000100:00100000:2.0:1767318625.351822:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318625.351911:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894272768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (613us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318625.351919:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3998
00000100:00100000:2.0:1767318625.351938:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16408
00000100:00100000:2.0:1767318625.351943:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894272640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318625.351966:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318625.351994:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894272640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (739us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318625.351999:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16408
00000100:00080000:2.0:1767318625.353253:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318625.388989:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318625.709598:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318626.285457:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318626.287008:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940310656:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318626.287079:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318626.288397:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310656
00000100:00100000:1.0:1767318626.288409:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310656
00000100:00100000:1.0:1767318626.288478:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150
00000100:00100000:1.0:1767318626.288487:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940310656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318626.288520:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767318626.288714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318626.288759:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940310656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 272us (1677us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318626.288766:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150
00000100:00100000:3.0:1767318626.288901:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940310656:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318626.412986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318626.733324:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318626.796932:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318626.796945:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318626.796948:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318626.796952:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318626.796957:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318626.796966:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3871
00000100:00080000:0.0:1767318626.796971:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318626.798267:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318626.798325:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b100 x1853163940310784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318626.798365:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318626.798369:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318626.798372:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318626.798376:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3871
00000100:00080000:0.0:1767318626.798380:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318626.798384:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318626.798397:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409880 x1853163940310912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318626.798430:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940310784:0@lo:38:kworker.0
00000100:00100000:2.0:1767318626.798510:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318626.798594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940310912:0@lo:38:kworker.0
00000100:00100000:2.0:1767318626.798625:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318626.798806:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310912
00000100:00100000:3.0:1767318626.798815:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310912
00000100:00100000:3.0:1767318626.798882:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985
00000100:00100000:3.0:1767318626.798890:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940310912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318626.798914:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318626.798961:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940310912:12345-0@lo:38:kworker.0 Request processed in 70us (335us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318626.798968:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985
00000100:00080000:2.0:1767318626.800285:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318626.800295:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318626.800301:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940310912:0@lo:38:kworker.0
00000100:00080000:0.0:1767318626.801956:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318626.801962:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318626.801965:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318626.801972:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3871
00000100:00080000:0.0:1767318626.801989:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318626.802002:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318626.802027:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409880 x1853163940311296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318626.802055:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318626.802058:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318626.802060:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318626.802063:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3871
00000100:00080000:0.0:1767318626.802065:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318626.802068:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318626.802078:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b480 x1853163940311552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318626.802090:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940310784
00000100:00100000:1.0:1767318626.802098:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940310784
00000100:00100000:1.0:1767318626.802139:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16409
00000100:00100000:1.0:1767318626.802146:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940310784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318626.802166:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318626.802235:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940310784:12345-0@lo:38:kworker.0 Request processed in 88us (3726us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318626.802241:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16409
00000100:00100000:1.0:1767318626.802302:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940311168:0@lo:400:kworker.0
00000100:00100000:1.0:1767318626.802343:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318626.802378:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318626.802384:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940311424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318626.802404:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318626.802426:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318626.802435:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940311040:0@lo:400:kworker.0
00000100:00100000:1.0:1767318626.802466:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318626.802500:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311040
00000100:00100000:1.0:1767318626.802504:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311040
00000100:00100000:1.0:1767318626.802546:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625
00000100:00100000:1.0:1767318626.802553:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940311040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318626.802597:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940311040:12345-0@lo:400:kworker.0 Request processed in 44us (129us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318626.802605:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625
00000100:00100000:1.0:1767318626.802629:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311168
00000100:00100000:1.0:1767318626.802644:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311168
00000100:00100000:1.0:1767318626.802671:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311424
00000100:00100000:1.0:1767318626.802674:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311424
00000100:00100000:1.0:1767318626.802693:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999
00000100:00100000:1.0:1767318626.802700:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940311168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318626.803617:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940311168:12345-0@lo:400:kworker.0 Request processed in 912us (1269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318626.803628:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999
00000100:00080000:2.0:1767318626.803767:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318626.803788:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318626.804645:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000
00000100:00100000:3.0:1767318626.804663:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940311424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318626.804737:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940311424:12345-0@lo:400:kworker.0 Request processed in 83us (2331us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318626.804743:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000
00000100:00100000:3.0:1767318626.804813:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940311296:0@lo:38:kworker.0
00000100:00100000:3.0:1767318626.804866:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318626.804892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940311552:0@lo:38:kworker.0
00000100:00100000:3.0:1767318626.804917:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318626.804966:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318626.804982:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318626.804986:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940310784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318626.805029:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311296
00000100:00100000:3.0:1767318626.805035:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311296
00000100:00100000:3.0:1767318626.805063:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311552
00000100:00100000:3.0:1767318626.805066:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311552
00000100:00100000:3.0:1767318626.805077:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16410
00000100:00100000:3.0:1767318626.805099:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940311296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318626.805125:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318626.805160:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940311296:12345-0@lo:38:kworker.0 Request processed in 59us (295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318626.805166:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16410
00000100:00100000:3.0:1767318626.805180:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16411
00000100:00100000:3.0:1767318626.805183:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940311552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318626.805192:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318626.805226:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940311552:12345-0@lo:38:kworker.0 Request processed in 41us (308us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318626.805233:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16411
00000100:00080000:3.0:1767318626.805255:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318626.805259:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318626.805262:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940311296:0@lo:38:kworker.0
00000100:00080000:3.0:1767318626.805268:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318626.805271:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318626.805274:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940311552:0@lo:38:kworker.0
00000100:00100000:3.0:1767318626.805321:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940311040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318626.805347:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940311424:0@lo:400:kworker.0
00000100:00100000:3.0:1767318626.805360:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940311168:0@lo:400:kworker.0
00000100:00100000:2.0:1767318627.313163:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318627.313189:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940311680:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318627.313267:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318627.313744:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311680
00000100:00100000:3.0:1767318627.313754:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311680
00000100:00100000:3.0:1767318627.313856:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151
00000100:00100000:3.0:1767318627.313868:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940311680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318627.313909:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318627.313977:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940311680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (708us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318627.313983:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151
00000100:00100000:2.0:1767318627.314193:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940311680:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318627.436960:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318627.757371:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318628.460972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318628.781020:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318629.489820:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318629.805021:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318630.474038:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318630.474137:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894272896
00000100:00100000:2.0:1767318630.474148:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894272896
00000100:00100000:2.0:1767318630.474291:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16412
00000100:00100000:2.0:1767318630.474300:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894272896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318630.474331:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318630.474414:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894272896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 114us (389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318630.474422:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16412
00000100:00100000:1.0:1767318630.488067:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318630.488193:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273024
00000100:00100000:0.0:1767318630.488204:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273024
00000100:00100000:0.0:1767318630.488288:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4001
00000100:00100000:0.0:1767318630.488298:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318630.488382:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318630.488390:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4001
00000100:00080000:2.0:1767318630.488522:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318630.508935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318630.829344:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318631.407025:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940311808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318631.407111:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318631.416083:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940311808
00000100:00100000:0.0:1767318631.416101:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940311808
00000100:00100000:0.0:1767318631.416193:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152
00000100:00100000:0.0:1767318631.416203:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940311808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318631.416237:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318631.416359:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318631.420712:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940311808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4494us (13585us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318631.420730:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152
00000100:00100000:2.0:1767318631.424903:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940311808:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318631.532968:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318631.854128:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318631.916977:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318606/real 1767318606]  req@ffff93cf47964380 x1853163940305792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318631.917014:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47964380 x1853163940305792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318631.917035:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318631.917045:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318631.917050:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940305792:0@lo:250:kworker.0
00000100:00080000:2.0:1767318631.917218:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318631.917224:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318631.917227:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318631.917231:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3856
00000100:00080000:2.0:1767318631.917236:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318631.917242:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318631.917276:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47172300 x1853163940311936/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318631.917301:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318631.917304:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318631.917306:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318631.917309:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3876
00000100:00080000:2.0:1767318631.917311:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318631.917315:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318631.917332:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173b80 x1853163940312064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318631.917351:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318631.917355:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318631.917356:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318631.917360:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3876
00000100:00080000:2.0:1767318631.917362:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318631.917365:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318631.917377:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171f80 x1853163940312192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318631.917405:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318631.917408:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318631.917409:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318631.917412:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3876
00000100:00080000:2.0:1767318631.917414:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318631.917418:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318631.917430:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38700 x1853163940312576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318631.917450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318631.917453:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318631.917454:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318631.917457:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3876
00000100:00080000:2.0:1767318631.917458:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318631.917461:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318631.917470:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38e00 x1853163940312832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318631.917492:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940312704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318631.917537:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940312320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318631.917576:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318631.917584:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318631.917672:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940312448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318631.917701:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318631.917731:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940311936:0@lo:250:kworker.0
00000100:00100000:0.0:1767318631.917738:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312704
00000100:00100000:0.0:1767318631.917746:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312704
00000400:00000100:3.0:1767318631.917760:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940311936 offset 0 length 520: 4
00000100:00100000:0.0:1767318631.917823:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312448
00000100:00100000:0.0:1767318631.917827:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312448
00000100:00100000:3.0:1767318631.917845:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002
00000100:00100000:3.0:1767318631.917860:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940312704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318631.917926:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940312704:12345-0@lo:400:kworker.0 Request processed in 73us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318631.918006:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312320
00000100:00100000:1.0:1767318631.918011:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312320
00000100:00100000:1.0:1767318631.918043:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626
00000100:00100000:1.0:1767318631.918050:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940312320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318631.918083:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940312320:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318631.918089:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626
00000100:00080000:1.0:1767318631.918110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318631.918115:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318631.919135:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003
00000100:00100000:0.0:1767318631.919152:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940312448:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318631.919219:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940312448:12345-0@lo:400:kworker.0 Request processed in 75us (1516us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318631.919225:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003
00000100:00100000:2.0:1767318631.919335:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940312320:0@lo:400:kworker.0
00000100:00100000:2.0:1767318631.919389:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940312704:0@lo:400:kworker.0
00000100:00100000:2.0:1767318631.919622:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940312064:0@lo:38:kworker.0
00000100:00100000:2.0:1767318631.919670:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318631.919696:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940312192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318631.919721:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318631.919740:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940312576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318631.919758:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318631.919873:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312064
00000100:00100000:1.0:1767318631.919879:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312064
00000100:00100000:1.0:1767318631.919906:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312576
00000100:00100000:1.0:1767318631.919910:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312576
00000100:00100000:1.0:1767318631.919928:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16413
00000100:00100000:1.0:1767318631.919933:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940312064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318631.919951:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318631.920177:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940312832:0@lo:38:kworker.0
00000100:00100000:2.0:1767318631.920204:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318631.920276:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940312448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318631.920301:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312832
00000100:00100000:0.0:1767318631.920304:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312832
00000100:00100000:0.0:1767318631.920319:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414
00000100:00100000:0.0:1767318631.920324:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940312576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318631.920334:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318631.920700:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002
00000100:00100000:3.0:1767318631.920725:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16415
00000100:00100000:3.0:1767318631.920729:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940312832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318631.920739:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318631.922857:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940312064:12345-0@lo:38:kworker.0 Request processed in 2913us (3177us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318631.922924:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318631.922931:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318631.922935:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940312064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318631.922968:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16413
00000100:00100000:1.0:1767318631.923047:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312192
00000100:00100000:1.0:1767318631.923054:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312192
00000100:00100000:1.0:1767318631.923087:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986
00000100:00100000:1.0:1767318631.923094:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940312192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318631.923115:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318631.923116:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940312576:12345-0@lo:38:kworker.0 Request processed in 2788us (3353us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318631.923129:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414
00000100:00100000:1.0:1767318631.923188:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940312192:12345-0@lo:38:kworker.0 Request processed in 93us (3465us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318631.923195:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986
00000100:00080000:2.0:1767318631.923224:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318631.923229:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318631.923232:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940312576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318631.931126:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940312832:12345-0@lo:38:kworker.0 Request processed in 10382us (10907us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318631.931142:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16415
00000100:00080000:0.0:1767318631.931348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318631.931354:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318631.931358:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940312832:0@lo:38:kworker.0
00000100:00080000:0.0:1767318631.931414:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318631.931419:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318631.931421:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940312192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318632.429340:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940312960:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318632.429435:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318632.429879:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940312960
00000100:00100000:1.0:1767318632.429888:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940312960
00000100:00100000:1.0:1767318632.429948:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153
00000100:00100000:1.0:1767318632.429957:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940312960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318632.429993:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318632.430062:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940312960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (627us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318632.430069:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153
00000100:00100000:2.0:1767318632.430552:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940312960:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318632.556982:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318632.883270:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318633.581328:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318633.901046:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318634.605709:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318634.925061:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318635.590338:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318635.590386:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318635.590483:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273280
00000100:00100000:3.0:1767318635.590495:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273280
00000100:00100000:3.0:1767318635.590579:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273152
00000100:00100000:3.0:1767318635.590583:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273152
00000100:00100000:3.0:1767318635.590601:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4004
00000100:00100000:3.0:1767318635.590613:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894273280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318635.590689:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894273280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (363us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318635.590696:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4004
00000100:00100000:3.0:1767318635.590719:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16416
00000100:00100000:3.0:1767318635.590724:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894273152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318635.590760:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318635.590811:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894273152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 84us (424us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318635.590817:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16416
00000100:00080000:1.0:1767318635.591372:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318635.629035:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318635.950685:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318636.527485:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940313088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318636.527560:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318636.527683:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313088
00000100:00100000:1.0:1767318636.527691:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313088
00000100:00100000:1.0:1767318636.527763:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154
00000100:00100000:1.0:1767318636.527798:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940313088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318636.527841:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318636.527890:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940313088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318636.527898:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154
00000100:00080000:0.0:1767318636.528050:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318636.528090:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940313088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318636.653622:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318636.973022:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318637.044271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318637.044282:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318637.044285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318637.044289:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318637.044294:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318637.044302:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3881
00000100:00080000:3.0:1767318637.044307:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318637.044314:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318637.044358:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940313216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318637.044378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318637.044381:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318637.044383:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318637.044387:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3881
00000100:00080000:3.0:1767318637.044390:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318637.044393:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318637.044408:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940313344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318637.044538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318637.044541:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318637.044543:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318637.044547:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3881
00000100:00080000:3.0:1767318637.044549:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318637.044553:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318637.044565:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470fd880 x1853163940313856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318637.044586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318637.044589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318637.044590:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318637.044593:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3881
00000100:00080000:3.0:1767318637.044595:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318637.044598:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318637.044608:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470ff800 x1853163940314112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318637.045649:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940313728:0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.045750:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.045930:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318637.045937:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940313600:0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.045966:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.046005:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313728
00000100:00100000:2.0:1767318637.046014:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313728
00000100:00100000:2.0:1767318637.046074:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005
00000100:00100000:2.0:1767318637.046085:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940313728:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.046137:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940313728:12345-0@lo:400:kworker.0 Request processed in 54us (387us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318637.046144:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005
00000100:00100000:2.0:1767318637.046167:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313600
00000100:00100000:2.0:1767318637.046171:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313600
00000100:00100000:2.0:1767318637.046197:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627
00000100:00100000:2.0:1767318637.046203:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940313600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.046229:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940313600:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318637.046234:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627
00000100:00080000:2.0:1767318637.046248:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318637.046252:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318637.046282:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940313600:0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.046291:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940313728:0@lo:400:kworker.0
00000100:00100000:2.0:1767318637.046334:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940313216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318637.046359:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.046376:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313216
00000100:00100000:2.0:1767318637.046379:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313216
00000100:00100000:2.0:1767318637.046399:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16417
00000100:00100000:2.0:1767318637.046404:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940313216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318637.046426:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318637.046453:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940313216:12345-0@lo:38:kworker.0 Request processed in 48us (94us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318637.046459:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16417
00000100:00080000:2.0:1767318637.047609:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318637.047620:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318637.047624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940313216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318637.047634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940313344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318637.047682:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.047704:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940313856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318637.047736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.047762:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313856
00000100:00100000:2.0:1767318637.047768:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313856
00000100:00100000:0.0:1767318637.048641:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940313472:0@lo:400:kworker.0
00000100:00100000:0.0:1767318637.048701:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318637.048747:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318637.048754:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940313984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318637.048799:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318637.049651:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313344
00000100:00100000:1.0:1767318637.049660:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313344
00000100:00100000:1.0:1767318637.049706:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987
00000100:00100000:1.0:1767318637.049714:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940313344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318637.049751:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318637.054034:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313984
00000100:00100000:0.0:1767318637.054052:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313984
00000100:00100000:0.0:1767318637.054134:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006
00000100:00100000:0.0:1767318637.054143:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940313984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318637.054243:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940313984:12345-0@lo:400:kworker.0 Request processed in 100us (5442us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318637.054250:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006
00000100:00100000:0.0:1767318637.054270:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418
00000100:00100000:0.0:1767318637.054275:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940313856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318637.054296:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318637.054327:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940313856:12345-0@lo:38:kworker.0 Request processed in 50us (6600us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318637.054333:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418
00000100:00100000:0.0:1767318637.054384:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940313984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318637.054890:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940313344:12345-0@lo:38:kworker.0 Request processed in 5174us (7204us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318637.054905:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987
00000100:00080000:3.0:1767318637.055303:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318637.055308:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318637.055312:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940313856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318637.055325:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940314112:0@lo:38:kworker.0
00000100:00100000:3.0:1767318637.055365:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318637.055416:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318637.055420:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318637.055423:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940313344:0@lo:38:kworker.0
00000100:00080000:3.0:1767318637.055454:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318637.055470:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940313472
00000100:00100000:3.0:1767318637.055487:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940313472
00000100:00100000:3.0:1767318637.055526:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628
00000100:00100000:3.0:1767318637.055534:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940313472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318637.055581:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940313472:12345-0@lo:400:kworker.0 Request processed in 48us (6879us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318637.055587:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628
00000100:00100000:0.0:1767318637.057975:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314112
00000100:00100000:0.0:1767318637.057992:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314112
00000100:00100000:0.0:1767318637.058045:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16419
00000100:00100000:0.0:1767318637.058053:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940314112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318637.058077:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318637.058158:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940314112:12345-0@lo:38:kworker.0 Request processed in 104us (2791us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318637.058165:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16419
00000100:00100000:0.0:1767318637.058222:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940313472:0@lo:400:kworker.0
00000100:00080000:0.0:1767318637.058261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318637.058267:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318637.058270:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940314112:0@lo:38:kworker.0
00000100:00100000:0.0:1767318637.549494:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318637.549519:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940314240:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318637.549590:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318637.549660:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314240
00000100:00100000:0.0:1767318637.549668:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314240
00000100:00100000:0.0:1767318637.549717:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155
00000100:00100000:0.0:1767318637.549740:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940314240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318637.549793:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318637.549847:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940314240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318637.549855:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155
00000100:00100000:0.0:1767318637.549906:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940314240:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318637.677514:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318637.997655:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318638.701482:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318639.031504:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318639.727426:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318640.045102:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318640.711285:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318640.711383:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318640.716456:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273536
00000100:00100000:2.0:1767318640.716472:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273536
00000100:00100000:2.0:1767318640.716543:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273408
00000100:00100000:2.0:1767318640.716547:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273408
00000100:00100000:2.0:1767318640.716577:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4007
00000100:00100000:2.0:1767318640.716587:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318640.716684:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 98us (5409us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318640.716703:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4007
00000100:00100000:2.0:1767318640.716725:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16420
00000100:00100000:2.0:1767318640.716730:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894273408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318640.716753:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318640.716804:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894273408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 71us (5420us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318640.716811:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16420
00000100:00080000:3.0:1767318640.717365:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318640.748904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318641.071398:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318641.645518:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940314368:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318641.645611:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318641.645759:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314368
00000100:00100000:2.0:1767318641.645768:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314368
00000100:00100000:2.0:1767318641.645875:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156
00000100:00100000:2.0:1767318641.645886:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940314368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318641.645921:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318641.646529:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318641.646753:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940314368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 866us (1139us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318641.646764:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156
00000100:00100000:0.0:1767318641.647378:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940314368:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318641.773908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318642.095126:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318642.160098:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318642.160109:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318642.160112:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318642.160117:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318642.160121:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318642.160128:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3887
00000100:00080000:3.0:1767318642.160133:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318642.160139:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318642.160180:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08000 x1853163940314496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318642.160198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318642.160201:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318642.160203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318642.160207:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3887
00000100:00080000:3.0:1767318642.160210:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318642.160214:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318642.160225:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08700 x1853163940314624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318642.160285:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318642.160289:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318642.160291:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318642.160295:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3887
00000100:00080000:3.0:1767318642.160297:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318642.160301:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318642.160312:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08380 x1853163940315136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318642.160327:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318642.160329:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318642.160345:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318642.160348:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3887
00000100:00080000:3.0:1767318642.160350:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318642.160354:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318642.160365:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0a680 x1853163940315392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318642.160398:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940315008:0@lo:400:kworker.0
00000100:00100000:3.0:1767318642.160469:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318642.160532:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318642.160538:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940314880:0@lo:400:kworker.0
00000100:00100000:3.0:1767318642.160565:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318642.160603:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314880
00000100:00100000:3.0:1767318642.160610:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314880
00000100:00100000:3.0:1767318642.160666:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629
00000100:00100000:3.0:1767318642.160676:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940314880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318642.160755:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940314880:12345-0@lo:400:kworker.0 Request processed in 81us (189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318642.160762:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629
00000100:00080000:3.0:1767318642.160813:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318642.160841:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940314880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.160952:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940314752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.160982:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318642.161003:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318642.161008:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940315264:0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161029:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318642.161054:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315008
00000100:00100000:1.0:1767318642.161058:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315008
00000100:00100000:1.0:1767318642.161089:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315264
00000100:00100000:1.0:1767318642.161092:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315264
00000100:00100000:1.0:1767318642.161110:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008
00000100:00100000:1.0:1767318642.161116:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940315008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161150:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940315008:12345-0@lo:400:kworker.0 Request processed in 34us (681us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318642.161156:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008
00000100:00100000:1.0:1767318642.161169:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009
00000100:00100000:1.0:1767318642.161175:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940315264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161201:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940315264:12345-0@lo:400:kworker.0 Request processed in 27us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318642.161206:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009
00000100:00100000:1.0:1767318642.161221:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314752
00000100:00100000:1.0:1767318642.161224:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314752
00000100:00100000:1.0:1767318642.161245:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630
00000100:00100000:1.0:1767318642.161251:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940314752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161279:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940314752:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318642.161284:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630
00000100:00080000:1.0:1767318642.161298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318642.161313:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940315264:0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161321:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940314752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318642.161347:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940315008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318642.161919:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940314496:0@lo:38:kworker.0
00000100:00100000:0.0:1767318642.161954:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318642.161971:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940314624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318642.161991:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318642.162008:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940315136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318642.162028:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318642.162042:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940315392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318642.162060:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318642.162089:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314496
00000100:00100000:0.0:1767318642.162092:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314496
00000100:00100000:0.0:1767318642.162112:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315136
00000100:00100000:0.0:1767318642.162114:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315136
00000100:00100000:0.0:1767318642.162125:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315392
00000100:00100000:0.0:1767318642.162127:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315392
00000100:00100000:0.0:1767318642.162137:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16421
00000100:00100000:0.0:1767318642.162141:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940314496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318642.162156:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318642.162186:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940314496:12345-0@lo:38:kworker.0 Request processed in 44us (231us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318642.162191:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16421
00000100:00100000:0.0:1767318642.162204:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16422
00000100:00100000:0.0:1767318642.162208:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940315136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318642.162215:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318642.162237:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940315136:12345-0@lo:38:kworker.0 Request processed in 28us (209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318642.162243:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16422
00000100:00100000:0.0:1767318642.162253:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16423
00000100:00100000:0.0:1767318642.162257:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940315392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318642.162265:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318642.162286:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940315392:12345-0@lo:38:kworker.0 Request processed in 27us (224us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318642.162291:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16423
00000100:00100000:0.0:1767318642.162309:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940314624
00000100:00100000:0.0:1767318642.162313:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940314624
00000100:00100000:0.0:1767318642.162345:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988
00000100:00100000:0.0:1767318642.162349:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940314624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318642.162358:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318642.162381:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940314624:12345-0@lo:38:kworker.0 Request processed in 31us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318642.162387:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988
00000100:00080000:0.0:1767318642.162444:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318642.162448:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318642.162452:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940314496:0@lo:38:kworker.0
00000100:00080000:0.0:1767318642.162459:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318642.162462:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318642.162465:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940314624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318642.162471:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318642.162474:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318642.162476:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940315136:0@lo:38:kworker.0
00000100:00080000:0.0:1767318642.162482:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318642.162485:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318642.162488:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940315392:0@lo:38:kworker.0
00000100:00100000:1.0:1767318642.669257:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940315520:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318642.669331:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318642.670748:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315520
00000100:00100000:0.0:1767318642.670760:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315520
00000100:00100000:0.0:1767318642.670856:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157
00000100:00100000:0.0:1767318642.670866:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940315520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318642.670899:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318642.670976:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940315520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1645us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318642.670984:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157
00000100:00100000:2.0:1767318642.675015:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940315520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318642.797296:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318643.117022:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318643.820837:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318644.142580:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318644.844918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318645.168628:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318645.830845:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318645.830894:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318645.831021:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273792
00000100:00100000:0.0:1767318645.831031:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273792
00000100:00100000:1.0:1767318645.831040:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894273664
00000100:00100000:1.0:1767318645.831047:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894273664
00000100:00080000:3.0:1767318645.831113:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318645.831157:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4010
00000100:00100000:1.0:1767318645.831168:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273792:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318645.831268:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894273792:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (433us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318645.831275:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4010
00000100:00100000:1.0:1767318645.831295:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16424
00000100:00100000:1.0:1767318645.831299:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894273664:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318645.831321:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318645.831345:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894273664:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (451us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318645.831351:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16424
00000100:00100000:2.0:1767318645.868909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318646.191938:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318646.766113:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940315648:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318646.766190:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318646.766438:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315648
00000100:00100000:1.0:1767318646.766446:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315648
00000100:00100000:1.0:1767318646.766513:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158
00000100:00100000:1.0:1767318646.766524:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940315648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318646.766555:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318646.766609:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940315648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (419us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318646.766616:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158
00000100:00100000:2.0:1767318646.766689:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940315648:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318646.766707:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318646.893000:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318647.213235:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318647.277253:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318647.277265:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318647.277268:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318647.277272:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318647.277276:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318647.277286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3892
00000100:00080000:1.0:1767318647.277293:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767318647.277302:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318647.283033:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010000 x1853163940315776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318647.283076:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318647.283081:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318647.283084:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318647.283089:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3892
00000100:00080000:1.0:1767318647.283095:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767318647.283102:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318647.283136:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011180 x1853163940315904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318647.283212:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318647.283216:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318647.283218:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318647.283222:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3892
00000100:00080000:1.0:1767318647.283226:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00100000:2.0:1767318647.283229:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940316032:0@lo:400:kworker.0
00000100:00080000:1.0:1767318647.283232:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318647.283253:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c0a80 x1853163940316416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318647.283272:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318647.283275:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318647.283277:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318647.283280:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3892
00000100:00080000:1.0:1767318647.283283:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318647.283286:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318647.283298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940316672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318647.283307:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318647.283338:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940316160:0@lo:400:kworker.0
00000100:00100000:2.0:1767318647.283373:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318647.283381:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940316544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318647.283405:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318647.283439:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316544
00000100:00100000:2.0:1767318647.283447:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316544
00000100:00100000:1.0:1767318647.283470:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318647.283506:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318647.283511:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011
00000100:00100000:1.0:1767318647.283515:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940316288:0@lo:400:kworker.0
00000100:00100000:2.0:1767318647.283525:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940316544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318647.283540:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318647.283890:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940316544:12345-0@lo:400:kworker.0 Request processed in 368us (483us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318647.283899:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011
00000100:00100000:2.0:1767318647.283916:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316288
00000100:00100000:2.0:1767318647.283919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316288
00000100:00100000:2.0:1767318647.283940:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012
00000100:00100000:2.0:1767318647.283959:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940316288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318647.283999:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940316288:12345-0@lo:400:kworker.0 Request processed in 41us (460us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318647.284005:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316032
00000100:00100000:2.0:1767318647.284006:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012
00000100:00100000:1.0:1767318647.284012:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316032
00000100:00080000:2.0:1767318647.284027:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318647.284049:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316160
00000100:00100000:1.0:1767318647.284054:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316160
00000100:00100000:2.0:1767318647.284063:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940316288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318647.284090:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631
00000100:00100000:2.0:1767318647.284097:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632
00000100:00100000:1.0:1767318647.284102:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940316032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318647.284111:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940316160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318647.284145:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940316032:12345-0@lo:400:kworker.0 Request processed in 47us (842us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318647.284153:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631
00000100:00100000:2.0:1767318647.284160:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940316160:12345-0@lo:400:kworker.0 Request processed in 52us (689us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318647.284167:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632
00000100:00100000:0.0:1767318647.284302:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940315776:0@lo:38:kworker.0
00000100:00100000:0.0:1767318647.284333:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318647.284366:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940315904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318647.284390:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318647.284397:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318647.284412:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940316416:0@lo:38:kworker.0
00000100:00100000:2.0:1767318647.284423:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940316160:0@lo:400:kworker.0
00000100:00100000:0.0:1767318647.284436:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318647.284455:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940316544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318647.284461:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940316672:0@lo:38:kworker.0
00000100:00100000:2.0:1767318647.284470:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940316032:0@lo:400:kworker.0
00000100:00100000:0.0:1767318647.284488:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318647.284512:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315904
00000100:00100000:2.0:1767318647.284518:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315904
00000100:00100000:0.0:1767318647.284532:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940315776
00000100:00100000:0.0:1767318647.284537:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940315776
00000100:00100000:2.0:1767318647.284545:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989
00000100:00100000:2.0:1767318647.284550:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940315904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318647.284567:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318647.284572:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316416
00000100:00100000:0.0:1767318647.284576:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316416
00000100:00100000:0.0:1767318647.284592:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316672
00000100:00100000:0.0:1767318647.284594:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316672
00000100:00100000:0.0:1767318647.284604:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16425
00000100:00100000:0.0:1767318647.284608:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940315776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318647.284619:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318647.284677:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940315776:12345-0@lo:38:kworker.0 Request processed in 67us (343us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318647.284687:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16425
00000100:00100000:0.0:1767318647.284700:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16426
00000100:00100000:0.0:1767318647.284704:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940316416:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318647.284713:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318647.284732:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940316416:12345-0@lo:38:kworker.0 Request processed in 27us (297us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318647.284738:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16426
00000100:00100000:0.0:1767318647.284749:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16427
00000100:00100000:0.0:1767318647.284752:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940316672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318647.284761:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318647.284802:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940316672:12345-0@lo:38:kworker.0 Request processed in 49us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318647.284808:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16427
00000100:00080000:0.0:1767318647.284846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318647.284852:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318647.284857:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940315776:0@lo:38:kworker.0
00000100:00100000:2.0:1767318647.284865:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940315904:12345-0@lo:38:kworker.0 Request processed in 311us (472us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318647.284869:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318647.284874:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989
00000100:00080000:0.0:1767318647.284876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318647.284881:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940315904:0@lo:38:kworker.0
00000100:00080000:0.0:1767318647.284892:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318647.284896:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318647.284901:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940316416:0@lo:38:kworker.0
00000100:00080000:0.0:1767318647.284908:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318647.284913:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318647.284916:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940316672:0@lo:38:kworker.0
00000100:00100000:2.0:1767318647.789264:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940316800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318647.789333:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318647.789474:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316800
00000100:00100000:1.0:1767318647.789484:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316800
00000100:00100000:1.0:1767318647.789543:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159
00000100:00100000:1.0:1767318647.789552:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940316800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318647.789580:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318647.796006:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940316800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6444us (6661us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318647.796023:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159
00000100:00100000:2.0:1767318647.796226:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940316800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318647.918479:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318648.237071:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318648.941081:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318649.261391:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318649.925993:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318649.926373:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894273920 offset 0 length 520: 4
00000100:00100000:3.0:1767318649.926398:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318649.926489:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274176
00000100:00100000:1.0:1767318649.926500:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274176
00000100:00100000:1.0:1767318649.926571:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274048
00000100:00100000:1.0:1767318649.926575:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274048
00000100:00100000:1.0:1767318649.926600:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4013
00000100:00080000:3.0:1767318649.926618:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318649.926619:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894274176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318649.926669:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16428
00000100:00100000:3.0:1767318649.926675:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894274048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318649.926709:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318649.926710:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894274176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (726us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318649.926716:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4013
00000100:00100000:3.0:1767318649.926737:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894274048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 61us (337us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318649.926742:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16428
00000100:00100000:2.0:1767318649.965098:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318650.285632:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318650.988937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318651.309135:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318651.887262:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940316928:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318651.887342:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318651.903498:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940316928
00000100:00100000:1.0:1767318651.903515:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940316928
00000100:00080000:3.0:1767318651.903585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318651.903616:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160
00000100:00100000:1.0:1767318651.903627:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940316928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318651.903663:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318651.903770:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940316928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (16428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318651.903795:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160
00000100:00100000:3.0:1767318651.910501:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940316928:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318652.012964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318652.333294:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318652.397251:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318652.397264:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318652.397267:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318652.397271:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318652.397275:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318652.397283:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3897
00000100:00080000:2.0:1767318652.397290:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767318652.397298:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318652.397348:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940317056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318652.397367:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318652.397371:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318652.397373:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318652.397376:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3897
00000100:00080000:2.0:1767318652.397379:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767318652.397382:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318652.397399:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011180 x1853163940317184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318652.397463:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318652.397466:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318652.397468:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318652.397472:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3897
00000100:00080000:2.0:1767318652.397474:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767318652.397477:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318652.397487:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940317696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318652.397505:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318652.397508:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318652.397510:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318652.397514:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3897
00000100:00080000:2.0:1767318652.397516:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318652.397519:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318652.397530:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ea00 x1853163940317952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318652.397556:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940317568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318652.397665:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318652.397751:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318652.397757:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940317440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318652.397809:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318652.397848:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317568
00000100:00100000:2.0:1767318652.397856:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317568
00000100:00100000:2.0:1767318652.397925:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014
00000100:00100000:2.0:1767318652.397937:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940317568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318652.397995:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940317568:12345-0@lo:400:kworker.0 Request processed in 61us (331us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318652.398002:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014
00000100:00100000:2.0:1767318652.398026:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317440
00000100:00100000:2.0:1767318652.398030:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317440
00000100:00100000:2.0:1767318652.398057:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633
00000100:00100000:2.0:1767318652.398063:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940317440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318652.398094:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940317440:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318652.398099:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633
00000100:00100000:2.0:1767318652.398146:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940317440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318652.398155:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940317568:0@lo:400:kworker.0
00000100:00100000:0.0:1767318652.398258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940317056:0@lo:38:kworker.0
00000100:00100000:0.0:1767318652.398289:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318652.398314:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940317184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318652.398336:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318652.398354:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940317696:0@lo:38:kworker.0
00000100:00100000:0.0:1767318652.398373:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318652.398387:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940317952:0@lo:38:kworker.0
00000100:00100000:0.0:1767318652.398406:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318652.398440:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317184
00000100:00100000:0.0:1767318652.398443:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317184
00000100:00100000:0.0:1767318652.398465:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990
00000100:00100000:0.0:1767318652.398470:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940317184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318652.398490:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318652.398521:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940317184:12345-0@lo:38:kworker.0 Request processed in 50us (184us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318652.398527:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990
00000100:00100000:0.0:1767318652.398545:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317056
00000100:00100000:0.0:1767318652.398549:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317056
00000100:00100000:0.0:1767318652.398563:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317696
00000100:00100000:0.0:1767318652.398565:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317696
00000100:00100000:0.0:1767318652.398576:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317952
00000100:00100000:0.0:1767318652.398579:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317952
00000100:00100000:0.0:1767318652.398605:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16429
00000100:00100000:0.0:1767318652.398609:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317056:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318652.398619:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318652.398643:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317056:12345-0@lo:38:kworker.0 Request processed in 33us (354us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318652.398649:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16429
00000100:00100000:0.0:1767318652.398659:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16430
00000100:00100000:0.0:1767318652.398662:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318652.398669:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318652.398687:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317696:12345-0@lo:38:kworker.0 Request processed in 23us (313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318652.398692:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16430
00000100:00100000:0.0:1767318652.398702:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16431
00000100:00100000:0.0:1767318652.398706:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318652.398715:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318652.398735:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940317952:12345-0@lo:38:kworker.0 Request processed in 27us (328us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318652.398740:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16431
00000100:00080000:0.0:1767318652.398797:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318652.398802:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318652.398806:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940317056:0@lo:38:kworker.0
00000100:00080000:0.0:1767318652.398814:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318652.398817:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318652.398819:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940317184:0@lo:38:kworker.0
00000100:00080000:0.0:1767318652.398828:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318652.398831:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318652.398833:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940317696:0@lo:38:kworker.0
00000100:00080000:0.0:1767318652.398839:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318652.398842:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318652.398845:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940317952:0@lo:38:kworker.0
00000100:00100000:3.0:1767318652.399147:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940317824:0@lo:400:kworker.0
00000100:00100000:3.0:1767318652.399184:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318652.399219:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318652.399226:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940317312:0@lo:400:kworker.0
00000100:00100000:3.0:1767318652.399252:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318652.399280:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318652.399287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318652.399298:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317312
00000100:00100000:3.0:1767318652.399303:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317312
00000100:00100000:3.0:1767318652.399338:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634
00000100:00100000:3.0:1767318652.399344:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940317312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318652.399385:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940317312:12345-0@lo:400:kworker.0 Request processed in 41us (131us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318652.399391:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634
00000100:00100000:3.0:1767318652.399423:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940317312:0@lo:400:kworker.0
00000100:00100000:1.0:1767318652.399503:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940317824
00000100:00100000:1.0:1767318652.399509:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940317824
00000100:00100000:1.0:1767318652.399552:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015
00000100:00100000:1.0:1767318652.399557:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940317824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318652.399603:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940317824:12345-0@lo:400:kworker.0 Request processed in 45us (418us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318652.399608:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015
00000100:00100000:1.0:1767318652.399641:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940317824:0@lo:400:kworker.0
00000100:00080000:3.0:1767318652.400940:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318652.909440:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940318080:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318652.909525:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318652.909685:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318080
00000100:00100000:2.0:1767318652.909694:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318080
00000100:00100000:2.0:1767318652.909752:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161
00000100:00100000:2.0:1767318652.909763:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940318080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318652.909816:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318652.912835:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940318080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3050us (3286us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318652.912857:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161
00000100:00100000:1.0:1767318652.915936:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940318080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318653.036905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318653.357158:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318654.060935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318654.381520:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318655.048481:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318655.048602:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318655.052459:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274304
00000100:00100000:2.0:1767318655.052476:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274304
00000100:00100000:2.0:1767318655.053786:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274432
00000100:00100000:2.0:1767318655.053797:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274432
00000100:00080000:3.0:1767318655.053889:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318655.056539:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4016
00000100:00100000:1.0:1767318655.056584:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894274432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318655.057024:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894274432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 468us (8418us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318655.057033:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4016
00000100:00100000:1.0:1767318655.057071:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16432
00000100:00100000:1.0:1767318655.057077:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894274304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318655.057104:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318655.057133:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894274304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 55us (8663us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318655.057140:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16432
00000100:00100000:2.0:1767318655.084944:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318655.405348:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318656.109882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318656.430729:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318656.493128:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318631/real 1767318631]  req@ffff93cf47172300 x1853163940311936/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318656.493157:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47172300 x1853163940311936/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318656.493175:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318656.493198:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318656.493202:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940311936:0@lo:250:kworker.0
00000100:00080000:2.0:1767318656.493230:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318656.493237:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318656.493241:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318656.493245:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3881
00000100:00080000:2.0:1767318656.493249:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318656.493258:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318656.493298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219e300 x1853163940318208/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318656.493524:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940318208:0@lo:250:kworker.0
00000100:00080000:2.0:1767318656.493863:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318656.493867:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318656.493869:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318656.493872:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3902
00000100:00080000:2.0:1767318656.493876:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318656.493881:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318656.493900:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219dc00 x1853163940318336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318656.493911:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318656.493914:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318656.493916:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318656.493918:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3902
00000100:00080000:2.0:1767318656.493920:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318656.493923:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318656.493939:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d180 x1853163940318464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318656.494006:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940318592:0@lo:400:kworker.0
00000400:00000100:1.0:1767318656.494061:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940318208 offset 0 length 520: 4
00000100:00080000:2.0:1767318656.494129:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318656.494133:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318656.494135:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318656.494139:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3902
00000100:00080000:2.0:1767318656.494142:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318656.494147:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318656.494160:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219fb80 x1853163940318976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318656.494177:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318656.494180:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318656.494182:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318656.494185:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3902
00000100:00080000:2.0:1767318656.494187:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318656.494191:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318656.494201:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010000 x1853163940319232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318656.494229:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940319104:0@lo:400:kworker.0
00000100:00100000:3.0:1767318656.494295:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940318720:0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.495300:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318656.495406:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940318848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.495440:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318656.495478:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318848
00000100:00100000:0.0:1767318656.495489:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318848
00000100:00100000:0.0:1767318656.495726:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017
00000100:00100000:0.0:1767318656.495737:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940318848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.495814:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940318848:12345-0@lo:400:kworker.0 Request processed in 79us (373us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318656.495823:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017
00000100:00100000:0.0:1767318656.495868:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940318848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.495909:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318592
00000100:00100000:0.0:1767318656.495913:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318592
00000100:00100000:0.0:1767318656.495943:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635
00000100:00100000:0.0:1767318656.495949:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940318592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.495986:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940318592:12345-0@lo:400:kworker.0 Request processed in 38us (691us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318656.495993:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635
00000100:00080000:0.0:1767318656.496011:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318656.496016:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318656.496032:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940318592:0@lo:400:kworker.0
00000100:00100000:1.0:1767318656.496247:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940318336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318656.496281:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318656.496312:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940318464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318656.496337:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318656.496358:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940318976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318656.496377:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318656.496393:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940319232:0@lo:38:kworker.0
00000100:00100000:1.0:1767318656.496413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318656.496447:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318336
00000100:00100000:1.0:1767318656.496451:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318336
00000100:00100000:1.0:1767318656.496473:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318976
00000100:00100000:1.0:1767318656.496476:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318976
00000100:00100000:1.0:1767318656.496490:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319232
00000100:00100000:1.0:1767318656.496493:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319232
00000100:00100000:1.0:1767318656.496524:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16433
00000100:00100000:1.0:1767318656.496529:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940318336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318656.496556:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318656.496593:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940318336:12345-0@lo:38:kworker.0 Request processed in 62us (311us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318656.496601:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16433
00000100:00100000:1.0:1767318656.496623:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16434
00000100:00100000:1.0:1767318656.496627:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940318976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318656.496636:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318656.496663:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940318976:12345-0@lo:38:kworker.0 Request processed in 34us (285us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318656.496669:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16434
00000100:00100000:1.0:1767318656.496680:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16435
00000100:00100000:1.0:1767318656.496684:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940319232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318656.496693:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318656.496715:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940319232:12345-0@lo:38:kworker.0 Request processed in 29us (301us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318656.496720:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16435
00000100:00100000:1.0:1767318656.496744:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318464
00000100:00100000:1.0:1767318656.496749:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318464
00000100:00100000:1.0:1767318656.496771:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991
00000100:00100000:1.0:1767318656.496793:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940318464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318656.496802:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318656.496828:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940318464:12345-0@lo:38:kworker.0 Request processed in 33us (489us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318656.496833:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991
00000100:00080000:1.0:1767318656.496878:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318656.496884:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318656.496887:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940318336:0@lo:38:kworker.0
00000100:00080000:1.0:1767318656.496898:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318656.496902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318656.496905:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940318464:0@lo:38:kworker.0
00000100:00080000:1.0:1767318656.496912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318656.496915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318656.496917:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940318976:0@lo:38:kworker.0
00000100:00080000:1.0:1767318656.496923:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318656.496926:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318656.496928:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940319232:0@lo:38:kworker.0
00000100:00100000:2.0:1767318656.497738:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318656.497904:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318656.498032:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940318720
00000100:00100000:1.0:1767318656.498039:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940318720
00000100:00080000:3.0:1767318656.498148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318656.498187:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636
00000100:00100000:1.0:1767318656.498198:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940318720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318656.498256:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940318720:12345-0@lo:400:kworker.0 Request processed in 60us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318656.498263:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636
00000100:00100000:3.0:1767318656.498331:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940318720:0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.498378:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319104
00000100:00100000:0.0:1767318656.498383:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319104
00000100:00100000:0.0:1767318656.498432:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018
00000100:00100000:0.0:1767318656.498439:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940319104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318656.498480:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940319104:12345-0@lo:400:kworker.0 Request processed in 42us (746us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318656.498485:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018
00000100:00080000:3.0:1767318656.499615:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318656.499693:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940319104:0@lo:400:kworker.0
00000100:00100000:3.0:1767318657.005395:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318657.005422:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940319360:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318657.005507:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318657.005759:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319360
00000100:00100000:2.0:1767318657.005769:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319360
00000100:00100000:2.0:1767318657.005864:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162
00000100:00100000:2.0:1767318657.005874:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940319360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318657.005910:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318657.005974:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940319360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (466us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318657.005981:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162
00000100:00100000:1.0:1767318657.006145:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940319360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318657.134563:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318657.453115:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318658.031566:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940319488:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318658.031653:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318658.032668:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319488
00000100:00100000:3.0:1767318658.032679:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319488
00000100:00100000:3.0:1767318658.032757:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163
00000100:00100000:3.0:1767318658.032768:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940319488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318658.032844:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318658.032984:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940319488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 217us (1329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318658.032993:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163
00000100:00080000:0.0:1767318658.033063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318658.035269:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940319488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318658.158674:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318658.477704:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318659.181685:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318659.501107:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318660.174356:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318660.174433:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274688
00000100:00100000:0.0:1767318660.174444:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274688
00000100:00100000:0.0:1767318660.174536:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4019
00000100:00100000:0.0:1767318660.174547:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894274688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318660.174679:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894274688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 134us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318660.174688:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4019
00000100:00080000:3.0:1767318660.174853:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318660.178367:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318660.178464:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274560
00000100:00100000:2.0:1767318660.178474:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274560
00000100:00100000:2.0:1767318660.178535:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16436
00000100:00100000:2.0:1767318660.178544:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894274560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318660.178568:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318660.178633:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894274560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 89us (275us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318660.178640:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16436
00000100:00100000:2.0:1767318660.210729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318660.525180:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318661.229427:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318661.549114:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318661.613259:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.613271:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318661.613274:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.613278:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.613283:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.613291:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3906
00000100:00080000:0.0:1767318661.613297:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.613305:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318661.613349:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940319616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.613372:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.613376:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.613378:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.613381:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3906
00000100:00080000:0.0:1767318661.613384:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.613387:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318661.613400:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940319744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.613467:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.613471:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.613474:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.613477:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3906
00000100:00080000:0.0:1767318661.613480:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.613483:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318661.613494:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401ad80 x1853163940320256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.613524:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.613527:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.613529:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.613532:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3906
00000100:00080000:0.0:1767318661.613535:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.613538:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318661.613547:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a300 x1853163940320512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318661.613573:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940320128:0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.613634:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318661.613718:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318661.613724:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940320384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.613747:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318661.613811:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320128
00000100:00100000:0.0:1767318661.613818:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320128
00000100:00100000:0.0:1767318661.613870:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320384
00000100:00100000:0.0:1767318661.613873:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320384
00000100:00080000:3.0:1767318661.614087:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318661.614101:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940320000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614136:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318661.614164:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318661.614170:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940319872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614191:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318661.614215:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320000
00000100:00100000:3.0:1767318661.614219:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320000
00000100:00100000:3.0:1767318661.614254:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319872
00000100:00100000:3.0:1767318661.614257:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319872
00000100:00100000:3.0:1767318661.614279:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637
00000100:00100000:3.0:1767318661.614288:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940320000:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614341:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940320000:12345-0@lo:400:kworker.0 Request processed in 53us (204us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318661.614348:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637
00000100:00100000:3.0:1767318661.614366:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638
00000100:00100000:3.0:1767318661.614372:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940319872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614397:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940319872:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318661.614403:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638
00000100:00080000:3.0:1767318661.614426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318661.614429:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318661.614455:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940319872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614469:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940320000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614524:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767318661.614532:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940320128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.614566:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940320128:12345-0@lo:400:kworker.0 Request processed in 35us (931us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318661.614571:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767318661.614601:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940320128:0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.614822:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021
00000100:00100000:0.0:1767318661.614829:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940320384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.614863:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940320384:12345-0@lo:400:kworker.0 Request processed in 35us (1116us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318661.614870:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021
00000100:00080000:3.0:1767318661.615316:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318661.615344:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940320384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318661.615450:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940319616:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.615486:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.615521:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940319744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.615545:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.615562:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940320256:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.615581:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.615596:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940320512:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.615615:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.615647:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319744
00000100:00100000:1.0:1767318661.615651:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319744
00000100:00100000:0.0:1767318661.615794:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940319616
00000100:00100000:0.0:1767318661.615799:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940319616
00000100:00100000:0.0:1767318661.615816:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320256
00000100:00100000:0.0:1767318661.615820:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320256
00000100:00100000:0.0:1767318661.615827:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320512
00000100:00100000:0.0:1767318661.615829:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320512
00000100:00100000:0.0:1767318661.615840:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16437
00000100:00100000:0.0:1767318661.615845:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940319616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318661.615866:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318661.616107:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16438
00000100:00100000:2.0:1767318661.616114:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940320256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318661.616125:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318661.616175:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940320256:12345-0@lo:38:kworker.0 Request processed in 59us (592us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318661.616194:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16438
00000100:00100000:2.0:1767318661.616211:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16439
00000100:00100000:2.0:1767318661.616215:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940320512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318661.616224:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318661.616247:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940320512:12345-0@lo:38:kworker.0 Request processed in 31us (631us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318661.616252:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16439
00000100:00100000:1.0:1767318661.616511:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992
00000100:00100000:1.0:1767318661.616518:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940319744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318661.616530:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318661.616558:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940319744:12345-0@lo:38:kworker.0 Request processed in 39us (1012us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318661.617406:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940319616:12345-0@lo:38:kworker.0 Request processed in 1555us (1916us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318661.617415:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16437
00000100:00080000:0.0:1767318661.617523:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.617530:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.617534:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940319616:0@lo:38:kworker.0
00000100:00080000:0.0:1767318661.617545:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.617548:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.617551:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940319744:0@lo:38:kworker.0
00000100:00080000:0.0:1767318661.617561:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.617564:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.617567:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940320256:0@lo:38:kworker.0
00000100:00080000:0.0:1767318661.617577:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.617581:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.617583:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940320512:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.617683:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992
00000100:00100000:3.0:1767318662.127086:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318662.127112:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940320640:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318662.127208:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318662.127362:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320640
00000100:00100000:1.0:1767318662.127373:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320640
00000100:00100000:1.0:1767318662.127437:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164
00000100:00100000:1.0:1767318662.127448:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940320640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318662.127478:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318662.127538:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940320640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (330us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318662.127544:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164
00000100:00100000:0.0:1767318662.127925:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940320640:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318662.253138:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318662.578319:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318663.149246:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318663.149271:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940320768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318663.149340:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318663.149671:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320768
00000100:00100000:0.0:1767318663.149679:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320768
00000100:00100000:0.0:1767318663.149753:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165
00000100:00100000:0.0:1767318663.149762:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940320768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318663.149816:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318663.149873:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940320768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (532us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318663.149881:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165
00000100:00100000:2.0:1767318663.149999:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940320768:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318663.150054:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318663.277013:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318663.597026:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318664.301562:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318664.621403:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318665.287125:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318665.287445:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274944
00000100:00100000:0.0:1767318665.287456:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274944
00000100:00100000:0.0:1767318665.287566:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4022
00000100:00100000:0.0:1767318665.287577:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894274944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318665.287663:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894274944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (554us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318665.287670:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4022
00000100:00100000:1.0:1767318665.287833:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318665.287914:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894274816
00000100:00100000:0.0:1767318665.287918:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894274816
00000100:00100000:0.0:1767318665.287938:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16440
00000100:00100000:0.0:1767318665.287944:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894274816:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318665.287968:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318665.288014:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894274816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 69us (181us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318665.288020:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16440
00000100:00080000:3.0:1767318665.298219:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318665.324923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318665.645649:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318666.350260:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318666.669442:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318666.733124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318666.733147:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318666.733150:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318666.733154:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318666.733158:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318666.733166:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3911
00000100:00080000:2.0:1767318666.733170:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318666.733176:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318666.733215:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011f80 x1853163940320896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318666.733232:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318666.733236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318666.733237:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318666.733241:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3911
00000100:00080000:2.0:1767318666.733243:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318666.733246:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318666.733256:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940321024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318666.733308:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318666.733311:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318666.733313:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318666.733316:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3911
00000100:00080000:2.0:1767318666.733318:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318666.733322:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318666.733329:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940321536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318666.733343:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318666.733346:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318666.733348:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318666.733351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3911
00000100:00080000:2.0:1767318666.733353:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318666.733356:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318666.733363:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940321792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318666.733393:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940321408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.733477:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318666.733548:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318666.733555:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940321664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.733576:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318666.733606:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321408
00000100:00100000:2.0:1767318666.733613:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321408
00000100:00100000:2.0:1767318666.733663:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321664
00000100:00100000:2.0:1767318666.733665:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321664
00000100:00100000:2.0:1767318666.733689:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023
00000100:00100000:2.0:1767318666.733697:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940321408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.733748:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940321408:12345-0@lo:400:kworker.0 Request processed in 52us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318666.733756:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023
00000100:00100000:2.0:1767318666.733790:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024
00000100:00100000:2.0:1767318666.733796:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940321664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.733818:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940321664:12345-0@lo:400:kworker.0 Request processed in 23us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318666.734899:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024
00000100:00100000:2.0:1767318666.734976:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940321664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.734990:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940321408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735054:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940321152:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735095:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318666.735127:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318666.735229:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940321280:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735251:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318666.735283:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321152
00000100:00100000:2.0:1767318666.735288:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321152
00000100:00100000:2.0:1767318666.735321:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321280
00000100:00100000:2.0:1767318666.735361:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321280
00000100:00100000:2.0:1767318666.735380:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639
00000100:00100000:2.0:1767318666.735386:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940321152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735419:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940321152:12345-0@lo:400:kworker.0 Request processed in 33us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318666.735425:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639
00000100:00100000:2.0:1767318666.735435:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640
00000100:00100000:2.0:1767318666.735440:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940321280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735472:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940321280:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318666.735477:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640
00000100:00100000:2.0:1767318666.735498:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940321280:0@lo:400:kworker.0
00000100:00100000:2.0:1767318666.735506:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940321152:0@lo:400:kworker.0
00000100:00080000:2.0:1767318666.735540:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318666.735544:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318666.735547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318666.739880:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940320896:0@lo:38:kworker.0
00000100:00100000:0.0:1767318666.739965:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318666.740008:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940321024:0@lo:38:kworker.0
00000100:00100000:0.0:1767318666.740048:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318666.740080:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940321536:0@lo:38:kworker.0
00000100:00100000:2.0:1767318666.740081:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321024
00000100:00100000:2.0:1767318666.740090:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321024
00000100:00100000:0.0:1767318666.740101:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318666.740118:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940321792:0@lo:38:kworker.0
00000100:00100000:2.0:1767318666.740142:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993
00000100:00100000:0.0:1767318666.740143:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318666.740150:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940321024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318666.740173:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318666.740217:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940321024:12345-0@lo:38:kworker.0 Request processed in 66us (167us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318666.740224:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993
00000100:00100000:2.0:1767318666.740261:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940320896
00000100:00100000:2.0:1767318666.740265:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940320896
00000100:00100000:2.0:1767318666.740284:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321536
00000100:00100000:2.0:1767318666.740287:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321536
00000100:00100000:2.0:1767318666.740299:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321792
00000100:00100000:2.0:1767318666.740301:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321792
00000100:00100000:2.0:1767318666.740314:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16441
00000100:00100000:2.0:1767318666.740319:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940320896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318666.740329:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318666.740354:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940320896:12345-0@lo:38:kworker.0 Request processed in 34us (390us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318666.740359:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16441
00000100:00100000:2.0:1767318666.740371:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16442
00000100:00100000:2.0:1767318666.740375:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940321536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318666.740384:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318666.740407:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940321536:12345-0@lo:38:kworker.0 Request processed in 30us (304us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318666.740412:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16442
00000100:00100000:2.0:1767318666.740422:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16443
00000100:00100000:2.0:1767318666.740425:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940321792:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767318666.740431:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:2.0:1767318666.740433:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318666.740436:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318666.740440:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940320896:0@lo:38:kworker.0
00000100:00080000:0.0:1767318666.740449:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318666.740452:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318666.740452:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940321792:12345-0@lo:38:kworker.0 Request processed in 25us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318666.740467:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940321024:0@lo:38:kworker.0
00000100:00100000:2.0:1767318666.740469:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16443
00000100:00080000:0.0:1767318666.740475:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318666.740478:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318666.740481:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940321536:0@lo:38:kworker.0
00000100:00080000:0.0:1767318666.740488:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318666.740491:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318666.740493:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940321792:0@lo:38:kworker.0
00000100:00100000:0.0:1767318667.245519:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318667.245548:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940321920:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318667.245637:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318667.245903:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940321920
00000100:00100000:1.0:1767318667.245912:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940321920
00000100:00100000:1.0:1767318667.245965:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166
00000100:00100000:1.0:1767318667.245975:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940321920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318667.246017:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318667.246393:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940321920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 419us (756us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318667.246401:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166
00000100:00100000:2.0:1767318667.252142:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940321920:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318667.372939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318667.693067:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318668.269231:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940322048:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318668.269435:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318668.269573:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322048
00000100:00100000:1.0:1767318668.269583:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322048
00000100:00100000:1.0:1767318668.269665:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167
00000100:00100000:1.0:1767318668.269675:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940322048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318668.269707:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318668.269793:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318668.270041:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940322048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 368us (605us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318668.270048:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167
00000100:00100000:2.0:1767318668.270054:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940322048:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318668.396923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318668.717960:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318669.421360:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318669.748324:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318670.406628:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318670.406750:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318670.407355:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275200
00000100:00100000:2.0:1767318670.407369:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275200
00000100:00100000:2.0:1767318670.407490:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275072
00000100:00100000:2.0:1767318670.407494:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275072
00000100:00100000:2.0:1767318670.407530:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4025
00000100:00100000:2.0:1767318670.407541:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275200:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318670.407626:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (1015us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318670.407633:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4025
00000100:00100000:2.0:1767318670.407653:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16444
00000100:00100000:2.0:1767318670.407657:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894275072:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318670.407680:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318670.407705:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894275072:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (956us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318670.407712:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16444
00000100:00080000:3.0:1767318670.407911:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318670.445825:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318670.765313:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318671.468935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318671.788992:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318671.853133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318671.853160:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318671.853164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318671.853168:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318671.853173:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318671.853196:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3916
00000100:00080000:2.0:1767318671.853202:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318671.853210:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318671.853310:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a680 x1853163940322176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318671.853364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318671.853368:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318671.853370:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318671.853374:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3916
00000100:00080000:2.0:1767318671.853376:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318671.853380:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318671.853394:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89c00 x1853163940322304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318671.853501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318671.853505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318671.853507:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318671.853511:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3916
00000100:00080000:2.0:1767318671.853513:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318671.853517:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318671.853554:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940322816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318671.853585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318671.853588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318671.853590:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318671.853593:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3916
00000100:00080000:2.0:1767318671.853596:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318671.853599:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318671.853618:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940322432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318671.853624:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011f80 x1853163940323072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318671.853690:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940322560:0@lo:400:kworker.0
00000100:00100000:1.0:1767318671.853710:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318671.853723:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940322944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318671.853751:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318671.853800:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318671.853806:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940322688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318671.853824:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322432
00000100:00100000:2.0:1767318671.853829:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318671.853831:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322432
00000100:00100000:2.0:1767318671.853865:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322944
00000100:00100000:2.0:1767318671.853882:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322944
00000100:00100000:1.0:1767318671.853885:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641
00000100:00100000:1.0:1767318671.853893:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940322432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318671.853908:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322688
00000100:00100000:2.0:1767318671.853911:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322688
00000100:00100000:2.0:1767318671.853931:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026
00000100:00100000:2.0:1767318671.853937:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940322944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318671.853959:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940322432:12345-0@lo:400:kworker.0 Request processed in 66us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318671.853964:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940322944:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318671.853967:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641
00000100:00100000:2.0:1767318671.853970:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026
00000100:00100000:2.0:1767318671.853983:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027
00000100:00100000:2.0:1767318671.853989:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940322688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318671.854023:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940322432:0@lo:400:kworker.0
00000100:00100000:3.0:1767318671.854185:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940322176:0@lo:38:kworker.0
00000100:00100000:2.0:1767318671.854652:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940322688:12345-0@lo:400:kworker.0 Request processed in 661us (819us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318671.854659:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027
00000100:00080000:2.0:1767318671.854685:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318671.854690:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318671.862000:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318671.862196:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322560
00000100:00100000:2.0:1767318671.862210:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322560
00000100:00100000:2.0:1767318671.862292:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642
00000100:00100000:2.0:1767318671.862303:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940322560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318671.862441:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318671.862497:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940322304:0@lo:38:kworker.0
00000100:00100000:3.0:1767318671.862534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318671.862554:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940322816:0@lo:38:kworker.0
00000100:00100000:3.0:1767318671.862576:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318671.862609:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940323072:0@lo:38:kworker.0
00000100:00100000:3.0:1767318671.862646:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318671.862685:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322176
00000100:00100000:3.0:1767318671.862689:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322176
00000100:00100000:3.0:1767318671.862710:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322816
00000100:00100000:3.0:1767318671.862713:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322816
00000100:00100000:3.0:1767318671.862726:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323072
00000100:00100000:3.0:1767318671.862729:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323072
00000100:00100000:3.0:1767318671.862746:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16445
00000100:00100000:3.0:1767318671.862751:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940322176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318671.862795:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318671.862829:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940322176:12345-0@lo:38:kworker.0 Request processed in 77us (389us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318671.862836:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16445
00000100:00100000:3.0:1767318671.862853:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16446
00000100:00100000:3.0:1767318671.862856:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940322816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318671.862866:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318671.862887:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940322816:12345-0@lo:38:kworker.0 Request processed in 29us (310us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318671.862892:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16446
00000100:00100000:3.0:1767318671.862903:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16447
00000100:00100000:3.0:1767318671.862906:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940323072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318671.862915:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318671.862936:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940323072:12345-0@lo:38:kworker.0 Request processed in 28us (302us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318671.862941:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16447
00000100:00100000:3.0:1767318671.862958:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940322304
00000100:00100000:3.0:1767318671.862962:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940322304
00000100:00100000:3.0:1767318671.862980:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994
00000100:00100000:3.0:1767318671.862985:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940322304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318671.862994:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318671.863017:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940322304:12345-0@lo:38:kworker.0 Request processed in 31us (483us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318671.863023:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994
00000100:00080000:3.0:1767318671.863067:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318671.863072:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318671.863076:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940322176:0@lo:38:kworker.0
00000100:00080000:3.0:1767318671.863083:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318671.863086:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318671.863089:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940322304:0@lo:38:kworker.0
00000100:00080000:3.0:1767318671.863095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318671.863098:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318671.863100:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940322816:0@lo:38:kworker.0
00000100:00080000:3.0:1767318671.863107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318671.863109:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318671.863112:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940323072:0@lo:38:kworker.0
00000100:00080000:3.0:1767318671.863150:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318671.864152:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940322944:0@lo:400:kworker.0
00000100:00100000:0.0:1767318671.864189:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940322688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318671.870756:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940322560:12345-0@lo:400:kworker.0 Request processed in 8442us (8750us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318671.870843:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940322560:0@lo:400:kworker.0
00000100:00100000:2.0:1767318671.874502:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642
00000100:00100000:3.0:1767318672.365931:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940323200:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318672.366013:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318672.366789:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323200
00000100:00100000:1.0:1767318672.366799:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323200
00000100:00100000:1.0:1767318672.366850:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168
00000100:00100000:1.0:1767318672.366859:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940323200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318672.366892:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318672.366962:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940323200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (949us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318672.366969:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168
00000100:00100000:2.0:1767318672.367457:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940323200:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318672.492979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318672.813002:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318673.389435:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940323328:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318673.389524:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318673.389731:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323328
00000100:00100000:0.0:1767318673.389740:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323328
00000100:00080000:3.0:1767318673.389903:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318673.390169:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169
00000100:00100000:0.0:1767318673.390180:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940323328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318673.390212:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318673.390275:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940323328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (751us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318673.390283:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169
00000100:00100000:2.0:1767318673.390422:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940323328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318673.516917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318673.839384:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318674.541018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318674.866261:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318675.526907:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767318675.526952:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894275328 offset 0 length 520: 4
00000100:00100000:0.0:1767318675.526976:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318675.527075:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275584
00000100:00100000:1.0:1767318675.527086:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275584
00000100:00100000:1.0:1767318675.527167:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275456
00000100:00100000:1.0:1767318675.527170:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275456
00000100:00100000:1.0:1767318675.527191:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4028
00000100:00100000:1.0:1767318675.527201:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318675.527280:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (393us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318675.527288:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4028
00000100:00100000:1.0:1767318675.527317:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16448
00000100:00100000:1.0:1767318675.527322:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894275456:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318675.527342:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318675.527368:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894275456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (391us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318675.527383:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16448
00000100:00080000:0.0:1767318675.527986:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318675.565641:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318675.886538:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318676.588898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318676.912008:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318676.982846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318676.982858:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318676.982861:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318676.982866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318676.982871:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318676.982879:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3921
00000100:00080000:1.0:1767318676.982884:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318676.982890:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318676.982928:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38000 x1853163940323456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318676.982972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318676.982976:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318676.982978:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318676.982982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3921
00000100:00080000:1.0:1767318676.982985:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318676.982988:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318676.983002:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38e00 x1853163940323584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318676.983058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318676.983062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318676.983064:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318676.983067:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3921
00000100:00080000:1.0:1767318676.983069:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318676.983072:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318676.983085:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38380 x1853163940324096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318676.983100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318676.983103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318676.983105:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318676.983108:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3921
00000100:00080000:1.0:1767318676.983110:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318676.983113:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318676.983123:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940324352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318676.983216:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940323712:0@lo:400:kworker.0
00000100:00100000:0.0:1767318676.983280:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318676.983348:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318676.983354:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940323840:0@lo:400:kworker.0
00000100:00100000:0.0:1767318676.983388:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.983805:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940323968:0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.983838:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.983866:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318676.983872:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940324224:0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.983892:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.983922:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323968
00000100:00100000:3.0:1767318676.983929:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323968
00000100:00100000:3.0:1767318676.983972:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324224
00000100:00100000:3.0:1767318676.983975:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324224
00000100:00100000:3.0:1767318676.983996:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029
00000100:00100000:3.0:1767318676.984004:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940323968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984051:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940323968:12345-0@lo:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318676.984058:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029
00000100:00100000:3.0:1767318676.984076:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030
00000100:00100000:3.0:1767318676.984082:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940324224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984106:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940324224:12345-0@lo:400:kworker.0 Request processed in 24us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318676.984111:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030
00000100:00100000:3.0:1767318676.984146:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940324224:0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984157:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940323968:0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984180:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323712
00000100:00100000:3.0:1767318676.984183:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323712
00000100:00100000:3.0:1767318676.984220:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323840
00000100:00100000:3.0:1767318676.984223:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323840
00000100:00100000:3.0:1767318676.984241:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643
00000100:00100000:3.0:1767318676.984247:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940323712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984278:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940323712:12345-0@lo:400:kworker.0 Request processed in 31us (999us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318676.984288:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643
00000100:00100000:3.0:1767318676.984299:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1767318676.984305:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940323840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318676.984330:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940323840:12345-0@lo:400:kworker.0 Request processed in 26us (941us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318676.984336:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1767318676.984355:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940323456:0@lo:38:kworker.0
00000100:00100000:3.0:1767318676.984393:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.984406:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940323584:0@lo:38:kworker.0
00000100:00100000:3.0:1767318676.984424:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.984437:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940324096:0@lo:38:kworker.0
00000100:00100000:3.0:1767318676.984454:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.984469:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940324352:0@lo:38:kworker.0
00000100:00100000:3.0:1767318676.984486:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318676.984513:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323584
00000100:00100000:3.0:1767318676.984517:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323584
00000100:00100000:3.0:1767318676.984535:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995
00000100:00100000:3.0:1767318676.984539:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940323584:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318676.984556:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318676.984586:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940323584:12345-0@lo:38:kworker.0 Request processed in 45us (161us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318676.984592:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995
00000100:00100000:3.0:1767318676.984610:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940323456
00000100:00100000:3.0:1767318676.984613:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940323456
00000100:00100000:3.0:1767318676.984625:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324096
00000100:00100000:3.0:1767318676.984628:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324096
00000100:00100000:3.0:1767318676.984634:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324352
00000100:00100000:3.0:1767318676.984636:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324352
00000100:00100000:3.0:1767318676.984643:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16449
00000100:00100000:3.0:1767318676.984647:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940323456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318676.984656:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318676.984680:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940323456:12345-0@lo:38:kworker.0 Request processed in 31us (286us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318676.984685:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16449
00000100:00100000:3.0:1767318676.984695:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16450
00000100:00100000:3.0:1767318676.984698:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940324096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318676.984706:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318676.984726:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940324096:12345-0@lo:38:kworker.0 Request processed in 26us (271us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318676.984732:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16450
00000100:00100000:3.0:1767318676.984742:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16451
00000100:00100000:3.0:1767318676.984745:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940324352:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318676.984753:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318676.984798:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940324352:12345-0@lo:38:kworker.0 Request processed in 26us (285us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318676.984804:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16451
00000100:00080000:3.0:1767318676.984834:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318676.984838:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318676.984841:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940323456:0@lo:38:kworker.0
00000100:00080000:3.0:1767318676.984848:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318676.984851:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318676.984854:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940323584:0@lo:38:kworker.0
00000100:00080000:3.0:1767318676.984860:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318676.984863:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318676.984865:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940324096:0@lo:38:kworker.0
00000100:00080000:3.0:1767318676.984871:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318676.984874:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318676.984877:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940324352:0@lo:38:kworker.0
00000100:00080000:0.0:1767318676.985019:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318676.985023:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318676.985026:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318676.985049:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940323840:0@lo:400:kworker.0
00000100:00100000:0.0:1767318676.985058:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940323712:0@lo:400:kworker.0
00000100:00100000:0.0:1767318677.486594:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940324480:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318677.486677:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318677.486847:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324480
00000100:00100000:1.0:1767318677.486854:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324480
00000100:00100000:1.0:1767318677.486904:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170
00000100:00100000:1.0:1767318677.486913:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940324480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318677.486951:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318677.487004:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940324480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318677.487011:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170
00000100:00100000:3.0:1767318677.487094:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940324480:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318677.613106:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318677.933022:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318678.510283:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318678.518177:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940324608:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318678.518274:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318678.518911:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324608
00000100:00100000:0.0:1767318678.518920:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324608
00000100:00100000:0.0:1767318678.518994:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171
00000100:00100000:0.0:1767318678.519005:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940324608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318678.519038:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318678.519102:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940324608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (827us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318678.519110:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171
00000100:00080000:2.0:1767318678.519196:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318678.519983:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940324608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318678.637789:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318678.957802:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318679.663138:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318679.982037:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318680.649386:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318680.649712:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275712
00000100:00100000:2.0:1767318680.649726:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275712
00000100:00100000:2.0:1767318680.649829:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16452
00000100:00100000:2.0:1767318680.649837:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894275712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318680.649865:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318680.649928:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894275712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 90us (558us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318680.649935:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16452
00000100:00100000:0.0:1767318680.653035:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318680.653990:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275840
00000100:00100000:3.0:1767318680.654005:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275840
00000100:00100000:3.0:1767318680.654107:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4031
00000100:00100000:3.0:1767318680.654120:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318680.654213:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894275840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (1189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318680.654229:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4031
00000100:00080000:2.0:1767318680.658571:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318680.685021:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318681.007932:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318681.070888:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318656/real 1767318656]  req@ffff93cf5219e300 x1853163940318208/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318681 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318681.070927:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf5219e300 x1853163940318208/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318681 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318681.070950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318681.070979:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318681.070983:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940318208:0@lo:250:kworker.0
00000100:00080000:1.0:1767318681.071073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318681.071079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318681.071082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318681.071087:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3906
00000100:00080000:1.0:1767318681.071091:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318681.071098:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318681.071132:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a680 x1853163940324736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318681.071165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318681.071168:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318681.071170:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318681.071174:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3927
00000100:00080000:1.0:1767318681.071176:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318681.071179:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318681.071194:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88380 x1853163940324864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318681.071203:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318681.071206:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318681.071207:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318681.071211:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3927
00000100:00080000:1.0:1767318681.071212:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318681.071215:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318681.071239:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940324992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318681.071314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318681.071317:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318681.071319:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318681.071322:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3927
00000100:00080000:1.0:1767318681.071334:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318681.071338:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318681.071349:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eada680 x1853163940325504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318681.071364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318681.071367:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318681.071369:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318681.071372:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3927
00000100:00080000:1.0:1767318681.071374:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318681.071378:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318681.071388:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eada300 x1853163940325760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318681.071416:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940325632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318681.071477:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318681.071549:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318681.071556:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940325376:0@lo:400:kworker.0
00000100:00100000:1.0:1767318681.071586:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318681.071622:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325632
00000100:00100000:1.0:1767318681.071629:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325632
00000100:00100000:1.0:1767318681.071699:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325376
00000100:00100000:1.0:1767318681.071702:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325376
00000100:00100000:1.0:1767318681.071728:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032
00000100:00100000:1.0:1767318681.071736:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940325632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318681.071816:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940325632:12345-0@lo:400:kworker.0 Request processed in 80us (338us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318681.071823:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032
00000100:00100000:1.0:1767318681.071840:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033
00000100:00100000:1.0:1767318681.071846:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940325376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318681.071873:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940325376:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318681.071879:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033
00000100:00100000:1.0:1767318681.071916:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940325376:0@lo:400:kworker.0
00000100:00100000:1.0:1767318681.071927:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940325632:0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072467:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940325120:0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072516:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318681.072561:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318681.072567:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940325248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072590:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318681.072624:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325120
00000100:00100000:0.0:1767318681.072629:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325120
00000100:00100000:0.0:1767318681.072664:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325248
00000100:00100000:0.0:1767318681.072667:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325248
00000100:00100000:0.0:1767318681.072702:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645
00000100:00100000:0.0:1767318681.072709:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940325120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072747:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940325120:12345-0@lo:400:kworker.0 Request processed in 39us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318681.072753:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645
00000100:00100000:0.0:1767318681.072766:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646
00000100:00100000:0.0:1767318681.072797:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940325248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072839:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940325248:12345-0@lo:400:kworker.0 Request processed in 67us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318681.072845:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646
00000100:00100000:0.0:1767318681.072877:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940325248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318681.072886:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940325120:0@lo:400:kworker.0
00000100:00080000:2.0:1767318681.073623:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318681.073630:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318681.073633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318681.073943:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940324736:0@lo:250:kworker.0
00000400:00000100:3.0:1767318681.073981:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940324736 offset 0 length 520: 4
00000100:00100000:3.0:1767318681.074007:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940324864:0@lo:38:kworker.0
00000100:00100000:3.0:1767318681.074032:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318681.074058:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940324992:0@lo:38:kworker.0
00000100:00100000:3.0:1767318681.074082:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318681.074101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940325504:0@lo:38:kworker.0
00000100:00100000:3.0:1767318681.074123:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318681.074140:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940325760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318681.074176:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318681.074213:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324992
00000100:00100000:3.0:1767318681.074230:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324992
00000100:00100000:3.0:1767318681.074262:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996
00000100:00100000:3.0:1767318681.074268:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940324992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318681.074289:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318681.074340:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940324992:12345-0@lo:38:kworker.0 Request processed in 70us (256us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318681.074347:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996
00000100:00100000:3.0:1767318681.074371:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940324864
00000100:00100000:3.0:1767318681.074375:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940324864
00000100:00100000:3.0:1767318681.074397:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325504
00000100:00100000:3.0:1767318681.074399:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325504
00000100:00100000:3.0:1767318681.074411:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325760
00000100:00100000:3.0:1767318681.074413:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325760
00000100:00100000:3.0:1767318681.074427:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16453
00000100:00100000:3.0:1767318681.074432:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940324864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318681.074442:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318681.074466:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940324864:12345-0@lo:38:kworker.0 Request processed in 32us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318681.074472:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16453
00000100:00100000:3.0:1767318681.074494:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16454
00000100:00100000:3.0:1767318681.074499:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940325504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318681.074507:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318681.074531:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940325504:12345-0@lo:38:kworker.0 Request processed in 31us (407us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318681.074537:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16454
00000100:00100000:3.0:1767318681.074547:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16455
00000100:00100000:3.0:1767318681.074550:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940325760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318681.074559:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318681.074581:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940325760:12345-0@lo:38:kworker.0 Request processed in 29us (404us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318681.074586:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16455
00000100:00080000:3.0:1767318681.074638:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318681.074643:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318681.074647:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940324864:0@lo:38:kworker.0
00000100:00080000:3.0:1767318681.074657:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318681.074661:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318681.074663:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940324992:0@lo:38:kworker.0
00000100:00080000:3.0:1767318681.074670:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318681.074672:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318681.074675:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940325504:0@lo:38:kworker.0
00000100:00080000:3.0:1767318681.074694:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318681.074698:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318681.074701:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940325760:0@lo:38:kworker.0
00000100:00100000:2.0:1767318681.710597:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318682.030270:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318682.606799:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318682.606828:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940325888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318682.606900:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318682.607061:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940325888
00000100:00100000:1.0:1767318682.607069:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940325888
00000100:00100000:1.0:1767318682.607139:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172
00000100:00100000:1.0:1767318682.607149:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940325888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318682.607180:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318682.607663:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940325888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 514us (760us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318682.607671:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172
00000100:00100000:2.0:1767318682.607810:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940325888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318682.733646:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318683.054810:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318683.629266:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318683.635631:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940326016:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318683.635740:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318683.636638:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326016
00000100:00100000:3.0:1767318683.636653:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326016
00000100:00100000:3.0:1767318683.636751:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173
00000100:00100000:3.0:1767318683.636766:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940326016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318683.636838:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318683.636931:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940326016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (1189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318683.636939:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173
00000100:00080000:2.0:1767318683.637920:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318683.648859:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940326016:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318683.757419:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318684.079920:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318684.781102:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318685.101194:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318685.766840:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318685.766975:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318685.767236:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276096
00000100:00100000:3.0:1767318685.767249:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276096
00000100:00100000:3.0:1767318685.767343:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894275968
00000100:00100000:3.0:1767318685.767347:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894275968
00000100:00100000:3.0:1767318685.767377:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4034
00000100:00100000:3.0:1767318685.767387:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894276096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318685.767463:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894276096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (635us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318685.767470:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4034
00000100:00100000:3.0:1767318685.767493:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16456
00000100:00100000:3.0:1767318685.767498:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894275968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318685.767522:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318685.767548:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894275968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (572us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318685.767554:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16456
00000100:00080000:0.0:1767318685.768180:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318685.805101:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318686.125060:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318686.191527:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318686.191541:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318686.191544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318686.191548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318686.191553:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318686.191563:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1767318686.191568:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318686.191576:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318686.191624:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940326144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318686.191657:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318686.191661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318686.191663:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318686.191666:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1767318686.191669:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318686.191672:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318686.191686:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8000 x1853163940326272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318686.191763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318686.191766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318686.191768:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318686.191789:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1767318686.191793:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318686.191797:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318686.191808:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47979180 x1853163940326784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318686.191823:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318686.191826:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318686.191828:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318686.191830:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1767318686.191833:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318686.191837:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318686.191847:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797aa00 x1853163940327040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318686.191879:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940326912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.191954:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318686.192023:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318686.192029:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940326656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.192064:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318686.192113:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326912
00000100:00100000:1.0:1767318686.192122:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326912
00000100:00100000:1.0:1767318686.192173:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326656
00000100:00100000:1.0:1767318686.192176:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326656
00000100:00100000:1.0:1767318686.192198:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035
00000100:00100000:1.0:1767318686.192205:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940326912:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.192254:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940326912:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318686.192262:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035
00000100:00100000:1.0:1767318686.192293:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036
00000100:00100000:1.0:1767318686.192300:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940326656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.192328:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940326656:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318686.192333:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036
00000100:00100000:2.0:1767318686.192577:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940326400:0@lo:400:kworker.0
00000100:00100000:2.0:1767318686.192617:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318686.192647:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318686.192653:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940326528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318686.192676:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318686.192706:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326400
00000100:00100000:2.0:1767318686.192711:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326400
00000100:00100000:2.0:1767318686.192742:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326528
00000100:00100000:2.0:1767318686.192745:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326528
00000100:00100000:2.0:1767318686.192768:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647
00000100:00100000:2.0:1767318686.192794:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940326400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318686.192832:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940326400:12345-0@lo:400:kworker.0 Request processed in 58us (215us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318686.192839:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647
00000100:00100000:2.0:1767318686.193060:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648
00000100:00100000:2.0:1767318686.193066:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940326528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318686.193109:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940326528:12345-0@lo:400:kworker.0 Request processed in 42us (431us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318686.193114:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648
00000100:00100000:2.0:1767318686.193148:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940326528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318686.193156:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940326400:0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.193311:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940326656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318686.193326:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940326912:0@lo:400:kworker.0
00000100:00100000:3.0:1767318686.194261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940326144:0@lo:38:kworker.0
00000100:00100000:3.0:1767318686.194317:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318686.194341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940326272:0@lo:38:kworker.0
00000100:00100000:3.0:1767318686.194379:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318686.194400:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940326784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318686.194421:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318686.194440:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940327040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318686.194461:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318686.194499:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326144
00000100:00100000:3.0:1767318686.194504:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326144
00000100:00100000:3.0:1767318686.194533:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326784
00000100:00100000:3.0:1767318686.194536:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326784
00000100:00100000:3.0:1767318686.194545:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327040
00000100:00100000:3.0:1767318686.194547:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327040
00000100:00100000:3.0:1767318686.194559:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457
00000100:00100000:3.0:1767318686.194563:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940326144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318686.194583:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318686.194619:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940326144:12345-0@lo:38:kworker.0 Request processed in 53us (301us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318686.194625:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457
00000100:00100000:3.0:1767318686.194642:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458
00000100:00100000:3.0:1767318686.194646:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940326784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318686.194655:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318686.194677:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940326784:12345-0@lo:38:kworker.0 Request processed in 30us (254us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318686.194682:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458
00000100:00100000:3.0:1767318686.194693:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16459
00000100:00100000:3.0:1767318686.194696:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940327040:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318686.194705:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318686.194726:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940327040:12345-0@lo:38:kworker.0 Request processed in 29us (265us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318686.194730:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16459
00000100:00100000:3.0:1767318686.194757:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940326272
00000100:00100000:3.0:1767318686.194760:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940326272
00000100:00100000:3.0:1767318686.194795:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997
00000100:00100000:3.0:1767318686.194799:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940326272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318686.194808:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318686.194836:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940326272:12345-0@lo:38:kworker.0 Request processed in 35us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318686.194842:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997
00000100:00080000:3.0:1767318686.194887:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318686.194892:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318686.194896:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940326144:0@lo:38:kworker.0
00000100:00080000:3.0:1767318686.194905:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318686.194908:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318686.194911:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940326272:0@lo:38:kworker.0
00000100:00080000:3.0:1767318686.194919:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318686.194922:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318686.194925:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940326784:0@lo:38:kworker.0
00000100:00080000:3.0:1767318686.194932:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318686.194935:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318686.194937:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940327040:0@lo:38:kworker.0
00000100:00080000:0.0:1767318686.196276:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318686.196295:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318686.196298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318686.829287:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318687.149870:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318687.727932:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940327168:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318687.728062:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318687.728329:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327168
00000100:00100000:1.0:1767318687.728342:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327168
00000100:00100000:1.0:1767318687.728432:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174
00000100:00100000:1.0:1767318687.728445:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940327168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318687.728493:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318687.728561:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940327168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (498us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318687.728570:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174
00000100:00100000:1.0:1767318687.728635:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940327168:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318687.855017:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318688.176966:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318688.756319:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940327296:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318688.756424:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318688.756641:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327296
00000100:00100000:3.0:1767318688.756651:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327296
00000100:00100000:3.0:1767318688.756722:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175
00000100:00100000:3.0:1767318688.756733:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940327296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318688.756767:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318688.756854:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940327296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (429us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318688.756861:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175
00000100:00080000:0.0:1767318688.756942:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318688.758522:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940327296:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318688.877330:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318689.197067:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318689.900904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318690.227879:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318690.891165:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318690.891649:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276352
00000100:00100000:2.0:1767318690.891662:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276352
00000100:00080000:0.0:1767318690.891819:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318690.891928:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4037
00000100:00100000:3.0:1767318690.892044:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894276352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318690.892162:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894276352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 225us (1007us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318690.892171:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4037
00000100:00100000:0.0:1767318690.900140:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318690.900309:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276224
00000100:00100000:3.0:1767318690.900321:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276224
00000100:00100000:3.0:1767318690.900381:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16460
00000100:00100000:3.0:1767318690.900389:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894276224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318690.900416:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318690.900492:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894276224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (363us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318690.900500:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16460
00000100:00100000:2.0:1767318690.925044:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318691.245354:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318691.310838:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318691.310851:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318691.310854:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318691.310857:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318691.310862:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318691.310870:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3936
00000100:00080000:2.0:1767318691.310875:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318691.310881:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318691.310925:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940327424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318691.310964:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318691.310968:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318691.310970:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318691.310973:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3936
00000100:00080000:2.0:1767318691.310975:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318691.310979:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318691.311002:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940327552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318691.311077:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318691.311081:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318691.311082:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318691.311086:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3936
00000100:00080000:2.0:1767318691.311089:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318691.311093:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318691.311104:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abce00 x1853163940328064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318691.311120:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318691.311122:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318691.311124:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318691.311126:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3936
00000100:00080000:2.0:1767318691.311129:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318691.311132:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318691.311140:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940328320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318691.311174:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940327936:0@lo:400:kworker.0
00000100:00100000:2.0:1767318691.311260:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318691.311348:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318691.311355:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940328192:0@lo:400:kworker.0
00000100:00100000:2.0:1767318691.311378:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318691.311409:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327936
00000100:00100000:2.0:1767318691.311415:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327936
00000100:00100000:2.0:1767318691.311469:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328192
00000100:00100000:2.0:1767318691.311472:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328192
00000100:00100000:2.0:1767318691.311497:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038
00000100:00100000:2.0:1767318691.311505:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940327936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318691.311558:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940327936:12345-0@lo:400:kworker.0 Request processed in 54us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318691.311566:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038
00000100:00100000:2.0:1767318691.311583:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039
00000100:00100000:2.0:1767318691.311590:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940328192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318691.311616:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940328192:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318691.311622:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039
00000100:00100000:2.0:1767318691.311667:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940328192:0@lo:400:kworker.0
00000100:00100000:3.0:1767318691.311672:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940327808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318691.311677:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940327936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318691.311708:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318691.311734:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318691.311739:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940327680:0@lo:400:kworker.0
00000100:00100000:3.0:1767318691.311760:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.312311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940327424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318691.312344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.312369:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940327552:0@lo:38:kworker.0
00000100:00100000:0.0:1767318691.312388:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.312409:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940328064:0@lo:38:kworker.0
00000100:00100000:0.0:1767318691.312425:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.312437:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940328320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318691.312452:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.312477:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327808
00000100:00100000:0.0:1767318691.312481:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327808
00000100:00100000:0.0:1767318691.312511:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327680
00000100:00100000:0.0:1767318691.312513:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327680
00000100:00100000:0.0:1767318691.312530:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649
00000100:00100000:0.0:1767318691.312535:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940327808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318691.312569:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940327808:12345-0@lo:400:kworker.0 Request processed in 33us (861us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318691.312574:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649
00000100:00100000:0.0:1767318691.312585:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1767318691.312591:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940327680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318691.312610:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940327680:12345-0@lo:400:kworker.0 Request processed in 19us (849us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318691.312625:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1767318691.312649:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327424
00000100:00100000:0.0:1767318691.312652:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327424
00000100:00100000:0.0:1767318691.312667:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328064
00000100:00100000:0.0:1767318691.312669:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328064
00000100:00100000:0.0:1767318691.312679:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328320
00000100:00100000:0.0:1767318691.312681:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328320
00000100:00100000:0.0:1767318691.312694:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16461
00000100:00100000:0.0:1767318691.312698:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940327424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318691.312718:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318691.312749:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940327424:12345-0@lo:38:kworker.0 Request processed in 49us (404us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318691.312755:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16461
00000100:00100000:0.0:1767318691.312766:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16462
00000100:00100000:0.0:1767318691.312769:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940328064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318691.312802:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318691.312826:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940328064:12345-0@lo:38:kworker.0 Request processed in 55us (400us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318691.312831:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16462
00000100:00100000:0.0:1767318691.312842:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16463
00000100:00100000:0.0:1767318691.312845:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940328320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318691.312853:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318691.312870:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940328320:12345-0@lo:38:kworker.0 Request processed in 24us (417us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318691.312875:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16463
00000100:00080000:0.0:1767318691.312896:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318691.312899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318691.312902:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318691.312921:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940327680:0@lo:400:kworker.0
00000100:00100000:0.0:1767318691.312931:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940327808:0@lo:400:kworker.0
00000100:00080000:0.0:1767318691.312974:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318691.312979:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318691.312990:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940327424:0@lo:38:kworker.0
00000100:00080000:0.0:1767318691.312998:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318691.313000:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318691.313003:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940328064:0@lo:38:kworker.0
00000100:00080000:0.0:1767318691.313009:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318691.313012:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318691.313015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940328320:0@lo:38:kworker.0
00000100:00100000:1.0:1767318691.313347:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940327552
00000100:00100000:1.0:1767318691.313353:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940327552
00000100:00100000:1.0:1767318691.313386:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998
00000100:00100000:1.0:1767318691.313392:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940327552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318691.313402:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318691.313441:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940327552:12345-0@lo:38:kworker.0 Request processed in 48us (1051us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318691.313447:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998
00000100:00080000:1.0:1767318691.313473:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318691.313477:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318691.313480:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940327552:0@lo:38:kworker.0
00000100:00100000:2.0:1767318691.948969:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318692.269085:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318692.845082:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940328448:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318692.845177:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318692.845884:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328448
00000100:00100000:1.0:1767318692.845893:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328448
00000100:00100000:1.0:1767318692.845949:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176
00000100:00100000:1.0:1767318692.845972:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940328448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318692.846004:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318692.846064:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940328448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (886us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318692.846070:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176
00000100:00100000:0.0:1767318692.846580:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940328448:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318692.972941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318693.293475:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318693.878604:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940328576:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318693.878682:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318693.878819:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328576
00000100:00100000:2.0:1767318693.878829:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328576
00000100:00100000:2.0:1767318693.878906:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177
00000100:00100000:2.0:1767318693.878916:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940328576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318693.878947:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318693.881985:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318693.889885:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940328576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10948us (11179us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318693.889904:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177
00000100:00100000:3.0:1767318693.894851:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940328576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318693.997664:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318694.317160:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318695.020949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318695.341030:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318696.008013:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318696.008440:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276608
00000100:00100000:3.0:1767318696.008451:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276608
00000100:00080000:1.0:1767318696.008506:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318696.008538:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4040
00000100:00100000:3.0:1767318696.008550:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894276608:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318696.008631:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894276608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (629us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318696.008640:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4040
00000100:00100000:1.0:1767318696.009918:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318696.010095:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276480
00000100:00100000:3.0:1767318696.010104:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276480
00000100:00100000:3.0:1767318696.010156:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16464
00000100:00100000:3.0:1767318696.010165:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894276480:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318696.010220:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318696.010372:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894276480:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 207us (459us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318696.010381:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16464
00000100:00100000:2.0:1767318696.045951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318696.368279:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318696.428894:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318696.428912:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318696.428915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318696.428920:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318696.428926:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318696.428937:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3941
00000100:00080000:2.0:1767318696.428943:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318696.428951:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318696.429007:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8000 x1853163940328704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318696.429030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318696.429034:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318696.429037:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318696.429042:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3941
00000100:00080000:2.0:1767318696.429045:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318696.429049:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318696.429068:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940328832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318696.429155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318696.429159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318696.429161:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318696.429165:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3941
00000100:00080000:2.0:1767318696.429168:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318696.429173:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318696.429201:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71180 x1853163940329344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318696.429224:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318696.429228:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318696.429230:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318696.429234:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3941
00000100:00100000:3.0:1767318696.429235:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940328960:0@lo:400:kworker.0
00000100:00080000:2.0:1767318696.429237:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318696.429242:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318696.429324:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318696.429549:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318696.429557:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940329088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.429581:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318696.430377:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70700 x1853163940329600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318696.430426:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940329216:0@lo:400:kworker.0
00000100:00100000:2.0:1767318696.430484:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318696.431165:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328960
00000100:00100000:3.0:1767318696.431176:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328960
00000100:00100000:3.0:1767318696.431261:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329088
00000100:00100000:3.0:1767318696.431265:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329088
00000100:00100000:3.0:1767318696.431299:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651
00000100:00100000:3.0:1767318696.431312:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940328960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.431381:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940328960:12345-0@lo:400:kworker.0 Request processed in 74us (2059us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318696.431390:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651
00000100:00100000:3.0:1767318696.431416:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652
00000100:00100000:3.0:1767318696.431424:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940329088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.432396:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940329088:12345-0@lo:400:kworker.0 Request processed in 968us (2808us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318696.432406:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652
00000100:00100000:3.0:1767318696.432952:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329216
00000100:00100000:3.0:1767318696.432960:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329216
00000100:00100000:3.0:1767318696.433020:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041
00000100:00100000:3.0:1767318696.433029:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940329216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433086:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940329216:12345-0@lo:400:kworker.0 Request processed in 59us (2603us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318696.433097:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041
00000100:00100000:3.0:1767318696.433127:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940329472:0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433161:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318696.433211:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329472
00000100:00100000:3.0:1767318696.433215:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329472
00000100:00100000:3.0:1767318696.433239:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042
00000100:00100000:3.0:1767318696.433244:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940329472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433274:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940329472:12345-0@lo:400:kworker.0 Request processed in 29us (115us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318696.433279:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042
00000100:00100000:3.0:1767318696.433311:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940329472:0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433341:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940329088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433351:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940328960:0@lo:400:kworker.0
00000100:00100000:3.0:1767318696.433415:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940328704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.433439:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318696.433706:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940329216:0@lo:400:kworker.0
00000100:00100000:2.0:1767318696.433735:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328704
00000100:00100000:2.0:1767318696.433738:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328704
00000100:00100000:2.0:1767318696.433761:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465
00000100:00100000:2.0:1767318696.433765:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940328704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318696.433800:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318696.433834:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940328704:12345-0@lo:38:kworker.0 Request processed in 66us (394us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318696.433840:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465
00000100:00080000:2.0:1767318696.433877:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318696.433883:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318696.433885:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318696.434302:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318696.434308:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318696.434312:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940328704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.434319:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940328832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.434344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318696.434371:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940329344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.434387:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318696.434398:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940329600:0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.434413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318696.435385:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940328832
00000100:00100000:2.0:1767318696.435394:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940328832
00000100:00100000:2.0:1767318696.435437:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999
00000100:00100000:2.0:1767318696.435445:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940328832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318696.435465:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318696.435514:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940328832:12345-0@lo:38:kworker.0 Request processed in 69us (1169us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318696.435522:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999
00000100:00100000:2.0:1767318696.435544:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329344
00000100:00100000:2.0:1767318696.435548:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329344
00000100:00080000:3.0:1767318696.435589:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318696.435595:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318696.435599:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940328832:0@lo:38:kworker.0
00000100:00100000:2.0:1767318696.435667:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329600
00000100:00100000:2.0:1767318696.435671:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329600
00000100:00100000:2.0:1767318696.438747:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16466
00000100:00100000:2.0:1767318696.438766:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940329344:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318696.438767:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16467
00000100:00100000:3.0:1767318696.438785:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940329600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318696.438804:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318696.438894:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940329344:12345-0@lo:38:kworker.0 Request processed in 130us (4505us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318696.438900:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16466
00000100:00080000:2.0:1767318696.438972:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318696.438978:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318696.438982:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940329344:0@lo:38:kworker.0
00010000:00020000:3.0:1767318696.439611:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318696.439680:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940329600:12345-0@lo:38:kworker.0 Request processed in 904us (5264us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318696.439687:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16467
00000100:00080000:2.0:1767318696.439839:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318696.439844:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318696.439848:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940329600:0@lo:38:kworker.0
00000100:00100000:2.0:1767318697.069053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318697.389195:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318697.965199:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318697.965224:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940329728:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318697.965294:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318697.965566:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329728
00000100:00100000:0.0:1767318697.965575:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329728
00000100:00100000:0.0:1767318697.965641:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178
00000100:00100000:0.0:1767318697.965650:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940329728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318697.965687:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318697.965753:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940329728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318697.965761:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178
00000100:00100000:2.0:1767318697.965912:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940329728:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318698.093057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318698.414006:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318698.991187:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318698.991214:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940329856:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318698.991289:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318698.991444:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329856
00000100:00100000:1.0:1767318698.991454:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329856
00000100:00100000:1.0:1767318698.991537:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179
00000100:00100000:1.0:1767318698.991547:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940329856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318698.991582:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318698.991632:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940329856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318698.991640:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179
00000100:00100000:1.0:1767318698.991685:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940329856:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318698.992036:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318699.117132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318699.437078:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318700.112074:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318700.112115:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894276736 offset 0 length 520: 4
00000100:00100000:1.0:1767318700.112228:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318700.112359:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276992
00000100:00100000:0.0:1767318700.112371:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276992
00000100:00100000:0.0:1767318700.112456:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894276864
00000100:00100000:0.0:1767318700.112461:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894276864
00000100:00100000:0.0:1767318700.112480:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4043
00000100:00100000:0.0:1767318700.112491:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894276992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318700.112597:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894276992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 107us (534us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318700.112605:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4043
00000100:00100000:0.0:1767318700.112625:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16468
00000100:00100000:0.0:1767318700.112630:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894276864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318700.112656:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318700.112681:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894276864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (453us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318700.112686:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16468
00000100:00080000:2.0:1767318700.113097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318700.140939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318700.461378:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318701.164928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318701.486435:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318701.549082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318701.549095:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318701.549099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318701.549103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318701.549108:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318701.549116:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3946
00000100:00080000:2.0:1767318701.549121:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318701.549128:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318701.549179:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac700 x1853163940329984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318701.549214:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318701.549218:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318701.549220:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318701.549224:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3946
00000100:00080000:2.0:1767318701.549226:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318701.549230:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318701.549249:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940330112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318701.549322:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318701.549325:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318701.549327:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318701.549331:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3946
00000100:00080000:2.0:1767318701.549334:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318701.549338:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318701.549351:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940330624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318701.549367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318701.549370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318701.549372:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318701.549375:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3946
00000100:00080000:2.0:1767318701.549377:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318701.549381:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318701.549432:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940330240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318701.549517:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318701.549602:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318701.549609:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940330368:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.549659:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221880 x1853163940330880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318701.549687:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940330752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.549722:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.549745:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318701.549750:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940330496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.549769:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.549824:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330752
00000100:00100000:2.0:1767318701.549832:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330752
00000100:00100000:2.0:1767318701.549893:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330496
00000100:00100000:2.0:1767318701.549896:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330496
00000100:00100000:2.0:1767318701.549927:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044
00000100:00100000:2.0:1767318701.549935:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940330752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.549989:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940330752:12345-0@lo:400:kworker.0 Request processed in 54us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318701.549998:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044
00000100:00100000:2.0:1767318701.550017:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045
00000100:00100000:2.0:1767318701.550023:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940330496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.550048:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940330496:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318701.550053:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045
00000100:00080000:2.0:1767318701.550073:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318701.550102:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940330496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.550111:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940330752:0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.550393:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330240
00000100:00100000:3.0:1767318701.550399:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330240
00000100:00100000:3.0:1767318701.550448:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653
00000100:00100000:3.0:1767318701.550467:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940330240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.550508:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940330240:12345-0@lo:400:kworker.0 Request processed in 44us (991us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318701.550514:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653
00000100:00100000:0.0:1767318701.550660:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940329984:0@lo:38:kworker.0
00000100:00100000:0.0:1767318701.550693:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318701.550726:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940330112:0@lo:38:kworker.0
00000100:00100000:0.0:1767318701.550749:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318701.550770:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940330624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318701.550814:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318701.550833:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940330880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318701.550854:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318701.550887:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330112
00000100:00100000:0.0:1767318701.550891:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330112
00000100:00100000:0.0:1767318701.550915:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000
00000100:00100000:0.0:1767318701.550920:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940330112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318701.550940:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318701.550974:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940330112:12345-0@lo:38:kworker.0 Request processed in 53us (223us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318701.550980:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000
00000100:00100000:0.0:1767318701.551001:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940329984
00000100:00100000:0.0:1767318701.551004:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940329984
00000100:00100000:0.0:1767318701.551021:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330624
00000100:00100000:0.0:1767318701.551024:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330624
00000100:00100000:0.0:1767318701.551036:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330880
00000100:00100000:0.0:1767318701.551039:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330880
00000100:00100000:0.0:1767318701.551048:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469
00000100:00100000:0.0:1767318701.551052:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940329984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318701.551063:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318701.551089:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940329984:12345-0@lo:38:kworker.0 Request processed in 34us (394us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318701.551095:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469
00000100:00100000:0.0:1767318701.551106:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470
00000100:00100000:0.0:1767318701.551110:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940330624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318701.551118:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318701.551152:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940330624:12345-0@lo:38:kworker.0 Request processed in 29us (326us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318701.551157:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470
00000100:00100000:0.0:1767318701.551168:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16471
00000100:00100000:0.0:1767318701.551171:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940330880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318701.551180:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318701.551203:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940330880:12345-0@lo:38:kworker.0 Request processed in 30us (348us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318701.551209:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16471
00000100:00080000:0.0:1767318701.551245:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318701.551250:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318701.551254:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940329984:0@lo:38:kworker.0
00000100:00080000:0.0:1767318701.551262:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318701.551266:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318701.551268:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940330112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318701.551275:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318701.551279:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318701.551281:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940330624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318701.551288:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318701.551291:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318701.551294:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940330880:0@lo:38:kworker.0
00000100:00080000:2.0:1767318701.551433:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318701.551586:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318701.551676:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940330240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.553153:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940330368
00000100:00100000:3.0:1767318701.553169:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940330368
00000100:00100000:3.0:1767318701.553331:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654
00000100:00100000:3.0:1767318701.553344:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940330368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.553444:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940330368:12345-0@lo:400:kworker.0 Request processed in 104us (1858us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318701.553453:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654
00000100:00100000:1.0:1767318701.553828:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940330368:0@lo:400:kworker.0
00000100:00080000:2.0:1767318701.561358:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318702.189264:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318702.511591:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318703.085643:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318703.085671:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940331008:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318703.085764:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318703.086003:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331008
00000100:00100000:0.0:1767318703.086015:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331008
00000100:00080000:2.0:1767318703.086151:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318703.086207:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180
00000100:00100000:0.0:1767318703.086229:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940331008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318703.086264:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318703.086331:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940331008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (566us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318703.086343:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180
00000100:00100000:3.0:1767318703.086431:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940331008:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318703.216274:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318703.537562:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318704.109228:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940331136:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318704.109347:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318704.109608:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331136
00000100:00100000:0.0:1767318704.109620:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331136
00000100:00100000:0.0:1767318704.109718:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181
00000100:00100000:0.0:1767318704.109731:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940331136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318704.109803:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318704.109863:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940331136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (515us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318704.109870:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181
00000100:00100000:3.0:1767318704.110065:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940331136:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318704.110147:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318704.237441:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318704.557318:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318705.228501:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318705.228814:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277248
00000100:00100000:3.0:1767318705.228827:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277248
00000100:00100000:3.0:1767318705.228921:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4046
00000100:00100000:3.0:1767318705.228934:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894277248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318705.229021:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894277248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (535us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318705.229029:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4046
00000100:00080000:1.0:1767318705.229267:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318705.230349:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318705.230437:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277120
00000100:00100000:2.0:1767318705.230445:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277120
00000100:00100000:2.0:1767318705.230486:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16472
00000100:00100000:2.0:1767318705.230493:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894277120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318705.230516:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318705.230573:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894277120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 79us (233us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318705.230581:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16472
00000100:00100000:2.0:1767318705.262055:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318705.581316:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318706.285436:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318706.611007:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318706.668986:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318681/real 1767318681]  req@ffff93cf45d8a680 x1853163940324736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318706.669032:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45d8a680 x1853163940324736/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318706.669055:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318706.669063:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318706.669067:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940324736:0@lo:250:kworker.0
00000100:00080000:1.0:1767318706.671063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318706.671075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318706.671080:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318706.671090:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1767318706.671105:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318706.671115:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318706.671156:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1f80 x1853163940331264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318706.671192:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318706.671196:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318706.671197:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318706.671200:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1767318706.671202:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318706.671206:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318706.671218:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1880 x1853163940331392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318706.671226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318706.671229:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318706.671230:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318706.671234:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1767318706.671236:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318706.671239:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318706.671250:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1c00 x1853163940331520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318706.671321:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318706.671326:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318706.671328:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318706.671331:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1767318706.671335:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318706.671339:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318706.671350:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0380 x1853163940332032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318706.671364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318706.671367:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318706.671369:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318706.671372:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1767318706.671375:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318706.671379:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318706.671390:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0a80 x1853163940332288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318706.671431:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940331904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.671529:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.672655:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940331648:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.672723:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.672766:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940332160:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.672808:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.672839:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331904
00000100:00100000:3.0:1767318706.672848:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331904
00000100:00100000:3.0:1767318706.672930:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332160
00000100:00100000:3.0:1767318706.672934:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332160
00000100:00100000:3.0:1767318706.672967:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047
00000100:00100000:0.0:1767318706.673042:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940331776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318706.673072:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318706.673117:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048
00000100:00100000:0.0:1767318706.673125:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940332160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318706.673181:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940332160:12345-0@lo:400:kworker.0 Request processed in 56us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318706.673188:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048
00000100:00100000:0.0:1767318706.673234:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331648
00000100:00100000:0.0:1767318706.673237:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331648
00000100:00100000:0.0:1767318706.673264:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331776
00000100:00100000:0.0:1767318706.673266:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331776
00000100:00100000:0.0:1767318706.673282:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655
00000100:00100000:0.0:1767318706.673288:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940331648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318706.673318:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940331648:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318706.673324:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655
00000100:00100000:0.0:1767318706.673336:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656
00000100:00100000:0.0:1767318706.673341:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940331776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318706.673365:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940331776:12345-0@lo:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318706.673371:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656
00000100:00080000:0.0:1767318706.673418:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318706.673422:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318706.673424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318706.673468:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940331264:0@lo:250:kworker.0
00000400:00000100:0.0:1767318706.673488:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940331264 offset 0 length 520: 4
00000100:00100000:3.0:1767318706.673932:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940331904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.673976:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940331904:12345-0@lo:400:kworker.0 Request processed in 1001us (2447us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318706.673983:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047
00000100:00100000:1.0:1767318706.675304:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940331904:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.686890:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940331648:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.687331:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940332160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.687530:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940331392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318706.687649:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940331776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.687731:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318706.687800:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940331520:0@lo:38:kworker.0
00000100:00100000:1.0:1767318706.687835:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318706.687852:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940332032:0@lo:38:kworker.0
00000100:00100000:1.0:1767318706.687875:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318706.687892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940332288:0@lo:38:kworker.0
00000100:00100000:1.0:1767318706.687913:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318706.687956:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331392
00000100:00100000:1.0:1767318706.687964:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331392
00000100:00100000:1.0:1767318706.687999:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332032
00000100:00100000:1.0:1767318706.688003:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332032
00000100:00100000:1.0:1767318706.688016:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332288
00000100:00100000:1.0:1767318706.688018:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332288
00000100:00100000:1.0:1767318706.688035:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473
00000100:00100000:1.0:1767318706.688042:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940331392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318706.688062:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318706.688124:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940331392:12345-0@lo:38:kworker.0 Request processed in 81us (393us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318706.688131:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473
00000100:00100000:1.0:1767318706.688148:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16474
00000100:00100000:1.0:1767318706.688152:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940332032:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318706.688160:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318706.688184:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940332032:12345-0@lo:38:kworker.0 Request processed in 31us (309us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318706.688189:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16474
00000100:00100000:1.0:1767318706.688199:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16475
00000100:00100000:1.0:1767318706.688202:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940332288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318706.688211:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318706.688231:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940332288:12345-0@lo:38:kworker.0 Request processed in 27us (317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318706.688237:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16475
00000100:00080000:1.0:1767318706.688278:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318706.688284:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318706.688288:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940331392:0@lo:38:kworker.0
00000100:00080000:1.0:1767318706.688297:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318706.688301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318706.688304:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940332032:0@lo:38:kworker.0
00000100:00080000:1.0:1767318706.688310:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318706.688313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318706.688315:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940332288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318706.688395:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940331520
00000100:00100000:0.0:1767318706.688399:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940331520
00000100:00100000:0.0:1767318706.688429:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001
00000100:00100000:0.0:1767318706.688711:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940331520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318706.688723:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318706.688790:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940331520:12345-0@lo:38:kworker.0 Request processed in 62us (937us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318706.688798:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001
00000100:00080000:3.0:1767318706.689067:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318706.689072:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318706.689076:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940331520:0@lo:38:kworker.0
00000100:00100000:2.0:1767318707.309138:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318707.634137:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318708.205064:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940332416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318708.205175:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318708.205556:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332416
00000100:00100000:1.0:1767318708.205566:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332416
00000100:00100000:1.0:1767318708.205686:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182
00000100:00100000:1.0:1767318708.205697:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940332416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318708.205728:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318708.205814:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940332416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (638us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318708.205823:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182
00000100:00100000:3.0:1767318708.205903:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940332416:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318708.206093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318708.333035:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318708.653216:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318709.230881:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318709.230912:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940332544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318709.230991:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318709.232281:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332544
00000100:00100000:0.0:1767318709.232292:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332544
00000100:00100000:0.0:1767318709.232368:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183
00000100:00100000:0.0:1767318709.232378:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940332544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318709.232409:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318709.232483:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940332544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1491us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318709.232490:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183
00000100:00100000:0.0:1767318709.232545:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940332544:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318709.232875:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318709.356953:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318709.679280:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318710.343227:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318710.343474:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277504
00000100:00100000:3.0:1767318710.343485:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277504
00000100:00100000:3.0:1767318710.343570:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4049
00000100:00100000:3.0:1767318710.343581:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894277504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318710.343648:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894277504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (433us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318710.343655:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4049
00000100:00100000:1.0:1767318710.343907:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318710.344022:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277376
00000100:00100000:2.0:1767318710.344027:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277376
00000100:00080000:0.0:1767318710.344789:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318710.348993:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16476
00000100:00100000:2.0:1767318710.349009:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894277376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318710.349038:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318710.349134:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894277376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 125us (5226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318710.349142:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16476
00000100:00100000:2.0:1767318710.380903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318710.701025:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318711.404894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318711.725020:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318711.801543:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318711.801555:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318711.801558:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318711.801561:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318711.801566:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318711.801573:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3956
00000100:00080000:3.0:1767318711.801580:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318711.801586:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318711.802318:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71180 x1853163940332672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318711.802355:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318711.802359:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318711.802361:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318711.802365:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3956
00000100:00080000:3.0:1767318711.802367:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318711.802371:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318711.802386:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72a00 x1853163940332800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318711.802483:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940332928:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.802549:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318711.802668:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940332672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318711.802712:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318711.802736:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940332800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318711.802767:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318711.802831:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332800
00000100:00100000:1.0:1767318711.802839:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332800
00000100:00100000:1.0:1767318711.802876:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002
00000100:00100000:1.0:1767318711.802884:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940332800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318711.802903:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318711.802976:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940332800:12345-0@lo:38:kworker.0 Request processed in 91us (207us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318711.802983:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002
00000100:00100000:0.0:1767318711.805293:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332928
00000100:00100000:0.0:1767318711.805309:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332928
00000100:00100000:0.0:1767318711.805379:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657
00000100:00100000:0.0:1767318711.805388:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940332928:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318711.805625:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318711.805631:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318711.805634:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940332800:0@lo:38:kworker.0
00000100:00080000:1.0:1767318711.805750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318711.805798:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940332672
00000100:00100000:1.0:1767318711.805802:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940332672
00000100:00100000:1.0:1767318711.805834:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16477
00000100:00100000:1.0:1767318711.805839:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940332672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318711.805859:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318711.805898:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940332672:12345-0@lo:38:kworker.0 Request processed in 58us (3185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318711.805905:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16477
00000100:00080000:1.0:1767318711.805931:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318711.805935:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318711.805938:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940332672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318711.806898:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318711.806945:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318711.806995:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333056
00000100:00100000:1.0:1767318711.806999:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333056
00000100:00100000:1.0:1767318711.807054:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658
00000100:00100000:1.0:1767318711.807061:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318711.807097:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333056:12345-0@lo:400:kworker.0 Request processed in 36us (151us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318711.807102:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658
00000100:00080000:1.0:1767318711.807118:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318711.807147:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.817328:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940332928:12345-0@lo:400:kworker.0 Request processed in 11929us (14765us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318711.817344:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657
00000100:00080000:3.0:1767318711.818122:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318711.818135:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318711.818139:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318711.818144:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3956
00000100:00080000:3.0:1767318711.818148:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318711.818154:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318711.818174:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95f80 x1853163940333312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318711.818213:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940333312:0@lo:38:kworker.0
00000100:00100000:3.0:1767318711.818269:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318711.818316:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333312
00000100:00100000:3.0:1767318711.818322:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333312
00000100:00100000:3.0:1767318711.818350:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16478
00000100:00100000:3.0:1767318711.818356:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940333312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318711.818375:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318711.818409:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940333312:12345-0@lo:38:kworker.0 Request processed in 51us (138us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318711.818414:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16478
00000100:00080000:3.0:1767318711.818446:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318711.818450:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318711.818453:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940333312:0@lo:38:kworker.0
00000100:00080000:3.0:1767318711.818480:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318711.818483:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318711.818485:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318711.818488:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3956
00000100:00080000:3.0:1767318711.818491:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318711.818495:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318711.818504:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96300 x1853163940333568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318711.818533:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940333568:0@lo:38:kworker.0
00000100:00100000:3.0:1767318711.818553:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318711.818572:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333568
00000100:00100000:3.0:1767318711.818575:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333568
00000100:00100000:3.0:1767318711.818591:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16479
00000100:00100000:3.0:1767318711.818595:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940333568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318711.818604:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318711.818969:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940333184:0@lo:400:kworker.0
00000100:00100000:1.0:1767318711.819053:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940333440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.820464:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940332928:0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.823402:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318711.823507:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333184
00000100:00100000:0.0:1767318711.823528:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333184
00000100:00100000:0.0:1767318711.823598:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050
00000100:00100000:0.0:1767318711.823608:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940333184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.823680:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940333184:12345-0@lo:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318711.824371:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050
00000100:00100000:0.0:1767318711.824433:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940333184:0@lo:400:kworker.0
00000100:00080000:0.0:1767318711.824472:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318711.826441:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318711.826911:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333440
00000100:00100000:2.0:1767318711.826930:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333440
00000100:00100000:2.0:1767318711.827012:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051
00000100:00100000:2.0:1767318711.827021:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940333440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.827101:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940333440:12345-0@lo:400:kworker.0 Request processed in 82us (666us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318711.827108:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051
00000100:00100000:1.0:1767318711.827478:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940333440:0@lo:400:kworker.0
00000100:00080000:0.0:1767318711.829699:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318711.832092:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940333568:12345-0@lo:38:kworker.0 Request processed in 13482us (13525us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318711.832111:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16479
00000100:00080000:0.0:1767318711.840889:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318711.840903:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318711.840909:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940333568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318712.428961:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318712.750123:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318713.325135:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318713.325167:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318713.325243:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318713.325513:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333696
00000100:00100000:0.0:1767318713.325523:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333696
00000100:00100000:0.0:1767318713.325601:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184
00000100:00100000:0.0:1767318713.325611:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318713.325643:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318713.325670:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318713.325737:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (493us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318713.325745:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184
00000100:00100000:3.0:1767318713.325943:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318713.453122:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318713.773055:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318714.349829:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318714.349921:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318714.350114:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333824
00000100:00100000:0.0:1767318714.350123:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333824
00000100:00100000:0.0:1767318714.350194:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185
00000100:00080000:1.0:1767318714.350312:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318714.350342:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318714.350375:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318714.350505:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940333824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 303us (584us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318714.350512:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185
00000100:00100000:3.0:1767318714.350826:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940333824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318714.477090:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318714.797879:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318715.465384:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318715.465513:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318715.472956:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277632
00000100:00100000:3.0:1767318715.472970:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277632
00000100:00100000:3.0:1767318715.473068:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277760
00000100:00100000:3.0:1767318715.473072:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277760
00000100:00080000:0.0:1767318715.473153:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318715.475566:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4052
00000100:00100000:1.0:1767318715.475593:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894277760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318715.475660:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16480
00000100:00100000:2.0:1767318715.475668:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894277632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318715.475692:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318715.475917:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894277760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 335us (10402us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318715.475926:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4052
00000100:00100000:0.0:1767318715.506051:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767318715.512878:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894277632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 37195us (47784us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318715.512896:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16480
00010000:00010000:1.0:1767318715.825877:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318716.524912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318716.845081:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318716.909496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318716.909506:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318716.909509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318716.909513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318716.909517:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318716.909525:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3961
00000100:00080000:1.0:1767318716.909530:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318716.909537:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318716.909571:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3100 x1853163940333952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318716.909604:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318716.909607:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318716.909609:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318716.909612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3961
00000100:00080000:1.0:1767318716.909615:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318716.909618:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318716.909633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1c00 x1853163940334080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318716.909704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318716.909707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318716.909710:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318716.909713:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3961
00000100:00080000:1.0:1767318716.909716:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318716.909720:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318716.909730:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72300 x1853163940334592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318716.909745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318716.909748:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318716.909750:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318716.909753:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3961
00000100:00080000:1.0:1767318716.909756:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318716.909759:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318716.909767:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5500 x1853163940334848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318716.909811:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.909880:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318716.909949:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318716.909955:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334208:0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910227:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318716.910258:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940334464:0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910284:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318716.910301:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318716.910306:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940334720:0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910324:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318716.910351:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334336
00000100:00100000:1.0:1767318716.910359:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334336
00000100:00100000:1.0:1767318716.910409:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659
00000100:00100000:1.0:1767318716.910418:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910460:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334336:12345-0@lo:400:kworker.0 Request processed in 43us (579us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318716.910467:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659
00000100:00100000:1.0:1767318716.910482:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334208
00000100:00100000:1.0:1767318716.910485:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334208
00000100:00100000:1.0:1767318716.910502:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660
00000100:00100000:1.0:1767318716.910507:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334208:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910529:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334208:12345-0@lo:400:kworker.0 Request processed in 21us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318716.910534:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660
00000100:00100000:1.0:1767318716.910568:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334208:0@lo:400:kworker.0
00000100:00100000:1.0:1767318716.910577:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318716.910822:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334464
00000100:00100000:3.0:1767318716.910827:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334464
00000100:00100000:3.0:1767318716.910862:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334720
00000100:00100000:3.0:1767318716.910866:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334720
00000100:00100000:3.0:1767318716.910888:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053
00000100:00100000:3.0:1767318716.910907:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940334464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318716.910949:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940334464:12345-0@lo:400:kworker.0 Request processed in 55us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318716.910955:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053
00000100:00100000:3.0:1767318716.911218:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054
00000100:00100000:3.0:1767318716.911231:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940334720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318716.911260:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940334720:12345-0@lo:400:kworker.0 Request processed in 33us (935us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318716.911266:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054
00000100:00100000:3.0:1767318716.911312:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940334720:0@lo:400:kworker.0
00000100:00100000:3.0:1767318716.911323:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940334464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318716.911570:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940333952:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.911604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318716.911634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940334080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.911661:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318716.911697:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940334592:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.911717:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318716.911731:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940334848:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.911747:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318716.911798:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334080
00000100:00100000:2.0:1767318716.911802:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334080
00000100:00100000:2.0:1767318716.911824:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003
00000100:00100000:2.0:1767318716.911829:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940334080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318716.911848:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318716.911882:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940334080:12345-0@lo:38:kworker.0 Request processed in 51us (219us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318716.911888:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003
00000100:00080000:2.0:1767318716.911923:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318716.911927:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318716.911931:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940334080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.911948:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940333952
00000100:00100000:2.0:1767318716.911952:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940333952
00000100:00100000:2.0:1767318716.911964:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334592
00000100:00100000:2.0:1767318716.911966:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334592
00000100:00100000:2.0:1767318716.912222:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334848
00000100:00100000:2.0:1767318716.912226:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334848
00000100:00100000:2.0:1767318716.912238:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16481
00000100:00100000:2.0:1767318716.912242:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940333952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318716.912253:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318716.912286:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940333952:12345-0@lo:38:kworker.0 Request processed in 42us (681us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318716.912292:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16481
00000100:00080000:2.0:1767318716.912311:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318716.912315:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318716.912318:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940333952:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.912336:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16482
00000100:00100000:2.0:1767318716.912340:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940334592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318716.912349:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318716.912375:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940334592:12345-0@lo:38:kworker.0 Request processed in 33us (657us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318716.912380:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16482
00000100:00080000:2.0:1767318716.912397:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318716.912400:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318716.912403:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940334592:0@lo:38:kworker.0
00000100:00100000:2.0:1767318716.912418:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16483
00000100:00100000:2.0:1767318716.912422:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940334848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318716.912431:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318716.912456:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940334848:12345-0@lo:38:kworker.0 Request processed in 33us (708us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318716.912462:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16483
00000100:00080000:2.0:1767318716.912481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318716.912486:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318716.912489:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940334848:0@lo:38:kworker.0
00000100:00080000:0.0:1767318716.912600:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318716.912606:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318716.912609:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318717.553165:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318717.869465:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318718.445015:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318718.445038:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318718.445113:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318718.445294:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940334976
00000100:00100000:1.0:1767318718.445303:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940334976
00000100:00100000:1.0:1767318718.445375:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186
00000100:00100000:1.0:1767318718.445385:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318718.445422:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318718.445470:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940334976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (356us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318718.445477:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186
00000100:00100000:1.0:1767318718.445524:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940334976:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318718.445797:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318718.573098:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318718.893318:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318719.469091:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318719.469118:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940335104:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318719.469192:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318719.477244:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335104
00000100:00100000:3.0:1767318719.477260:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335104
00000100:00100000:3.0:1767318719.477367:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187
00000100:00100000:3.0:1767318719.477381:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940335104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318719.477416:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318719.477586:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318719.477809:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940335104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 433us (8616us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318719.477817:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187
00000100:00100000:2.0:1767318719.477894:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940335104:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318719.596913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318719.917094:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318720.583018:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318720.583081:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318720.586479:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278016
00000100:00100000:3.0:1767318720.586494:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278016
00000100:00080000:0.0:1767318720.586598:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318720.589124:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894277888
00000100:00100000:1.0:1767318720.589141:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894277888
00000100:00100000:1.0:1767318720.589217:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4055
00000100:00100000:1.0:1767318720.589236:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894278016:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318720.589337:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894278016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (6331us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318720.589348:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4055
00000100:00100000:1.0:1767318720.589371:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16484
00000100:00100000:1.0:1767318720.589376:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894277888:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318720.589397:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318720.589427:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894277888:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (6345us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318720.589433:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16484
00000100:00100000:0.0:1767318720.620906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318720.943870:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318721.644941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318721.965025:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318722.031388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318722.031399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318722.031402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318722.031407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318722.031411:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318722.031420:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3966
00000100:00080000:2.0:1767318722.031425:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318722.031432:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318722.031475:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222a00 x1853163940335232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318722.031494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318722.031498:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318722.031501:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318722.031504:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3966
00000100:00080000:2.0:1767318722.031506:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318722.031510:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318722.031522:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223100 x1853163940335360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318722.031594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318722.031598:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318722.031600:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318722.031604:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3966
00000100:00080000:2.0:1767318722.031607:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318722.031612:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318722.031615:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940335616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.031626:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221880 x1853163940335872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318722.031645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318722.031649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318722.031650:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318722.031654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3966
00000100:00080000:2.0:1767318722.031656:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318722.031659:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318722.031670:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3100 x1853163940336128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318722.031696:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318722.031703:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940335744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.031745:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318722.031793:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318722.031794:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318722.031804:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940335488:0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.031805:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940336000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318722.031844:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318722.031850:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318722.031899:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335616
00000100:00100000:3.0:1767318722.031907:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335616
00000100:00100000:0.0:1767318722.031946:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940335232:0@lo:38:kworker.0
00000100:00100000:3.0:1767318722.031971:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335488
00000100:00100000:3.0:1767318722.031976:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335488
00000100:00100000:0.0:1767318722.031993:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318722.032005:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661
00000100:00100000:0.0:1767318722.032015:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940335360:0@lo:38:kworker.0
00000100:00100000:3.0:1767318722.032025:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940335616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318722.032338:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662
00000100:00100000:1.0:1767318722.032349:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940335488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.032438:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335744
00000100:00100000:2.0:1767318722.032442:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335744
00000100:00100000:2.0:1767318722.032473:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336000
00000100:00100000:2.0:1767318722.032476:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336000
00000100:00100000:2.0:1767318722.032495:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335232
00000100:00100000:2.0:1767318722.032498:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335232
00000100:00100000:2.0:1767318722.032514:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056
00000100:00100000:2.0:1767318722.032521:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940335744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.032557:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940335744:12345-0@lo:400:kworker.0 Request processed in 37us (811us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318722.032564:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056
00000100:00100000:2.0:1767318722.032580:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057
00000100:00100000:2.0:1767318722.032599:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940336000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.032624:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940336000:12345-0@lo:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318722.032629:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057
00000100:00100000:2.0:1767318722.032641:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16485
00000100:00100000:2.0:1767318722.032645:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940335232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318722.032663:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318722.032690:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940335232:12345-0@lo:38:kworker.0 Request processed in 42us (697us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318722.032696:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16485
00000100:00100000:2.0:1767318722.032741:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940336000:0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.032752:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940335744:0@lo:400:kworker.0
00000100:00080000:2.0:1767318722.032818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318722.032824:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318722.032825:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318722.033604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318722.033653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940335872:0@lo:38:kworker.0
00000100:00100000:0.0:1767318722.033689:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318722.033710:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940336128:0@lo:38:kworker.0
00000100:00100000:0.0:1767318722.033731:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318722.033765:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318722.033770:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318722.033794:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940335232:0@lo:38:kworker.0
00000100:00100000:0.0:1767318722.033837:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335872
00000100:00100000:0.0:1767318722.033841:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335872
00000100:00100000:0.0:1767318722.033868:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336128
00000100:00100000:0.0:1767318722.033871:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336128
00000100:00100000:0.0:1767318722.033887:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16486
00000100:00100000:0.0:1767318722.033892:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940335872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318722.033919:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318722.033962:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940335872:12345-0@lo:38:kworker.0 Request processed in 59us (263us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318722.033969:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16486
00000100:00100000:0.0:1767318722.033994:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16487
00000100:00100000:0.0:1767318722.033998:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940336128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318722.034007:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318722.034031:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940336128:12345-0@lo:38:kworker.0 Request processed in 31us (299us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318722.034048:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16487
00000100:00080000:0.0:1767318722.034081:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318722.034085:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318722.034088:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940335872:0@lo:38:kworker.0
00000100:00080000:0.0:1767318722.034095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318722.034097:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318722.034100:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940336128:0@lo:38:kworker.0
00000100:00100000:2.0:1767318722.036561:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940335360
00000100:00100000:2.0:1767318722.036572:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940335360
00000100:00100000:2.0:1767318722.036634:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004
00000100:00100000:2.0:1767318722.036643:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940335360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318722.036666:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318722.036733:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940335360:12345-0@lo:38:kworker.0 Request processed in 90us (3130us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318722.036740:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004
00000100:00100000:3.0:1767318722.036900:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940335616:12345-0@lo:400:kworker.0 Request processed in 4025us (4347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318722.036910:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661
00000100:00080000:0.0:1767318722.037185:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318722.037189:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318722.037193:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940335360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318722.038826:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940335488:12345-0@lo:400:kworker.0 Request processed in 6473us (6974us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318722.038841:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662
00000100:00100000:2.0:1767318722.043627:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940335488:0@lo:400:kworker.0
00000100:00100000:2.0:1767318722.043653:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940335616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318722.668916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318722.989710:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318723.565114:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940336256:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318723.565195:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318723.565363:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336256
00000100:00100000:1.0:1767318723.565373:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336256
00000100:00100000:1.0:1767318723.565473:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188
00000100:00100000:1.0:1767318723.565484:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940336256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318723.565518:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318723.565588:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940336256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318723.565594:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188
00000100:00100000:2.0:1767318723.565676:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940336256:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318723.693117:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318724.013461:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318724.589503:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940336384:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318724.589606:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318724.589637:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336384
00000100:00100000:1.0:1767318724.589647:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336384
00000100:00100000:1.0:1767318724.589736:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189
00000100:00100000:1.0:1767318724.589746:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940336384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318724.589803:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767318724.589809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318724.589863:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940336384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318724.589871:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189
00000100:00100000:2.0:1767318724.589913:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940336384:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318724.718354:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318725.041613:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318725.708354:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318725.708558:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278272
00000100:00100000:0.0:1767318725.708569:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278272
00000100:00100000:0.0:1767318725.708697:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4058
00000100:00100000:0.0:1767318725.708709:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894278272:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318725.708841:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894278272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 134us (499us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318725.708849:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4058
00000100:00080000:1.0:1767318725.708917:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318725.718937:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318725.718979:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894278400 offset 0 length 520: 4
00000100:00100000:0.0:1767318725.719141:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278144
00000100:00100000:0.0:1767318725.719150:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278144
00000100:00100000:0.0:1767318725.719208:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16488
00000100:00100000:0.0:1767318725.719217:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894278144:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318725.719242:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318725.719325:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894278144:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 107us (406us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318725.719333:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16488
00000100:00100000:0.0:1767318725.741069:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318726.061043:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318726.766544:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318727.086030:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318727.149247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318727.149259:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318727.149262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318727.149267:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318727.149272:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318727.149280:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1767318727.149294:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318727.149303:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318727.149348:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71500 x1853163940336512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318727.149378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318727.149382:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318727.149383:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318727.149387:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1767318727.149389:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318727.149392:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318727.149407:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940336640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318727.149469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318727.149472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318727.149475:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318727.149477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1767318727.149480:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318727.149483:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318727.149494:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401bb80 x1853163940337152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318727.149509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318727.149511:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318727.149513:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318727.149517:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1767318727.149521:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767318727.149525:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318727.149534:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940337408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318727.149605:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940336512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318727.149680:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.149740:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940336640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318727.149765:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.149807:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940337152:0@lo:38:kworker.0
00000100:00100000:2.0:1767318727.149828:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.149863:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940337408:0@lo:38:kworker.0
00000100:00100000:2.0:1767318727.149890:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.149938:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940337280:0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.149965:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.149986:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318727.149990:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940337024:0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.150008:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.150036:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336640
00000100:00100000:2.0:1767318727.150042:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336640
00000100:00100000:2.0:1767318727.150081:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005
00000100:00100000:2.0:1767318727.150098:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940336640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318727.150119:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318727.150132:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940336896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.150161:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940336640:12345-0@lo:38:kworker.0 Request processed in 64us (394us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318727.150162:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.150168:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005
00000100:00100000:0.0:1767318727.150186:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318727.150191:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940336768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.150191:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336512
00000100:00100000:2.0:1767318727.150194:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336512
00000100:00100000:0.0:1767318727.150213:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.150213:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337152
00000100:00100000:2.0:1767318727.150215:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337152
00000100:00100000:2.0:1767318727.150223:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337408
00000100:00100000:2.0:1767318727.150225:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337408
00000100:00100000:2.0:1767318727.150233:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337280
00000100:00100000:0.0:1767318727.150235:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337024
00000100:00100000:2.0:1767318727.150235:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337280
00000100:00100000:0.0:1767318727.150238:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337024
00000100:00100000:2.0:1767318727.150513:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059
00000100:00100000:1.0:1767318727.150562:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16489
00000100:00100000:1.0:1767318727.150567:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940336512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318727.150578:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318727.150609:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940336512:12345-0@lo:38:kworker.0 Request processed in 40us (928us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318727.150614:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16489
00000100:00100000:1.0:1767318727.150629:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16490
00000100:00100000:1.0:1767318727.150632:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940337152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318727.150640:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318727.150662:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940337152:12345-0@lo:38:kworker.0 Request processed in 28us (833us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318727.150668:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16490
00000100:00100000:1.0:1767318727.150678:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16491
00000100:00100000:1.0:1767318727.150682:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940337408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318727.150691:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318727.150716:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940337408:12345-0@lo:38:kworker.0 Request processed in 32us (832us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318727.150721:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16491
00000100:00100000:1.0:1767318727.150739:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336896
00000100:00100000:1.0:1767318727.150743:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336896
00000100:00100000:1.0:1767318727.150769:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940336768
00000100:00100000:1.0:1767318727.150791:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940336768
00000100:00100000:1.0:1767318727.150816:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663
00000100:00100000:1.0:1767318727.150823:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940336896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318727.150868:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940336896:12345-0@lo:400:kworker.0 Request processed in 45us (704us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318727.150874:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663
00000100:00100000:1.0:1767318727.151419:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664
00000100:00100000:1.0:1767318727.151428:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940336768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318727.151464:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940336768:12345-0@lo:400:kworker.0 Request processed in 38us (1250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318727.151469:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664
00000100:00100000:1.0:1767318727.151566:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940336768:0@lo:400:kworker.0
00000100:00100000:1.0:1767318727.151581:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940336896:0@lo:400:kworker.0
00000100:00080000:1.0:1767318727.151648:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318727.151654:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318727.151658:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940336512:0@lo:38:kworker.0
00000100:00080000:1.0:1767318727.151668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318727.151671:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318727.151673:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940336640:0@lo:38:kworker.0
00000100:00080000:1.0:1767318727.151681:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318727.151684:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318727.151687:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940337152:0@lo:38:kworker.0
00000100:00080000:1.0:1767318727.151696:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318727.151699:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318727.151701:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940337408:0@lo:38:kworker.0
00000100:00080000:1.0:1767318727.151738:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318727.151742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318727.151745:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318727.160016:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060
00000100:00100000:0.0:1767318727.160032:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940337024:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.161309:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940337280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318727.166667:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940337280:12345-0@lo:400:kworker.0 Request processed in 16134us (16686us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318727.166689:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059
00000100:00100000:0.0:1767318727.169610:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940337024:12345-0@lo:400:kworker.0 Request processed in 9569us (19585us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318727.169627:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060
00000100:00100000:3.0:1767318727.170411:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940337280:0@lo:400:kworker.0
00000100:00100000:3.0:1767318727.170449:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940337024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318727.788944:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318728.111232:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318728.685204:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318728.685232:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940337536:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318728.685327:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318728.685458:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337536
00000100:00100000:1.0:1767318728.685469:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337536
00000100:00100000:1.0:1767318728.685535:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190
00000100:00100000:1.0:1767318728.685545:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940337536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318728.685580:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318728.685633:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940337536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318728.685749:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940337536:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318728.685832:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190
00000100:00100000:0.0:1767318728.812850:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318729.133818:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318729.709985:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940337664:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318729.710058:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318729.711904:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337664
00000100:00100000:2.0:1767318729.711918:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337664
00000100:00100000:2.0:1767318729.712015:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191
00000100:00100000:2.0:1767318729.712025:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940337664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318729.712054:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318729.712499:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318729.712623:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940337664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 599us (2563us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318729.712632:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191
00000100:00100000:2.0:1767318729.712919:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940337664:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318729.837396:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318730.157905:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318730.822308:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318730.822395:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318730.822398:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278656
00000100:00100000:0.0:1767318730.822409:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278656
00000100:00100000:2.0:1767318730.822479:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278528
00000100:00100000:2.0:1767318730.822484:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278528
00000100:00100000:2.0:1767318730.822529:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16492
00000100:00100000:2.0:1767318730.822537:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894278528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318730.822561:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318730.822622:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894278528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 85us (226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318730.822630:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16492
00000100:00100000:0.0:1767318730.822745:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4061
00000100:00100000:0.0:1767318730.822755:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894278656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767318730.822848:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318730.823214:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894278656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 460us (913us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318730.823222:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4061
00000100:00100000:0.0:1767318730.861525:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318731.183336:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318731.245651:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318706/real 1767318706]  req@ffff93cf520d1f80 x1853163940331264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318731 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318731.245700:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf520d1f80 x1853163940331264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318731 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318731.245718:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318731.245743:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318731.245747:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940331264:0@lo:250:kworker.0
00000100:00080000:3.0:1767318731.246313:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318731.246320:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318731.246323:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318731.246328:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3956
00000100:00080000:3.0:1767318731.246332:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318731.246339:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318731.246382:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399d880 x1853163940337792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318731.246419:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318731.246423:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318731.246425:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318731.246428:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3977
00000100:00080000:3.0:1767318731.246431:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318731.246433:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318731.246450:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399f480 x1853163940337920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318731.246458:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318731.246461:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318731.246463:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318731.246466:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3977
00000100:00080000:3.0:1767318731.246468:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318731.246471:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318731.246484:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940338048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318731.246596:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940337792:0@lo:250:kworker.0
00000400:00000100:1.0:1767318731.246647:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940337792 offset 0 length 520: 4
00000100:00080000:3.0:1767318731.246691:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318731.246694:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318731.246696:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767318731.246698:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940337920:0@lo:38:kworker.0
00000100:00080000:3.0:1767318731.246700:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3977
00000100:00080000:3.0:1767318731.246703:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318731.246707:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318731.246717:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399fb80 x1853163940338560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318731.246728:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318731.246732:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318731.246735:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318731.246737:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318731.246740:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3977
00000100:00080000:3.0:1767318731.246743:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00100000:1.0:1767318731.246745:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940338048:0@lo:38:kworker.0
00000100:00080000:3.0:1767318731.246747:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318731.246755:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399c700 x1853163940338816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318731.246763:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318731.246809:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940338560:0@lo:38:kworker.0
00000100:00100000:3.0:1767318731.246811:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940338304:0@lo:400:kworker.0
00000100:00100000:2.0:1767318731.246886:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940338688:0@lo:400:kworker.0
00000100:00100000:0.0:1767318731.246952:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940338176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318731.247018:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318731.247038:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940338816:0@lo:38:kworker.0
00000100:00100000:1.0:1767318731.247058:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318731.247096:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338048
00000100:00100000:1.0:1767318731.247103:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338048
00000100:00100000:1.0:1767318731.247131:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006
00000100:00100000:1.0:1767318731.247138:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940338048:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318731.247160:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318731.247199:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940338048:12345-0@lo:38:kworker.0 Request processed in 61us (434us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318731.247209:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006
00000100:00100000:1.0:1767318731.247232:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940337920
00000100:00100000:1.0:1767318731.247235:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940337920
00000100:00100000:1.0:1767318731.247253:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338560
00000100:00100000:1.0:1767318731.247255:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338560
00000100:00100000:1.0:1767318731.247266:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338816
00000100:00100000:1.0:1767318731.247268:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338816
00000100:00100000:1.0:1767318731.247281:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16493
00000100:00100000:1.0:1767318731.247285:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940337920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318731.247295:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318731.247318:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940337920:12345-0@lo:38:kworker.0 Request processed in 31us (588us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318731.247323:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16493
00000100:00100000:1.0:1767318731.247334:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16494
00000100:00100000:1.0:1767318731.247338:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940338560:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318731.247346:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318731.247367:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940338560:12345-0@lo:38:kworker.0 Request processed in 27us (349us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318731.247372:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16494
00000100:00100000:1.0:1767318731.247382:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16495
00000100:00100000:1.0:1767318731.247386:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940338816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318731.247394:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318731.247414:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940338816:12345-0@lo:38:kworker.0 Request processed in 27us (355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318731.247420:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16495
00000100:00080000:1.0:1767318731.247461:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318731.247466:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318731.247470:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940338560:0@lo:38:kworker.0
00000100:00080000:1.0:1767318731.247478:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318731.247481:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318731.247484:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940338816:0@lo:38:kworker.0
00000100:00080000:1.0:1767318731.247491:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318731.247495:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318731.247497:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940337920:0@lo:38:kworker.0
00000100:00080000:1.0:1767318731.247505:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318731.247508:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318731.247511:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940338048:0@lo:38:kworker.0
00000100:00100000:1.0:1767318731.247577:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940338432:0@lo:400:kworker.0
00000100:00100000:1.0:1767318731.247603:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318731.247630:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338432
00000100:00100000:1.0:1767318731.247634:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338432
00000100:00100000:1.0:1767318731.248035:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062
00000100:00100000:1.0:1767318731.248044:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940338432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318731.248087:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940338432:12345-0@lo:400:kworker.0 Request processed in 45us (483us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318731.248093:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062
00000100:00080000:1.0:1767318731.248110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318731.248132:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940338432:0@lo:400:kworker.0
00000100:00100000:3.0:1767318731.250628:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318731.251179:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318731.251276:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338688
00000100:00100000:3.0:1767318731.251286:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338688
00000100:00100000:3.0:1767318731.251362:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063
00000100:00100000:3.0:1767318731.251372:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940338688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318731.251619:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338304
00000100:00100000:1.0:1767318731.251624:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338304
00000100:00100000:1.0:1767318731.251663:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665
00000100:00100000:1.0:1767318731.251671:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940338304:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318731.251728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318731.251733:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318731.257833:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940338304:12345-0@lo:400:kworker.0 Request processed in 6152us (7201us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318731.257850:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665
00000100:00100000:2.0:1767318731.258115:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940338304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318731.274249:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940338688:12345-0@lo:400:kworker.0 Request processed in 22867us (23060us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318731.274267:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063
00000100:00100000:0.0:1767318731.274469:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318731.274687:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338176
00000100:00100000:1.0:1767318731.274697:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338176
00000100:00100000:1.0:1767318731.274766:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666
00000100:00100000:1.0:1767318731.274792:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940338176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318731.274848:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940338176:12345-0@lo:400:kworker.0 Request processed in 75us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318731.274855:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666
00000100:00100000:0.0:1767318731.274957:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940338176:0@lo:400:kworker.0
00000100:00080000:3.0:1767318731.276559:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318731.277442:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940338688:0@lo:400:kworker.0
00000100:00100000:0.0:1767318731.884961:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318732.211262:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318732.909218:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318733.229191:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318733.805163:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318733.805186:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940338944:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318733.805257:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318733.805549:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940338944
00000100:00100000:1.0:1767318733.805559:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940338944
00000100:00100000:1.0:1767318733.805630:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192
00000100:00100000:1.0:1767318733.805641:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940338944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318733.805676:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318733.805736:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940338944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (478us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318733.805744:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192
00000100:00080000:3.0:1767318733.805805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318733.805883:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940338944:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318733.932939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318734.253241:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318734.829020:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318734.829053:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940339072:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318734.829147:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318734.829293:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339072
00000100:00100000:1.0:1767318734.829301:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339072
00000100:00100000:1.0:1767318734.829377:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193
00000100:00100000:1.0:1767318734.829387:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940339072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318734.829424:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318734.829490:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940339072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318734.829498:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193
00000100:00100000:0.0:1767318734.829562:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940339072:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318734.829854:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318734.957225:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318735.278637:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318735.943224:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318735.943445:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278912
00000100:00100000:1.0:1767318735.943457:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278912
00000100:00080000:2.0:1767318735.943603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318735.943649:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4064
00000100:00100000:1.0:1767318735.943661:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894278912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318735.943690:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318735.943768:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894278912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (545us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318735.943811:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4064
00000100:00100000:1.0:1767318735.947574:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894278784
00000100:00100000:1.0:1767318735.947591:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894278784
00000100:00100000:1.0:1767318735.947644:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16496
00000100:00100000:1.0:1767318735.947652:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894278784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318735.947678:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318735.947756:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894278784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 101us (4066us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318735.947802:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16496
00000100:00100000:0.0:1767318735.980986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318736.302975:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318736.366036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318736.366047:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318736.366051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318736.366055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318736.366059:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318736.366068:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3981
00000100:00080000:2.0:1767318736.366073:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318736.366080:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318736.366123:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8a80 x1853163940339200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318736.366151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318736.366155:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318736.366157:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318736.366160:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3981
00000100:00080000:2.0:1767318736.366163:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318736.366167:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318736.366182:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940339328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318736.366255:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940339456:0@lo:400:kworker.0
00000100:00100000:3.0:1767318736.366322:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318736.366467:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339456
00000100:00100000:0.0:1767318736.366476:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339456
00000100:00100000:0.0:1767318736.366544:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667
00000100:00100000:0.0:1767318736.366555:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940339456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.366690:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940339200:0@lo:38:kworker.0
00000100:00100000:1.0:1767318736.366726:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318736.366748:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940339328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318736.366769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318736.366870:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339200
00000100:00100000:1.0:1767318736.366874:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339200
00000100:00100000:1.0:1767318736.366901:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16497
00000100:00100000:1.0:1767318736.366907:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940339200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318736.366928:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318736.366966:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940339200:12345-0@lo:38:kworker.0 Request processed in 59us (240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318736.366973:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16497
00000100:00100000:1.0:1767318736.366996:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339328
00000100:00100000:1.0:1767318736.367000:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339328
00000100:00100000:1.0:1767318736.367019:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007
00000100:00100000:1.0:1767318736.367023:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940339328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318736.367033:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318736.367058:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940339328:12345-0@lo:38:kworker.0 Request processed in 33us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318736.367063:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007
00000100:00080000:1.0:1767318736.367098:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318736.367102:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318736.367106:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940339200:0@lo:38:kworker.0
00000100:00080000:1.0:1767318736.367114:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318736.367117:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318736.367120:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940339328:0@lo:38:kworker.0
00000100:00080000:1.0:1767318736.367173:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318736.367193:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940339584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.367218:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318736.367251:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339584
00000100:00100000:1.0:1767318736.367254:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339584
00000100:00100000:1.0:1767318736.367283:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668
00000100:00100000:1.0:1767318736.367288:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940339584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.367321:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940339584:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318736.367326:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668
00000100:00080000:1.0:1767318736.367339:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318736.367357:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940339584:0@lo:400:kworker.0
00000100:00100000:0.0:1767318736.376663:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940339456:12345-0@lo:400:kworker.0 Request processed in 10099us (10329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318736.376680:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667
00000100:00100000:3.0:1767318736.381654:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940339456:0@lo:400:kworker.0
00000100:00080000:2.0:1767318736.381960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318736.381965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318736.381969:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318736.381974:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3981
00000100:00080000:2.0:1767318736.381978:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318736.381984:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318736.382004:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940339840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318736.382036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318736.382039:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318736.382041:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318736.382044:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3981
00000100:00080000:2.0:1767318736.382047:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318736.382051:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318736.382061:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940340096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318736.382097:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940339840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318736.382153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318736.382193:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940340096:0@lo:38:kworker.0
00000100:00100000:2.0:1767318736.382214:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318736.382250:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339840
00000100:00100000:2.0:1767318736.382256:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339840
00000100:00100000:2.0:1767318736.382287:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340096
00000100:00100000:2.0:1767318736.382290:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340096
00000100:00100000:2.0:1767318736.382310:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16498
00000100:00100000:2.0:1767318736.382318:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940339840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318736.382339:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318736.382379:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940339840:12345-0@lo:38:kworker.0 Request processed in 61us (225us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318736.382385:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16498
00000100:00100000:1.0:1767318736.382579:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940339968:0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.382610:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318736.382634:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318736.382650:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940339712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.382671:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318736.382694:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339968
00000100:00100000:1.0:1767318736.382697:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339968
00000100:00100000:1.0:1767318736.382727:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940339712
00000100:00100000:1.0:1767318736.382729:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940339712
00000100:00100000:1.0:1767318736.382742:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065
00000100:00100000:1.0:1767318736.382747:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940339968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.382818:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940339968:12345-0@lo:400:kworker.0 Request processed in 70us (206us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318736.382835:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065
00000100:00100000:1.0:1767318736.382850:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066
00000100:00100000:1.0:1767318736.382855:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940339712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318736.382881:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940339712:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318736.382886:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066
00000100:00100000:1.0:1767318736.382896:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16499
00000100:00100000:1.0:1767318736.382900:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940340096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318736.382912:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318736.382927:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318736.382938:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940340096:12345-0@lo:38:kworker.0 Request processed in 35us (722us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318736.382945:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16499
00000100:00100000:0.0:1767318736.382980:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940339712:0@lo:400:kworker.0
00000100:00080000:2.0:1767318736.383231:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318736.383236:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318736.383240:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940339840:0@lo:38:kworker.0
00000100:00080000:2.0:1767318736.383248:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318736.383251:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318736.383253:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940340096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318736.383382:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940339968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318737.004946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318737.325526:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318738.029079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318738.349011:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318738.925111:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940340224:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318738.925198:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318738.925331:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340224
00000100:00100000:1.0:1767318738.925340:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340224
00000100:00100000:1.0:1767318738.925408:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194
00000100:00100000:1.0:1767318738.925418:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940340224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318738.925461:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318738.925506:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940340224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318738.925513:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194
00000100:00100000:3.0:1767318738.925822:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940340224:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318738.926179:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318739.054714:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318739.377527:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318739.950305:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940340352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318739.950399:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318739.950817:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340352
00000100:00100000:0.0:1767318739.950826:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340352
00000100:00100000:0.0:1767318739.955191:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195
00000100:00100000:0.0:1767318739.955214:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940340352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318739.955251:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318739.955347:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940340352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (4947us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318739.955367:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195
00000100:00100000:3.0:1767318739.957013:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940340352:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318739.964909:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318740.076894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318740.405696:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318741.064539:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318741.064667:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279168
00000100:00100000:1.0:1767318741.064675:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279168
00000100:00100000:1.0:1767318741.064738:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4067
00000100:00100000:1.0:1767318741.064747:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894279168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318741.064887:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894279168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 141us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318741.064893:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4067
00000100:00080000:0.0:1767318741.065546:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318741.068611:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318741.069042:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279040
00000100:00100000:2.0:1767318741.069055:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279040
00000100:00100000:2.0:1767318741.069111:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16500
00000100:00100000:2.0:1767318741.069119:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894279040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318741.069148:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318741.069510:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894279040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 390us (906us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318741.069517:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16500
00000100:00100000:0.0:1767318741.101167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318741.421830:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318741.486385:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318741.486396:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318741.486399:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318741.486404:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318741.486408:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318741.486416:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3986
00000100:00080000:2.0:1767318741.486421:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318741.486428:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318741.486479:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940340480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318741.486505:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318741.486508:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318741.486510:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318741.486514:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3986
00000100:00080000:2.0:1767318741.486516:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318741.486519:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318741.486532:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940340608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318741.486589:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318741.486592:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318741.486594:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318741.486597:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3986
00000100:00080000:2.0:1767318741.486600:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318741.486603:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318741.486613:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d180 x1853163940341120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318741.486627:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318741.486630:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318741.486631:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318741.486635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3986
00000100:00080000:2.0:1767318741.486637:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318741.486640:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318741.486649:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940341376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318741.486678:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940340992:0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.486736:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318741.487100:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318741.487107:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940341248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.487133:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318741.487166:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340992
00000100:00100000:2.0:1767318741.487174:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340992
00000100:00100000:2.0:1767318741.487228:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341248
00000100:00100000:2.0:1767318741.487232:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341248
00000100:00100000:2.0:1767318741.487252:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068
00000100:00100000:2.0:1767318741.487261:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940340992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.487313:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940340992:12345-0@lo:400:kworker.0 Request processed in 52us (575us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318741.487320:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068
00000100:00100000:2.0:1767318741.487335:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069
00000100:00100000:2.0:1767318741.487341:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940341248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.487366:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940341248:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318741.487372:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069
00000100:00080000:2.0:1767318741.487391:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318741.487420:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940341248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.487431:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940340992:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.487830:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940340864:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.487868:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318741.487900:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318741.487905:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940340736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.487926:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318741.487972:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340864
00000100:00100000:1.0:1767318741.487977:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340864
00000100:00100000:1.0:1767318741.488009:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340736
00000100:00100000:1.0:1767318741.488012:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340736
00000100:00100000:1.0:1767318741.488031:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669
00000100:00100000:1.0:1767318741.488038:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940340864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.488073:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940340864:12345-0@lo:400:kworker.0 Request processed in 36us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318741.488079:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669
00000100:00100000:1.0:1767318741.488092:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670
00000100:00100000:1.0:1767318741.488097:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940340736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.488122:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940340736:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318741.488127:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670
00000100:00100000:1.0:1767318741.488159:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940340736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.488168:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940340864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318741.488426:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940340480:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.488460:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.488489:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940340608:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.488511:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.488532:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940341120:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.488551:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.488565:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940341376:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.488585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.488615:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340608
00000100:00100000:3.0:1767318741.488619:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340608
00000100:00100000:3.0:1767318741.488642:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008
00000100:00100000:3.0:1767318741.488647:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940340608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.488666:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.488695:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940340608:12345-0@lo:38:kworker.0 Request processed in 47us (183us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.488701:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008
00000100:00100000:3.0:1767318741.488724:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940340480
00000100:00100000:3.0:1767318741.488728:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940340480
00000100:00100000:3.0:1767318741.488744:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341120
00000100:00100000:3.0:1767318741.488746:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341120
00000100:00100000:3.0:1767318741.488758:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341376
00000100:00100000:3.0:1767318741.488760:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341376
00000100:00100000:3.0:1767318741.488805:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16501
00000100:00100000:3.0:1767318741.488809:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940340480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.488818:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.488843:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940340480:12345-0@lo:38:kworker.0 Request processed in 32us (382us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.488852:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16501
00000100:00100000:3.0:1767318741.488863:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16502
00000100:00100000:3.0:1767318741.488867:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940341120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.488876:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.488898:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940341120:12345-0@lo:38:kworker.0 Request processed in 30us (346us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.488904:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16502
00000100:00100000:3.0:1767318741.488915:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16503
00000100:00100000:3.0:1767318741.488918:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940341376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.488926:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.488946:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940341376:12345-0@lo:38:kworker.0 Request processed in 26us (360us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.488951:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16503
00000100:00080000:3.0:1767318741.488992:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.488997:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.489001:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940340480:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.489010:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.489013:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.489016:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940340608:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.489023:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.489027:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.489029:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940341120:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.489035:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.489039:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.489042:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940341376:0@lo:38:kworker.0
00000100:00080000:2.0:1767318741.489591:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318741.489597:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318742.125505:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318742.445032:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318743.148916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318743.470687:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318744.045132:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318744.045161:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940341504:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318744.045250:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318744.045368:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341504
00000100:00100000:1.0:1767318744.045376:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341504
00000100:00100000:1.0:1767318744.045451:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196
00000100:00100000:1.0:1767318744.045460:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940341504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318744.045489:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318744.045536:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940341504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318744.045546:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196
00000100:00100000:1.0:1767318744.045593:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940341504:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318744.045793:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318744.173010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318744.493200:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318745.068993:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318745.069018:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940341632:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318745.069088:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318745.069251:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341632
00000100:00100000:2.0:1767318745.069258:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341632
00000100:00100000:2.0:1767318745.069308:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197
00000100:00100000:2.0:1767318745.069315:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940341632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318745.069340:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318745.069380:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940341632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318745.069387:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197
00000100:00080000:0.0:1767318745.069519:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318745.069558:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940341632:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318745.196908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318745.524909:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318746.188010:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318746.188053:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318746.188209:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279296
00000100:00100000:1.0:1767318746.188222:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279296
00000100:00100000:1.0:1767318746.188272:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279424
00000100:00100000:1.0:1767318746.188275:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279424
00000100:00100000:1.0:1767318746.188327:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4070
00000100:00100000:1.0:1767318746.188338:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894279424:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318746.188418:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894279424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (363us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318746.188425:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4070
00000100:00100000:1.0:1767318746.188442:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16504
00000100:00100000:1.0:1767318746.188447:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894279296:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318746.188471:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318746.188497:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894279296:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318746.188503:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16504
00000100:00080000:3.0:1767318746.188673:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318746.221251:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318746.541257:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318746.604965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318746.604976:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318746.604979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318746.604983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318746.604988:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318746.604995:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3991
00000100:00080000:2.0:1767318746.605000:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318746.605007:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318746.605051:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ce00 x1853163940341760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318746.605077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318746.605080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318746.605082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318746.605085:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3991
00000100:00080000:2.0:1767318746.605087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318746.605091:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318746.605108:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ed80 x1853163940341888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318746.605170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318746.605173:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318746.605176:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318746.605180:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3991
00000100:00080000:2.0:1767318746.605182:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318746.605186:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318746.605197:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940342400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318746.605212:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318746.605215:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318746.605216:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318746.605219:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3991
00000100:00080000:2.0:1767318746.605221:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318746.605225:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318746.605234:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760fb80 x1853163940342656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318746.605264:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940342528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318746.605329:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318746.605390:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318746.605397:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940342272:0@lo:400:kworker.0
00000100:00100000:2.0:1767318746.605418:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.605547:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940342144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.605576:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.605611:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318746.605625:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940342016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.605649:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.605680:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342144
00000100:00100000:3.0:1767318746.605688:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342144
00000100:00100000:3.0:1767318746.605744:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342016
00000100:00100000:3.0:1767318746.605748:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342016
00000100:00100000:3.0:1767318746.605797:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767318746.605806:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940342144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.605854:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940342144:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318746.605861:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767318746.605877:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672
00000100:00100000:3.0:1767318746.605884:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940342016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.605909:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940342016:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318746.605915:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672
00000100:00080000:3.0:1767318746.605937:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318746.605953:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940341760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318746.605978:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.605995:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940341888:0@lo:38:kworker.0
00000100:00100000:3.0:1767318746.606013:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.606030:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940342400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318746.606049:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.606063:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940342656:0@lo:38:kworker.0
00000100:00100000:3.0:1767318746.606080:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318746.606107:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341888
00000100:00100000:3.0:1767318746.606111:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341888
00000100:00100000:3.0:1767318746.606131:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009
00000100:00100000:3.0:1767318746.606136:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940341888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318746.606153:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318746.606185:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940341888:12345-0@lo:38:kworker.0 Request processed in 48us (170us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318746.606191:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009
00000100:00100000:3.0:1767318746.606209:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342528
00000100:00100000:3.0:1767318746.606212:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342528
00000100:00100000:3.0:1767318746.606237:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342272
00000100:00100000:3.0:1767318746.606240:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342272
00000100:00100000:3.0:1767318746.606250:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940341760
00000100:00100000:3.0:1767318746.606252:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940341760
00000100:00100000:3.0:1767318746.606259:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342400
00000100:00100000:3.0:1767318746.606261:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342400
00000100:00100000:3.0:1767318746.606267:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342656
00000100:00100000:3.0:1767318746.606269:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342656
00000100:00100000:3.0:1767318746.606278:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071
00000100:00100000:3.0:1767318746.606283:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940342528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.606313:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940342528:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318746.606318:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071
00000100:00100000:3.0:1767318746.606329:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072
00000100:00100000:3.0:1767318746.606335:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940342272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.606358:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940342272:12345-0@lo:400:kworker.0 Request processed in 24us (939us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318746.606363:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072
00000100:00100000:3.0:1767318746.606374:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505
00000100:00100000:3.0:1767318746.606378:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940341760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318746.606386:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318746.606408:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940341760:12345-0@lo:38:kworker.0 Request processed in 28us (428us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318746.606414:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505
00000100:00100000:3.0:1767318746.606425:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506
00000100:00100000:3.0:1767318746.606429:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940342400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318746.606437:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318746.606458:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940342400:12345-0@lo:38:kworker.0 Request processed in 28us (408us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318746.606464:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506
00000100:00100000:3.0:1767318746.606474:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16507
00000100:00100000:3.0:1767318746.606478:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940342656:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318746.606487:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318746.606506:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940342656:12345-0@lo:38:kworker.0 Request processed in 27us (425us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318746.606511:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16507
00000100:00080000:3.0:1767318746.606530:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318746.606558:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940342016:0@lo:400:kworker.0
00000100:00100000:3.0:1767318746.606567:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940342144:0@lo:400:kworker.0
00000100:00080000:3.0:1767318746.606593:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318746.606598:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318746.606600:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940341760:0@lo:38:kworker.0
00000100:00080000:3.0:1767318746.606608:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318746.606611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318746.606613:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940341888:0@lo:38:kworker.0
00000100:00080000:3.0:1767318746.606620:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318746.606622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318746.606625:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940342400:0@lo:38:kworker.0
00000100:00080000:3.0:1767318746.606630:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318746.606632:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318746.606635:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940342656:0@lo:38:kworker.0
00000100:00100000:2.0:1767318746.606937:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940342272:0@lo:400:kworker.0
00000100:00100000:2.0:1767318746.606948:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940342528:0@lo:400:kworker.0
00000100:00100000:0.0:1767318747.244918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318747.565387:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318748.270267:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318748.589136:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318749.165016:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940342784:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318749.165104:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318749.165221:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342784
00000100:00100000:2.0:1767318749.165230:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342784
00000100:00100000:2.0:1767318749.165292:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198
00000100:00100000:2.0:1767318749.165301:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940342784:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318749.165305:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767318749.165335:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318749.170076:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940342784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4757us (4952us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318749.170102:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198
00000100:00100000:0.0:1767318749.170274:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940342784:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318749.298846:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318749.613009:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318750.189062:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318750.189101:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940342912:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318750.189175:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318750.189591:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940342912
00000100:00100000:1.0:1767318750.189602:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940342912
00000100:00100000:1.0:1767318750.189683:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199
00000100:00100000:1.0:1767318750.189694:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940342912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318750.189743:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318750.189832:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940342912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (657us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318750.189841:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199
00000100:00080000:3.0:1767318750.189909:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318750.190055:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940342912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318750.284434:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767318750.284478:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894279552 offset 0 length 520: 4
00000100:00100000:3.0:1767318750.284501:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318750.284822:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279808
00000100:00100000:1.0:1767318750.284833:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279808
00000100:00100000:1.0:1767318750.284911:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4073
00000100:00100000:1.0:1767318750.284922:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894279808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318750.285014:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894279808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (592us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318750.285023:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4073
00000100:00100000:1.0:1767318750.285042:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279680
00000100:00100000:1.0:1767318750.285046:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279680
00000100:00100000:1.0:1767318750.285062:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16508
00000100:00100000:1.0:1767318750.285080:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894279680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318750.285104:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318750.285134:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894279680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (631us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318750.285141:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16508
00000100:00080000:3.0:1767318750.285694:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318750.316906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318750.637229:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318751.344187:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318751.662095:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318751.725430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318751.725451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318751.725454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318751.725458:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318751.725462:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318751.725470:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3996
00000100:00080000:2.0:1767318751.725474:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318751.725481:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318751.725519:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940343040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318751.725546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318751.725549:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318751.725551:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318751.725554:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3996
00000100:00080000:2.0:1767318751.725557:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318751.725560:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318751.725576:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433e680 x1853163940343168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318751.725651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318751.725654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318751.725656:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318751.725660:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3996
00000100:00080000:2.0:1767318751.725662:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318751.725666:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318751.725676:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c380 x1853163940343680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318751.725698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318751.725701:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318751.725702:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318751.725705:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3996
00000100:00080000:2.0:1767318751.725707:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318751.725714:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318751.725724:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210380 x1853163940343936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318751.725755:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940343040:0@lo:38:kworker.0
00000100:00100000:2.0:1767318751.725759:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940343424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318751.726186:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940343552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318751.726272:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318751.726272:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318751.726346:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318751.726354:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940343296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318751.726379:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318751.726409:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343424
00000100:00100000:0.0:1767318751.726410:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940343168:0@lo:38:kworker.0
00000100:00100000:2.0:1767318751.726417:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343424
00000100:00100000:0.0:1767318751.726443:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318751.726461:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940343680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318751.726481:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318751.726508:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940343936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318751.726528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318751.726561:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343040
00000100:00100000:0.0:1767318751.726565:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343040
00000100:00100000:3.0:1767318751.726580:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343296
00000100:00100000:3.0:1767318751.726586:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343296
00000100:00100000:0.0:1767318751.726596:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343680
00000100:00100000:0.0:1767318751.726600:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343680
00000100:00100000:0.0:1767318751.726625:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343936
00000100:00100000:0.0:1767318751.726628:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343936
00000100:00100000:0.0:1767318751.726650:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16509
00000100:00100000:0.0:1767318751.726658:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343040:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318751.726661:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673
00000100:00100000:3.0:1767318751.726675:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940343296:12345-0@lo:400:kworker.0
00010000:00020000:0.0:1767318751.726693:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318751.726746:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343040:12345-0@lo:38:kworker.0 Request processed in 87us (478us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318751.726753:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16509
00000100:00100000:3.0:1767318751.726770:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940343296:12345-0@lo:400:kworker.0 Request processed in 99us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318751.726794:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16510
00000100:00100000:3.0:1767318751.726798:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767318751.726888:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318751.726898:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318751.726922:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343680:12345-0@lo:38:kworker.0 Request processed in 120us (441us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318751.726928:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16510
00000100:00100000:0.0:1767318751.726940:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16511
00000100:00100000:0.0:1767318751.726944:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318751.726952:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318751.726973:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940343936:12345-0@lo:38:kworker.0 Request processed in 27us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318751.726979:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16511
00000100:00080000:0.0:1767318751.727014:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318751.727019:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318751.727022:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940343040:0@lo:38:kworker.0
00000100:00080000:0.0:1767318751.727030:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318751.727033:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318751.727036:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940343680:0@lo:38:kworker.0
00000100:00080000:0.0:1767318751.727042:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318751.727046:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318751.727048:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940343936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318751.727122:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343168
00000100:00100000:0.0:1767318751.727127:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343168
00000100:00100000:1.0:1767318751.727197:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318751.732826:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318751.732861:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940343808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318751.733234:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674
00000100:00100000:2.0:1767318751.733252:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940343424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318751.733318:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940343424:12345-0@lo:400:kworker.0 Request processed in 74us (7051us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318751.733325:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674
00000100:00100000:1.0:1767318751.737267:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318751.737346:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343552
00000100:00100000:3.0:1767318751.737346:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940343808
00000100:00100000:1.0:1767318751.737354:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343552
00000100:00100000:3.0:1767318751.737354:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940343808
00000100:00100000:2.0:1767318751.737406:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074
00000100:00100000:2.0:1767318751.737452:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940343552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318751.737528:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940343552:12345-0@lo:400:kworker.0 Request processed in 79us (10330us total) trans 0 rc 0/0
00000100:00080000:0.0:1767318751.737557:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318751.737575:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010
00000100:00100000:0.0:1767318751.737581:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940343168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318751.737658:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318751.737725:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940343168:12345-0@lo:38:kworker.0 Request processed in 143us (11281us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318751.737733:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010
00000100:00080000:0.0:1767318751.737800:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318751.737820:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318751.737824:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940343168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318751.737982:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940343296:0@lo:400:kworker.0
00000100:00100000:0.0:1767318751.737999:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940343424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318751.738004:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940343552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318751.738464:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075
00000100:00100000:3.0:1767318751.738475:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940343808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318751.738533:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940343808:12345-0@lo:400:kworker.0 Request processed in 58us (1269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318751.738540:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075
00000100:00100000:0.0:1767318751.738577:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940343808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318751.738656:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074
00000100:00100000:0.0:1767318752.365502:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318752.694820:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318753.389139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318753.709980:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318754.285329:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318754.285357:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940344064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318754.285438:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318754.285588:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344064
00000100:00100000:1.0:1767318754.285596:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344064
00000100:00100000:1.0:1767318754.285677:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200
00000100:00100000:1.0:1767318754.285688:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940344064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318754.285725:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318754.285816:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940344064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (377us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318754.285824:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200
00000100:00080000:0.0:1767318754.286377:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318754.286417:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940344064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318754.413342:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318754.733306:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318755.309302:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940344192:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318755.309381:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318755.310079:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344192
00000100:00100000:0.0:1767318755.310089:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344192
00000100:00100000:0.0:1767318755.310162:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1767318755.310172:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940344192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318755.310202:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318755.310274:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940344192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (892us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318755.310282:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201
00000100:00100000:3.0:1767318755.310449:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940344192:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318755.311049:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318755.403480:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318755.403562:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318755.403746:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280064
00000100:00100000:0.0:1767318755.403757:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280064
00000100:00100000:0.0:1767318755.403859:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894279936
00000100:00100000:0.0:1767318755.403863:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894279936
00000100:00100000:0.0:1767318755.403884:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4076
00000100:00100000:0.0:1767318755.403895:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894280064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318755.403975:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894280064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318755.404000:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4076
00000100:00100000:0.0:1767318755.404020:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16512
00000100:00100000:0.0:1767318755.404025:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894279936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318755.404047:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318755.404073:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894279936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (510us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318755.404079:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16512
00000100:00080000:3.0:1767318755.404688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318755.436952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318755.763440:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318756.461255:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318756.781083:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318756.845663:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.845674:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318756.845678:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.845681:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318756.845686:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318756.845693:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4001
00000100:00080000:3.0:1767318756.845697:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318756.845704:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318756.845741:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940344320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318756.845769:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.845795:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318756.845797:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318756.845800:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4001
00000100:00080000:3.0:1767318756.845803:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318756.845807:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318756.845831:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf480 x1853163940344448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318756.845883:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.845887:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318756.845888:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318756.845892:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4001
00000100:00080000:3.0:1767318756.845894:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318756.845898:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318756.845909:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940344960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318756.845925:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.845929:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318756.845930:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318756.845934:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4001
00000100:00080000:3.0:1767318756.845936:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318756.845939:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318756.845950:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d500 x1853163940345216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318756.845996:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940344832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.846272:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318756.846331:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318756.846337:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940345088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.846360:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318756.846404:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344832
00000100:00100000:3.0:1767318756.846410:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344832
00000100:00100000:3.0:1767318756.846461:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345088
00000100:00100000:3.0:1767318756.846464:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345088
00000100:00100000:3.0:1767318756.846488:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077
00000100:00100000:3.0:1767318756.846496:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940344832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.846544:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940344832:12345-0@lo:400:kworker.0 Request processed in 48us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318756.846551:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077
00000100:00100000:3.0:1767318756.846567:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078
00000100:00100000:3.0:1767318756.846574:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940345088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.846600:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940345088:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318756.846605:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078
00000100:00080000:3.0:1767318756.846621:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318756.846656:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940345088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.846665:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940344832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318756.846944:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940344576:0@lo:400:kworker.0
00000100:00100000:1.0:1767318756.846996:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318756.847037:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318756.847042:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940344704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318756.847064:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318756.847514:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318731/real 1767318731]  req@ffff93cf4399d880 x1853163940337792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318756 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318756.847534:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4399d880 x1853163940337792/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318756 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318756.847549:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940344320:0@lo:38:kworker.0
00000100:00100000:2.0:1767318756.847579:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318756.847606:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940344448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318756.847629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318756.847661:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940344960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318756.847683:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318756.847701:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940345216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318756.847724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318756.847740:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318756.847751:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318756.847755:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940337792:0@lo:250:kworker.0
00000100:00100000:2.0:1767318756.847805:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344320
00000100:00100000:2.0:1767318756.847810:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344320
00000100:00100000:0.0:1767318756.848386:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344960
00000100:00100000:0.0:1767318756.848391:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344960
00000100:00100000:0.0:1767318756.848419:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345216
00000100:00100000:0.0:1767318756.848422:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345216
00000100:00100000:0.0:1767318756.848435:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16513
00000100:00100000:0.0:1767318756.848440:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940344960:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318756.848460:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318756.848508:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940344960:12345-0@lo:38:kworker.0 Request processed in 67us (824us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318756.848516:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16513
00000100:00100000:0.0:1767318756.848530:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16514
00000100:00100000:0.0:1767318756.848535:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940345216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318756.848545:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318756.848569:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940345216:12345-0@lo:38:kworker.0 Request processed in 33us (845us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318756.848576:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16514
00000100:00100000:0.0:1767318756.848596:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344448
00000100:00100000:0.0:1767318756.848599:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344448
00000100:00100000:0.0:1767318756.848617:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011
00000100:00100000:0.0:1767318756.848622:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940344448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318756.848631:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318756.848668:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940344448:12345-0@lo:38:kworker.0 Request processed in 44us (1037us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318756.848675:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011
00000100:00100000:2.0:1767318756.850253:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16515
00000100:00100000:2.0:1767318756.850263:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940344320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318756.850281:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318756.850333:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940344320:12345-0@lo:38:kworker.0 Request processed in 70us (2753us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318756.850339:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16515
00000100:00100000:3.0:1767318756.850538:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344576
00000100:00100000:3.0:1767318756.850544:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344576
00000100:00100000:3.0:1767318756.850595:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940344704
00000100:00100000:3.0:1767318756.850598:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940344704
00000100:00100000:3.0:1767318756.850616:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675
00000100:00100000:3.0:1767318756.850622:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940344576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.850679:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940344576:12345-0@lo:400:kworker.0 Request processed in 56us (3699us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318756.850689:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675
00000100:00100000:3.0:1767318756.850704:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676
00000100:00100000:3.0:1767318756.850710:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940344704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318756.850737:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940344704:12345-0@lo:400:kworker.0 Request processed in 27us (3672us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318756.850741:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676
00000100:00080000:3.0:1767318756.850768:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318756.850791:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318756.850794:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318756.850799:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 3981
00000100:00080000:3.0:1767318756.850803:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318756.850807:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318756.850842:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940345344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318756.851382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318756.852229:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940344704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318756.852245:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940344576:0@lo:400:kworker.0
00000100:00080000:0.0:1767318756.852447:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318756.852452:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318756.852456:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940344448:0@lo:38:kworker.0
00000100:00080000:0.0:1767318756.852470:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318756.852474:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318756.852476:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940344960:0@lo:38:kworker.0
00000100:00080000:0.0:1767318756.852486:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318756.852490:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318756.852493:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940345216:0@lo:38:kworker.0
00000100:00100000:0.0:1767318756.852517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940345344:0@lo:250:kworker.0
00000400:00000100:0.0:1767318756.852561:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940345344 offset 0 length 520: 4
00000100:00080000:0.0:1767318756.852597:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318756.852601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318756.852604:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940344320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318757.486574:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318757.806362:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318758.508844:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318758.829178:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318759.405090:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940345472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318759.405166:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318759.405272:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345472
00000100:00100000:2.0:1767318759.405280:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345472
00000100:00100000:2.0:1767318759.405343:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202
00000100:00100000:2.0:1767318759.405353:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940345472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318759.405383:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318759.405438:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940345472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318759.405445:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202
00000100:00100000:2.0:1767318759.405495:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940345472:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318759.405686:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318759.533710:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318759.853206:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318760.429070:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940345600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318760.429258:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318760.429569:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345600
00000100:00100000:3.0:1767318760.429586:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345600
00000100:00100000:3.0:1767318760.429688:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203
00000100:00100000:3.0:1767318760.429699:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940345600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318760.429729:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767318760.429800:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318760.435792:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940345600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6068us (6506us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318760.435811:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203
00000100:00100000:2.0:1767318760.438670:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940345600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318760.519013:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318760.519346:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280192
00000100:00100000:1.0:1767318760.519357:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280192
00000100:00100000:1.0:1767318760.519410:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16516
00000100:00100000:1.0:1767318760.519419:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894280192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318760.519444:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318760.519522:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894280192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (520us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318760.519530:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16516
00000100:00100000:1.0:1767318760.520396:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318760.520469:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280320
00000100:00100000:3.0:1767318760.520475:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280320
00000100:00100000:3.0:1767318760.520544:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4079
00000100:00100000:3.0:1767318760.520556:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894280320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318760.520837:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894280320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 285us (442us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318760.520845:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4079
00000100:00080000:1.0:1767318760.521430:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318760.557019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318760.877414:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318761.580916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318761.901128:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318761.966097:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318761.966107:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318761.966110:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318761.966114:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318761.966118:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318761.966126:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4006
00000100:00080000:3.0:1767318761.966131:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318761.966137:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318761.966177:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ce00 x1853163940345728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318761.966203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318761.966207:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318761.966208:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318761.966211:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4006
00000100:00080000:3.0:1767318761.966214:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318761.966217:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318761.966228:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d180 x1853163940345856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318761.966295:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940345984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318761.966359:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318761.966454:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940345728:0@lo:38:kworker.0
00000100:00100000:0.0:1767318761.966483:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318761.966501:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940345856:0@lo:38:kworker.0
00000100:00100000:0.0:1767318761.966517:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318761.966545:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345856
00000100:00100000:0.0:1767318761.966551:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345856
00000100:00100000:0.0:1767318761.966601:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012
00000100:00100000:0.0:1767318761.966608:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940345856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318761.966629:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318761.966664:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940345856:12345-0@lo:38:kworker.0 Request processed in 55us (145us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318761.966671:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012
00000100:00080000:0.0:1767318761.966705:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318761.966710:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318761.966713:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940345856:0@lo:38:kworker.0
00000100:00100000:0.0:1767318761.966735:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345728
00000100:00100000:0.0:1767318761.966737:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345728
00000100:00100000:0.0:1767318761.966755:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16517
00000100:00100000:0.0:1767318761.966760:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940345728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318761.966769:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318761.966811:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940345728:12345-0@lo:38:kworker.0 Request processed in 50us (327us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318761.966816:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16517
00000100:00080000:0.0:1767318761.966849:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318761.966853:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318761.966856:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940345728:0@lo:38:kworker.0
00000100:00100000:0.0:1767318761.966883:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940345984
00000100:00100000:0.0:1767318761.966886:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940345984
00000100:00100000:0.0:1767318761.966921:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677
00000100:00100000:0.0:1767318761.966928:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940345984:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318761.967117:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318761.967887:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940346112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318761.967921:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318761.967977:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346112
00000100:00100000:1.0:1767318761.967981:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346112
00000100:00100000:1.0:1767318761.968007:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678
00000100:00100000:1.0:1767318761.968013:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940346112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318761.968042:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940346112:12345-0@lo:400:kworker.0 Request processed in 29us (120us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318761.968047:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678
00000100:00100000:1.0:1767318761.968075:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940346112:0@lo:400:kworker.0
00000100:00080000:3.0:1767318761.972436:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318761.972444:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318761.972448:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318761.972456:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4006
00000100:00080000:3.0:1767318761.972461:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318761.972468:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318761.972491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d500 x1853163940346368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318761.972701:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318761.972704:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318761.972706:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318761.972710:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4006
00000100:00080000:3.0:1767318761.972713:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318761.972717:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318761.972730:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940346624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318761.972839:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940346240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318761.972911:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318761.973206:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318761.973213:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940346496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318761.973237:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318761.973334:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346240
00000100:00100000:1.0:1767318761.973342:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346240
00000100:00100000:1.0:1767318761.973443:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346496
00000100:00100000:1.0:1767318761.973448:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346496
00000100:00100000:1.0:1767318761.973482:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080
00000100:00100000:1.0:1767318761.973491:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940346240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318761.973518:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940346368:0@lo:38:kworker.0
00000100:00100000:1.0:1767318761.973553:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940346240:12345-0@lo:400:kworker.0 Request processed in 62us (641us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318761.973565:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318761.973581:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080
00000100:00100000:2.0:1767318761.973598:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940346624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318761.973607:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346368
00000100:00100000:1.0:1767318761.973611:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346368
00000100:00100000:2.0:1767318761.973629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318761.973634:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346624
00000100:00100000:1.0:1767318761.973638:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346624
00000100:00100000:1.0:1767318761.973655:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081
00000100:00100000:1.0:1767318761.973663:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940346496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318761.973669:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16518
00000100:00100000:2.0:1767318761.973676:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940346368:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318761.973695:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940346496:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0
00010000:00020000:2.0:1767318761.973696:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318761.973707:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081
00000100:00100000:1.0:1767318761.973723:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16519
00000100:00100000:1.0:1767318761.973728:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940346624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318761.973740:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318761.973742:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940346368:12345-0@lo:38:kworker.0 Request processed in 62us (178us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318761.973751:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16518
00000100:00100000:1.0:1767318761.973771:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940346624:12345-0@lo:38:kworker.0 Request processed in 41us (142us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318761.973807:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16519
00000100:00080000:2.0:1767318761.973817:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318761.973824:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318761.973828:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940346368:0@lo:38:kworker.0
00000100:00080000:2.0:1767318761.973838:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318761.973843:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:1.0:1767318761.973845:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318761.973848:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940346624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318761.973874:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940346496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318761.973888:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940346240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318761.976895:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940345984:12345-0@lo:400:kworker.0 Request processed in 9956us (10524us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318761.976911:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677
00000100:00100000:2.0:1767318761.977318:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940345984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318762.604871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318762.927831:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318763.529065:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318763.529105:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318763.529351:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280448
00000100:00100000:1.0:1767318763.529361:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280448
00000100:00100000:1.0:1767318763.529401:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280576
00000100:00100000:1.0:1767318763.529404:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280576
00000100:00100000:1.0:1767318763.529458:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4082
00000100:00100000:1.0:1767318763.529467:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894280576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318763.529542:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894280576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (435us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318763.529548:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4082
00000100:00100000:1.0:1767318763.529566:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16520
00000100:00100000:1.0:1767318763.529570:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894280448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318763.529600:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318763.529625:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894280448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (568us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318763.529632:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16520
00000100:00080000:2.0:1767318763.529838:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318763.628924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318763.951650:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318764.525098:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940346752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318764.525172:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318764.525343:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346752
00000100:00100000:3.0:1767318764.525352:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346752
00000100:00100000:3.0:1767318764.525415:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204
00000100:00080000:2.0:1767318764.525450:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318764.525478:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940346752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318764.525513:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318764.525563:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940346752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318764.525631:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940346752:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318764.534457:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204
00000100:00100000:0.0:1767318764.653197:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318764.974685:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318764.974821:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318764.974827:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318764.974830:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318764.974833:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318764.974838:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318764.974847:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4011
00000100:00080000:0.0:1767318764.974852:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318764.974861:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318764.974900:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433f800 x1853163940346880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318764.974930:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318764.974934:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318764.974935:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318764.974938:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4011
00000100:00080000:0.0:1767318764.974941:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318764.974944:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318764.974957:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940347008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318764.975013:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318764.975016:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318764.975017:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318764.975021:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4012
00000100:00080000:0.0:1767318764.975023:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318764.975026:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318764.975035:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b480 x1853163940347520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318764.975048:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318764.975051:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318764.975052:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318764.975055:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4012
00000100:00080000:0.0:1767318764.975057:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318764.975061:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318764.975069:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940347776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318764.975167:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940346880:0@lo:38:kworker.0
00000100:00100000:2.0:1767318764.975230:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318764.975292:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940347008:0@lo:38:kworker.0
00000100:00100000:2.0:1767318764.975315:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318764.975333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940347520:0@lo:38:kworker.0
00000100:00100000:2.0:1767318764.975351:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318764.975365:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940347776:0@lo:38:kworker.0
00000100:00100000:2.0:1767318764.975384:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318764.975421:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347008
00000100:00100000:2.0:1767318764.975427:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347008
00000100:00100000:2.0:1767318764.975460:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013
00000100:00100000:2.0:1767318764.975466:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940347008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318764.975485:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318764.975523:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940347008:12345-0@lo:38:kworker.0 Request processed in 55us (205us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318764.975530:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013
00000100:00100000:2.0:1767318764.975578:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940346880
00000100:00100000:2.0:1767318764.975582:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940346880
00000100:00100000:2.0:1767318764.975599:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347520
00000100:00100000:2.0:1767318764.975602:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347520
00000100:00100000:2.0:1767318764.975614:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347776
00000100:00100000:2.0:1767318764.975617:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347776
00000100:00100000:2.0:1767318764.975630:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16521
00000100:00100000:2.0:1767318764.975635:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940346880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318764.975645:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318764.975670:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940346880:12345-0@lo:38:kworker.0 Request processed in 33us (439us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318764.975675:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16521
00000100:00100000:2.0:1767318764.975686:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522
00000100:00100000:2.0:1767318764.975690:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940347520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318764.975698:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318764.975719:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940347520:12345-0@lo:38:kworker.0 Request processed in 27us (366us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318764.975724:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522
00000100:00100000:2.0:1767318764.975735:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16523
00000100:00100000:2.0:1767318764.975739:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940347776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318764.975748:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318764.975815:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940347776:12345-0@lo:38:kworker.0 Request processed in 75us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318764.975821:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16523
00000100:00080000:2.0:1767318764.975863:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318764.975867:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318764.975870:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940346880:0@lo:38:kworker.0
00000100:00080000:2.0:1767318764.975878:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318764.975881:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318764.975884:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940347008:0@lo:38:kworker.0
00000100:00080000:2.0:1767318764.975891:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318764.975894:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318764.975896:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940347520:0@lo:38:kworker.0
00000100:00080000:2.0:1767318764.975902:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318764.975905:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318764.975907:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940347776:0@lo:38:kworker.0
00000100:00100000:3.0:1767318764.976354:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940347648:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976389:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318764.976421:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318764.976427:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940347136:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976450:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318764.976483:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940347392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976502:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318764.976516:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318764.976521:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940347264:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976551:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318764.976593:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347136
00000100:00100000:3.0:1767318764.976598:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347136
00000100:00100000:3.0:1767318764.976633:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347264
00000100:00100000:3.0:1767318764.976636:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347264
00000100:00100000:3.0:1767318764.976661:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679
00000100:00100000:3.0:1767318764.976667:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940347136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976708:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940347136:12345-0@lo:400:kworker.0 Request processed in 41us (257us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318764.976714:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679
00000100:00100000:3.0:1767318764.976729:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680
00000100:00100000:3.0:1767318764.976734:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940347264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976762:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940347264:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318764.976767:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680
00000100:00100000:3.0:1767318764.976832:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940347264:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.976855:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940347136:0@lo:400:kworker.0
00000100:00100000:1.0:1767318764.977190:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347648
00000100:00100000:1.0:1767318764.977194:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347648
00000100:00100000:1.0:1767318764.977232:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347392
00000100:00100000:1.0:1767318764.977235:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347392
00000100:00100000:1.0:1767318764.977250:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083
00000100:00100000:1.0:1767318764.977256:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940347648:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318764.977294:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940347648:12345-0@lo:400:kworker.0 Request processed in 38us (904us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318764.977299:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083
00000100:00100000:1.0:1767318764.977312:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084
00000100:00100000:1.0:1767318764.977318:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940347392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318764.977345:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940347392:12345-0@lo:400:kworker.0 Request processed in 27us (842us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318764.977350:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084
00000100:00080000:2.0:1767318764.977678:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318764.977683:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318764.977756:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940347392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318764.977809:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940347648:0@lo:400:kworker.0
00000100:00100000:3.0:1767318765.551400:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318765.555652:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940347904:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318765.555731:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318765.558020:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940347904
00000100:00100000:2.0:1767318765.558035:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940347904
00000100:00100000:2.0:1767318765.558160:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205
00000100:00100000:2.0:1767318765.558180:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940347904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318765.558222:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318765.558326:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940347904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (2594us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318765.558334:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205
00000100:00100000:3.0:1767318765.558437:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940347904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318765.678059:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318765.997601:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318766.700949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318767.021186:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318767.725073:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318768.046262:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318768.712393:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318768.712464:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318768.712627:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280832
00000100:00100000:1.0:1767318768.712638:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280832
00000100:00100000:1.0:1767318768.712734:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280704
00000100:00100000:1.0:1767318768.712738:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280704
00000100:00100000:1.0:1767318768.712755:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4085
00000100:00100000:1.0:1767318768.712764:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894280832:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318768.712880:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894280832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 116us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318768.712888:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4085
00000100:00100000:1.0:1767318768.712919:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16524
00000100:00100000:1.0:1767318768.712924:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894280704:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318768.712943:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318768.712968:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894280704:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (504us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318768.712974:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16524
00000100:00080000:0.0:1767318768.713690:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318768.748942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318769.072406:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318769.645033:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318769.646440:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940348032:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318769.646586:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318769.647196:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348032
00000100:00100000:2.0:1767318769.647205:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348032
00000100:00100000:2.0:1767318769.647351:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206
00000100:00100000:2.0:1767318769.647362:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940348032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318769.647426:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318769.647491:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940348032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (905us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318769.647499:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206
00000100:00100000:3.0:1767318769.647968:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940348032:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318769.649728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318769.773155:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318770.094078:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318770.157384:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318770.157396:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318770.157400:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318770.157404:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318770.157409:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318770.157419:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767318770.157425:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318770.157433:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318770.157479:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940348160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318770.157514:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318770.157544:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318770.157547:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318770.157551:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767318770.157553:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318770.157558:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318770.157627:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9180 x1853163940348288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318770.157693:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318770.157696:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318770.157698:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318770.157702:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767318770.157704:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318770.157708:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318770.157719:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9eb480 x1853163940348800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318770.157737:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318770.157741:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318770.157742:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318770.157746:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767318770.157748:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318770.157752:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318770.157763:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940349056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318770.157927:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940348416:0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158017:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318770.158104:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318770.158111:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940348928:0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158154:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318770.158204:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348416
00000100:00100000:0.0:1767318770.158213:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348416
00000100:00100000:0.0:1767318770.158276:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681
00000100:00100000:0.0:1767318770.158285:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940348416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158343:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940348416:12345-0@lo:400:kworker.0 Request processed in 59us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318770.158350:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681
00000100:00100000:0.0:1767318770.158403:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940348416:0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158446:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940348544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158472:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318770.158496:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318770.158502:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940348672:0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158535:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318770.158557:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348544
00000100:00100000:0.0:1767318770.158561:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348544
00000100:00100000:0.0:1767318770.158597:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682
00000100:00100000:0.0:1767318770.158604:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940348544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318770.158640:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940348544:12345-0@lo:400:kworker.0 Request processed in 36us (167us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318770.158646:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682
00000100:00080000:0.0:1767318770.158662:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318770.158682:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940348544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318770.161329:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940348160:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.161467:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318770.161532:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940348288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.161574:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318770.161606:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940348800:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.161644:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318770.161670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940349056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.161704:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318770.161815:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348928
00000100:00100000:2.0:1767318770.161822:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348928
00000100:00100000:2.0:1767318770.161884:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348672
00000100:00100000:2.0:1767318770.161888:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348672
00000100:00100000:2.0:1767318770.162890:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348160
00000100:00100000:2.0:1767318770.162898:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348160
00000100:00100000:1.0:1767318770.163033:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348800
00000100:00100000:1.0:1767318770.163037:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348800
00000100:00100000:1.0:1767318770.163053:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349056
00000100:00100000:1.0:1767318770.163055:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349056
00000100:00100000:1.0:1767318770.163068:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086
00000100:00100000:1.0:1767318770.163080:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940348928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318770.163161:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940348928:12345-0@lo:400:kworker.0 Request processed in 84us (5006us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318770.163168:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086
00000100:00100000:1.0:1767318770.163185:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087
00000100:00100000:1.0:1767318770.163191:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940348672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318770.163223:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940348672:12345-0@lo:400:kworker.0 Request processed in 33us (4688us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318770.163229:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087
00000100:00100000:1.0:1767318770.163242:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525
00000100:00100000:1.0:1767318770.163246:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940348800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318770.163266:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318770.163301:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940348800:12345-0@lo:38:kworker.0 Request processed in 53us (1656us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318770.163306:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525
00000100:00100000:1.0:1767318770.163318:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526
00000100:00100000:1.0:1767318770.163322:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940349056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318770.163331:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318770.163352:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940349056:12345-0@lo:38:kworker.0 Request processed in 29us (1648us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318770.163357:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526
00000100:00100000:1.0:1767318770.163440:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940348928:0@lo:400:kworker.0
00000100:00080000:1.0:1767318770.163486:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318770.163511:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318770.163528:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318770.163531:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940348800:0@lo:38:kworker.0
00000100:00080000:1.0:1767318770.163541:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318770.163545:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318770.163548:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940349056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.163633:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16527
00000100:00100000:2.0:1767318770.163637:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940348160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318770.163648:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318770.163684:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940348160:12345-0@lo:38:kworker.0 Request processed in 45us (2218us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318770.163689:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16527
00000100:00080000:2.0:1767318770.163714:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318770.163718:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318770.163720:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940348160:0@lo:38:kworker.0
00000100:00100000:0.0:1767318770.165147:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940348288
00000100:00100000:0.0:1767318770.165156:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940348288
00000100:00100000:0.0:1767318770.165202:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014
00000100:00100000:0.0:1767318770.165209:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940348288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318770.165226:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318770.165301:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940348288:12345-0@lo:38:kworker.0 Request processed in 91us (3725us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318770.165307:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014
00000100:00100000:0.0:1767318770.165351:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940348672:0@lo:400:kworker.0
00000100:00080000:3.0:1767318770.165489:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318770.165495:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318770.165498:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940348288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318770.669170:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318770.669194:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940349184:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318770.669272:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318770.669412:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349184
00000100:00100000:3.0:1767318770.669430:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349184
00000100:00100000:3.0:1767318770.669497:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207
00000100:00100000:3.0:1767318770.669507:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940349184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318770.669553:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318770.669609:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940349184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318770.669615:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207
00000100:00100000:0.0:1767318770.670077:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940349184:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318770.799305:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318771.118711:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318771.820931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318772.141095:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318772.845843:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318773.167056:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318773.834964:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318773.835029:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318773.835302:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281088
00000100:00100000:2.0:1767318773.835313:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281088
00000100:00100000:2.0:1767318773.835407:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894280960
00000100:00100000:2.0:1767318773.835411:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894280960
00000100:00100000:2.0:1767318773.835432:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4088
00000100:00100000:2.0:1767318773.835441:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894281088:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318773.835538:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894281088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (585us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318773.835546:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4088
00000100:00100000:2.0:1767318773.835565:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16528
00000100:00100000:2.0:1767318773.835569:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894280960:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318773.835591:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318773.835616:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894280960:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (586us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318773.835622:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16528
00000100:00080000:1.0:1767318773.836027:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318773.870608:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318774.190066:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318774.765158:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940349312:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318774.765267:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318774.765461:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349312
00000100:00100000:3.0:1767318774.765470:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349312
00000100:00100000:3.0:1767318774.765565:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208
00000100:00100000:3.0:1767318774.765576:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940349312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318774.765609:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318774.765678:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318774.773108:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940349312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7525us (7831us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318774.773125:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208
00000100:00100000:0.0:1767318774.773844:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940349312:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318774.892924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318775.213139:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318775.277094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318775.277104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318775.277108:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318775.277111:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318775.277116:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318775.277125:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4020
00000100:00080000:3.0:1767318775.277131:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318775.277138:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318775.277185:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9180 x1853163940349440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318775.277204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318775.277207:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318775.277208:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318775.277248:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4020
00000100:00080000:3.0:1767318775.277251:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318775.277255:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318775.277592:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ebb80 x1853163940349568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318775.277658:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318775.277661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318775.277663:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318775.277666:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4020
00000100:00080000:3.0:1767318775.277669:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318775.277674:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318775.277683:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ea680 x1853163940350080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318775.277698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318775.277701:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318775.277703:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318775.277706:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4020
00000100:00080000:3.0:1767318775.277708:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318775.277712:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318775.277722:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38e00 x1853163940350336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318775.277748:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940349952:0@lo:400:kworker.0
00000100:00100000:3.0:1767318775.277827:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318775.277915:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318775.277922:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940349824:0@lo:400:kworker.0
00000100:00100000:3.0:1767318775.277951:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318775.277988:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349952
00000100:00100000:3.0:1767318775.277995:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349952
00000100:00100000:3.0:1767318775.278050:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089
00000100:00100000:3.0:1767318775.278061:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940349952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318775.278109:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940349952:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318775.278117:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089
00000100:00080000:3.0:1767318775.278140:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318775.278168:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940349952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278547:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349824
00000100:00100000:0.0:1767318775.278552:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349824
00000100:00100000:0.0:1767318775.278597:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683
00000100:00100000:0.0:1767318775.278605:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940349824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278648:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940349824:12345-0@lo:400:kworker.0 Request processed in 44us (696us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318775.278655:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683
00000100:00100000:0.0:1767318775.278699:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940349824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278718:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940350208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278743:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318775.278761:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318775.278766:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940349696:0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278807:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318775.278849:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349696
00000100:00100000:0.0:1767318775.278853:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349696
00000100:00100000:0.0:1767318775.278877:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684
00000100:00100000:0.0:1767318775.278884:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940349696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.278916:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940349696:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318775.278925:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684
00000100:00100000:0.0:1767318775.278941:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350208
00000100:00100000:0.0:1767318775.278945:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350208
00000100:00100000:0.0:1767318775.278969:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090
00000100:00100000:0.0:1767318775.278975:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940350208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.279004:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940350208:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318775.279010:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090
00000100:00100000:0.0:1767318775.279038:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940349696:0@lo:400:kworker.0
00000100:00100000:0.0:1767318775.279047:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940350208:0@lo:400:kworker.0
00000100:00100000:2.0:1767318775.281320:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940349440:0@lo:38:kworker.0
00000100:00100000:2.0:1767318775.281565:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318775.281608:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940349568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318775.281637:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318775.281661:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940350080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318775.281684:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318775.281704:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940350336:0@lo:38:kworker.0
00000100:00100000:2.0:1767318775.281726:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318775.281809:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349568
00000100:00100000:2.0:1767318775.281817:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349568
00000100:00100000:2.0:1767318775.281853:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015
00000100:00100000:2.0:1767318775.281860:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940349568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318775.281882:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318775.281922:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940349568:12345-0@lo:38:kworker.0 Request processed in 61us (284us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318775.281929:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015
00000100:00100000:2.0:1767318775.281954:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940349440
00000100:00100000:2.0:1767318775.281957:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940349440
00000100:00100000:2.0:1767318775.281997:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350080
00000100:00100000:2.0:1767318775.282000:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350080
00000100:00100000:2.0:1767318775.282013:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350336
00000100:00100000:2.0:1767318775.282015:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350336
00000100:00100000:2.0:1767318775.282027:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529
00000100:00100000:2.0:1767318775.282032:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940349440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318775.282042:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318775.282068:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940349440:12345-0@lo:38:kworker.0 Request processed in 34us (503us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318775.282074:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529
00000100:00100000:2.0:1767318775.282086:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530
00000100:00100000:2.0:1767318775.282090:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940350080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318775.282099:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318775.282120:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940350080:12345-0@lo:38:kworker.0 Request processed in 29us (436us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318775.282126:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530
00000100:00100000:2.0:1767318775.282153:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16531
00000100:00100000:2.0:1767318775.282157:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940350336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318775.282166:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318775.282191:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940350336:12345-0@lo:38:kworker.0 Request processed in 32us (465us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318775.282197:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16531
00000100:00080000:2.0:1767318775.282233:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318775.282238:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318775.282241:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940349440:0@lo:38:kworker.0
00000100:00080000:2.0:1767318775.282250:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318775.282253:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318775.282255:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940349568:0@lo:38:kworker.0
00000100:00080000:2.0:1767318775.282261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318775.282464:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318775.282496:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318775.284659:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318775.284666:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940350080:0@lo:38:kworker.0
00000100:00080000:2.0:1767318775.284704:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318775.284708:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318775.284710:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940350336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318775.789114:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940350464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318775.789207:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318775.789367:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350464
00000100:00100000:3.0:1767318775.789375:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350464
00000100:00100000:3.0:1767318775.789433:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209
00000100:00100000:3.0:1767318775.789442:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940350464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318775.789487:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318775.789539:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940350464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (332us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318775.789546:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209
00000100:00100000:0.0:1767318775.793568:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940350464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318775.879946:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318775.879990:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894281216 offset 0 length 520: 4
00000100:00100000:1.0:1767318775.880032:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318775.880173:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281472
00000100:00100000:2.0:1767318775.880186:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281472
00000100:00100000:2.0:1767318775.880275:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281344
00000100:00100000:2.0:1767318775.880288:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281344
00000100:00100000:2.0:1767318775.880315:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4091
00000100:00100000:2.0:1767318775.880326:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894281472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318775.880442:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894281472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 118us (511us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318775.880452:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4091
00000100:00100000:2.0:1767318775.880482:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16532
00000100:00100000:2.0:1767318775.880487:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894281344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318775.880508:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318775.880533:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894281344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318775.880539:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16532
00000100:00080000:3.0:1767318775.881049:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318775.918961:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318776.237079:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318776.941270:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318777.262030:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318777.965124:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318778.286457:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318778.988881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318779.309084:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318779.887037:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940350592:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318779.887377:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318779.887522:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350592
00000100:00100000:1.0:1767318779.887531:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350592
00000100:00100000:1.0:1767318779.887603:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210
00000100:00100000:1.0:1767318779.887614:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940350592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318779.887648:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318779.887821:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318779.888626:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940350592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1010us (1246us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318779.888639:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210
00000100:00100000:0.0:1767318779.888864:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940350592:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318780.013362:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318780.334266:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318780.399293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318780.399306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318780.399309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318780.399313:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318780.399318:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318780.399327:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4025
00000100:00080000:0.0:1767318780.399332:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318780.399339:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318780.399389:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7e680 x1853163940350720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318780.399490:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940350720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318780.399617:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318780.399725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318780.399730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318780.399732:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318780.399736:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4025
00000100:00080000:0.0:1767318780.399739:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318780.399743:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318780.399759:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7d500 x1853163940350848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318780.399877:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350720
00000100:00100000:3.0:1767318780.399885:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350720
00000100:00100000:3.0:1767318780.399935:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16533
00000100:00100000:3.0:1767318780.399944:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940350720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318780.399979:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318780.402950:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940350848:0@lo:38:kworker.0
00000100:00100000:2.0:1767318780.403065:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318780.403193:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350848
00000100:00100000:1.0:1767318780.403200:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350848
00000100:00100000:1.0:1767318780.403243:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016
00000100:00100000:1.0:1767318780.403251:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940350848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318780.403281:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318780.403323:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940350848:12345-0@lo:38:kworker.0 Request processed in 72us (257us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318780.403334:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016
00000100:00080000:0.0:1767318780.404359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318780.404364:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318780.404367:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318780.404372:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4025
00000100:00080000:0.0:1767318780.404376:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318780.404382:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318780.404402:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3480 x1853163940351360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318780.404449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318780.404462:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318780.404464:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318780.404468:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4025
00000100:00080000:0.0:1767318780.404471:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318780.404474:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318780.404490:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1180 x1853163940351616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318780.404522:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940351488:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.404705:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940350976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.405757:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318780.405888:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940350976
00000100:00100000:1.0:1767318780.405895:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940350976
00000100:00100000:1.0:1767318780.405955:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685
00000100:00100000:1.0:1767318780.405964:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940350976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406018:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940350976:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318780.406025:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685
00000100:00100000:1.0:1767318780.406067:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940350976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406106:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940351104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406131:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318780.406169:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318780.406176:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940351232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406373:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318780.406401:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351104
00000100:00100000:1.0:1767318780.406405:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351104
00000100:00100000:1.0:1767318780.406453:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686
00000100:00100000:1.0:1767318780.406460:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940351104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406495:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940351104:12345-0@lo:400:kworker.0 Request processed in 35us (362us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318780.406501:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686
00000100:00100000:1.0:1767318780.406519:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351232
00000100:00100000:1.0:1767318780.406522:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351232
00000100:00100000:1.0:1767318780.406553:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092
00000100:00100000:1.0:1767318780.406558:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940351232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406601:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940351232:12345-0@lo:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318780.406607:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092
00000100:00100000:1.0:1767318780.406634:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940351232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318780.406643:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940351104:0@lo:400:kworker.0
00000100:00080000:1.0:1767318780.406684:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318780.406830:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318780.406922:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940350720:12345-0@lo:38:kworker.0 Request processed in 6976us (7303us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318780.406931:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16533
00000100:00100000:0.0:1767318780.407020:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318780.407107:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351488
00000100:00100000:3.0:1767318780.407112:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351488
00000100:00100000:3.0:1767318780.407157:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093
00000100:00100000:3.0:1767318780.407163:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940351488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318780.407200:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940351488:12345-0@lo:400:kworker.0 Request processed in 37us (179us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318780.407206:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093
00000100:00080000:0.0:1767318780.407275:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318780.407296:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940351488:0@lo:400:kworker.0
00000100:00080000:2.0:1767318780.412820:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318780.412836:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318780.412842:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940350720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318780.412884:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940351360:0@lo:38:kworker.0
00000100:00100000:2.0:1767318780.412953:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318780.412997:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940351616:0@lo:38:kworker.0
00000100:00100000:2.0:1767318780.413019:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318780.413055:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318780.413059:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318780.413063:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940350848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318780.413256:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351360
00000100:00100000:1.0:1767318780.413264:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351360
00000100:00100000:1.0:1767318780.413309:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351616
00000100:00100000:1.0:1767318780.413312:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351616
00000100:00100000:1.0:1767318780.413332:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534
00000100:00100000:1.0:1767318780.413340:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940351360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318780.413363:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318780.413409:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940351360:12345-0@lo:38:kworker.0 Request processed in 68us (455us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318780.413415:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534
00000100:00100000:1.0:1767318780.413444:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16535
00000100:00100000:1.0:1767318780.413448:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940351616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318780.413457:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318780.413485:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940351616:12345-0@lo:38:kworker.0 Request processed in 35us (465us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318780.413490:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16535
00000100:00080000:2.0:1767318780.413811:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318780.413816:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318780.413819:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940351360:0@lo:38:kworker.0
00000100:00080000:2.0:1767318780.413828:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318780.413831:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318780.413833:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940351616:0@lo:38:kworker.0
00000100:00100000:1.0:1767318780.909104:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940351744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318780.909220:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318780.909980:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940351744
00000100:00100000:3.0:1767318780.909992:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940351744
00000100:00100000:3.0:1767318780.910060:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211
00000100:00100000:3.0:1767318780.910070:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940351744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318780.910127:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318780.910197:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940351744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (976us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318780.910204:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211
00000100:00100000:1.0:1767318780.910354:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940351744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318781.002181:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318781.002238:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318781.002352:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281600
00000100:00100000:2.0:1767318781.002363:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281600
00000100:00100000:2.0:1767318781.002403:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281728
00000100:00100000:2.0:1767318781.002405:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281728
00000100:00100000:2.0:1767318781.002471:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4094
00000100:00100000:2.0:1767318781.002481:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894281728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318781.002562:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894281728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318781.002567:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4094
00000100:00100000:2.0:1767318781.002589:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16536
00000100:00100000:2.0:1767318781.002594:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894281600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318781.002617:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318781.002645:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894281600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (477us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318781.002652:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16536
00000100:00080000:0.0:1767318781.002892:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318781.037676:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318781.357118:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318781.421039:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318756/real 1767318756]  req@ffff93d04760c380 x1853163940345344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318781.421077:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04760c380 x1853163940345344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318781.421097:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318781.421119:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318781.421123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940345344:0@lo:250:kworker.0
00000100:00080000:0.0:1767318781.421202:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318781.421207:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318781.421211:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318781.421215:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4006
00000100:00080000:0.0:1767318781.421219:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318781.421224:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318781.421256:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3480 x1853163940351872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318781.421281:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318781.421285:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318781.421286:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318781.421289:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4030
00000100:00080000:0.0:1767318781.421292:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318781.421295:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318781.421309:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0a80 x1853163940352000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318781.421318:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318781.421321:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318781.421323:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318781.421326:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4030
00000100:00080000:0.0:1767318781.421328:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318781.421331:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318781.421341:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940352128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318781.421400:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318781.421422:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318781.421424:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318781.421428:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4030
00000100:00080000:0.0:1767318781.421431:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318781.421434:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318781.421448:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1c00 x1853163940352640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318781.421463:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318781.421466:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318781.421468:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318781.421471:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4030
00000100:00080000:0.0:1767318781.421473:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318781.421477:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318781.421484:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940352896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318781.421763:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940352384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.421847:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318781.421948:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318781.421955:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940352256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.421978:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318781.421996:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940352768:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422014:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318781.422028:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318781.422032:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940352512:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422051:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318781.422078:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352384
00000100:00100000:1.0:1767318781.422085:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352384
00000100:00100000:1.0:1767318781.422122:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352256
00000100:00100000:1.0:1767318781.422124:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352256
00000100:00100000:1.0:1767318781.422156:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767318781.422161:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940352384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422204:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940352384:12345-0@lo:400:kworker.0 Request processed in 42us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318781.422210:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767318781.422225:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688
00000100:00100000:1.0:1767318781.422231:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940352256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422255:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940352256:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318781.422258:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688
00000100:00100000:1.0:1767318781.422276:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352768
00000100:00100000:1.0:1767318781.422278:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352768
00000100:00100000:1.0:1767318781.422293:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352512
00000100:00100000:1.0:1767318781.422294:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352512
00000100:00100000:1.0:1767318781.422303:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095
00000100:00100000:1.0:1767318781.422306:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940352768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422325:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940352768:12345-0@lo:400:kworker.0 Request processed in 19us (310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318781.422329:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095
00000100:00100000:1.0:1767318781.422336:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096
00000100:00100000:1.0:1767318781.422339:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940352512:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422351:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940352512:12345-0@lo:400:kworker.0 Request processed in 12us (301us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318781.422355:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096
00000100:00080000:1.0:1767318781.422366:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318781.422387:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940352512:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422393:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940352768:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422481:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940352256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318781.422491:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940352384:0@lo:400:kworker.0
00000100:00100000:2.0:1767318781.422680:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940351872:0@lo:250:kworker.0
00000400:00000100:2.0:1767318781.422705:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940351872 offset 0 length 520: 4
00000100:00100000:2.0:1767318781.422721:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940352000:0@lo:38:kworker.0
00000100:00100000:2.0:1767318781.422742:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318781.422805:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940352128:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.422813:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352000
00000100:00100000:0.0:1767318781.422817:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352000
00000100:00100000:2.0:1767318781.422830:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318781.422857:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940352640:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.422896:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537
00000100:00100000:0.0:1767318781.422902:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940352000:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318781.422906:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352128
00000100:00100000:1.0:1767318781.422909:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352128
00010000:00020000:0.0:1767318781.422920:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318781.422929:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017
00000100:00100000:1.0:1767318781.422932:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940352128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318781.422942:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318781.422950:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940352000:12345-0@lo:38:kworker.0 Request processed in 47us (207us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318781.422956:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537
00000100:00100000:1.0:1767318781.422963:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940352128:12345-0@lo:38:kworker.0 Request processed in 30us (133us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318781.422969:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017
00000100:00100000:2.0:1767318781.422986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318781.423007:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352640
00000100:00100000:2.0:1767318781.423008:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940352896:0@lo:38:kworker.0
00000100:00100000:3.0:1767318781.423011:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352640
00000100:00100000:3.0:1767318781.423031:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16538
00000100:00100000:3.0:1767318781.423036:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940352640:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318781.423041:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767318781.423048:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318781.423069:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318781.423073:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940352640:12345-0@lo:38:kworker.0 Request processed in 37us (87us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318781.423074:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318781.423078:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940352000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318781.423079:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16538
00000100:00080000:2.0:1767318781.423085:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318781.423089:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318781.423090:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940352896
00000100:00100000:2.0:1767318781.423091:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940352128:0@lo:38:kworker.0
00000100:00100000:3.0:1767318781.423093:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940352896
00000100:00080000:2.0:1767318781.423098:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318781.423101:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318781.423104:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940352640:0@lo:38:kworker.0
00000100:00100000:3.0:1767318781.423108:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16539
00000100:00100000:3.0:1767318781.423111:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940352896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318781.423120:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318781.423164:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940352896:12345-0@lo:38:kworker.0 Request processed in 50us (121us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318781.423170:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16539
00000100:00080000:2.0:1767318781.423178:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318781.423193:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318781.423197:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940352896:0@lo:38:kworker.0
00000100:00100000:0.0:1767318782.065459:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318782.382564:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318783.085272:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318783.406551:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318784.109836:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318784.431001:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318785.009594:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940353024:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318785.009724:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318785.010705:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353024
00000100:00100000:0.0:1767318785.010718:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353024
00000100:00100000:0.0:1767318785.010855:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212
00000100:00100000:0.0:1767318785.010867:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940353024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318785.010902:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318785.011001:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940353024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318785.011010:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212
00000100:00100000:2.0:1767318785.011169:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940353024:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318785.011435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318785.133787:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318785.454790:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318786.029924:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940353152:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318786.030001:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318786.030297:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353152
00000100:00100000:3.0:1767318786.030305:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353152
00000100:00100000:3.0:1767318786.030391:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213
00000100:00100000:3.0:1767318786.030403:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940353152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318786.030436:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318786.030501:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940353152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (499us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318786.030511:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213
00000100:00100000:2.0:1767318786.030744:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940353152:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318786.030851:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318786.123191:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318786.123250:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318786.123453:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281984
00000100:00100000:0.0:1767318786.123465:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281984
00000100:00100000:0.0:1767318786.123603:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894281856
00000100:00100000:0.0:1767318786.123608:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894281856
00000100:00100000:0.0:1767318786.123632:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4097
00000100:00100000:0.0:1767318786.123643:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894281984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318786.123721:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894281984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (541us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318786.123730:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4097
00000100:00100000:0.0:1767318786.123755:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16540
00000100:00100000:0.0:1767318786.123760:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894281856:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318786.123813:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318786.123840:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894281856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 78us (589us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318786.123846:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16540
00000100:00080000:3.0:1767318786.124131:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318786.156868:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318786.481755:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318786.540914:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318786.540924:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318786.540927:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318786.540931:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318786.540935:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318786.540943:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4031
00000100:00080000:0.0:1767318786.540949:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318786.540956:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318786.540996:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940353280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318786.541025:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318786.541030:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318786.541031:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318786.541035:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4031
00000100:00080000:0.0:1767318786.541037:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318786.541042:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318786.541067:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940353408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318786.541116:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318786.541119:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318786.541121:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318786.541125:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4031
00000100:00080000:0.0:1767318786.541127:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318786.541131:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318786.541144:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940353792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318786.541167:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318786.541170:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318786.541172:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318786.541177:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4031
00000100:00080000:0.0:1767318786.541179:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318786.541182:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318786.541192:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940353536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318786.541193:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3100 x1853163940354048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318786.541279:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318786.541295:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940353664:0@lo:400:kworker.0
00000100:00100000:1.0:1767318786.541335:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318786.541419:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940353920:0@lo:400:kworker.0
00000100:00100000:0.0:1767318786.541574:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353536
00000100:00100000:0.0:1767318786.541582:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353536
00000100:00100000:3.0:1767318786.541626:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353664
00000100:00100000:2.0:1767318786.541649:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318786.541688:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689
00000100:00100000:2.0:1767318786.541690:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353920
00000100:00100000:2.0:1767318786.541694:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353920
00000100:00100000:0.0:1767318786.541703:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940353536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318786.541736:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098
00000100:00100000:2.0:1767318786.541744:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940353920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318786.541767:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940353536:12345-0@lo:400:kworker.0 Request processed in 67us (488us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318786.541796:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689
00000100:00100000:2.0:1767318786.541813:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940353920:12345-0@lo:400:kworker.0 Request processed in 69us (163us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318786.541853:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353664
00000100:00100000:2.0:1767318786.541883:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098
00000100:00100000:2.0:1767318786.541907:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940353280:0@lo:38:kworker.0
00000100:00100000:2.0:1767318786.541932:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318786.541948:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940353408:0@lo:38:kworker.0
00000100:00100000:2.0:1767318786.541970:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318786.541987:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940353792:0@lo:38:kworker.0
00000100:00100000:2.0:1767318786.542004:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318786.542015:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940354048:0@lo:38:kworker.0
00000100:00100000:2.0:1767318786.542034:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318786.542061:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353280
00000100:00100000:2.0:1767318786.542065:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353280
00000100:00100000:1.0:1767318786.542287:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353408
00000100:00100000:1.0:1767318786.542292:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353408
00000100:00100000:1.0:1767318786.542318:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018
00000100:00100000:1.0:1767318786.542323:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940353408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318786.542343:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318786.542395:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940353408:12345-0@lo:38:kworker.0 Request processed in 70us (423us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318786.542401:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018
00000100:00080000:1.0:1767318786.542436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318786.542440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318786.542444:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940353408:0@lo:38:kworker.0
00000100:00100000:1.0:1767318786.542478:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940353792
00000100:00100000:1.0:1767318786.542482:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940353792
00000100:00100000:3.0:1767318786.543006:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354048
00000100:00100000:3.0:1767318786.543013:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354048
00000100:00100000:3.0:1767318786.543036:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099
00000100:00100000:3.0:1767318786.543046:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940353664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318786.543094:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940353664:12345-0@lo:400:kworker.0 Request processed in 50us (1758us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318786.543101:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099
00000100:00100000:3.0:1767318786.543117:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16541
00000100:00100000:3.0:1767318786.543121:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940354048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318786.543133:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318786.543483:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940353664:0@lo:400:kworker.0
00000100:00080000:0.0:1767318786.543518:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318786.543524:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318786.543528:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940354048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318786.543572:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940353920:0@lo:400:kworker.0
00000100:00080000:0.0:1767318786.543604:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318786.543623:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940353536:0@lo:400:kworker.0
00000100:00100000:3.0:1767318786.543759:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940354048:12345-0@lo:38:kworker.0 Request processed in 634us (1722us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318786.543767:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16541
00000100:00100000:2.0:1767318786.543971:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16542
00000100:00100000:2.0:1767318786.543978:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940353280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318786.543990:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318786.544037:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940353280:12345-0@lo:38:kworker.0 Request processed in 59us (2104us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318786.544043:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16542
00000100:00100000:1.0:1767318786.544080:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16543
00000100:00100000:1.0:1767318786.544087:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940353792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318786.544099:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318786.544134:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940353792:12345-0@lo:38:kworker.0 Request processed in 46us (2128us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318786.544156:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318786.544162:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318786.544166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940353280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318786.544363:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16543
00000100:00080000:0.0:1767318786.544592:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318786.544597:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318786.544600:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940353792:0@lo:38:kworker.0
00000100:00100000:0.0:1767318787.180921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318787.501282:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318788.204958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318788.525042:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318789.228927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318789.552984:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318790.125813:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318790.125843:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940354176:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318790.125914:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318790.125981:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354176
00000100:00100000:0.0:1767318790.125990:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354176
00000100:00100000:0.0:1767318790.126088:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214
00000100:00100000:0.0:1767318790.126098:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940354176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318790.126129:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318790.126184:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318790.126186:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940354176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (269us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318790.126197:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214
00000100:00100000:2.0:1767318790.126261:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940354176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318790.252913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318790.574869:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318791.149133:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318791.149159:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940354304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318791.149242:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318791.149455:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354304
00000100:00100000:0.0:1767318791.149464:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354304
00000100:00100000:0.0:1767318791.149536:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215
00000100:00100000:0.0:1767318791.149547:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940354304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318791.149578:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318791.149640:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940354304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318791.149649:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215
00000100:00100000:0.0:1767318791.149703:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940354304:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318791.150066:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318791.238883:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318791.239019:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282240
00000100:00100000:1.0:1767318791.239032:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282240
00000100:00100000:1.0:1767318791.239201:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4100
00000100:00100000:1.0:1767318791.239212:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894282240:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318791.239316:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894282240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318791.239333:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4100
00000100:00100000:3.0:1767318791.240015:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318791.240147:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282112
00000100:00100000:2.0:1767318791.240153:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282112
00000100:00100000:2.0:1767318791.240193:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16544
00000100:00100000:2.0:1767318791.240199:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894282112:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318791.240230:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318791.240274:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894282112:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 73us (260us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318791.240281:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16544
00000100:00080000:0.0:1767318791.241869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318791.277078:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318791.597250:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318791.661019:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318791.661031:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318791.661036:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318791.661041:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318791.661047:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318791.661060:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4036
00000100:00080000:3.0:1767318791.661065:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318791.661074:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318791.661131:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940354432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318791.661219:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940354432:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.661301:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318791.661615:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354432
00000100:00100000:1.0:1767318791.661625:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354432
00000100:00100000:1.0:1767318791.661681:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545
00000100:00100000:1.0:1767318791.661691:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940354432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318791.661723:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318791.661816:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318791.661820:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318791.661822:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318791.661827:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4036
00000100:00080000:3.0:1767318791.661830:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318791.661834:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318791.661849:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9eb480 x1853163940354560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318791.663536:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940354560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.663623:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.663760:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354560
00000100:00100000:2.0:1767318791.663807:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354560
00000100:00100000:2.0:1767318791.663866:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019
00000100:00100000:2.0:1767318791.663876:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940354560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318791.663912:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318791.664016:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940354560:12345-0@lo:38:kworker.0 Request processed in 140us (392us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318791.664025:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019
00000100:00100000:1.0:1767318791.664083:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940354432:12345-0@lo:38:kworker.0 Request processed in 2387us (2776us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318791.664100:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545
00000100:00080000:3.0:1767318791.664296:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318791.664302:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318791.664306:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318791.664311:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4036
00000100:00080000:3.0:1767318791.664316:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767318791.664328:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:3.0:1767318791.664338:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318791.664351:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940354688:0@lo:400:kworker.0
00000100:00100000:3.0:1767318791.664357:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940354816:0@lo:400:kworker.0
00000100:00080000:0.0:1767318791.664537:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318791.664544:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318791.664548:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940354432:0@lo:38:kworker.0
00000100:00080000:0.0:1767318791.664577:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318791.664581:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318791.664584:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940354560:0@lo:38:kworker.0
00000100:00100000:3.0:1767318791.664651:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.664658:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.664839:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adfb80 x1853163940354944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318791.664885:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318791.664890:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318791.664895:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318791.664901:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4036
00000100:00080000:2.0:1767318791.664906:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318791.664915:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318791.664931:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940355200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318791.664934:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318791.664949:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940355072:0@lo:400:kworker.0
00000100:00100000:3.0:1767318791.664990:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318791.665132:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354688
00000100:00100000:0.0:1767318791.665208:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354688
00000100:00100000:0.0:1767318791.665272:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690
00000100:00100000:0.0:1767318791.665280:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940354688:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318791.665366:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940354688:12345-0@lo:400:kworker.0 Request processed in 87us (710us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318791.665373:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690
00000100:00100000:0.0:1767318791.665439:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940354688:0@lo:400:kworker.0
00000100:00100000:0.0:1767318791.665468:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940354944:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.665498:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318791.667572:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354816
00000100:00100000:1.0:1767318791.667589:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354816
00000100:00100000:1.0:1767318791.667839:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355072
00000100:00100000:1.0:1767318791.667844:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355072
00000100:00080000:3.0:1767318791.667899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318791.667929:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101
00000100:00100000:3.0:1767318791.667949:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940354816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318791.668093:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940354816:12345-0@lo:400:kworker.0 Request processed in 154us (3442us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318791.668103:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101
00000100:00100000:3.0:1767318791.668167:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940354816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318791.670403:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102
00000100:00100000:1.0:1767318791.670426:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940355072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318791.670560:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940355072:12345-0@lo:400:kworker.0 Request processed in 143us (5569us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318791.670568:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102
00000100:00100000:1.0:1767318791.670654:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940355072:0@lo:400:kworker.0
00000100:00100000:0.0:1767318791.677882:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940355200:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.677987:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.678284:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940354944
00000100:00100000:2.0:1767318791.678294:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940354944
00000100:00100000:2.0:1767318791.678356:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355200
00000100:00100000:2.0:1767318791.678359:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355200
00000100:00100000:2.0:1767318791.678385:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546
00000100:00100000:2.0:1767318791.678394:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940354944:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318791.678495:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547
00000100:00100000:1.0:1767318791.678505:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940355200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318791.678532:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318791.678612:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940355200:12345-0@lo:38:kworker.0 Request processed in 108us (626us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318791.678619:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547
00000100:00080000:0.0:1767318791.678918:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318791.678926:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318791.678931:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940355200:0@lo:38:kworker.0
00010000:00020000:2.0:1767318791.680850:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318791.680969:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940354944:12345-0@lo:38:kworker.0 Request processed in 2573us (15467us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318791.680981:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546
00000100:00080000:0.0:1767318791.681177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318791.681183:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318791.681188:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940354944:0@lo:38:kworker.0
00000100:00100000:0.0:1767318792.301071:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318792.621812:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318793.326262:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318793.648664:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318794.349481:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318794.669021:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318795.245131:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940355328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318795.245242:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318795.245553:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355328
00000100:00100000:2.0:1767318795.245565:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355328
00000100:00100000:2.0:1767318795.245661:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216
00000100:00100000:2.0:1767318795.245675:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940355328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318795.245727:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318795.245834:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940355328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (589us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318795.245843:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216
00000100:00080000:3.0:1767318795.245936:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318795.250172:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940355328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318795.373161:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318795.693020:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318796.269708:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318796.269736:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940355456:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318796.269843:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318796.270022:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355456
00000100:00100000:0.0:1767318796.270032:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355456
00000100:00100000:0.0:1767318796.270105:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217
00000100:00100000:0.0:1767318796.270116:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940355456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318796.270148:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318796.270199:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940355456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (356us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318796.270207:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217
00000100:00100000:0.0:1767318796.270259:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940355456:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318796.270339:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318796.358333:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318796.358379:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318796.358463:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282496
00000100:00100000:0.0:1767318796.358474:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282496
00000100:00100000:0.0:1767318796.358539:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282368
00000100:00100000:0.0:1767318796.358542:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282368
00000100:00100000:0.0:1767318796.358560:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4103
00000100:00100000:0.0:1767318796.358568:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894282496:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318796.358639:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894282496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318796.358647:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4103
00000100:00100000:0.0:1767318796.358666:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16548
00000100:00100000:0.0:1767318796.358670:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894282368:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318796.358703:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318796.358728:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894282368:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (348us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318796.358737:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16548
00000100:00080000:3.0:1767318796.359037:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318796.396963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318796.717198:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318796.784391:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318796.784401:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318796.784405:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318796.784409:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318796.784413:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318796.784420:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4041
00000100:00080000:0.0:1767318796.784425:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318796.784432:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318796.784472:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1880 x1853163940355584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318796.784501:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318796.784505:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318796.784506:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318796.784509:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4041
00000100:00080000:0.0:1767318796.784511:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318796.784515:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318796.784530:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940355712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318796.784573:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318796.784577:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318796.784579:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318796.784582:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4041
00000100:00080000:0.0:1767318796.784585:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318796.784589:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318796.784599:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940356096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318796.784627:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318796.784630:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318796.784632:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318796.784635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4041
00000100:00080000:0.0:1767318796.784637:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318796.784640:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318796.784649:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011180 x1853163940356352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318796.784683:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940356224:0@lo:400:kworker.0
00000100:00100000:0.0:1767318796.784747:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318796.784847:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356224
00000100:00100000:0.0:1767318796.784855:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356224
00000100:00100000:0.0:1767318796.784909:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104
00000100:00100000:0.0:1767318796.784918:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940356224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318796.784971:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940356224:12345-0@lo:400:kworker.0 Request processed in 54us (223us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318796.784978:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104
00000100:00100000:0.0:1767318796.785020:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940356224:0@lo:400:kworker.0
00000100:00100000:2.0:1767318796.785162:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940355584:0@lo:38:kworker.0
00000100:00100000:2.0:1767318796.785204:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318796.785235:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940355712:0@lo:38:kworker.0
00000100:00100000:2.0:1767318796.785259:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318796.785288:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940356096:0@lo:38:kworker.0
00000100:00100000:2.0:1767318796.785308:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318796.785320:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940356352:0@lo:38:kworker.0
00000100:00100000:2.0:1767318796.785337:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318796.785365:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355712
00000100:00100000:2.0:1767318796.785369:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355712
00000100:00100000:2.0:1767318796.785390:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020
00000100:00100000:2.0:1767318796.785394:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940355712:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.785414:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.785446:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940355712:12345-0@lo:38:kworker.0 Request processed in 50us (186us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.785452:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020
00000100:00100000:2.0:1767318796.785474:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355584
00000100:00100000:2.0:1767318796.785477:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355584
00000100:00100000:2.0:1767318796.785492:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356096
00000100:00100000:2.0:1767318796.785495:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356096
00000100:00100000:2.0:1767318796.785509:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356352
00000100:00100000:2.0:1767318796.785511:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356352
00000100:00100000:2.0:1767318796.785520:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549
00000100:00100000:2.0:1767318796.785523:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940355584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.785533:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.785558:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940355584:12345-0@lo:38:kworker.0 Request processed in 33us (354us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.785563:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549
00000100:00100000:2.0:1767318796.785573:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550
00000100:00100000:2.0:1767318796.785577:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940356096:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.785584:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.785605:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940356096:12345-0@lo:38:kworker.0 Request processed in 27us (296us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.785610:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550
00000100:00100000:2.0:1767318796.785619:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16551
00000100:00100000:2.0:1767318796.785622:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940356352:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.785630:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.785649:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940356352:12345-0@lo:38:kworker.0 Request processed in 26us (311us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.785668:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16551
00000100:00080000:2.0:1767318796.785697:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.785701:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.785705:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940355584:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.785712:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.785715:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.785718:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940355712:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.785725:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.785727:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.785730:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940356096:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.785737:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.785740:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.785742:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940356352:0@lo:38:kworker.0
00000100:00100000:3.0:1767318796.785952:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940355968:0@lo:400:kworker.0
00000100:00100000:3.0:1767318796.785983:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318796.786012:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318796.786018:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940355840:0@lo:400:kworker.0
00000100:00100000:3.0:1767318796.786041:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318796.786071:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318796.786083:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355840
00000100:00100000:3.0:1767318796.786087:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355840
00000100:00100000:3.0:1767318796.786119:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691
00000100:00100000:3.0:1767318796.786125:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940355840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318796.786172:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940355840:12345-0@lo:400:kworker.0 Request processed in 47us (130us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318796.786188:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691
00000100:00100000:3.0:1767318796.786216:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940355840:0@lo:400:kworker.0
00000100:00100000:1.0:1767318796.786346:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940355968
00000100:00100000:1.0:1767318796.786351:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940355968
00000100:00100000:1.0:1767318796.786401:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105
00000100:00100000:1.0:1767318796.786408:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940355968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318796.786443:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940355968:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318796.786449:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105
00000100:00080000:3.0:1767318796.786516:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318796.786534:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940355968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318797.420945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318797.742041:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318798.444926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318798.765008:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318799.469194:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318799.794455:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318800.365950:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318800.365985:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940356480:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318800.366062:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318800.366282:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356480
00000100:00100000:2.0:1767318800.366294:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356480
00000100:00100000:2.0:1767318800.366373:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218
00000100:00100000:2.0:1767318800.366385:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940356480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318800.366433:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318800.366497:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940356480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318800.366505:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218
00000100:00080000:3.0:1767318800.366570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318800.366654:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940356480:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318800.493885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318800.815862:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318801.389373:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940356608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318801.389463:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318801.391441:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356608
00000100:00100000:2.0:1767318801.391455:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356608
00000100:00080000:3.0:1767318801.391541:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318801.391569:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219
00000100:00100000:2.0:1767318801.391580:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940356608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318801.391614:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318801.393575:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940356608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1990us (4104us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318801.393589:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219
00000100:00100000:1.0:1767318801.399282:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940356608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318801.482368:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318801.482469:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894282624 offset 0 length 520: 4
00000100:00100000:1.0:1767318801.482513:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318801.492430:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282880
00000100:00100000:0.0:1767318801.492448:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282880
00000100:00100000:2.0:1767318801.492554:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894282752
00000100:00100000:2.0:1767318801.492559:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894282752
00000100:00100000:2.0:1767318801.492617:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16552
00000100:00100000:2.0:1767318801.492626:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894282752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318801.492651:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318801.492727:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894282752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 100us (10212us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318801.492734:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16552
00000100:00100000:0.0:1767318801.495743:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4106
00000100:00100000:0.0:1767318801.495763:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894282880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318801.495870:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894282880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 114us (13511us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318801.495879:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4106
00000100:00080000:3.0:1767318801.502310:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318801.516909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318801.836992:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318801.901700:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318801.901713:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318801.901715:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318801.901719:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318801.901725:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318801.901734:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4046
00000100:00080000:2.0:1767318801.901739:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318801.901748:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318801.901837:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90700 x1853163940356736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318801.901872:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318801.901876:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318801.901878:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318801.901881:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4046
00000100:00080000:2.0:1767318801.901883:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318801.901887:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318801.901901:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92680 x1853163940356864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318801.901973:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940356992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318801.902358:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318801.902625:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356992
00000100:00100000:1.0:1767318801.902633:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356992
00000100:00100000:1.0:1767318801.902692:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692
00000100:00100000:1.0:1767318801.902704:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940356992:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318801.902835:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318801.902839:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318801.902842:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318801.902847:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4046
00000100:00080000:2.0:1767318801.902849:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318801.902854:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318801.902870:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9eb800 x1853163940357248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318801.902888:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318801.902891:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318801.902892:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318801.902896:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4046
00000100:00080000:2.0:1767318801.902898:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318801.902902:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318801.902913:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940357504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318801.902962:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940357120:0@lo:400:kworker.0
00000100:00100000:2.0:1767318801.903008:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318801.903041:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318801.903047:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940357376:0@lo:400:kworker.0
00000100:00100000:0.0:1767318801.903267:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940356736:0@lo:38:kworker.0
00000100:00100000:0.0:1767318801.903299:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318801.903335:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940356864:0@lo:38:kworker.0
00000100:00100000:0.0:1767318801.903361:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318801.903380:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940357248:0@lo:38:kworker.0
00000100:00100000:0.0:1767318801.903401:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318801.903417:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940357504:0@lo:38:kworker.0
00000100:00100000:0.0:1767318801.903436:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318801.903470:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356864
00000100:00100000:0.0:1767318801.903475:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356864
00000100:00100000:0.0:1767318801.903502:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021
00000100:00100000:0.0:1767318801.903507:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940356864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318801.903530:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318801.903567:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940356864:12345-0@lo:38:kworker.0 Request processed in 58us (204us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318801.903575:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021
00000100:00100000:0.0:1767318801.903598:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357120
00000100:00100000:0.0:1767318801.903602:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357120
00000100:00100000:0.0:1767318801.903637:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940356736
00000100:00100000:0.0:1767318801.903641:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940356736
00000100:00100000:0.0:1767318801.903654:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357248
00000100:00100000:0.0:1767318801.903656:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357248
00000100:00100000:0.0:1767318801.903664:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357504
00000100:00100000:0.0:1767318801.903666:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357504
00000100:00100000:0.0:1767318801.903676:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107
00000100:00100000:0.0:1767318801.903682:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940357120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318801.903714:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940357120:12345-0@lo:400:kworker.0 Request processed in 33us (706us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318801.903720:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107
00000100:00100000:0.0:1767318801.903732:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553
00000100:00100000:0.0:1767318801.903735:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940356736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318801.903744:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318801.903765:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940356736:12345-0@lo:38:kworker.0 Request processed in 27us (465us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318801.903771:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553
00000100:00100000:0.0:1767318801.903802:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554
00000100:00100000:0.0:1767318801.903806:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940357248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318801.903815:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318801.903835:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940357248:12345-0@lo:38:kworker.0 Request processed in 27us (433us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318801.903843:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554
00000100:00100000:0.0:1767318801.903852:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555
00000100:00100000:0.0:1767318801.903855:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940357504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318801.903864:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318801.903883:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940357504:12345-0@lo:38:kworker.0 Request processed in 26us (447us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318801.903889:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555
00000100:00080000:0.0:1767318801.903926:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318801.903931:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318801.903934:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940356736:0@lo:38:kworker.0
00000100:00080000:0.0:1767318801.903942:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318801.903945:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318801.903948:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940356864:0@lo:38:kworker.0
00000100:00080000:0.0:1767318801.903954:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318801.903956:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318801.903959:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940357248:0@lo:38:kworker.0
00000100:00080000:0.0:1767318801.903965:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318801.903968:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318801.903971:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940357504:0@lo:38:kworker.0
00000100:00080000:0.0:1767318801.904074:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318801.904595:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318801.904641:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940357120:0@lo:400:kworker.0
00000100:00100000:0.0:1767318801.909576:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357376
00000100:00100000:0.0:1767318801.909594:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357376
00000100:00100000:0.0:1767318801.909694:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108
00000100:00100000:0.0:1767318801.909705:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940357376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318801.909827:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940357376:12345-0@lo:400:kworker.0 Request processed in 123us (5229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318801.909834:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108
00000100:00080000:2.0:1767318801.910716:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318801.910819:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940357376:0@lo:400:kworker.0
00000100:00100000:1.0:1767318801.915154:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940356992:12345-0@lo:400:kworker.0 Request processed in 12441us (12785us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318801.915171:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692
00000100:00100000:3.0:1767318801.919328:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940356992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318802.542280:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318802.861106:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318803.564902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318803.885150:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318804.591089:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318804.909080:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318805.485061:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318805.485089:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940357632:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318805.485170:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318805.485325:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357632
00000100:00100000:2.0:1767318805.485335:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357632
00000100:00100000:2.0:1767318805.485410:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220
00000100:00100000:2.0:1767318805.485420:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940357632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318805.485465:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318805.485518:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940357632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (347us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318805.485524:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220
00000100:00080000:0.0:1767318805.485588:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318805.485849:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940357632:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318805.614008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318805.934283:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318806.509503:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940357760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318806.509590:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318806.510102:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357760
00000100:00100000:3.0:1767318806.510112:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357760
00000100:00100000:3.0:1767318806.510213:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:3.0:1767318806.510227:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940357760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318806.510270:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318806.510349:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318806.511174:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940357760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 947us (1578us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318806.511194:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00100000:1.0:1767318806.511380:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940357760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318806.599182:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318806.599415:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318806.599976:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283008
00000100:00100000:0.0:1767318806.599991:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283008
00000100:00100000:0.0:1767318806.600085:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283136
00000100:00100000:0.0:1767318806.600090:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283136
00000100:00080000:3.0:1767318806.600198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318806.600325:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4109
00000100:00100000:2.0:1767318806.600356:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894283136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318806.600485:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894283136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 147us (1069us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318806.600494:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4109
00000100:00100000:2.0:1767318806.600530:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16556
00000100:00100000:2.0:1767318806.600536:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894283008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318806.600565:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318806.600598:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894283008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 59us (1445us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318806.600605:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16556
00000100:00100000:0.0:1767318806.636909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318806.957113:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318807.020888:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318781/real 1767318781]  req@ffff93cf439b3480 x1853163940351872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318806 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318807.020933:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf439b3480 x1853163940351872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318806 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318807.020942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318807.020948:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318807.020951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318807.020956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318807.020960:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318807.020960:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318807.020966:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4051
00000100:00080000:1.0:1767318807.020971:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318807.020980:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00080000:0.0:1767318807.020982:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318807.020985:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940351872:0@lo:250:kworker.0
00000100:00100000:1.0:1767318807.021027:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940357888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318807.021058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318807.021062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318807.021064:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318807.021068:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4051
00000100:00080000:1.0:1767318807.021071:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318807.021075:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318807.021091:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965f80 x1853163940358016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318807.021104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940357888:0@lo:38:kworker.0
00000100:00080000:1.0:1767318807.021191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318807.021194:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318807.021197:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318807.021200:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4051
00000100:00080000:1.0:1767318807.021203:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318807.021207:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318807.021209:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318807.021219:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeace00 x1853163940358528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318807.021235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318807.021237:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318807.021239:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318807.021242:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4051
00000100:00080000:1.0:1767318807.021244:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318807.021248:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318807.021258:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf800 x1853163940358784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318807.021271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767318807.021273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940358016:0@lo:38:kworker.0
00000100:00080000:1.0:1767318807.021274:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318807.021276:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318807.021279:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4031
00000100:00080000:1.0:1767318807.021281:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318807.021284:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318807.021300:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8a80 x1853163940358912/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318807.021313:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318807.021322:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940358400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318807.021333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940358528:0@lo:38:kworker.0
00000100:00100000:0.0:1767318807.021354:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318807.021402:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940358144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318807.021564:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940358272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318807.021573:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940358784:0@lo:38:kworker.0
00000100:00100000:2.0:1767318807.021878:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318807.022025:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940357888
00000100:00100000:1.0:1767318807.022027:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358528
00000100:00100000:1.0:1767318807.022034:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358528
00000100:00100000:2.0:1767318807.022034:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940357888
00000100:00100000:2.0:1767318807.022145:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557
00000100:00100000:2.0:1767318807.022167:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940358528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318807.022201:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318807.022250:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940358528:12345-0@lo:38:kworker.0 Request processed in 95us (893us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318807.022258:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557
00000100:00100000:2.0:1767318807.022280:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558
00000100:00100000:2.0:1767318807.022558:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940357888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318807.022569:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318807.022599:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940357888:12345-0@lo:38:kworker.0 Request processed in 42us (1390us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318807.022605:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558
00000100:00100000:2.0:1767318807.022703:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318807.022742:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318807.022753:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940358656:0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.022809:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318807.022836:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358400
00000100:00100000:2.0:1767318807.022841:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358400
00000100:00100000:2.0:1767318807.022896:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358656
00000100:00100000:2.0:1767318807.022899:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358656
00000100:00100000:2.0:1767318807.022924:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110
00000100:00100000:2.0:1767318807.022930:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940358400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.022978:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940358400:12345-0@lo:400:kworker.0 Request processed in 48us (274us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318807.022985:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110
00000100:00100000:2.0:1767318807.022998:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111
00000100:00100000:2.0:1767318807.023003:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940358656:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.023036:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940358656:12345-0@lo:400:kworker.0 Request processed in 32us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318807.023041:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111
00000100:00100000:2.0:1767318807.023077:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940358656:0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.023091:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940358400:0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.023128:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358144
00000100:00100000:2.0:1767318807.023132:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358144
00000100:00100000:2.0:1767318807.023275:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693
00000100:00100000:2.0:1767318807.023293:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940358144:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.023338:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940358144:12345-0@lo:400:kworker.0 Request processed in 55us (1459us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318807.023345:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693
00000100:00100000:2.0:1767318807.023376:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940358144:0@lo:400:kworker.0
00000100:00080000:2.0:1767318807.023408:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318807.023414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318807.023590:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358016
00000100:00100000:2.0:1767318807.023595:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358016
00000100:00100000:2.0:1767318807.023623:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022
00000100:00100000:2.0:1767318807.023627:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940358016:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318807.023643:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318807.023676:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940358016:12345-0@lo:38:kworker.0 Request processed in 48us (2363us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318807.023682:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022
00000100:00100000:0.0:1767318807.025663:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318807.025740:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358784
00000100:00080000:0.0:1767318807.025743:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318807.025749:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318807.025749:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358784
00000100:00100000:0.0:1767318807.025754:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940357888:0@lo:38:kworker.0
00000100:00100000:0.0:1767318807.025811:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940358912:0@lo:250:kworker.0
00000100:00100000:1.0:1767318807.025815:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16559
00000100:00100000:1.0:1767318807.025823:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940358784:12345-0@lo:38:kworker.0
00000400:00000100:0.0:1767318807.025839:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940358912 offset 0 length 520: 4
00010000:00020000:1.0:1767318807.025846:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318807.025870:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318807.025874:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318807.025877:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940358016:0@lo:38:kworker.0
00000100:00100000:1.0:1767318807.025886:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940358784:12345-0@lo:38:kworker.0 Request processed in 63us (232us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318807.025889:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318807.025892:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318807.025895:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940358528:0@lo:38:kworker.0
00000100:00080000:0.0:1767318807.025902:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318807.025905:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16559
00000100:00080000:0.0:1767318807.025906:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318807.025908:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940358784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318807.028830:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318807.029121:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940358272
00000100:00100000:2.0:1767318807.029504:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940358272
00000100:00100000:2.0:1767318807.029589:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694
00000100:00100000:2.0:1767318807.029601:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940358272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318807.029706:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940358272:12345-0@lo:400:kworker.0 Request processed in 107us (886us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318807.029714:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694
00000100:00100000:3.0:1767318807.030648:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940358272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318807.660955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318807.986238:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318808.685373:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318809.005236:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318809.708957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318810.029033:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318810.605190:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940359040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318810.605287:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318810.605591:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359040
00000100:00100000:1.0:1767318810.605603:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359040
00000100:00100000:1.0:1767318810.605695:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222
00000100:00100000:1.0:1767318810.605707:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940359040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318810.605747:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318810.605901:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940359040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (613us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318810.605910:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222
00000100:00080000:2.0:1767318810.606912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318810.609170:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940359040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318810.734451:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318811.053252:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318811.633499:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940359168:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318811.633602:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318811.633794:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359168
00000100:00100000:0.0:1767318811.633806:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359168
00000100:00100000:0.0:1767318811.633888:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223
00000100:00100000:0.0:1767318811.633899:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940359168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318811.633948:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318811.634014:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940359168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (411us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318811.634023:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223
00000100:00100000:1.0:1767318811.634104:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940359168:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318811.634165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318811.719224:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318811.719285:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318811.719387:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283392
00000100:00100000:1.0:1767318811.719402:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283392
00000100:00100000:2.0:1767318811.719411:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283264
00000100:00100000:2.0:1767318811.719419:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283264
00000100:00080000:3.0:1767318811.719498:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318811.719536:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4112
00000100:00100000:2.0:1767318811.719550:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894283392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318811.719655:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894283392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (447us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318811.719663:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4112
00000100:00100000:2.0:1767318811.719685:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16560
00000100:00100000:2.0:1767318811.719691:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894283264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318811.719716:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318811.719744:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894283264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (459us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318811.719751:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16560
00000100:00100000:0.0:1767318811.756976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318812.077103:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318812.141110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318812.141123:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318812.141127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318812.141131:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318812.141146:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318812.141157:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4057
00000100:00080000:0.0:1767318812.141163:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318812.141172:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318812.142929:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92680 x1853163940359296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318812.142961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318812.142966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318812.142969:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318812.142974:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4057
00000100:00080000:0.0:1767318812.142978:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318812.142986:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318812.143002:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940359296:0@lo:38:kworker.0
00000100:00100000:0.0:1767318812.143027:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90700 x1853163940359424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318812.143145:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940359552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318812.143240:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318812.143415:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359552
00000100:00100000:3.0:1767318812.143424:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359552
00000100:00100000:3.0:1767318812.143539:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695
00000100:00100000:2.0:1767318812.143547:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318812.143554:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940359552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.143594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940359424:0@lo:38:kworker.0
00000100:00100000:2.0:1767318812.143834:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318812.143891:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940359680:0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.143917:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318812.143953:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359424
00000100:00100000:2.0:1767318812.143957:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359424
00000100:00100000:2.0:1767318812.143980:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023
00000100:00100000:2.0:1767318812.143986:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940359424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318812.144006:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318812.144041:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940359424:12345-0@lo:38:kworker.0 Request processed in 54us (207us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318812.144239:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023
00000100:00100000:2.0:1767318812.144266:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359680
00000100:00100000:2.0:1767318812.144270:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359680
00000100:00100000:2.0:1767318812.144302:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696
00000100:00100000:2.0:1767318812.144308:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940359680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.144346:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940359680:12345-0@lo:400:kworker.0 Request processed in 38us (428us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318812.144352:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696
00000100:00100000:2.0:1767318812.144412:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940359680:0@lo:400:kworker.0
00000100:00080000:2.0:1767318812.144444:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318812.144449:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318812.144862:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940359552:12345-0@lo:400:kworker.0 Request processed in 1313us (1621us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318812.144871:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695
00000100:00080000:3.0:1767318812.144912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318812.144923:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940359424:0@lo:38:kworker.0
00000100:00100000:2.0:1767318812.144984:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359296
00000100:00100000:2.0:1767318812.144990:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359296
00000100:00080000:0.0:1767318812.145069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318812.145074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318812.145077:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318812.145083:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4057
00000100:00080000:0.0:1767318812.145086:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318812.145106:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318812.145125:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222300 x1853163940359936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318812.145161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318812.145165:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318812.145166:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318812.145170:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4057
00000100:00080000:0.0:1767318812.145172:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318812.145176:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318812.145187:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221f80 x1853163940360192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318812.145226:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940360064:0@lo:400:kworker.0
00000100:00100000:0.0:1767318812.145284:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318812.145356:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940359552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318812.145395:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940359808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.146219:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360064
00000100:00100000:0.0:1767318812.146226:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318812.146227:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360064
00000100:00100000:2.0:1767318812.146307:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359808
00000100:00100000:2.0:1767318812.146311:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359808
00000100:00100000:0.0:1767318812.146325:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113
00000100:00100000:2.0:1767318812.146344:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114
00000100:00100000:0.0:1767318812.146352:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940360064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.146356:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940359808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318812.146425:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940360064:12345-0@lo:400:kworker.0 Request processed in 91us (1139us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318812.146433:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940359808:12345-0@lo:400:kworker.0 Request processed in 79us (207us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318812.146441:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114
00000100:00100000:0.0:1767318812.146450:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113
00000100:00100000:0.0:1767318812.146470:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16561
00000100:00100000:0.0:1767318812.146475:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940359296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318812.146494:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318812.146524:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940359296:12345-0@lo:38:kworker.0 Request processed in 47us (2979us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318812.146530:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16561
00000100:00100000:0.0:1767318812.146564:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940360064:0@lo:400:kworker.0
00000100:00100000:2.0:1767318812.146635:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940359808:0@lo:400:kworker.0
00000100:00080000:0.0:1767318812.146640:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318812.146678:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940359936:0@lo:38:kworker.0
00000100:00100000:2.0:1767318812.146833:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318812.146851:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940360192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318812.146889:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318812.146915:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318812.146920:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318812.146923:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940359296:0@lo:38:kworker.0
00000100:00100000:2.0:1767318812.146965:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940359936
00000100:00100000:2.0:1767318812.146968:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940359936
00000100:00100000:2.0:1767318812.146986:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360192
00000100:00100000:2.0:1767318812.146988:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360192
00000100:00100000:2.0:1767318812.147001:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16562
00000100:00100000:2.0:1767318812.147005:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940359936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318812.147017:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318812.147234:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940359936:12345-0@lo:38:kworker.0 Request processed in 42us (216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318812.147242:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16562
00000100:00100000:2.0:1767318812.147256:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16563
00000100:00100000:2.0:1767318812.147260:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940360192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318812.147271:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318812.147298:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940360192:12345-0@lo:38:kworker.0 Request processed in 36us (409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318812.147304:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16563
00000100:00080000:2.0:1767318812.147327:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318812.147331:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318812.147334:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940359936:0@lo:38:kworker.0
00000100:00080000:2.0:1767318812.147341:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318812.147344:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318812.147346:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940360192:0@lo:38:kworker.0
00000100:00100000:0.0:1767318812.781491:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318813.101101:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318813.805154:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318814.128177:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318814.829233:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318815.149526:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318815.725921:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940360320:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318815.726043:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318815.726333:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360320
00000100:00100000:0.0:1767318815.726342:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360320
00000100:00100000:0.0:1767318815.726435:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224
00000100:00100000:0.0:1767318815.726445:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940360320:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318815.726582:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:0.0:1767318815.727292:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318815.727384:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940360320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 940us (1341us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318815.727394:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224
00000100:00100000:1.0:1767318815.727590:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940360320:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318815.852917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318816.175343:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318816.749275:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318816.749299:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940360448:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318816.749366:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318816.749440:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360448
00000100:00100000:0.0:1767318816.749448:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360448
00000100:00100000:0.0:1767318816.749513:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225
00000100:00100000:0.0:1767318816.749522:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940360448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318816.749601:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318816.749649:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940360448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318816.749656:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225
00000100:00100000:0.0:1767318816.749712:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940360448:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318816.749869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318816.842500:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318816.842601:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283648
00000100:00100000:1.0:1767318816.842611:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283648
00000100:00100000:1.0:1767318816.842739:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4115
00000100:00100000:1.0:1767318816.842750:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894283648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767318816.842766:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318816.842866:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894283648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (368us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318816.842873:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4115
00000100:00100000:3.0:1767318816.844464:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318816.844578:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283520
00000100:00100000:0.0:1767318816.844586:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283520
00000100:00100000:0.0:1767318816.844629:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16564
00000100:00100000:0.0:1767318816.844636:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894283520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318816.844657:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318816.844715:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894283520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 77us (258us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318816.844721:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16564
00000100:00100000:0.0:1767318816.876939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318817.200441:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318817.261183:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318817.261194:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318817.261198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318817.261202:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318817.261207:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318817.261216:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4062
00000100:00080000:3.0:1767318817.261221:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318817.261229:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318817.261275:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa680 x1853163940360576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318817.261297:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318817.261299:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318817.261300:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318817.261303:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4062
00000100:00080000:3.0:1767318817.261305:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318817.261307:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318817.261315:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940360704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318817.261387:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318817.261390:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318817.261392:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318817.261395:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4062
00000100:00080000:3.0:1767318817.261397:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318817.261400:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318817.261409:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430f480 x1853163940361216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318817.261421:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318817.261423:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318817.261424:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318817.261428:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4062
00000100:00080000:3.0:1767318817.261430:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318817.261431:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940360960:0@lo:400:kworker.0
00000100:00080000:3.0:1767318817.261432:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318817.261443:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f100 x1853163940361472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318817.261460:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940361088:0@lo:400:kworker.0
00000100:00100000:1.0:1767318817.261519:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318817.261519:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318817.261587:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318817.261593:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940361344:0@lo:400:kworker.0
00000100:00100000:1.0:1767318817.261610:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318817.261616:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318817.261621:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940360832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318817.261646:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360960
00000100:00100000:3.0:1767318817.261653:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360960
00000100:00100000:1.0:1767318817.261666:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318817.261794:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940360576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318817.261820:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318817.261832:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940360704:0@lo:38:kworker.0
00000100:00100000:2.0:1767318817.261850:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318817.261866:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940361216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318817.261885:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318817.261901:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940361472:0@lo:38:kworker.0
00000100:00100000:2.0:1767318817.261922:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318817.261952:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360704
00000100:00100000:2.0:1767318817.261956:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360704
00000100:00100000:2.0:1767318817.261982:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024
00000100:00100000:2.0:1767318817.261989:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940360704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318817.262009:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318817.262050:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940360704:12345-0@lo:38:kworker.0 Request processed in 58us (196us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318817.262057:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024
00000100:00100000:2.0:1767318817.262080:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361088
00000100:00100000:2.0:1767318817.262084:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361088
00000100:00100000:2.0:1767318817.262156:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361344
00000100:00100000:2.0:1767318817.262159:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361344
00000100:00100000:2.0:1767318817.262171:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360576
00000100:00100000:2.0:1767318817.262174:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360576
00000100:00100000:2.0:1767318817.262182:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361216
00000100:00100000:2.0:1767318817.262184:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361216
00000100:00100000:2.0:1767318817.262191:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361472
00000100:00100000:2.0:1767318817.262192:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361472
00000100:00100000:2.0:1767318817.262201:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116
00000100:00100000:2.0:1767318817.262207:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940361088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318817.262252:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940361088:12345-0@lo:400:kworker.0 Request processed in 45us (740us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318817.262258:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116
00000100:00100000:2.0:1767318817.262270:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117
00000100:00100000:2.0:1767318817.262274:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940361344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318817.262293:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940361344:12345-0@lo:400:kworker.0 Request processed in 19us (678us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318817.262296:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117
00000100:00100000:2.0:1767318817.262302:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16565
00000100:00100000:2.0:1767318817.262305:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940360576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318817.262312:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318817.262326:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940360576:12345-0@lo:38:kworker.0 Request processed in 20us (505us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318817.262331:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16565
00000100:00100000:2.0:1767318817.262341:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16566
00000100:00100000:2.0:1767318817.262344:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940361216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318817.262352:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318817.262375:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940361216:12345-0@lo:38:kworker.0 Request processed in 29us (488us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318817.262381:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16566
00000100:00100000:2.0:1767318817.262392:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16567
00000100:00100000:2.0:1767318817.262395:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940361472:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318817.262402:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318817.262418:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940361472:12345-0@lo:38:kworker.0 Request processed in 22us (496us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318817.262421:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16567
00000100:00080000:2.0:1767318817.262470:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318817.262474:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318817.262476:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940360576:0@lo:38:kworker.0
00000100:00080000:2.0:1767318817.262482:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318817.262484:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318817.262485:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940360704:0@lo:38:kworker.0
00000100:00080000:2.0:1767318817.262490:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318817.262492:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318817.262493:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940361216:0@lo:38:kworker.0
00000100:00080000:2.0:1767318817.262497:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318817.262499:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318817.262500:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940361472:0@lo:38:kworker.0
00000100:00080000:2.0:1767318817.262539:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318817.262556:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940361344:0@lo:400:kworker.0
00000100:00100000:2.0:1767318817.262561:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940361088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318817.262815:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940360832
00000100:00100000:3.0:1767318817.262819:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940360832
00000100:00080000:0.0:1767318817.263127:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318817.263580:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697
00000100:00100000:1.0:1767318817.263596:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940360960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318817.263660:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940360960:12345-0@lo:400:kworker.0 Request processed in 70us (2148us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318817.263667:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697
00000100:00100000:1.0:1767318817.263685:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698
00000100:00100000:1.0:1767318817.263691:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940360832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318817.263899:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940360832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318817.263925:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940360960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318817.264183:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940360832:12345-0@lo:400:kworker.0 Request processed in 491us (2517us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318817.264191:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698
00000100:00100000:0.0:1767318817.900914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318818.222627:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318818.925210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318819.245920:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318819.948975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318820.269117:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318820.846855:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940361600:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318820.846948:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318820.847240:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361600
00000100:00100000:2.0:1767318820.847250:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361600
00000100:00100000:2.0:1767318820.847339:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226
00000100:00100000:2.0:1767318820.847349:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940361600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318820.847384:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318820.847470:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940361600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (522us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318820.847477:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226
00000100:00100000:3.0:1767318820.847744:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940361600:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318820.847912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318820.973234:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318821.292982:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318821.869263:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940361728:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318821.869362:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318821.869446:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361728
00000100:00100000:2.0:1767318821.869514:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361728
00000100:00100000:2.0:1767318821.869593:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227
00000100:00100000:2.0:1767318821.869605:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940361728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318821.869639:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767318821.869710:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318821.872640:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940361728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3026us (3265us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318821.872658:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227
00000100:00100000:1.0:1767318821.874532:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940361728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318821.961371:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318821.961423:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318821.961577:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283904
00000100:00100000:0.0:1767318821.961588:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283904
00000100:00100000:0.0:1767318821.961684:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894283776
00000100:00100000:0.0:1767318821.961688:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894283776
00000100:00100000:0.0:1767318821.961714:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4118
00000100:00100000:0.0:1767318821.961724:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894283904:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318821.961767:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16568
00000100:00100000:1.0:1767318821.961798:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894283776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318821.961822:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318821.961838:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894283904:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 115us (478us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318821.961846:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4118
00000100:00100000:1.0:1767318821.961850:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894283776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 76us (427us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318821.961855:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16568
00000100:00080000:3.0:1767318821.961918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318821.996922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318822.317128:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318822.381527:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318822.381540:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318822.381543:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318822.381547:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318822.381552:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318822.381563:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4067
00000100:00080000:0.0:1767318822.381568:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318822.381587:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318822.381642:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940361856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318822.381679:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318822.381683:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318822.381685:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318822.381739:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4067
00000100:00080000:0.0:1767318822.381742:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318822.381745:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318822.381792:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940361984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318822.381866:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318822.381869:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318822.381871:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318822.381874:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4067
00000100:00080000:0.0:1767318822.381876:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318822.381880:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318822.381894:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211c00 x1853163940362496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318822.381910:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318822.381914:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318822.381916:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318822.381920:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4067
00000100:00080000:0.0:1767318822.381923:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318822.381938:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382022:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318822.382099:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318822.382105:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382126:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318822.382159:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362240
00000100:00100000:1.0:1767318822.382168:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362240
00000100:00100000:2.0:1767318822.382215:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940362624:0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382225:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362112
00000100:00100000:1.0:1767318822.382231:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362112
00000100:00100000:2.0:1767318822.382259:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318822.382277:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699
00000100:00100000:2.0:1767318822.382285:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318822.382291:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318822.382293:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940362368:0@lo:400:kworker.0
00000100:00100000:2.0:1767318822.382324:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318822.382358:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362624
00000100:00100000:2.0:1767318822.382363:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362624
00000100:00100000:1.0:1767318822.382365:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362240:12345-0@lo:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318822.382374:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699
00000100:00100000:1.0:1767318822.382395:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700
00000100:00100000:2.0:1767318822.382400:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362368
00000100:00100000:1.0:1767318822.382405:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318822.382406:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362368
00000100:00100000:1.0:1767318822.382440:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362112:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318822.382446:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700
00000100:00100000:2.0:1767318822.382454:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119
00000100:00100000:2.0:1767318822.382463:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940362624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382475:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120
00000100:00100000:1.0:1767318822.382484:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940362368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318822.382509:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940362624:12345-0@lo:400:kworker.0 Request processed in 46us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318822.382517:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119
00000100:00100000:1.0:1767318822.382522:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940362368:12345-0@lo:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318822.382530:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120
00000100:00100000:2.0:1767318822.382568:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940362368:0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382570:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362112:0@lo:400:kworker.0
00000100:00100000:2.0:1767318822.382593:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940362624:0@lo:400:kworker.0
00000100:00100000:1.0:1767318822.382596:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362240:0@lo:400:kworker.0
00000100:00080000:3.0:1767318822.382807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318822.382812:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318822.382826:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940361856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318822.382857:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318822.382872:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940361984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318822.382917:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318822.382929:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361856
00000100:00100000:1.0:1767318822.382934:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361856
00000100:00100000:1.0:1767318822.382960:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16569
00000100:00100000:1.0:1767318822.382965:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940361856:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318822.382967:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940362496:0@lo:38:kworker.0
00010000:00020000:1.0:1767318822.382987:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318822.383003:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318822.383031:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940361856:12345-0@lo:38:kworker.0 Request processed in 64us (172us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318822.383038:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16569
00000100:00080000:3.0:1767318822.383050:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318822.383058:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318822.383061:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362496
00000100:00100000:3.0:1767318822.383062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940361856:0@lo:38:kworker.0
00000100:00100000:1.0:1767318822.383065:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362496
00000100:00100000:1.0:1767318822.383089:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16570
00000100:00100000:1.0:1767318822.383095:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940362496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318822.383105:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318822.383157:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940362496:12345-0@lo:38:kworker.0 Request processed in 61us (154us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318822.383163:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16570
00000100:00080000:3.0:1767318822.383390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318822.383395:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318822.383398:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940362496:0@lo:38:kworker.0
00000100:00080000:0.0:1767318822.383540:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318822.383566:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940362752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318822.384387:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940361984
00000100:00100000:2.0:1767318822.384395:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940361984
00000100:00100000:2.0:1767318822.384448:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025
00000100:00100000:2.0:1767318822.384454:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940361984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318822.384473:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318822.384530:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940361984:12345-0@lo:38:kworker.0 Request processed in 74us (1613us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318822.384535:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025
00000100:00100000:3.0:1767318822.384685:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940362752:0@lo:38:kworker.0
00000100:00100000:3.0:1767318822.384719:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318822.384799:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318822.384804:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318822.384808:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940361984:0@lo:38:kworker.0
00000100:00100000:1.0:1767318822.384975:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362752
00000100:00100000:1.0:1767318822.384980:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362752
00000100:00100000:1.0:1767318822.385015:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16571
00000100:00100000:1.0:1767318822.385020:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940362752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318822.385032:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318822.385083:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940362752:12345-0@lo:38:kworker.0 Request processed in 61us (363us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318822.385090:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16571
00000100:00080000:3.0:1767318822.385336:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318822.385342:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318822.385346:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940362752:0@lo:38:kworker.0
00000100:00100000:0.0:1767318823.021473:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318823.343009:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318824.046708:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318824.365130:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318825.069050:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318825.390120:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318825.966093:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318825.966133:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362880:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318825.966248:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318825.966960:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940362880
00000100:00100000:2.0:1767318825.966969:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940362880
00000100:00100000:2.0:1767318825.967092:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228
00000100:00100000:2.0:1767318825.967103:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318825.967135:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318825.967211:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940362880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (963us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318825.967219:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228
00000100:00100000:1.0:1767318825.967370:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940362880:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318825.967495:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318826.057661:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318826.059315:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284288
00000100:00100000:1.0:1767318826.059335:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284288
00000100:00100000:1.0:1767318826.059450:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4121
00000100:00100000:1.0:1767318826.059462:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894284288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318826.059562:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894284288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (1912us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318826.059568:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4121
00000100:00080000:3.0:1767318826.059639:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767318826.061415:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894284032 offset 0 length 520: 4
00000100:00100000:3.0:1767318826.061465:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318826.061541:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284160
00000100:00100000:2.0:1767318826.061551:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284160
00000100:00100000:2.0:1767318826.061604:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16572
00000100:00100000:2.0:1767318826.061612:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894284160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318826.061677:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318826.061754:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894284160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 141us (287us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318826.061762:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16572
00000100:00100000:0.0:1767318826.093233:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318826.414320:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318826.989201:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940363008:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318826.989274:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318826.989441:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363008
00000100:00100000:0.0:1767318826.989448:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363008
00000100:00100000:0.0:1767318826.989517:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229
00000100:00100000:0.0:1767318826.989528:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940363008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318826.989612:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318826.989709:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940363008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (433us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318826.989717:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229
00000100:00080000:3.0:1767318826.989794:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318826.995442:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940363008:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318827.116927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318827.436987:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318827.501430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318827.501442:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318827.501445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318827.501449:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318827.501454:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318827.501463:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4072
00000100:00080000:0.0:1767318827.501469:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318827.501478:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318827.501565:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210380 x1853163940363136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318827.501592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318827.501597:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318827.501598:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318827.501602:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4072
00000100:00080000:0.0:1767318827.501605:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318827.501608:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318827.501622:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940363264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318827.501673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318827.501676:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318827.501678:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318827.501682:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4072
00000100:00080000:0.0:1767318827.501684:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318827.501688:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318827.501714:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940363648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318827.501798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318827.501801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318827.501803:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318827.501807:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4072
00000100:00080000:0.0:1767318827.501810:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318827.501814:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318827.501839:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dfb80 x1853163940363904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318827.501923:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940363520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318827.502019:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318827.502099:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318827.502106:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940363392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318827.502132:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318827.502306:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318827.502316:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940363776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318827.502347:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318827.502442:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363520
00000100:00100000:2.0:1767318827.502450:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363520
00000100:00100000:2.0:1767318827.502527:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363776
00000100:00100000:2.0:1767318827.502531:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363776
00000100:00100000:2.0:1767318827.502556:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122
00000100:00100000:2.0:1767318827.502567:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940363520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318827.502632:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940363520:12345-0@lo:400:kworker.0 Request processed in 66us (612us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318827.502641:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122
00000100:00100000:2.0:1767318827.502659:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123
00000100:00100000:2.0:1767318827.502665:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940363776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318827.502694:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940363776:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318827.502700:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123
00000100:00100000:2.0:1767318827.502736:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940363520:0@lo:400:kworker.0
00000100:00100000:3.0:1767318827.503017:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940363136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318827.503065:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318827.503102:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940363264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318827.503125:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318827.503141:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940363648:0@lo:38:kworker.0
00000100:00100000:3.0:1767318827.503161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318827.503177:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940363904:0@lo:38:kworker.0
00000100:00100000:3.0:1767318827.503198:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318827.503230:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363136
00000100:00100000:3.0:1767318827.503234:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363136
00000100:00100000:3.0:1767318827.503256:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363648
00000100:00100000:3.0:1767318827.503259:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363648
00000100:00100000:3.0:1767318827.503270:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363904
00000100:00100000:3.0:1767318827.503273:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363904
00000100:00100000:3.0:1767318827.503287:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16573
00000100:00100000:3.0:1767318827.503291:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318827.503310:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318827.503355:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363136:12345-0@lo:38:kworker.0 Request processed in 61us (288us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318827.503361:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16573
00000100:00100000:3.0:1767318827.503374:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16574
00000100:00100000:3.0:1767318827.503379:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318827.503388:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318827.503411:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363648:12345-0@lo:38:kworker.0 Request processed in 30us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318827.503416:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16574
00000100:00100000:3.0:1767318827.503427:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16575
00000100:00100000:3.0:1767318827.503431:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318827.503440:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318827.503462:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940363904:12345-0@lo:38:kworker.0 Request processed in 30us (263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318827.503467:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16575
00000100:00100000:3.0:1767318827.503489:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363392
00000100:00100000:3.0:1767318827.503493:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363392
00000100:00100000:3.0:1767318827.503522:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701
00000100:00100000:3.0:1767318827.503531:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940363392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318827.503565:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940363392:12345-0@lo:400:kworker.0 Request processed in 36us (1431us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318827.503571:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701
00000100:00080000:3.0:1767318827.503601:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318827.503607:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318827.503610:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940363136:0@lo:38:kworker.0
00000100:00080000:3.0:1767318827.503619:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318827.503622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318827.503625:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940363648:0@lo:38:kworker.0
00000100:00080000:3.0:1767318827.503632:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318827.503635:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318827.503638:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940363904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318827.503832:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940363392:0@lo:400:kworker.0
00000100:00080000:1.0:1767318827.504681:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318827.504688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318827.504723:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940363776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318827.504861:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940363264
00000100:00100000:0.0:1767318827.504868:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940363264
00000100:00100000:0.0:1767318827.504911:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026
00000100:00100000:0.0:1767318827.504918:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940363264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318827.504936:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318827.505015:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940363264:12345-0@lo:38:kworker.0 Request processed in 96us (1888us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318827.505022:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026
00000100:00080000:3.0:1767318827.505742:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318827.505749:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318827.505753:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940363264:0@lo:38:kworker.0
00000100:00100000:0.0:1767318828.140909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318828.461053:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318829.164939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318829.487604:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318830.189139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318830.510388:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318831.085185:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318831.085255:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940364032:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318831.085341:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318831.085526:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364032
00000100:00100000:2.0:1767318831.085544:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364032
00000100:00100000:2.0:1767318831.085623:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230
00000100:00100000:2.0:1767318831.085632:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940364032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318831.085667:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318831.085715:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940364032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318831.085723:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230
00000100:00080000:3.0:1767318831.086187:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318831.086241:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940364032:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318831.175017:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318831.175200:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284544
00000100:00100000:2.0:1767318831.175211:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284544
00000100:00100000:2.0:1767318831.175295:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4124
00000100:00100000:2.0:1767318831.175305:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894284544:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318831.175394:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894284544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318831.175402:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4124
00000100:00080000:3.0:1767318831.176741:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318831.178284:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318831.178515:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284416
00000100:00100000:0.0:1767318831.178525:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284416
00000100:00100000:0.0:1767318831.178582:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16576
00000100:00100000:0.0:1767318831.178591:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894284416:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318831.178618:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318831.178710:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894284416:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 119us (436us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318831.178718:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16576
00000100:00100000:0.0:1767318831.213546:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318831.543452:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318832.109323:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940364160:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318832.109425:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318832.109819:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364160
00000100:00100000:0.0:1767318832.109828:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364160
00000100:00100000:0.0:1767318832.109909:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231
00000100:00100000:0.0:1767318832.109919:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940364160:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318832.110171:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767318832.110286:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318832.110457:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940364160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 538us (1031us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318832.110465:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231
00000100:00100000:1.0:1767318832.110608:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940364160:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318832.239292:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318832.557302:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318832.621912:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318807/real 1767318807]  req@ffff93cf4ead8a80 x1853163940358912/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318832 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318832.621961:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4ead8a80 x1853163940358912/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318832 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318832.621986:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318832.622015:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318832.622020:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940358912:0@lo:250:kworker.0
00000100:00080000:0.0:1767318832.624100:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318832.624110:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318832.624115:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318832.624122:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4057
00000100:00080000:0.0:1767318832.624127:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318832.624135:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318832.624181:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df100 x1853163940364288/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318832.624214:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318832.624217:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318832.624219:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318832.624223:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4077
00000100:00080000:0.0:1767318832.624225:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318832.624228:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318832.624249:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940364416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318832.624258:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318832.624262:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318832.624263:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318832.624267:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4077
00000100:00080000:0.0:1767318832.624269:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318832.624273:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318832.624286:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dca80 x1853163940364544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318832.624341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318832.624344:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318832.624346:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318832.624349:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4077
00000100:00080000:0.0:1767318832.624352:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318832.624355:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318832.624366:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dce00 x1853163940364928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318832.624379:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318832.624383:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318832.624384:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318832.624387:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4077
00000100:00080000:0.0:1767318832.624389:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318832.624392:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318832.624402:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de680 x1853163940365184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318832.624560:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940365056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.624701:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.624794:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318832.624802:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940364800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.624826:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.624866:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365056
00000100:00100000:1.0:1767318832.624874:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365056
00000100:00100000:1.0:1767318832.624931:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364800
00000100:00100000:1.0:1767318832.624934:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364800
00000100:00100000:1.0:1767318832.624972:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125
00000100:00100000:1.0:1767318832.624981:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940365056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625033:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940365056:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318832.625041:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125
00000100:00100000:1.0:1767318832.625058:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126
00000100:00100000:1.0:1767318832.625064:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940364800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625094:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940364800:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318832.625100:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126
00000100:00080000:1.0:1767318832.625124:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318832.625157:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940364800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625168:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940365056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625188:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318832.625195:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940364672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625223:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.625256:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364672
00000100:00100000:1.0:1767318832.625259:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364672
00000100:00100000:1.0:1767318832.625284:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702
00000100:00100000:1.0:1767318832.625291:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940364672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.625324:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940364672:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318832.625329:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702
00000100:00100000:1.0:1767318832.625353:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940364672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318832.627329:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940364288:0@lo:250:kworker.0
00000400:00000100:3.0:1767318832.627387:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940364288 offset 0 length 520: 4
00000100:00100000:3.0:1767318832.627442:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940364416:0@lo:38:kworker.0
00000100:00100000:3.0:1767318832.627475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318832.627511:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940364544:0@lo:38:kworker.0
00000100:00100000:3.0:1767318832.627534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318832.627565:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940364928:0@lo:38:kworker.0
00000100:00100000:3.0:1767318832.627585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318832.627604:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940365184:0@lo:38:kworker.0
00000100:00100000:3.0:1767318832.627623:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318832.627665:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364416
00000100:00100000:3.0:1767318832.627672:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364416
00000100:00100000:3.0:1767318832.627703:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364928
00000100:00100000:3.0:1767318832.627707:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364928
00000100:00100000:3.0:1767318832.627721:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365184
00000100:00100000:3.0:1767318832.627723:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365184
00000100:00100000:3.0:1767318832.627739:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16577
00000100:00100000:3.0:1767318832.627746:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940364416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318832.627770:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318832.627842:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940364416:12345-0@lo:38:kworker.0 Request processed in 95us (365us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318832.627849:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16577
00000100:00100000:3.0:1767318832.627866:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16578
00000100:00100000:3.0:1767318832.627870:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940364928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318832.627879:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318832.627902:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940364928:12345-0@lo:38:kworker.0 Request processed in 30us (316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318832.627907:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16578
00000100:00100000:3.0:1767318832.627918:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16579
00000100:00100000:3.0:1767318832.627922:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940365184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318832.627932:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318832.627966:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940365184:12345-0@lo:38:kworker.0 Request processed in 42us (341us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318832.627972:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16579
00000100:00080000:3.0:1767318832.628019:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318832.628024:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318832.628028:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940364416:0@lo:38:kworker.0
00000100:00080000:3.0:1767318832.628037:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318832.628040:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318832.628042:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940364928:0@lo:38:kworker.0
00000100:00080000:3.0:1767318832.628049:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318832.628052:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318832.628054:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940365184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318832.628904:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940364544
00000100:00100000:1.0:1767318832.628913:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940364544
00000100:00100000:1.0:1767318832.628961:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027
00000100:00100000:1.0:1767318832.628968:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940364544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318832.628985:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318832.629049:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940364544:12345-0@lo:38:kworker.0 Request processed in 79us (1512us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318832.629055:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027
00000100:00080000:3.0:1767318832.629168:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318832.629173:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318832.629177:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940364544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318833.260993:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318833.581100:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318834.285412:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318834.607166:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318835.309188:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318835.629082:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318836.205524:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318836.205555:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940365312:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318836.205630:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318836.205837:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365312
00000100:00100000:2.0:1767318836.205847:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365312
00000100:00100000:2.0:1767318836.205934:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232
00000100:00100000:2.0:1767318836.205945:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940365312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318836.205994:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318836.206046:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940365312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (416us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318836.206054:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232
00000100:00100000:2.0:1767318836.206101:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940365312:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318836.206315:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318836.294535:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318836.294903:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284800
00000100:00100000:3.0:1767318836.294946:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284800
00000100:00100000:3.0:1767318836.295052:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4127
00000100:00100000:3.0:1767318836.295067:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894284800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318836.295169:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894284800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 107us (646us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318836.295178:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4127
00000100:00080000:1.0:1767318836.295580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318836.295987:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318836.296837:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284672
00000100:00100000:1.0:1767318836.296847:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284672
00000100:00100000:1.0:1767318836.296905:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16580
00000100:00100000:1.0:1767318836.296921:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894284672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318836.296949:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318836.297029:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894284672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 115us (1043us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318836.297037:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16580
00000100:00100000:0.0:1767318836.332965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318836.653249:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318837.230245:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318837.230272:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940365440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318837.230349:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318837.230436:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365440
00000100:00100000:1.0:1767318837.230444:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365440
00000100:00100000:1.0:1767318837.230500:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233
00000100:00100000:1.0:1767318837.230509:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940365440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318837.230539:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318837.230583:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940365440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318837.230589:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233
00000100:00080000:1.0:1767318837.230610:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318837.230646:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940365440:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318837.358452:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318837.678605:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318837.747499:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318837.747508:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318837.747511:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318837.747515:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318837.747519:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318837.747527:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4082
00000100:00080000:3.0:1767318837.747532:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318837.747538:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318837.747576:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9aa00 x1853163940365568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318837.747608:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318837.747612:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318837.747614:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318837.747617:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4082
00000100:00080000:3.0:1767318837.747619:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318837.747623:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318837.747635:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98700 x1853163940365696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318837.747685:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318837.747690:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318837.747692:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318837.747695:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4082
00000100:00080000:3.0:1767318837.747698:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318837.747701:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318837.747709:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940366080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318837.747914:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940365568:0@lo:38:kworker.0
00000100:00100000:0.0:1767318837.747985:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.748059:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940365696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318837.748249:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365568
00000100:00100000:2.0:1767318837.748268:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365568
00000100:00100000:2.0:1767318837.748309:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16581
00000100:00100000:2.0:1767318837.748317:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940365568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318837.748338:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318837.748501:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318837.748505:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318837.748507:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318837.748510:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4082
00000100:00080000:3.0:1767318837.748513:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318837.748517:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318837.748555:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0ad80 x1853163940366336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318837.748584:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318837.748594:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940366208:0@lo:400:kworker.0
00000100:00100000:1.0:1767318837.748677:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940365824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318837.751259:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.751332:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940366080:0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.751377:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.751383:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365696
00000100:00100000:0.0:1767318837.751391:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365696
00000100:00100000:3.0:1767318837.751417:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366208
00000100:00100000:3.0:1767318837.751420:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366208
00000100:00100000:0.0:1767318837.751428:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028
00000100:00100000:0.0:1767318837.751435:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940365696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318837.751457:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318837.751460:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128
00000100:00100000:3.0:1767318837.751468:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940366208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318837.751495:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940365696:12345-0@lo:38:kworker.0 Request processed in 59us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318837.751503:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028
00000100:00100000:3.0:1767318837.751507:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940366208:12345-0@lo:400:kworker.0 Request processed in 42us (258us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318837.751511:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128
00000100:00100000:0.0:1767318837.751526:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.751548:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940366336:0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.751550:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940366208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318837.751573:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318837.751584:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940365952:0@lo:400:kworker.0
00000100:00080000:0.0:1767318837.751594:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318837.751599:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318837.751603:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940365696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.751607:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.751626:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366080
00000100:00100000:0.0:1767318837.751630:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366080
00000100:00100000:3.0:1767318837.751630:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366336
00000100:00100000:3.0:1767318837.751632:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366336
00000100:00100000:1.0:1767318837.751680:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318837.751681:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940365568:12345-0@lo:38:kworker.0 Request processed in 3363us (3695us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318837.751688:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16581
00000100:00100000:2.0:1767318837.751701:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365952
00000100:00100000:2.0:1767318837.751705:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365952
00000100:00100000:3.0:1767318837.751891:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129
00000100:00100000:3.0:1767318837.751909:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940365952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.751947:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940365952:12345-0@lo:400:kworker.0 Request processed in 49us (338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318837.751953:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129
00000100:00100000:3.0:1767318837.751965:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16582
00000100:00100000:3.0:1767318837.751969:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940366080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318837.751980:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318837.752004:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940366080:12345-0@lo:38:kworker.0 Request processed in 33us (477us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318837.752010:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16582
00000100:00100000:3.0:1767318837.752032:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16583
00000100:00100000:3.0:1767318837.752035:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940366336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318837.752045:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318837.752069:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940366336:12345-0@lo:38:kworker.0 Request processed in 33us (496us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318837.752074:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16583
00000100:00100000:3.0:1767318837.752111:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940365952:0@lo:400:kworker.0
00000100:00080000:3.0:1767318837.752150:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318837.752154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318837.752157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940366080:0@lo:38:kworker.0
00000100:00080000:3.0:1767318837.752164:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318837.752167:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318837.752169:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940366336:0@lo:38:kworker.0
00000100:00080000:3.0:1767318837.752177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318837.752179:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318837.752182:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940365568:0@lo:38:kworker.0
00000100:00080000:3.0:1767318837.752214:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318837.752234:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940365824
00000100:00100000:3.0:1767318837.752237:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940365824
00000100:00100000:3.0:1767318837.752501:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703
00000100:00100000:3.0:1767318837.752509:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940365824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.752548:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940365824:12345-0@lo:400:kworker.0 Request processed in 41us (866us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318837.752553:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703
00000100:00100000:3.0:1767318837.752613:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940365824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318838.380980:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318838.704517:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318839.404935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318839.730399:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318840.430382:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318840.752258:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318841.325068:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318841.326700:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940366464:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318841.326848:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318841.328187:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366464
00000100:00100000:2.0:1767318841.328199:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366464
00000100:00100000:2.0:1767318841.328416:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234
00000100:00100000:2.0:1767318841.328428:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940366464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318841.328464:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318841.328535:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940366464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (1687us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318841.328542:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234
00000100:00100000:0.0:1767318841.328612:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940366464:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318841.328619:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318841.414350:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318841.414399:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318841.415075:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894284928
00000100:00100000:0.0:1767318841.415087:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894284928
00000100:00100000:0.0:1767318841.415137:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285056
00000100:00100000:0.0:1767318841.415141:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285056
00000100:00100000:1.0:1767318841.415153:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16584
00000100:00100000:1.0:1767318841.415162:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894284928:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:0.0:1767318841.415189:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4130
00010000:00020000:1.0:1767318841.415195:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318841.415196:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894285056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318841.415269:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894284928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 106us (931us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318841.415276:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16584
00000100:00080000:3.0:1767318841.416186:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318841.416330:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894285056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1130us (1927us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318841.416340:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4130
00000100:00100000:0.0:1767318841.453064:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318841.775743:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318842.352650:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318842.352676:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940366592:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318842.352747:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318842.353046:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366592
00000100:00100000:0.0:1767318842.353057:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366592
00000100:00100000:0.0:1767318842.353135:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235
00000100:00100000:0.0:1767318842.353145:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940366592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318842.353179:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318842.353228:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940366592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (481us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318842.353235:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235
00000100:00080000:1.0:1767318842.353401:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318842.353448:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940366592:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318842.476964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318842.797498:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318842.862665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318842.862678:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318842.862682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318842.862686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318842.862693:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318842.862704:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4087
00000100:00080000:2.0:1767318842.862710:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318842.862720:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318842.862810:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210700 x1853163940366720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318842.862828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318842.862832:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318842.862835:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318842.862840:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4087
00000100:00080000:2.0:1767318842.862842:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318842.862845:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318842.862868:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940366720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318842.862873:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210380 x1853163940366848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318842.862943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318842.862947:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318842.862949:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318842.862955:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4087
00000100:00080000:2.0:1767318842.862957:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318842.862964:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318842.862966:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318842.862980:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa680 x1853163940367232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318842.863003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767318842.863047:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940366848:0@lo:38:kworker.0
00000100:00100000:3.0:1767318842.863075:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318842.863201:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318842.863214:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940366976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.863250:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318842.863284:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940367360:0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.863307:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318842.863327:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318842.863332:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940367104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.863366:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318842.863398:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366720
00000100:00100000:1.0:1767318842.863406:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366720
00000100:00100000:1.0:1767318842.863443:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367360
00000100:00100000:1.0:1767318842.863446:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367360
00000100:00100000:1.0:1767318842.863495:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367104
00000100:00100000:1.0:1767318842.863499:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367104
00000100:00100000:3.0:1767318842.863526:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940367232:0@lo:38:kworker.0
00000100:00100000:1.0:1767318842.863533:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131
00000100:00100000:1.0:1767318842.863544:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940367360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318842.863570:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318842.863606:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366976
00000100:00100000:1.0:1767318842.863611:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940367360:12345-0@lo:400:kworker.0 Request processed in 66us (299us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318842.863612:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366976
00000100:00100000:1.0:1767318842.863623:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131
00000100:00100000:1.0:1767318842.863645:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367232
00000100:00100000:1.0:1767318842.863649:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367232
00000100:00100000:3.0:1767318842.863653:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704
00000100:00100000:3.0:1767318842.863663:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940366976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.863670:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132
00000100:00100000:1.0:1767318842.863680:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940367104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318842.863711:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940366976:12345-0@lo:400:kworker.0 Request processed in 49us (458us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318842.863719:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704
00000100:00100000:1.0:1767318842.863724:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940367104:12345-0@lo:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318842.863732:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132
00000100:00100000:3.0:1767318842.863751:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16585
00000100:00100000:3.0:1767318842.863758:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940366720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318842.863805:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318842.863810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318842.863814:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318842.863819:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4087
00000100:00080000:2.0:1767318842.863822:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318842.863827:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318842.863844:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940366720:12345-0@lo:38:kworker.0 Request processed in 84us (880us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318842.863848:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeace00 x1853163940367488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318842.863911:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940366848
00000100:00100000:0.0:1767318842.863917:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940366848
00000100:00100000:0.0:1767318842.863959:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029
00000100:00100000:0.0:1767318842.863965:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940366848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318842.863976:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318842.864018:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940366848:12345-0@lo:38:kworker.0 Request processed in 42us (932us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318842.864024:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029
00000100:00100000:1.0:1767318842.864191:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16586
00000100:00100000:1.0:1767318842.864197:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940367232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318842.864208:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318842.864236:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940367232:12345-0@lo:38:kworker.0 Request processed in 38us (666us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318842.864242:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16586
00000100:00080000:1.0:1767318842.864266:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318842.864303:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940367104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.864314:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940367360:0@lo:400:kworker.0
00000100:00100000:1.0:1767318842.864387:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940366976:0@lo:400:kworker.0
00000100:00100000:3.0:1767318842.864585:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16585
00000100:00100000:3.0:1767318842.864613:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940367488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318842.864645:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318842.864682:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318842.864686:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318842.864690:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940366848:0@lo:38:kworker.0
00000100:00080000:3.0:1767318842.864698:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318842.864702:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318842.864705:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940367232:0@lo:38:kworker.0
00000100:00080000:3.0:1767318842.864713:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318842.864716:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318842.864719:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940366720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318842.864821:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367488
00000100:00100000:2.0:1767318842.864826:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367488
00000100:00100000:2.0:1767318842.864867:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16587
00000100:00100000:2.0:1767318842.864873:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940367488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318842.864885:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318842.864918:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940367488:12345-0@lo:38:kworker.0 Request processed in 44us (273us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318842.864923:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16587
00000100:00080000:3.0:1767318842.868212:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318842.868238:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318842.868243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940367488:0@lo:38:kworker.0
00000100:00100000:0.0:1767318843.500924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318843.821445:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318844.525138:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318844.845324:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318845.548929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318845.871175:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318846.445261:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940367616:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318846.445339:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318846.445588:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367616
00000100:00100000:3.0:1767318846.445597:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367616
00000100:00100000:3.0:1767318846.445668:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236
00000100:00100000:3.0:1767318846.445679:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940367616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318846.445713:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767318846.445746:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318846.445771:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940367616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (432us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318846.445804:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236
00000100:00100000:2.0:1767318846.447532:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940367616:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318846.534118:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318846.534165:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318846.534262:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285184
00000100:00100000:0.0:1767318846.534273:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285184
00000100:00100000:0.0:1767318846.534320:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285312
00000100:00100000:0.0:1767318846.534324:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285312
00000100:00100000:1.0:1767318846.534381:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4133
00000100:00100000:0.0:1767318846.534391:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16588
00000100:00100000:1.0:1767318846.534397:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894285312:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318846.534401:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894285184:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318846.534425:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318846.534541:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318846.534651:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894285312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 259us (484us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318846.534659:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4133
00000100:00100000:0.0:1767318846.534942:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894285184:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 542us (833us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318846.534947:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16588
00000100:00100000:0.0:1767318846.573276:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318846.893069:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318847.471682:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940367744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318847.471765:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.472004:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367744
00000100:00100000:3.0:1767318847.472013:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367744
00000100:00100000:3.0:1767318847.472081:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237
00000100:00100000:3.0:1767318847.472094:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940367744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318847.472125:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318847.472179:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940367744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318847.472186:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237
00000100:00100000:1.0:1767318847.472279:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940367744:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318847.472338:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318847.597076:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318847.918037:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318847.982043:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318847.982187:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318847.982191:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318847.982194:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318847.982199:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318847.982206:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4092
00000100:00080000:0.0:1767318847.982211:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318847.982218:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318847.982257:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df480 x1853163940367872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318847.982273:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318847.982276:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318847.982278:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318847.982281:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4092
00000100:00080000:0.0:1767318847.982284:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318847.982287:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318847.982298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dca80 x1853163940368000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318847.982397:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318847.982400:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318847.982402:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318847.982405:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4092
00000100:00080000:0.0:1767318847.982407:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318847.982411:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318847.982422:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ded80 x1853163940368512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318847.982435:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318847.982438:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318847.982440:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318847.982443:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4092
00000100:00080000:0.0:1767318847.982445:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318847.982448:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318847.982456:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddc00 x1853163940368768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318847.982482:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940368384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318847.982541:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318847.982602:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318847.982608:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940368640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318847.982627:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318847.982675:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368384
00000100:00100000:0.0:1767318847.982683:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368384
00000100:00100000:0.0:1767318847.982728:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368640
00000100:00100000:0.0:1767318847.982730:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368640
00000100:00100000:0.0:1767318847.982749:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134
00000100:00100000:0.0:1767318847.982757:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940368384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318847.982839:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940368384:12345-0@lo:400:kworker.0 Request processed in 82us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318847.982846:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134
00000100:00100000:0.0:1767318847.982863:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135
00000100:00100000:0.0:1767318847.982869:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940368640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318847.982871:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940367872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318847.982908:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.982931:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940368000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318847.982956:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.982974:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940368512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318847.982993:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.983006:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940368768:0@lo:38:kworker.0
00000100:00100000:3.0:1767318847.983025:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.983047:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368000
00000100:00100000:3.0:1767318847.983051:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368000
00000100:00100000:3.0:1767318847.983075:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030
00000100:00100000:3.0:1767318847.983079:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940368000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318847.983096:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318847.983109:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368256:0@lo:400:kworker.0
00000100:00100000:3.0:1767318847.983127:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940368000:12345-0@lo:38:kworker.0 Request processed in 46us (171us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318847.983133:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030
00000100:00100000:2.0:1767318847.983136:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.983155:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940367872
00000100:00100000:3.0:1767318847.983158:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940367872
00000100:00100000:2.0:1767318847.983159:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318847.983164:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318847.983168:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368512
00000100:00100000:3.0:1767318847.983170:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368512
00000100:00100000:3.0:1767318847.983177:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368768
00000100:00100000:3.0:1767318847.983179:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368768
00000100:00100000:2.0:1767318847.983183:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318847.983187:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16589
00000100:00100000:3.0:1767318847.983191:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940367872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318847.983200:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318847.983204:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318847.983216:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16590
00000100:00100000:2.0:1767318847.983221:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940368512:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318847.983222:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940367872:12345-0@lo:38:kworker.0 Request processed in 30us (314us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318847.983228:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16589
00010000:00020000:2.0:1767318847.983230:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318847.983238:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16591
00000100:00100000:3.0:1767318847.983242:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940368768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318847.983251:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318847.983252:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940368512:12345-0@lo:38:kworker.0 Request processed in 30us (258us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318847.983258:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16590
00000100:00100000:3.0:1767318847.983268:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940368768:12345-0@lo:38:kworker.0 Request processed in 25us (243us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318847.983273:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16591
00000100:00100000:2.0:1767318847.983276:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368256
00000100:00100000:2.0:1767318847.983280:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368256
00000100:00080000:3.0:1767318847.983301:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318847.983302:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368128
00000100:00100000:2.0:1767318847.983304:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368128
00000100:00080000:3.0:1767318847.983306:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318847.983309:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940367872:0@lo:38:kworker.0
00000100:00080000:3.0:1767318847.983318:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318847.983321:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318847.983323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940368000:0@lo:38:kworker.0
00000100:00100000:2.0:1767318847.983331:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705
00000100:00080000:3.0:1767318847.983331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318847.983333:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318847.983336:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940368512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318847.983337:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368256:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318847.983343:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318847.983345:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318847.983348:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940368768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318847.983368:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368256:12345-0@lo:400:kworker.0 Request processed in 32us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318847.983374:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705
00000100:00100000:2.0:1767318847.983385:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706
00000100:00100000:2.0:1767318847.983390:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318847.983408:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368256:0@lo:400:kworker.0
00000100:00100000:2.0:1767318847.983414:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368128:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318847.983420:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706
00000100:00100000:3.0:1767318847.983421:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368128:0@lo:400:kworker.0
00000100:00100000:2.0:1767318847.983586:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940368384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318847.983648:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940368640:12345-0@lo:400:kworker.0 Request processed in 778us (1019us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318847.983655:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135
00000100:00100000:2.0:1767318847.986526:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940368640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318848.620930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318848.941352:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318849.644922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318849.965079:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318850.668937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318850.990929:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318851.565823:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318851.565863:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368896:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318851.565983:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318851.566057:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940368896
00000100:00100000:0.0:1767318851.566128:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940368896
00000100:00100000:0.0:1767318851.566275:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238
00000100:00100000:0.0:1767318851.566286:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318851.566321:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318851.566413:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940368896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (430us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318851.566422:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238
00000100:00100000:1.0:1767318851.566578:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940368896:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318851.568010:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318851.658992:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318851.659078:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767318851.659100:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894285696 offset 0 length 520: 4
00000100:00100000:0.0:1767318851.659186:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285440
00000100:00100000:0.0:1767318851.659196:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285440
00000100:00100000:0.0:1767318851.659241:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285568
00000100:00100000:0.0:1767318851.659244:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285568
00000100:00100000:0.0:1767318851.659303:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4136
00000100:00100000:0.0:1767318851.659313:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894285568:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767318851.659329:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318851.659393:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894285568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318851.659401:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4136
00000100:00100000:0.0:1767318851.659420:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16592
00000100:00100000:0.0:1767318851.659424:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894285440:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318851.659446:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318851.659476:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894285440:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 50us (495us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318851.659482:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16592
00000100:00100000:0.0:1767318851.692983:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318852.013008:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318852.592065:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318852.592095:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940369024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318852.592191:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318852.592868:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369024
00000100:00100000:3.0:1767318852.592878:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369024
00000100:00100000:3.0:1767318852.592944:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239
00000100:00100000:3.0:1767318852.592955:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940369024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318852.592986:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318852.593047:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940369024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (856us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318852.593055:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239
00000100:00080000:2.0:1767318852.593114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318852.593184:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940369024:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318852.716966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318853.037401:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318853.102449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318853.102458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318853.102461:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318853.102465:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318853.102469:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318853.102477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4098
00000100:00080000:1.0:1767318853.102492:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318853.102499:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318853.102537:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0786ab100 x1853163940369152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318853.102567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318853.102571:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318853.102573:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318853.102576:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4098
00000100:00080000:1.0:1767318853.102579:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318853.102582:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318853.102596:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0786aa300 x1853163940369280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318853.102675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318853.102679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318853.102681:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318853.102684:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4098
00000100:00080000:1.0:1767318853.102686:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318853.102690:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318853.102712:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210700 x1853163940369792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318853.102727:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318853.102730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318853.102732:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318853.102736:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4098
00000100:00080000:1.0:1767318853.102738:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318853.102741:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318853.102751:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940370048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318853.102808:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940369920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318853.102875:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318853.102957:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318853.102964:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940369664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103141:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940369408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103174:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318853.103203:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318853.103208:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940369536:0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103229:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318853.103265:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369408
00000100:00100000:2.0:1767318853.103272:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369408
00000100:00100000:2.0:1767318853.103319:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369536
00000100:00100000:2.0:1767318853.103322:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369536
00000100:00100000:2.0:1767318853.103341:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707
00000100:00100000:2.0:1767318853.103350:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940369408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103400:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940369408:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318853.103408:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707
00000100:00100000:2.0:1767318853.103424:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708
00000100:00100000:2.0:1767318853.103430:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940369536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103459:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940369536:12345-0@lo:400:kworker.0 Request processed in 30us (229us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318853.103464:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708
00000100:00080000:2.0:1767318853.103484:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318853.103514:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940369536:0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103523:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940369408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103564:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369920
00000100:00100000:2.0:1767318853.103567:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369920
00000100:00100000:2.0:1767318853.103594:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137
00000100:00100000:2.0:1767318853.103600:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940369920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318853.103628:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940369920:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318853.103633:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137
00000100:00080000:2.0:1767318853.103647:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318853.103843:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940369152:0@lo:38:kworker.0
00000100:00100000:1.0:1767318853.104231:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318853.104282:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940369920:0@lo:400:kworker.0
00000100:00100000:3.0:1767318853.104344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318853.104380:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940369280:0@lo:38:kworker.0
00000100:00100000:3.0:1767318853.104408:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318853.104428:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940369792:0@lo:38:kworker.0
00000100:00100000:3.0:1767318853.104450:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318853.104470:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940370048:0@lo:38:kworker.0
00000100:00100000:3.0:1767318853.104490:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318853.104523:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369664
00000100:00100000:3.0:1767318853.104528:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369664
00000100:00100000:3.0:1767318853.104561:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369152
00000100:00100000:3.0:1767318853.104563:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369152
00000100:00100000:3.0:1767318853.104575:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369792
00000100:00100000:3.0:1767318853.104577:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369792
00000100:00100000:3.0:1767318853.104583:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370048
00000100:00100000:3.0:1767318853.104585:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370048
00000100:00100000:3.0:1767318853.104594:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138
00000100:00100000:3.0:1767318853.104600:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940369664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318853.104637:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940369664:12345-0@lo:400:kworker.0 Request processed in 36us (1630us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318853.104657:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138
00000100:00100000:3.0:1767318853.104676:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16593
00000100:00100000:3.0:1767318853.104679:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940369152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318853.104696:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318853.104740:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940369152:12345-0@lo:38:kworker.0 Request processed in 58us (395us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318853.104746:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16593
00000100:00100000:3.0:1767318853.104758:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16594
00000100:00100000:3.0:1767318853.104794:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940369792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318853.104804:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318853.104829:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940369792:12345-0@lo:38:kworker.0 Request processed in 55us (378us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318853.104835:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16594
00000100:00100000:3.0:1767318853.104846:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16595
00000100:00100000:3.0:1767318853.104849:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940370048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318853.104858:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318853.104879:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940370048:12345-0@lo:38:kworker.0 Request processed in 28us (388us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318853.104885:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16595
00000100:00080000:3.0:1767318853.104906:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318853.104925:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318853.104930:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318853.104933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940369152:0@lo:38:kworker.0
00000100:00080000:3.0:1767318853.104952:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318853.104957:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318853.104960:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940369792:0@lo:38:kworker.0
00000100:00080000:3.0:1767318853.104968:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318853.104971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318853.104977:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940370048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318853.105134:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940369280
00000100:00100000:0.0:1767318853.105139:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940369280
00000100:00100000:0.0:1767318853.105163:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031
00000100:00100000:0.0:1767318853.105167:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940369280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318853.105177:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318853.105209:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940369280:12345-0@lo:38:kworker.0 Request processed in 41us (800us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318853.105217:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031
00000100:00080000:0.0:1767318853.105242:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318853.105246:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318853.105249:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940369280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318853.106881:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940369664:0@lo:400:kworker.0
00000100:00100000:0.0:1767318853.743729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318854.061351:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318854.764862:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318855.084990:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318855.788950:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318856.109796:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318856.686936:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940370176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318856.687023:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318856.687185:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370176
00000100:00100000:1.0:1767318856.687195:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370176
00000100:00100000:1.0:1767318856.687302:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240
00000100:00100000:1.0:1767318856.687312:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940370176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318856.687343:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318856.689307:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318856.689425:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940370176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2108us (2396us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318856.689439:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240
00000100:00100000:0.0:1767318856.689589:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940370176:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318856.774474:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318856.774930:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285952
00000100:00100000:1.0:1767318856.774943:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285952
00000100:00100000:1.0:1767318856.775028:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4139
00000100:00100000:1.0:1767318856.775038:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894285952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767318856.775097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318856.775129:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894285952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (665us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318856.775138:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4139
00000100:00100000:3.0:1767318856.784104:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318856.784574:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894285824
00000100:00100000:1.0:1767318856.784585:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894285824
00000100:00100000:1.0:1767318856.785043:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16596
00000100:00100000:1.0:1767318856.785053:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894285824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318856.785078:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318856.785152:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894285824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (1057us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318856.785159:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16596
00000100:00100000:0.0:1767318856.815234:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318857.133151:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318857.196917:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318832/real 1767318832]  req@ffff93d0712df100 x1853163940364288/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318857 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318857.196955:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0712df100 x1853163940364288/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318857 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318857.196976:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318857.197000:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318857.197004:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940364288:0@lo:250:kworker.0
00000100:00080000:2.0:1767318857.197261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318857.197267:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318857.197270:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318857.197275:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4082
00000100:00080000:2.0:1767318857.197280:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318857.197287:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318857.197319:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699df80 x1853163940370304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318857.197351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318857.197354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318857.197356:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318857.197359:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4103
00000100:00080000:2.0:1767318857.197361:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318857.197364:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318857.197377:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699d880 x1853163940370432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318857.197385:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318857.197388:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318857.197390:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318857.197393:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4103
00000100:00080000:2.0:1767318857.197395:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318857.197398:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318857.197407:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699f100 x1853163940370560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318857.197474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318857.197477:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318857.197479:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318857.197482:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4103
00000100:00080000:2.0:1767318857.197484:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318857.197488:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318857.197499:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699dc00 x1853163940371072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318857.197501:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:2.0:1767318857.197515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767318857.197517:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940370688:0@lo:400:kworker.0
00000100:00080000:2.0:1767318857.197518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318857.197519:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318857.197522:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4103
00000100:00080000:2.0:1767318857.197525:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318857.197528:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318857.197537:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04699c380 x1853163940371328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318857.197556:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940370816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318857.197584:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318857.197597:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940370944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318857.197621:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318857.197642:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940371200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318857.197669:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318857.197675:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318857.197958:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370944
00000100:00100000:1.0:1767318857.197967:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370944
00000100:00100000:1.0:1767318857.198019:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371200
00000100:00100000:1.0:1767318857.198023:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371200
00000100:00100000:1.0:1767318857.198044:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140
00000100:00100000:1.0:1767318857.198053:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940370944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318857.198080:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370688
00000100:00100000:2.0:1767318857.198084:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370688
00000100:00100000:2.0:1767318857.198107:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370816
00000100:00100000:1.0:1767318857.198108:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940370944:12345-0@lo:400:kworker.0 Request processed in 55us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318857.198110:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370816
00000100:00100000:1.0:1767318857.198114:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140
00000100:00100000:1.0:1767318857.198129:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141
00000100:00100000:2.0:1767318857.198130:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709
00000100:00100000:1.0:1767318857.198135:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940371200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318857.198135:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940370688:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318857.198298:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940370304:0@lo:250:kworker.0
00000400:00000100:0.0:1767318857.198322:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940370304 offset 0 length 520: 4
00000100:00100000:1.0:1767318857.198326:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940371200:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318857.198333:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141
00000100:00100000:0.0:1767318857.198341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940370432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318857.198417:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710
00000100:00100000:3.0:1767318857.198427:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940370816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318857.198826:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940371200:0@lo:400:kworker.0
00000100:00100000:0.0:1767318857.202931:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318857.203018:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940370560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318857.203061:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318857.203082:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940371072:0@lo:38:kworker.0
00000100:00100000:0.0:1767318857.203107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318857.203127:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940371328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318857.203150:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318857.203211:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370560
00000100:00100000:0.0:1767318857.203218:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370560
00000100:00100000:0.0:1767318857.203256:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032
00000100:00100000:0.0:1767318857.203263:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940370560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318857.203285:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318857.203325:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940370560:12345-0@lo:38:kworker.0 Request processed in 61us (262us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318857.203332:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032
00000100:00100000:0.0:1767318857.203359:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940370432
00000100:00100000:0.0:1767318857.203363:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940370432
00000100:00100000:0.0:1767318857.203380:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371072
00000100:00100000:0.0:1767318857.203383:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371072
00000100:00100000:0.0:1767318857.203391:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371328
00000100:00100000:0.0:1767318857.203393:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371328
00000100:00100000:0.0:1767318857.203403:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16597
00000100:00100000:0.0:1767318857.203407:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940370432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318857.203417:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318857.203441:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940370432:12345-0@lo:38:kworker.0 Request processed in 33us (520us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318857.203447:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16597
00000100:00100000:0.0:1767318857.203459:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16598
00000100:00100000:0.0:1767318857.203463:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940371072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318857.203472:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318857.203494:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940371072:12345-0@lo:38:kworker.0 Request processed in 29us (386us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318857.203499:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16598
00000100:00100000:0.0:1767318857.203508:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16599
00000100:00100000:0.0:1767318857.203512:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940371328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318857.203520:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318857.203541:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940371328:12345-0@lo:38:kworker.0 Request processed in 27us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318857.203546:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16599
00000100:00080000:0.0:1767318857.203585:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318857.203590:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318857.203594:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940370432:0@lo:38:kworker.0
00000100:00080000:0.0:1767318857.203603:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318857.203606:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318857.203608:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940370560:0@lo:38:kworker.0
00000100:00080000:0.0:1767318857.203615:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318857.203618:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318857.203621:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940371072:0@lo:38:kworker.0
00000100:00080000:0.0:1767318857.203628:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318857.203631:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318857.203634:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940371328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318857.204329:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940370944:0@lo:400:kworker.0
00000100:00080000:0.0:1767318857.204402:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318857.204408:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318857.204495:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940370688:12345-0@lo:400:kworker.0 Request processed in 6358us (6909us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318857.204505:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709
00000100:00100000:3.0:1767318857.205641:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940370816:12345-0@lo:400:kworker.0 Request processed in 7211us (7965us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318857.205653:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710
00000100:00100000:2.0:1767318857.205849:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940370816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318857.209448:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940370688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318857.713067:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318857.713091:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940371456:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318857.713170:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318857.713348:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371456
00000100:00100000:0.0:1767318857.713357:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371456
00000100:00100000:0.0:1767318857.713416:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241
00000100:00100000:0.0:1767318857.713426:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940371456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318857.713454:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318857.713506:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940371456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318857.713514:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241
00000100:00100000:1.0:1767318857.713598:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940371456:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318857.836932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318858.157119:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318858.862617:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318859.182792:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318859.884923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318860.205208:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318860.909064:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318861.231641:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318861.806940:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318861.806963:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940371584:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318861.807034:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318861.807200:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371584
00000100:00100000:2.0:1767318861.807209:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371584
00000100:00100000:2.0:1767318861.807277:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242
00000100:00100000:2.0:1767318861.807286:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940371584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318861.807319:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318861.807378:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940371584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318861.807385:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242
00000100:00080000:3.0:1767318861.807441:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318861.807676:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940371584:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318861.894802:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318861.894843:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318861.894868:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286208
00000100:00100000:0.0:1767318861.894879:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286208
00000100:00100000:3.0:1767318861.894885:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286080
00000100:00100000:3.0:1767318861.894890:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286080
00000100:00100000:3.0:1767318861.894935:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16600
00000100:00100000:3.0:1767318861.894941:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894286080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318861.894962:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318861.895018:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4142
00000100:00100000:3.0:1767318861.895024:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894286080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 80us (178us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318861.895031:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894286208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318861.895039:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16600
00000100:00100000:0.0:1767318861.895081:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894286208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318861.895090:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4142
00000100:00080000:1.0:1767318861.895207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318861.932896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318862.253437:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318862.317187:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318862.317201:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318862.317204:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318862.317210:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318862.317214:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318862.317222:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4107
00000100:00080000:3.0:1767318862.317227:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318862.317236:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318862.317298:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940371712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318862.317326:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318862.317329:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318862.317331:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318862.317335:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4107
00000100:00080000:3.0:1767318862.317338:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318862.317342:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318862.317358:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940371840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318862.317458:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318862.317462:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318862.317464:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318862.317468:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4107
00000100:00080000:3.0:1767318862.317471:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318862.317477:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940371968:0@lo:400:kworker.0
00000100:00080000:3.0:1767318862.317477:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318862.317492:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196d80 x1853163940372352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318862.317515:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318862.317519:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318862.317520:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318862.317524:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4107
00000100:00080000:3.0:1767318862.317526:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318862.317530:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318862.317541:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194e00 x1853163940372608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318862.317566:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940372224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318862.317579:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318862.317650:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940371712:0@lo:38:kworker.0
00000100:00100000:2.0:1767318862.317650:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940372480:0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318225:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318862.318276:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318862.318283:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940372096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318311:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318862.318348:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371968
00000100:00100000:3.0:1767318862.318356:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371968
00000100:00100000:3.0:1767318862.318397:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372096
00000100:00100000:3.0:1767318862.318401:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372096
00000100:00080000:3.0:1767318862.318422:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318862.318446:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711
00000100:00100000:3.0:1767318862.318454:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940371968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318503:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940371968:12345-0@lo:400:kworker.0 Request processed in 49us (924us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318862.318511:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711
00000100:00100000:3.0:1767318862.318527:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712
00000100:00100000:3.0:1767318862.318533:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940372096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318565:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940372096:12345-0@lo:400:kworker.0 Request processed in 32us (252us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318862.318571:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712
00000100:00100000:3.0:1767318862.318603:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940372096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318909:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372224
00000100:00100000:3.0:1767318862.318913:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372224
00000100:00100000:3.0:1767318862.318948:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143
00000100:00100000:3.0:1767318862.318955:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940372224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318862.318994:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940372224:12345-0@lo:400:kworker.0 Request processed in 39us (769us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318862.318999:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143
00000100:00080000:3.0:1767318862.319014:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318862.319032:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940372224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318862.319221:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940371968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318862.321426:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318862.321480:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940371840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318862.321515:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371712
00000100:00100000:3.0:1767318862.321525:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371712
00000100:00100000:0.0:1767318862.321531:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318862.321570:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16601
00000100:00100000:3.0:1767318862.321577:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940371712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318862.321598:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318862.321667:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940371712:12345-0@lo:38:kworker.0 Request processed in 89us (247us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318862.321674:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16601
00000100:00100000:1.0:1767318862.321691:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940371840
00000100:00100000:1.0:1767318862.321698:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940371840
00000100:00100000:1.0:1767318862.321728:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033
00000100:00100000:1.0:1767318862.321735:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940371840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318862.321747:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318862.323115:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940371840:12345-0@lo:38:kworker.0 Request processed in 1372us (1577us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318862.323128:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033
00000100:00080000:0.0:1767318862.325011:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318862.325027:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318862.325033:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940371840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318862.325049:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940372352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318862.325409:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318862.325453:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940372608:0@lo:38:kworker.0
00000100:00100000:0.0:1767318862.325487:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318862.325489:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372352
00000100:00100000:3.0:1767318862.325499:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372352
00000100:00100000:3.0:1767318862.325687:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372608
00000100:00100000:3.0:1767318862.325692:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372608
00000100:00080000:0.0:1767318862.325706:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318862.325713:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318862.325719:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16602
00000100:00100000:0.0:1767318862.325721:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940371712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318862.325732:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940372352:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318862.325754:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318862.325761:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16603
00000100:00100000:0.0:1767318862.325768:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940372608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318862.325801:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318862.325840:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940372352:12345-0@lo:38:kworker.0 Request processed in 108us (430us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318862.325851:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16602
00000100:00100000:0.0:1767318862.325853:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940372608:12345-0@lo:38:kworker.0 Request processed in 79us (361us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318862.325863:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16603
00000100:00080000:0.0:1767318862.325899:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318862.325903:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318862.325906:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940372352:0@lo:38:kworker.0
00000100:00080000:0.0:1767318862.325913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318862.325917:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318862.325920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940372608:0@lo:38:kworker.0
00000100:00100000:2.0:1767318862.326719:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318862.329263:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372480
00000100:00100000:1.0:1767318862.329279:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372480
00000100:00080000:3.0:1767318862.329356:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318862.329372:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144
00000100:00100000:1.0:1767318862.329384:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940372480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318862.329480:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940372480:12345-0@lo:400:kworker.0 Request processed in 99us (2764us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318862.329488:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144
00000100:00100000:2.0:1767318862.329659:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940372480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318862.829242:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940372736:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318862.829314:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318862.829431:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372736
00000100:00100000:0.0:1767318862.829440:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372736
00000100:00100000:0.0:1767318862.829484:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243
00000100:00100000:0.0:1767318862.829494:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940372736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318862.829521:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318862.829585:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940372736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (270us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318862.829592:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243
00000100:00100000:1.0:1767318862.829871:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940372736:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318862.956899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318863.277690:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318863.982120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318864.304435:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318865.004903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318865.325159:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318866.028899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318866.349016:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318866.924980:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940372864:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318866.925258:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318866.925822:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372864
00000100:00100000:0.0:1767318866.925832:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372864
00000100:00080000:2.0:1767318866.925899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318866.925901:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244
00000100:00100000:0.0:1767318866.925915:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940372864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318866.925951:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318866.926072:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940372864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (814us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318866.926090:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244
00000100:00100000:2.0:1767318866.926336:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940372864:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318867.014244:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318867.014315:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286464
00000100:00100000:0.0:1767318867.014326:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286464
00000100:00100000:0.0:1767318867.014475:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4145
00000100:00100000:0.0:1767318867.014486:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894286464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318867.014591:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894286464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (355us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318867.014599:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4145
00000100:00080000:2.0:1767318867.015348:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318867.022068:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318867.022164:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286336
00000100:00100000:1.0:1767318867.022188:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286336
00000100:00100000:1.0:1767318867.022246:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16604
00000100:00100000:1.0:1767318867.022255:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894286336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318867.022284:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318867.022372:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894286336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 116us (314us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318867.022380:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16604
00000100:00100000:0.0:1767318867.057167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318867.373593:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318867.436992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318867.437015:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318867.437019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318867.437025:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318867.437031:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318867.437039:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4112
00000100:00080000:1.0:1767318867.437045:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318867.437052:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318867.437093:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412a00 x1853163940372992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318867.437122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318867.437125:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318867.437127:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318867.437131:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4112
00000100:00080000:1.0:1767318867.437134:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318867.437137:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318867.437151:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073410700 x1853163940373120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318867.437187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940372992:0@lo:38:kworker.0
00000100:00080000:1.0:1767318867.437239:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318867.437244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318867.437246:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318867.437250:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4112
00000100:00080000:1.0:1767318867.437253:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318867.437257:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318867.437263:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318867.437272:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411180 x1853163940373632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318867.437299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318867.437302:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318867.437304:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318867.437307:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4112
00000100:00080000:1.0:1767318867.437310:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318867.437313:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318867.437326:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940373120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318867.437327:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411f80 x1853163940373888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318867.437357:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318867.437358:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940373504:0@lo:400:kworker.0
00000100:00100000:2.0:1767318867.437381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940373632:0@lo:38:kworker.0
00000100:00100000:1.0:1767318867.437398:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318867.437427:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318867.437428:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318867.437438:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940373376:0@lo:400:kworker.0
00000100:00100000:2.0:1767318867.437451:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940373888:0@lo:38:kworker.0
00000100:00100000:1.0:1767318867.437471:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318867.437482:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318867.437572:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940373760:0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.437579:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940373248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318867.437602:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318867.437638:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318867.437649:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940372992
00000100:00100000:0.0:1767318867.437657:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940372992
00000100:00100000:3.0:1767318867.437680:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373504
00000100:00100000:3.0:1767318867.437685:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373504
00000100:00100000:0.0:1767318867.437689:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373632
00000100:00100000:0.0:1767318867.437694:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373632
00000100:00100000:0.0:1767318867.437703:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373888
00000100:00100000:0.0:1767318867.437706:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373888
00000100:00100000:0.0:1767318867.437713:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373760
00000100:00100000:0.0:1767318867.437715:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373760
00000100:00100000:3.0:1767318867.437740:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146
00000100:00100000:3.0:1767318867.438092:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940373504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.438143:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940373504:12345-0@lo:400:kworker.0 Request processed in 394us (745us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318867.444757:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373120
00000100:00100000:2.0:1767318867.444781:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373120
00000100:00100000:0.0:1767318867.444876:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147
00000100:00100000:3.0:1767318867.444914:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146
00000100:00100000:2.0:1767318867.444926:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034
00000100:00100000:2.0:1767318867.444934:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940373120:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318867.444953:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16605
00010000:00020000:2.0:1767318867.444959:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318867.444962:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940372992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318867.444975:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318867.445016:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940373760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318867.445091:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16606
00000100:00100000:1.0:1767318867.445102:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940373632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318867.445113:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318867.445266:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940372992:12345-0@lo:38:kworker.0 Request processed in 304us (8004us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318867.445273:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16605
00000100:00100000:3.0:1767318867.445289:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16607
00000100:00100000:3.0:1767318867.445293:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940373888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318867.445305:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318867.445331:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940373888:12345-0@lo:38:kworker.0 Request processed in 37us (7850us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318867.445337:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16607
00000100:00100000:3.0:1767318867.445369:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373376
00000100:00100000:3.0:1767318867.445373:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373376
00000100:00100000:3.0:1767318867.445410:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940373248
00000100:00100000:3.0:1767318867.445413:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940373248
00000100:00100000:3.0:1767318867.445434:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713
00000100:00100000:3.0:1767318867.445440:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940373376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.445473:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940373376:12345-0@lo:400:kworker.0 Request processed in 34us (8003us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318867.445479:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713
00000100:00100000:3.0:1767318867.445490:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714
00000100:00100000:3.0:1767318867.445496:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940373248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.445542:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940373248:12345-0@lo:400:kworker.0 Request processed in 46us (7912us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318867.445549:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714
00000100:00100000:3.0:1767318867.445802:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940373248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.445843:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940373376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318867.445856:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940373504:0@lo:400:kworker.0
00000100:00080000:3.0:1767318867.445900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318867.445906:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318867.445931:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318867.445938:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318867.445942:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940373888:0@lo:38:kworker.0
00000100:00080000:3.0:1767318867.445953:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318867.445956:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318867.445959:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940372992:0@lo:38:kworker.0
00000100:00080000:3.0:1767318867.445968:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318867.445972:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318867.445975:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940373120:0@lo:38:kworker.0
00000100:00100000:3.0:1767318867.450302:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940373760:0@lo:400:kworker.0
00000100:00080000:3.0:1767318867.450366:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318867.450372:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318867.450375:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940373632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318867.458268:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940373120:12345-0@lo:38:kworker.0 Request processed in 13323us (20900us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318867.458284:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034
00000100:00100000:0.0:1767318867.458360:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940373760:12345-0@lo:400:kworker.0 Request processed in 13350us (20755us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318867.458369:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940373632:12345-0@lo:38:kworker.0 Request processed in 13267us (20939us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318867.458372:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147
00000100:00100000:1.0:1767318867.458384:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16606
00000100:00100000:3.0:1767318867.950935:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940374016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318867.951020:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318867.951988:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374016
00000100:00100000:0.0:1767318867.952000:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374016
00000100:00100000:0.0:1767318867.952067:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:0.0:1767318867.952077:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940374016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318867.952109:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318867.952180:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940374016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1160us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318867.952188:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:3.0:1767318867.954575:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940374016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318868.076938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318868.397067:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318869.104053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318869.421919:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318870.126635:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318870.451814:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318871.148909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318871.471807:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318872.045085:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940374144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318872.045162:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318872.045308:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374144
00000100:00100000:0.0:1767318872.045319:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374144
00000100:00100000:0.0:1767318872.045392:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246
00000100:00080000:3.0:1767318872.045399:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318872.045402:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940374144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318872.045435:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318872.045499:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940374144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318872.045507:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246
00000100:00100000:3.0:1767318872.045658:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940374144:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318872.134384:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318872.134671:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286592
00000100:00100000:1.0:1767318872.134683:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286592
00000100:00100000:1.0:1767318872.134738:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16608
00000100:00100000:1.0:1767318872.134746:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894286592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318872.134804:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318872.138697:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894286592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 3936us (4309us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318872.138715:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16608
00000100:00100000:3.0:1767318872.139518:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318872.139643:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286720
00000100:00100000:1.0:1767318872.139652:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286720
00000100:00100000:1.0:1767318872.139721:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4148
00000100:00100000:1.0:1767318872.139730:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894286720:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767318872.139978:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318872.141941:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894286720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 2199us (2412us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318872.141956:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4148
00000100:00100000:0.0:1767318872.172948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318872.493059:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318872.557010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318872.557022:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318872.557025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318872.557029:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318872.557035:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318872.557052:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4117
00000100:00080000:3.0:1767318872.557057:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318872.557065:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318872.557108:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d197800 x1853163940374272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318872.557138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318872.557142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318872.557144:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318872.557148:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4117
00000100:00080000:3.0:1767318872.557150:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318872.557153:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318872.557168:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940374400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318872.557176:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940374272:0@lo:38:kworker.0
00000100:00080000:3.0:1767318872.557230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318872.557235:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318872.557236:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318872.557240:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4117
00000100:00080000:3.0:1767318872.557243:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318872.557247:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318872.557253:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318872.557266:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940374784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318872.557282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318872.557285:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318872.557298:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318872.557302:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4117
00000100:00080000:3.0:1767318872.557305:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318872.557310:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318872.557323:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195c00 x1853163940375040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318872.557333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940374400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.557345:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318872.557356:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940374528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.557365:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318872.557397:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.557399:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940374784:0@lo:38:kworker.0
00000100:00100000:2.0:1767318872.557430:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.557454:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940375040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.557454:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940374912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318872.557518:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940374656:0@lo:400:kworker.0
00000100:00100000:0.0:1767318872.557595:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374272
00000100:00100000:0.0:1767318872.557604:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374272
00000100:00100000:0.0:1767318872.557642:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374784
00000100:00100000:0.0:1767318872.557653:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374784
00000100:00100000:0.0:1767318872.557675:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16609
00000100:00100000:0.0:1767318872.557682:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940374272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318872.557704:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.558146:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.558187:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374400
00000100:00100000:2.0:1767318872.558191:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374400
00000100:00100000:2.0:1767318872.558215:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035
00000100:00100000:2.0:1767318872.558220:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940374400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318872.558233:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.558321:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940374400:12345-0@lo:38:kworker.0 Request processed in 99us (956us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318872.558328:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035
00000100:00100000:2.0:1767318872.558352:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375040
00000100:00100000:2.0:1767318872.558356:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375040
00000100:00100000:2.0:1767318872.558374:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16610
00000100:00100000:2.0:1767318872.558379:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940374784:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.559399:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318872.559455:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374528
00000100:00100000:3.0:1767318872.559462:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374528
00000100:00100000:3.0:1767318872.559522:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715
00000100:00100000:3.0:1767318872.559530:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940374528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.559768:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940374528:12345-0@lo:400:kworker.0 Request processed in 238us (2370us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.559791:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715
00000100:00100000:3.0:1767318872.559816:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374912
00000100:00100000:3.0:1767318872.559820:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374912
00000100:00100000:3.0:1767318872.559844:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149
00000100:00100000:3.0:1767318872.559851:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940374912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.559886:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940374912:12345-0@lo:400:kworker.0 Request processed in 35us (491us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.559892:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149
00000100:00100000:3.0:1767318872.559904:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16611
00000100:00100000:3.0:1767318872.559908:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0786a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940375040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318872.559980:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767318872.559986:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.560019:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940374784:12345-0@lo:38:kworker.0 Request processed in 1637us (2588us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318872.560026:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16610
00000100:00080000:2.0:1767318872.560049:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318872.560053:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318872.560085:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.560092:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318872.560095:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0786a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940375040:12345-0@lo:38:kworker.0 Request processed in 182us (1946us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318872.560098:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940374400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.560108:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16611
00000100:00080000:2.0:1767318872.560114:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.560120:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318872.560124:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940374784:0@lo:38:kworker.0
00000100:00080000:2.0:1767318872.560154:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.560158:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318872.560162:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940375040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.560177:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940374528:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.560211:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940374912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318872.560958:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318872.564027:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940374656
00000100:00100000:3.0:1767318872.564047:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940374656
00000100:00100000:3.0:1767318872.564153:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150
00000100:00100000:3.0:1767318872.564163:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940374656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.564261:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940374656:12345-0@lo:400:kworker.0 Request processed in 100us (3304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.564269:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150
00000100:00100000:1.0:1767318872.564384:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940374656:0@lo:400:kworker.0
00000100:00080000:2.0:1767318872.565068:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318872.565457:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940374272:12345-0@lo:38:kworker.0 Request processed in 7772us (8205us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318872.565469:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16609
00000100:00080000:2.0:1767318872.565573:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.565579:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318872.565593:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940374272:0@lo:38:kworker.0
00000100:00100000:3.0:1767318873.071078:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940375168:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318873.071153:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318873.071308:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375168
00000100:00100000:2.0:1767318873.071318:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375168
00000100:00100000:2.0:1767318873.071367:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247
00000100:00100000:2.0:1767318873.071377:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940375168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318873.071422:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318873.071486:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940375168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318873.071494:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247
00000100:00100000:3.0:1767318873.071820:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940375168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318873.196920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318873.517179:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318874.220911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318874.542373:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318875.245010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318875.571765:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767318876.231074:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894286848 offset 0 length 520: 4
00000100:00100000:3.0:1767318876.231131:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318876.231176:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318876.235759:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894286976
00000100:00100000:2.0:1767318876.235789:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894286976
00000100:00100000:2.0:1767318876.235846:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287104
00000100:00100000:2.0:1767318876.235850:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287104
00000100:00100000:2.0:1767318876.235980:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4151
00000100:00100000:2.0:1767318876.235993:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318876.236079:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (4901us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318876.236087:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4151
00000100:00100000:2.0:1767318876.236107:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16612
00000100:00100000:2.0:1767318876.236113:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894286976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318876.236150:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318876.236179:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894286976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 65us (5058us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318876.236185:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16612
00000100:00080000:0.0:1767318876.244514:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318876.268917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318876.588972:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318877.167729:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940375296:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318877.167865:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318877.168049:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375296
00000100:00100000:2.0:1767318877.168058:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375296
00000100:00100000:2.0:1767318877.168148:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1767318877.168159:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940375296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318877.168195:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318877.168259:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940375296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318877.168266:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248
00000100:00100000:0.0:1767318877.168336:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940375296:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318877.168436:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318877.293479:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318877.613407:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318877.678430:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318877.678442:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318877.678445:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318877.678458:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318877.678462:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318877.678471:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4122
00000100:00080000:2.0:1767318877.678476:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318877.678484:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318877.678523:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0786aa300 x1853163940375424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318877.678612:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940375424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318877.678684:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318877.678819:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375424
00000100:00100000:0.0:1767318877.678832:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375424
00000100:00100000:0.0:1767318877.678882:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16613
00000100:00100000:0.0:1767318877.678889:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940375424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318877.678912:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318877.678980:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318877.678984:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318877.678986:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318877.678990:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4122
00000100:00080000:2.0:1767318877.678993:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318877.678997:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318877.679024:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0786ab100 x1853163940375552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318877.679130:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940375552:0@lo:38:kworker.0
00000100:00100000:1.0:1767318877.679159:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318877.679211:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375552
00000100:00100000:3.0:1767318877.679215:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375552
00000100:00100000:3.0:1767318877.679245:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036
00000100:00100000:3.0:1767318877.679250:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940375552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318877.679260:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318877.679291:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940375552:12345-0@lo:38:kworker.0 Request processed in 39us (130us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318877.679298:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036
00000100:00100000:0.0:1767318877.681039:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940375424:12345-0@lo:38:kworker.0 Request processed in 2139us (2346us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318877.681054:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16613
00000100:00080000:1.0:1767318877.681333:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318877.681339:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318877.681343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940375424:0@lo:38:kworker.0
00000100:00080000:1.0:1767318877.681373:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318877.681377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318877.681379:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940375552:0@lo:38:kworker.0
00000100:00100000:1.0:1767318877.681977:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940375680:0@lo:400:kworker.0
00000100:00100000:1.0:1767318877.682189:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318877.682282:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318877.682287:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318877.682290:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318877.682294:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4122
00000100:00080000:2.0:1767318877.682298:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318877.682304:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318877.682325:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0786ab100 x1853163940375936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318877.682358:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318877.682362:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318877.682364:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318877.682367:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4122
00000100:00080000:2.0:1767318877.682370:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318877.682373:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318877.682408:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8000 x1853163940376192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318877.682446:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940376064:0@lo:400:kworker.0
00000100:00100000:2.0:1767318877.682623:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318877.682682:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376064
00000100:00100000:2.0:1767318877.682689:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376064
00000100:00100000:2.0:1767318877.682744:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152
00000100:00100000:2.0:1767318877.682754:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940376064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318877.682832:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940376064:12345-0@lo:400:kworker.0 Request processed in 79us (208us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318877.682839:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152
00000100:00080000:2.0:1767318877.682863:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318877.682891:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940376064:0@lo:400:kworker.0
00000100:00100000:1.0:1767318877.682979:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318877.682987:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940375808:0@lo:400:kworker.0
00000100:00100000:1.0:1767318877.683024:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318877.683054:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940375936:0@lo:38:kworker.0
00000100:00100000:1.0:1767318877.683077:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318877.683092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940376192:0@lo:38:kworker.0
00000100:00100000:1.0:1767318877.683112:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318877.683150:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375808
00000100:00100000:1.0:1767318877.683154:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375808
00000100:00100000:1.0:1767318877.683185:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375936
00000100:00100000:1.0:1767318877.683188:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375936
00000100:00100000:1.0:1767318877.683201:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376192
00000100:00100000:1.0:1767318877.683203:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376192
00000100:00100000:1.0:1767318877.683216:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153
00000100:00100000:1.0:1767318877.683222:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940375808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318877.683255:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940375808:12345-0@lo:400:kworker.0 Request processed in 33us (230us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318877.683262:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153
00000100:00100000:1.0:1767318877.683275:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16614
00000100:00100000:1.0:1767318877.683279:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940375936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318877.683300:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318877.683329:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940375936:12345-0@lo:38:kworker.0 Request processed in 48us (251us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318877.683334:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16614
00000100:00100000:1.0:1767318877.683345:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16615
00000100:00100000:1.0:1767318877.683348:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940376192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318877.683357:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318877.683380:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940376192:12345-0@lo:38:kworker.0 Request processed in 31us (268us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318877.683385:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16615
00000100:00100000:1.0:1767318877.683409:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940375808:0@lo:400:kworker.0
00000100:00080000:1.0:1767318877.683426:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318877.683430:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318877.683433:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940375936:0@lo:38:kworker.0
00000100:00080000:1.0:1767318877.683441:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318877.683443:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318877.683445:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940376192:0@lo:38:kworker.0
00000100:00080000:2.0:1767318877.683691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318877.685273:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940375680
00000100:00100000:3.0:1767318877.685285:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940375680
00000100:00080000:2.0:1767318877.685441:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318877.685595:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716
00000100:00100000:3.0:1767318877.685606:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940375680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318877.685704:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940375680:12345-0@lo:400:kworker.0 Request processed in 99us (3514us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318877.685711:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716
00000100:00100000:1.0:1767318877.685997:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0786a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940375680:0@lo:400:kworker.0
00000100:00100000:3.0:1767318878.189096:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318878.189132:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940376320:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318878.189218:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318878.189351:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376320
00000100:00100000:0.0:1767318878.189361:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376320
00000100:00100000:0.0:1767318878.189421:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249
00000100:00100000:0.0:1767318878.189430:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940376320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318878.189467:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318878.189516:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940376320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318878.189524:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249
00000100:00100000:1.0:1767318878.189841:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940376320:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318878.317092:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318878.637132:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318879.340893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318879.661050:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318880.364915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318880.685183:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318881.351498:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318881.351686:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287360
00000100:00100000:2.0:1767318881.351696:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287360
00000100:00100000:2.0:1767318881.351867:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4154
00000100:00100000:2.0:1767318881.351878:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894287360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318881.351967:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894287360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (478us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318881.351975:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4154
00000100:00080000:0.0:1767318881.352232:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318881.354747:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318881.355061:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287232
00000100:00100000:2.0:1767318881.355070:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287232
00000100:00100000:2.0:1767318881.355153:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16616
00000100:00100000:2.0:1767318881.355161:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894287232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318881.355186:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318881.355259:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894287232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 96us (520us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318881.355266:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16616
00000100:00100000:0.0:1767318881.389132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318881.709367:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318882.285173:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940376448:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318882.285251:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318882.285422:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376448
00000100:00100000:3.0:1767318882.285431:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376448
00000100:00100000:3.0:1767318882.285545:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250
00000100:00100000:3.0:1767318882.285566:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940376448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318882.285607:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767318882.285677:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318882.302798:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940376448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 17218us (17520us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318882.302980:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250
00000100:00100000:1.0:1767318882.309929:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940376448:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318882.413009:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318882.738597:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318882.798580:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318857/real 1767318857]  req@ffff93d04699df80 x1853163940370304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318882 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318882.798614:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04699df80 x1853163940370304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318882 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318882.798636:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318882.798644:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318882.798648:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940370304:0@lo:250:kworker.0
00000100:00080000:0.0:1767318882.798796:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.798807:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318882.798811:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.798816:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4107
00000100:00080000:0.0:1767318882.798820:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.798826:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318882.798862:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940376576/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.798892:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.798904:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.798906:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.798909:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4127
00000100:00080000:0.0:1767318882.798912:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.798915:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318882.798931:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940376704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.798940:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.798943:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.798945:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.798948:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4127
00000100:00080000:0.0:1767318882.798951:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.798954:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318882.798965:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223b80 x1853163940376832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.799030:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.799033:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.799035:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.799038:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4127
00000100:00080000:0.0:1767318882.799041:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.799044:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318882.799059:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3b80 x1853163940377216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.799074:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.799077:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.799079:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.799082:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4127
00000100:00080000:0.0:1767318882.799084:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.799088:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318882.799097:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046999c00 x1853163940377472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318882.799239:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940377088:0@lo:400:kworker.0
00000100:00100000:1.0:1767318882.799351:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318882.799418:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318882.799425:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940377344:0@lo:400:kworker.0
00000100:00100000:1.0:1767318882.799450:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318882.799473:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318882.799480:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940376960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318882.799516:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318882.801173:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377088
00000100:00100000:3.0:1767318882.801186:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377088
00000100:00100000:3.0:1767318882.801265:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377344
00000100:00100000:3.0:1767318882.801268:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377344
00000100:00100000:3.0:1767318882.801299:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155
00000100:00100000:3.0:1767318882.801308:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940377088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.801389:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940377088:12345-0@lo:400:kworker.0 Request processed in 83us (2038us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318882.801397:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155
00000100:00100000:3.0:1767318882.801415:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156
00000100:00100000:3.0:1767318882.801422:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940377344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.801448:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940377344:12345-0@lo:400:kworker.0 Request processed in 27us (1997us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318882.801453:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156
00000100:00100000:3.0:1767318882.801516:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940377344:0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.801530:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940377088:0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.801574:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376960
00000100:00100000:3.0:1767318882.801578:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376960
00000100:00100000:3.0:1767318882.801605:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717
00000100:00100000:3.0:1767318882.801611:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940376960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.801644:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940376960:12345-0@lo:400:kworker.0 Request processed in 33us (2127us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318882.801650:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717
00000100:00080000:1.0:1767318882.801801:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318882.801806:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318882.801829:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940376960:0@lo:400:kworker.0
00000100:00100000:2.0:1767318882.802042:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940376576:0@lo:250:kworker.0
00000400:00000100:2.0:1767318882.802075:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940376576 offset 0 length 520: 4
00000100:00100000:2.0:1767318882.802101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940376704:0@lo:38:kworker.0
00000100:00100000:2.0:1767318882.802127:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318882.802155:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940376832:0@lo:38:kworker.0
00000100:00100000:2.0:1767318882.802179:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318882.802206:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940377216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318882.802226:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318882.802243:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940377472:0@lo:38:kworker.0
00000100:00100000:2.0:1767318882.802265:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318882.802295:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376704
00000100:00100000:2.0:1767318882.802299:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376704
00000100:00100000:2.0:1767318882.802319:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377216
00000100:00100000:2.0:1767318882.802322:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377216
00000100:00100000:2.0:1767318882.802333:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377472
00000100:00100000:2.0:1767318882.802336:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377472
00000100:00100000:2.0:1767318882.802345:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16617
00000100:00100000:2.0:1767318882.802349:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940376704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318882.802368:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318882.802400:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940376704:12345-0@lo:38:kworker.0 Request processed in 49us (272us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318882.802406:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16617
00000100:00100000:2.0:1767318882.802418:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16618
00000100:00100000:2.0:1767318882.802422:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940377216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318882.802432:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318882.802455:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940377216:12345-0@lo:38:kworker.0 Request processed in 30us (227us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318882.802461:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16618
00000100:00100000:2.0:1767318882.802471:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16619
00000100:00100000:2.0:1767318882.802475:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940377472:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318882.802483:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318882.802519:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940377472:12345-0@lo:38:kworker.0 Request processed in 42us (253us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318882.802524:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16619
00000100:00080000:2.0:1767318882.802565:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318882.802570:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318882.802574:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940376704:0@lo:38:kworker.0
00000100:00080000:2.0:1767318882.802583:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318882.802586:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318882.802589:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940377216:0@lo:38:kworker.0
00000100:00080000:2.0:1767318882.802596:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318882.802599:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318882.802601:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940377472:0@lo:38:kworker.0
00000100:00100000:1.0:1767318882.805800:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940376832
00000100:00100000:1.0:1767318882.805817:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940376832
00000100:00100000:1.0:1767318882.805880:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037
00000100:00100000:1.0:1767318882.805889:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940376832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318882.805922:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318882.806030:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940376832:12345-0@lo:38:kworker.0 Request processed in 141us (3849us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318882.806037:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037
00000100:00080000:0.0:1767318882.806152:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318882.806159:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318882.806163:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940376832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318883.312805:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318883.312831:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940377600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318883.312923:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318883.313039:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377600
00000100:00100000:2.0:1767318883.313049:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377600
00000100:00100000:2.0:1767318883.313108:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1767318883.313118:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940377600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318883.313151:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318883.313209:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940377600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318883.313216:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251
00000100:00100000:3.0:1767318883.313414:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940377600:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318883.438206:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318883.757065:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318884.463123:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318884.781846:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318885.484926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318885.805036:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318886.475863:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318886.475965:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318886.476250:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287616
00000100:00100000:3.0:1767318886.476260:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287616
00000100:00100000:3.0:1767318886.476376:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287488
00000100:00100000:3.0:1767318886.476380:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287488
00000100:00100000:3.0:1767318886.476403:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4157
00000100:00100000:3.0:1767318886.476414:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318886.476508:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (654us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318886.476516:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4157
00000100:00100000:3.0:1767318886.476843:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16620
00000100:00100000:3.0:1767318886.476851:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894287488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318886.476872:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318886.476901:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894287488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (936us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318886.479673:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318886.484147:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16620
00000100:00100000:0.0:1767318886.510111:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318886.831953:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318887.405115:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04699a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940377728:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318887.405204:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.405563:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377728
00000100:00100000:0.0:1767318887.405572:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377728
00000100:00100000:0.0:1767318887.405648:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:0.0:1767318887.405659:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940377728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318887.405688:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318887.405748:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940377728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (542us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318887.405755:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00100000:3.0:1767318887.405948:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04699a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940377728:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318887.406005:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318887.532961:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318887.853034:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318887.919604:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318887.919614:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318887.919617:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318887.919621:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318887.919626:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318887.919635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4132
00000100:00080000:2.0:1767318887.919640:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318887.919648:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318887.919688:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea300 x1853163940377856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318887.919715:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318887.919719:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318887.919720:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318887.919724:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4132
00000100:00080000:2.0:1767318887.919726:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318887.919729:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318887.919741:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8a80 x1853163940377984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318887.919806:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318887.919885:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318887.919899:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940378240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.919958:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318887.920019:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378240
00000100:00100000:3.0:1767318887.920026:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378240
00000100:00100000:3.0:1767318887.920077:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158
00000100:00100000:3.0:1767318887.920088:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940378240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.920134:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940378240:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318887.920141:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158
00000100:00080000:3.0:1767318887.920163:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318887.920189:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940378240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318887.920903:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940377856:0@lo:38:kworker.0
00000100:00100000:0.0:1767318887.920940:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.920977:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940377984:0@lo:38:kworker.0
00000100:00100000:0.0:1767318887.921001:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.921033:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377984
00000100:00100000:0.0:1767318887.921037:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377984
00000100:00100000:0.0:1767318887.921062:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038
00000100:00100000:0.0:1767318887.921068:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940377984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318887.921086:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318887.921117:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04699a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940377984:12345-0@lo:38:kworker.0 Request processed in 49us (115us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318887.921123:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038
00000100:00080000:0.0:1767318887.921151:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318887.921156:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318887.921159:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940377984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318887.921230:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940377856
00000100:00100000:3.0:1767318887.921234:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940377856
00000100:00100000:3.0:1767318887.921273:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16621
00000100:00100000:3.0:1767318887.921279:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940377856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318887.921289:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318887.921319:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940377856:12345-0@lo:38:kworker.0 Request processed in 40us (379us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318887.921325:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16621
00000100:00080000:0.0:1767318887.921560:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318887.921564:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318887.921567:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940377856:0@lo:38:kworker.0
00000100:00100000:1.0:1767318887.922144:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940378112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318887.922181:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318887.923635:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378112
00000100:00100000:3.0:1767318887.923647:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378112
00000100:00100000:3.0:1767318887.923724:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718
00000100:00100000:3.0:1767318887.923733:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940378112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.923837:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940378112:12345-0@lo:400:kworker.0 Request processed in 105us (1656us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318887.923844:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718
00000100:00080000:1.0:1767318887.924234:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318887.924285:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940378112:0@lo:400:kworker.0
00000100:00080000:2.0:1767318887.924540:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318887.924546:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318887.924549:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318887.924554:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4132
00000100:00080000:2.0:1767318887.924558:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318887.924563:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318887.924595:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8e00 x1853163940378368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318887.924636:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318887.924639:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318887.924641:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318887.924645:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4132
00000100:00080000:2.0:1767318887.924647:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318887.924650:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318887.924662:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea680 x1853163940378624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318887.924690:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940378368:0@lo:38:kworker.0
00000100:00100000:2.0:1767318887.924730:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318887.924750:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940378624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318887.924789:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.924909:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378368
00000100:00100000:0.0:1767318887.924914:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378368
00000100:00100000:0.0:1767318887.924942:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378624
00000100:00100000:0.0:1767318887.924945:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378624
00000100:00100000:0.0:1767318887.924964:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16622
00000100:00100000:0.0:1767318887.924970:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940378368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318887.924989:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318887.925026:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940378368:12345-0@lo:38:kworker.0 Request processed in 55us (296us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318887.925033:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16622
00000100:00100000:0.0:1767318887.925048:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16623
00000100:00100000:0.0:1767318887.925052:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940378624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318887.925061:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318887.925084:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940378624:12345-0@lo:38:kworker.0 Request processed in 30us (309us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318887.925089:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16623
00000100:00080000:0.0:1767318887.925122:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318887.925126:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318887.925129:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940378368:0@lo:38:kworker.0
00000100:00080000:0.0:1767318887.925138:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318887.925141:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318887.925144:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940378624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318887.925507:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940378496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318887.925539:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318887.926641:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378496
00000100:00100000:3.0:1767318887.926651:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378496
00000100:00100000:3.0:1767318887.926788:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159
00000100:00100000:3.0:1767318887.926797:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940378496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.926879:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940378496:12345-0@lo:400:kworker.0 Request processed in 83us (1338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318887.926887:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159
00000100:00100000:2.0:1767318887.927061:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940378496:0@lo:400:kworker.0
00000100:00080000:1.0:1767318887.927655:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318888.436240:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940378752:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318888.436329:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318888.436713:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378752
00000100:00100000:3.0:1767318888.436723:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378752
00000100:00100000:3.0:1767318888.436812:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253
00000100:00100000:3.0:1767318888.436833:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940378752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318888.436867:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318888.437035:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940378752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (704us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318888.437043:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253
00000100:00100000:1.0:1767318888.443557:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940378752:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318888.557360:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318888.878058:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318889.580915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318889.901107:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318890.606354:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318890.932646:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318891.593490:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318891.593590:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318891.593742:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287872
00000100:00100000:2.0:1767318891.593753:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287872
00000100:00100000:2.0:1767318891.593882:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894287744
00000100:00100000:2.0:1767318891.593886:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894287744
00000100:00100000:2.0:1767318891.593905:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4160
00000100:00100000:2.0:1767318891.593915:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318891.593993:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894287872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (514us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318891.594000:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4160
00000100:00100000:2.0:1767318891.594019:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16624
00000100:00100000:2.0:1767318891.594023:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894287744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318891.594044:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318891.594068:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894287744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (479us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318891.594074:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16624
00000100:00080000:1.0:1767318891.594345:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318891.629100:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318891.949184:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318892.529654:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318892.529683:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940378880:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318892.529758:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318892.529916:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940378880
00000100:00100000:0.0:1767318892.529925:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940378880
00000100:00100000:0.0:1767318892.529994:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254
00000100:00100000:0.0:1767318892.530005:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940378880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318892.530039:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318892.530089:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940378880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318892.530097:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254
00000100:00100000:0.0:1767318892.530145:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940378880:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318892.530207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318892.653004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318892.973030:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318893.036898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318893.036909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318893.036912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318893.036916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318893.036921:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318893.036928:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4137
00000100:00080000:2.0:1767318893.036934:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318893.036941:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318893.036985:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8380 x1853163940379008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318893.037012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318893.037016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318893.037017:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318893.037021:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4137
00000100:00080000:2.0:1767318893.037024:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318893.037028:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318893.037043:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9500 x1853163940379136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318893.037046:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940379008:0@lo:38:kworker.0
00000100:00080000:2.0:1767318893.037110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318893.037114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318893.037116:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318893.037120:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4137
00000100:00080000:2.0:1767318893.037122:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318893.037128:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318893.037138:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318893.037156:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ead80 x1853163940379648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318893.037175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318893.037178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318893.037179:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318893.037182:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4137
00000100:00080000:2.0:1767318893.037185:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318893.037189:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318893.037201:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8a80 x1853163940379904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318893.037208:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940379136:0@lo:38:kworker.0
00000100:00100000:2.0:1767318893.037235:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940379264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.037243:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318893.037265:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940379648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318893.037280:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318893.037299:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318893.037334:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940379904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318893.037334:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318893.037344:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940379776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.037365:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318893.037380:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940379392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.037427:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379136
00000100:00100000:0.0:1767318893.037436:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379136
00000100:00100000:2.0:1767318893.037442:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318893.037474:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039
00000100:00100000:2.0:1767318893.037475:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318893.037484:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940379136:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318893.037484:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940379520:0@lo:400:kworker.0
00010000:00020000:0.0:1767318893.037509:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318893.037514:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318893.037549:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379264
00000100:00100000:2.0:1767318893.037553:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379264
00000100:00100000:0.0:1767318893.037557:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940379136:12345-0@lo:38:kworker.0 Request processed in 73us (316us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318893.037565:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039
00000100:00100000:0.0:1767318893.037589:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379008
00000100:00100000:2.0:1767318893.037591:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379392
00000100:00100000:0.0:1767318893.037594:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379008
00000100:00100000:2.0:1767318893.037596:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379392
00000100:00100000:0.0:1767318893.037615:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379648
00000100:00100000:0.0:1767318893.037619:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379648
00000100:00100000:2.0:1767318893.037638:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719
00000100:00100000:0.0:1767318893.037639:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379904
00000100:00100000:0.0:1767318893.037643:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379904
00000100:00100000:2.0:1767318893.037648:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940379264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.037652:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379520
00000100:00100000:0.0:1767318893.037656:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379520
00000100:00100000:0.0:1767318893.037676:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161
00000100:00100000:2.0:1767318893.037693:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940379264:12345-0@lo:400:kworker.0 Request processed in 47us (412us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318893.037698:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940379520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318893.037705:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719
00000100:00100000:2.0:1767318893.037723:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720
00000100:00100000:2.0:1767318893.037731:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940379392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.037739:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940379520:12345-0@lo:400:kworker.0 Request processed in 45us (226us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318893.037746:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161
00000100:00100000:0.0:1767318893.037761:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16625
00000100:00100000:0.0:1767318893.037766:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940379008:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318893.037771:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940379392:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0
00010000:00020000:0.0:1767318893.037803:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318893.037804:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720
00000100:00100000:0.0:1767318893.037831:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940379008:12345-0@lo:38:kworker.0 Request processed in 62us (704us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318893.037834:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16626
00000100:00100000:0.0:1767318893.037844:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16625
00000100:00100000:2.0:1767318893.037845:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b833050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940379648:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318893.037860:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16627
00010000:00020000:2.0:1767318893.037860:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318893.037868:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940379904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318893.037877:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318893.037897:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b833050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940379648:12345-0@lo:38:kworker.0 Request processed in 52us (597us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318893.037905:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16626
00000100:00100000:0.0:1767318893.037909:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940379904:12345-0@lo:38:kworker.0 Request processed in 37us (542us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318893.037916:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16627
00000100:00080000:3.0:1767318893.038004:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318893.038008:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318893.038018:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318893.038220:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318893.038227:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318893.038232:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940379904:0@lo:38:kworker.0
00000100:00080000:0.0:1767318893.038245:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318893.038249:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318893.038253:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940379136:0@lo:38:kworker.0
00000100:00080000:0.0:1767318893.038264:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318893.038268:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318893.038272:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940379648:0@lo:38:kworker.0
00000100:00080000:0.0:1767318893.038283:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318893.038286:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318893.038290:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940379008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318893.038360:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940379520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.038448:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940379392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318893.048562:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940379264:0@lo:400:kworker.0
00000100:00100000:2.0:1767318893.050463:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940379776
00000100:00100000:2.0:1767318893.050476:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940379776
00000100:00100000:2.0:1767318893.050553:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162
00000100:00100000:2.0:1767318893.050562:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940379776:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318893.050738:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318893.051204:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940379776:12345-0@lo:400:kworker.0 Request processed in 642us (13183us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318893.051211:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162
00000100:00100000:3.0:1767318893.051282:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940379776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318893.550005:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318893.550030:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940380032:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318893.550103:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318893.550389:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380032
00000100:00100000:2.0:1767318893.550428:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380032
00000100:00100000:2.0:1767318893.550484:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255
00000100:00100000:2.0:1767318893.550493:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940380032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318893.550525:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318893.550576:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940380032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (473us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318893.550583:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255
00000100:00100000:0.0:1767318893.550717:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940380032:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318893.676964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318893.997078:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318894.701890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318895.021077:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318895.724918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318896.045063:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318896.714491:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318896.714596:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318896.715150:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288128
00000100:00100000:1.0:1767318896.715161:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288128
00000100:00080000:3.0:1767318896.715208:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318896.715236:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288000
00000100:00100000:1.0:1767318896.715240:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288000
00000100:00100000:1.0:1767318896.715269:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4163
00000100:00100000:1.0:1767318896.715278:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894288128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318896.715377:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894288128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (896us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318896.721627:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16628
00000100:00100000:2.0:1767318896.721641:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894288000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318896.721664:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318896.722618:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894288000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 975us (8018us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318896.722629:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16628
00000100:00100000:1.0:1767318896.726097:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4163
00000100:00100000:2.0:1767318896.748939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318897.069021:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318897.644997:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318897.645020:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940380160:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318897.645104:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318897.645174:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380160
00000100:00100000:3.0:1767318897.645184:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380160
00000100:00100000:3.0:1767318897.645310:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256
00000100:00100000:3.0:1767318897.645321:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940380160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318897.645362:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318897.645412:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940380160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (308us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318897.645419:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256
00000100:00100000:3.0:1767318897.645467:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940380160:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318897.645557:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318897.774588:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318898.093004:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318898.156912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318898.156922:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318898.156924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318898.156927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318898.156932:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318898.156939:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4143
00000100:00080000:2.0:1767318898.156943:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318898.156949:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318898.156988:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223800 x1853163940380288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318898.157006:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318898.157008:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318898.157010:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318898.157013:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4143
00000100:00080000:2.0:1767318898.157014:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318898.157017:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318898.157029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940380288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318898.157029:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220a80 x1853163940380416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318898.157077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318898.157079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318898.157080:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318898.157082:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4143
00000100:00080000:2.0:1767318898.157084:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318898.157086:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318898.157092:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222a00 x1853163940380928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318898.157111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318898.157113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318898.157114:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318898.157116:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4143
00000100:00080000:2.0:1767318898.157118:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318898.157120:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318898.157125:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940381184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318898.157139:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940380672:0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.157201:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318898.157286:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380672
00000100:00100000:3.0:1767318898.157295:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380672
00000100:00100000:3.0:1767318898.157374:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721
00000100:00100000:3.0:1767318898.157392:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940380672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.163694:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:1.0:1767318898.163702:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318898.163721:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940380800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318898.163793:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940380544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.163804:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318898.163842:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318898.163854:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940381056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318898.163884:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380544
00000100:00100000:2.0:1767318898.163885:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318898.163894:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380544
00000100:00100000:2.0:1767318898.163930:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380800
00000100:00100000:2.0:1767318898.163935:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380800
00000100:00100000:1.0:1767318898.163959:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722
00000100:00100000:1.0:1767318898.163969:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940380544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.163978:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381056
00000100:00100000:2.0:1767318898.163982:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381056
00000100:00100000:2.0:1767318898.164010:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164
00000100:00100000:2.0:1767318898.164019:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940380800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318898.164026:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940380544:12345-0@lo:400:kworker.0 Request processed in 57us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318898.164061:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940380800:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318898.164068:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164
00000100:00100000:2.0:1767318898.164084:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165
00000100:00100000:2.0:1767318898.164090:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940381056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.164121:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940381056:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318898.164127:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165
00000100:00100000:2.0:1767318898.164178:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940381056:0@lo:400:kworker.0
00000100:00080000:2.0:1767318898.164197:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318898.164211:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940380800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318898.164666:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940380544:0@lo:400:kworker.0
00000100:00100000:3.0:1767318898.164746:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940380672:12345-0@lo:400:kworker.0 Request processed in 7357us (7544us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318898.164757:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721
00000100:00100000:2.0:1767318898.164838:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940380672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318898.170765:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722
00000100:00100000:0.0:1767318898.173969:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318898.174069:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940380416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318898.174127:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318898.174158:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940380928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318898.174179:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318898.174204:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940381184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318898.174225:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318898.174272:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380288
00000100:00100000:0.0:1767318898.174280:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380288
00000100:00100000:3.0:1767318898.174313:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380928
00000100:00100000:0.0:1767318898.174316:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381184
00000100:00100000:3.0:1767318898.174318:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380928
00000100:00100000:0.0:1767318898.174321:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381184
00000100:00100000:3.0:1767318898.174347:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16629
00000100:00100000:3.0:1767318898.174364:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940380288:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318898.174386:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318898.174387:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940380416
00000100:00100000:1.0:1767318898.174392:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940380416
00000100:00100000:1.0:1767318898.174418:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040
00000100:00100000:1.0:1767318898.174425:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940380416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318898.174436:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318898.175134:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940380288:12345-0@lo:38:kworker.0 Request processed in 767us (1170us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318898.175144:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16629
00000100:00100000:3.0:1767318898.175177:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16630
00000100:00100000:3.0:1767318898.175182:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940380928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318898.175194:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318898.177761:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940380928:12345-0@lo:38:kworker.0 Request processed in 2567us (3570us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318898.177789:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16630
00000100:00100000:3.0:1767318898.177826:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16631
00000100:00100000:3.0:1767318898.177834:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940381184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318898.177856:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318898.177915:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940381184:12345-0@lo:38:kworker.0 Request processed in 80us (3689us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318898.177921:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16631
00000100:00100000:1.0:1767318898.184438:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940380416:12345-0@lo:38:kworker.0 Request processed in 10001us (10298us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318898.184454:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040
00000100:00080000:0.0:1767318898.185188:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318898.185195:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318898.185200:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940380416:0@lo:38:kworker.0
00000100:00080000:0.0:1767318898.185215:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318898.185219:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318898.185223:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940380928:0@lo:38:kworker.0
00000100:00080000:0.0:1767318898.185235:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318898.185238:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318898.185241:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940381184:0@lo:38:kworker.0
00000100:00080000:0.0:1767318898.185253:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318898.185257:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318898.185260:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940380288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318898.670249:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940381312:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318898.670322:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318898.670761:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381312
00000100:00100000:0.0:1767318898.670789:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381312
00000100:00100000:0.0:1767318898.670857:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257
00000100:00100000:0.0:1767318898.670867:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940381312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318898.670897:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318898.671166:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940381312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 300us (843us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318898.671174:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257
00000100:00100000:2.0:1767318898.671247:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940381312:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318898.798613:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318899.117033:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318899.821722:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318900.141013:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318900.844924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318901.165550:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1767318901.831199:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894288256 offset 0 length 520: 4
00000100:00100000:1.0:1767318901.831269:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318901.831305:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318901.831414:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288384
00000100:00100000:2.0:1767318901.831424:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288384
00000100:00100000:2.0:1767318901.831464:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288512
00000100:00100000:2.0:1767318901.831466:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288512
00000100:00100000:2.0:1767318901.831522:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4166
00000100:00100000:2.0:1767318901.831531:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894288512:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318901.831593:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894288512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 64us (287us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318901.831600:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4166
00000100:00100000:2.0:1767318901.831614:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16632
00000100:00100000:2.0:1767318901.831618:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894288384:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318901.831637:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318901.831656:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894288384:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 36us (387us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318901.831661:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16632
00000100:00080000:0.0:1767318901.832112:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318901.869121:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318902.189487:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318902.765360:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318902.765387:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940381440:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318902.765461:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318902.767387:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381440
00000100:00100000:1.0:1767318902.767399:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381440
00000100:00100000:1.0:1767318902.767461:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258
00000100:00100000:1.0:1767318902.767470:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940381440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318902.767501:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767318902.767568:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940381440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (2106us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318902.767575:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258
00000100:00100000:1.0:1767318902.767626:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940381440:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318902.768601:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318902.894470:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318903.213011:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318903.276961:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318903.276972:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318903.276975:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318903.276979:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318903.276984:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318903.276991:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4148
00000100:00080000:3.0:1767318903.277005:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318903.277012:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318903.277051:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194380 x1853163940381568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318903.277171:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318903.277175:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318903.277177:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318903.277181:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4148
00000100:00080000:3.0:1767318903.277183:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318903.277187:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318903.277202:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194a80 x1853163940381696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318903.277274:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318903.277277:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318903.277279:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318903.277282:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4148
00000100:00080000:3.0:1767318903.277284:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318903.277288:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318903.277297:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196d80 x1853163940382208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318903.277631:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318903.277646:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940381824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.277712:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318903.277808:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940381952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.277832:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318903.277856:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318903.277861:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940382080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.277884:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318903.277921:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381824
00000100:00100000:0.0:1767318903.277928:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381824
00000100:00100000:0.0:1767318903.277969:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381952
00000100:00100000:0.0:1767318903.277972:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381952
00000100:00100000:0.0:1767318903.278016:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723
00000100:00100000:0.0:1767318903.278025:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940381824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.278086:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940381824:12345-0@lo:400:kworker.0 Request processed in 62us (373us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318903.278094:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723
00000100:00100000:0.0:1767318903.278138:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940381824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.278159:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724
00000100:00100000:0.0:1767318903.278166:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940381952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.278196:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940381952:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318903.278202:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724
00000100:00100000:0.0:1767318903.278233:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940381952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.278264:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382080
00000100:00100000:0.0:1767318903.278268:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382080
00000100:00100000:0.0:1767318903.278294:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167
00000100:00100000:0.0:1767318903.278300:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940382080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.280512:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940382080:12345-0@lo:400:kworker.0 Request processed in 2203us (2617us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318903.280524:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167
00000100:00100000:1.0:1767318903.280931:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940382080:0@lo:400:kworker.0
00000100:00080000:0.0:1767318903.281872:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318903.281879:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318903.282318:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940382336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318903.282381:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318903.282473:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382336
00000100:00100000:1.0:1767318903.282481:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382336
00000100:00080000:1.0:1767318903.282514:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318903.282555:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4168
00000100:00100000:1.0:1767318903.282563:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940382336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318903.282642:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940381568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318903.282670:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318903.282689:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940381696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318903.282710:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318903.282726:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940382208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318903.282744:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318903.282788:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381568
00000100:00100000:2.0:1767318903.282793:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381568
00000100:00100000:2.0:1767318903.282813:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382208
00000100:00100000:2.0:1767318903.282816:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382208
00000100:00100000:2.0:1767318903.282831:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16633
00000100:00100000:2.0:1767318903.282848:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940381568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318903.282868:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318903.282919:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940381568:12345-0@lo:38:kworker.0 Request processed in 74us (240us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318903.282925:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16633
00000100:00100000:2.0:1767318903.282942:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16634
00000100:00100000:2.0:1767318903.282946:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940382208:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318903.282955:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318903.282978:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940382208:12345-0@lo:38:kworker.0 Request processed in 31us (233us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318903.282984:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16634
00000100:00100000:2.0:1767318903.283018:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940381696
00000100:00100000:2.0:1767318903.283021:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940381696
00000100:00100000:2.0:1767318903.283046:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041
00000100:00100000:2.0:1767318903.283050:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940381696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318903.283059:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318903.283082:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940381696:12345-0@lo:38:kworker.0 Request processed in 30us (370us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318903.283087:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041
00000100:00080000:2.0:1767318903.283120:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318903.283125:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318903.283128:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940381568:0@lo:38:kworker.0
00000100:00080000:2.0:1767318903.283136:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318903.283140:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318903.283142:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940381696:0@lo:38:kworker.0
00000100:00080000:2.0:1767318903.283148:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318903.283151:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318903.283153:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940382208:0@lo:38:kworker.0
00000100:00080000:3.0:1767318903.283269:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318903.283275:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318903.283278:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318903.283283:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4148
00000100:00080000:3.0:1767318903.283287:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318903.283292:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318903.283327:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d197100 x1853163940382464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318903.283360:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940382464:0@lo:38:kworker.0
00000100:00100000:3.0:1767318903.283386:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318903.283972:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382464
00000100:00100000:2.0:1767318903.283977:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382464
00000100:00100000:2.0:1767318903.284008:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16635
00000100:00100000:2.0:1767318903.284013:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940382464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318903.284025:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318903.284068:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940382464:12345-0@lo:38:kworker.0 Request processed in 54us (681us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318903.284074:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16635
00000100:00080000:3.0:1767318903.284218:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318903.284223:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318903.284226:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940382464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318903.285233:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940382336:12345-0@lo:400:kworker.0 Request processed in 2667us (2849us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318903.285242:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4168
00000100:00100000:0.0:1767318903.285377:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940382336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318903.789158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940382592:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318903.789234:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318903.789361:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382592
00000100:00100000:3.0:1767318903.789369:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382592
00000100:00100000:3.0:1767318903.789549:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259
00000100:00100000:3.0:1767318903.789557:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940382592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318903.789584:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318903.789628:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940382592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318903.789633:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259
00000100:00100000:2.0:1767318903.789804:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940382592:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318903.917602:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318904.236997:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318904.941755:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318905.261007:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318905.964973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318906.285073:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318906.950750:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318906.951845:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288768
00000100:00100000:1.0:1767318906.951941:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288768
00000100:00100000:1.0:1767318906.952035:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4169
00000100:00100000:1.0:1767318906.952046:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894288768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318906.953989:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894288768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1933us (3247us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318906.954003:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4169
00000100:00080000:0.0:1767318906.955157:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318906.974832:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318906.974999:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288640
00000100:00100000:1.0:1767318906.975009:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288640
00000100:00100000:1.0:1767318906.975058:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16636
00000100:00100000:1.0:1767318906.975065:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894288640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318906.975099:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318906.975165:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894288640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (394us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318906.975190:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16636
00000100:00100000:2.0:1767318906.992837:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318907.309510:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318907.372921:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318882/real 1767318882]  req@ffff93cf45222d80 x1853163940376576/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318907.372959:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45222d80 x1853163940376576/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318907.372985:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318907.373010:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318907.373015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940376576:0@lo:250:kworker.0
00000100:00080000:2.0:1767318907.373428:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318907.373434:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318907.373437:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318907.373442:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4132
00000100:00080000:2.0:1767318907.373446:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318907.373451:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318907.373484:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221500 x1853163940382720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318907.373511:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318907.373515:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318907.373517:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318907.373520:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4153
00000100:00080000:2.0:1767318907.373523:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318907.373526:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318907.373543:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940382848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318907.373553:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318907.373556:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318907.373558:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318907.373561:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4153
00000100:00080000:2.0:1767318907.373564:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318907.373567:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318907.373581:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af800 x1853163940382976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318907.373650:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318907.373653:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318907.373656:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318907.373659:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4153
00000100:00080000:2.0:1767318907.373662:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318907.373666:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318907.373678:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940383488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318907.373691:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318907.373694:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318907.373695:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318907.373698:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4153
00000100:00080000:2.0:1767318907.373700:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318907.373704:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318907.373714:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940383744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318907.373743:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383232:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.373824:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318907.373878:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318907.373884:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.373908:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318907.373932:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940383616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.373958:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318907.373974:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318907.373979:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940383360:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.373998:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318907.374233:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383232
00000100:00100000:0.0:1767318907.374241:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383232
00000100:00100000:0.0:1767318907.374324:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383104
00000100:00100000:0.0:1767318907.374327:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383104
00000100:00100000:0.0:1767318907.374352:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725
00000100:00100000:0.0:1767318907.374360:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318907.374411:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383232:12345-0@lo:400:kworker.0 Request processed in 51us (586us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318907.374419:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725
00000100:00100000:0.0:1767318907.374434:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726
00000100:00100000:0.0:1767318907.374440:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318907.374462:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383104:12345-0@lo:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318907.374467:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726
00000100:00100000:1.0:1767318907.374647:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383616
00000100:00100000:1.0:1767318907.374651:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383616
00000100:00100000:1.0:1767318907.374676:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383360
00000100:00100000:1.0:1767318907.374678:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383360
00000100:00100000:1.0:1767318907.374694:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4170
00000100:00100000:1.0:1767318907.374699:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940383616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318907.374732:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940383616:12345-0@lo:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318907.374738:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4170
00000100:00100000:1.0:1767318907.374748:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171
00000100:00100000:1.0:1767318907.374753:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940383360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318907.374788:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940383360:12345-0@lo:400:kworker.0 Request processed in 19us (774us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318907.374794:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171
00000100:00080000:2.0:1767318907.374954:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318907.374959:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318907.374961:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318907.374996:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940383360:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.375006:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940383616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.375031:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318907.375039:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318907.376002:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940382720:0@lo:250:kworker.0
00000400:00000100:3.0:1767318907.376047:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940382720 offset 0 length 520: 4
00000100:00100000:3.0:1767318907.376079:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940382848:0@lo:38:kworker.0
00000100:00100000:3.0:1767318907.376105:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318907.376137:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940382976:0@lo:38:kworker.0
00000100:00100000:3.0:1767318907.376161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318907.376186:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940383488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318907.376208:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318907.376237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940383744:0@lo:38:kworker.0
00000100:00100000:3.0:1767318907.376257:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318907.376349:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382976
00000100:00100000:2.0:1767318907.376360:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382976
00000100:00100000:2.0:1767318907.376404:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042
00000100:00100000:2.0:1767318907.376411:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940382976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318907.376432:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318907.376473:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940382976:12345-0@lo:38:kworker.0 Request processed in 61us (311us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318907.376480:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042
00000100:00100000:2.0:1767318907.376500:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940382848
00000100:00100000:2.0:1767318907.376504:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940382848
00000100:00100000:2.0:1767318907.376520:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383488
00000100:00100000:2.0:1767318907.376523:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383488
00000100:00100000:2.0:1767318907.376536:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383744
00000100:00100000:2.0:1767318907.376538:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383744
00000100:00100000:2.0:1767318907.376550:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16637
00000100:00100000:2.0:1767318907.376555:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940382848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318907.376563:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318907.376710:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16638
00000100:00100000:0.0:1767318907.376717:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940383488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318907.376744:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318907.376807:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318907.376814:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318907.376819:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16639
00000100:00100000:3.0:1767318907.376821:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940382976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318907.376829:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940383744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318907.376840:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318907.382987:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940383488:12345-0@lo:38:kworker.0 Request processed in 6257us (6765us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318907.383003:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16638
00000100:00080000:3.0:1767318907.383154:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318907.383159:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318907.383164:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940383488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318907.383285:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940383744:12345-0@lo:38:kworker.0 Request processed in 6456us (7025us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318907.383294:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16639
00000100:00080000:3.0:1767318907.383356:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318907.383360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318907.383363:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940383744:0@lo:38:kworker.0
00000100:00100000:2.0:1767318907.385649:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940382848:12345-0@lo:38:kworker.0 Request processed in 9076us (9526us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318907.385665:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16637
00000100:00080000:3.0:1767318907.385828:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318907.385834:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318907.385838:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940382848:0@lo:38:kworker.0
00000100:00100000:2.0:1767318907.885794:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318907.885819:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383872:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318907.885912:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318907.886018:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940383872
00000100:00100000:0.0:1767318907.886027:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940383872
00000100:00100000:0.0:1767318907.886227:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260
00000100:00100000:0.0:1767318907.886238:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318907.886296:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318907.886353:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940383872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (440us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318907.886360:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260
00000100:00100000:2.0:1767318907.887068:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940383872:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318908.014569:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318908.333173:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318908.913439:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318908.913462:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940384000:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318908.913530:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318908.913845:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384000
00000100:00100000:0.0:1767318908.913854:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384000
00000100:00100000:0.0:1767318908.913910:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261
00000100:00100000:0.0:1767318908.913919:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940384000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318908.913949:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318908.914002:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940384000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (471us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318908.914009:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261
00000100:00100000:1.0:1767318908.914290:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940384000:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318909.036911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318909.357024:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318910.060937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318910.381294:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318911.084925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318911.406241:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318912.075606:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318912.075747:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318912.081856:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289024
00000100:00100000:2.0:1767318912.081874:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289024
00000100:00100000:2.0:1767318912.081966:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894288896
00000100:00100000:2.0:1767318912.081970:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894288896
00000100:00100000:2.0:1767318912.081995:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4172
00000100:00100000:2.0:1767318912.082005:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894289024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318912.082103:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894289024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (6512us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318912.082111:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4172
00000100:00100000:3.0:1767318912.082488:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16640
00000100:00100000:3.0:1767318912.082496:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894288896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318912.082517:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318912.082548:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894288896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (6801us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318912.082554:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16640
00000100:00080000:0.0:1767318912.083573:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318912.108914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318912.429402:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318912.493184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318912.493195:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318912.493198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318912.493202:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318912.493207:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318912.493216:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4157
00000100:00080000:3.0:1767318912.493231:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318912.493238:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318912.493278:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194380 x1853163940384128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318912.493296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318912.493300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318912.493301:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318912.493305:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4157
00000100:00080000:3.0:1767318912.493307:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318912.493310:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318912.493322:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195500 x1853163940384256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318912.493384:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318912.493388:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318912.493390:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318912.493393:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4157
00000100:00080000:3.0:1767318912.493396:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318912.493400:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318912.493413:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194a80 x1853163940384768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318912.493430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318912.493433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318912.493435:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318912.493438:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4157
00000100:00080000:3.0:1767318912.493440:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318912.493443:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318912.493453:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9b800 x1853163940385024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318912.493480:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940384640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318912.493546:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318912.493719:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940384512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318912.493753:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318912.493805:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940384896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318912.493838:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318912.493930:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940384128:0@lo:38:kworker.0
00000100:00100000:0.0:1767318912.493960:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318912.493988:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384640
00000100:00100000:0.0:1767318912.493996:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384640
00000100:00100000:1.0:1767318912.494097:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940384384:0@lo:400:kworker.0
00000100:00100000:1.0:1767318912.494124:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318912.494148:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384896
00000100:00100000:1.0:1767318912.494151:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384896
00000100:00100000:2.0:1767318912.499321:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384512
00000100:00100000:2.0:1767318912.499340:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384512
00000100:00100000:2.0:1767318912.499441:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384384
00000100:00100000:2.0:1767318912.499445:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384384
00000100:00100000:2.0:1767318912.499476:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727
00000100:00100000:2.0:1767318912.499488:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940384512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318912.499584:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940384512:12345-0@lo:400:kworker.0 Request processed in 98us (5829us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318912.499603:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727
00000100:00100000:2.0:1767318912.499621:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728
00000100:00100000:2.0:1767318912.499627:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940384384:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318912.499671:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940384384:12345-0@lo:400:kworker.0 Request processed in 44us (5545us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318912.499677:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728
00000100:00100000:2.0:1767318912.499750:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940384512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318912.499822:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940384256:0@lo:38:kworker.0
00000100:00100000:2.0:1767318912.500125:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318912.500151:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940384768:0@lo:38:kworker.0
00000100:00100000:2.0:1767318912.500176:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318912.500194:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940385024:0@lo:38:kworker.0
00000100:00100000:2.0:1767318912.500214:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318912.500327:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384256
00000100:00100000:2.0:1767318912.500332:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384256
00000100:00100000:2.0:1767318912.500356:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043
00000100:00100000:2.0:1767318912.500362:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940384256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318912.500383:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318912.500416:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940384256:12345-0@lo:38:kworker.0 Request processed in 53us (292us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318912.500422:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043
00000100:00100000:2.0:1767318912.500438:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384128
00000100:00100000:2.0:1767318912.500441:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384128
00000100:00100000:2.0:1767318912.500458:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940384768
00000100:00100000:2.0:1767318912.500460:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940384768
00000100:00100000:2.0:1767318912.500466:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385024
00000100:00100000:2.0:1767318912.500468:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385024
00000100:00100000:2.0:1767318912.500476:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16641
00000100:00100000:2.0:1767318912.500481:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940384128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318912.500489:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318912.500510:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940384128:12345-0@lo:38:kworker.0 Request processed in 29us (6550us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318912.500516:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16641
00000100:00100000:2.0:1767318912.500524:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16642
00000100:00100000:2.0:1767318912.500528:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940384768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318912.500536:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318912.500551:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940384768:12345-0@lo:38:kworker.0 Request processed in 22us (375us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318912.500555:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16642
00000100:00100000:2.0:1767318912.500563:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16643
00000100:00100000:2.0:1767318912.500566:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940385024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318912.500574:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318912.500589:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940385024:12345-0@lo:38:kworker.0 Request processed in 22us (375us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318912.504689:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16643
00000100:00080000:2.0:1767318912.505095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318912.505102:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318912.505107:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940384128:0@lo:38:kworker.0
00000100:00080000:2.0:1767318912.505129:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318912.505132:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318912.505136:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940384256:0@lo:38:kworker.0
00000100:00080000:2.0:1767318912.505147:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318912.505150:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318912.505153:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940384768:0@lo:38:kworker.0
00000100:00080000:2.0:1767318912.505163:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318912.505165:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318912.505168:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940385024:0@lo:38:kworker.0
00000100:00080000:2.0:1767318912.505262:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318912.505267:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318912.505271:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318912.505327:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940384384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318912.505853:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173
00000100:00100000:0.0:1767318912.505874:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940384640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318912.505971:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940384640:12345-0@lo:400:kworker.0 Request processed in 108us (12424us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318912.505978:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173
00000100:00100000:2.0:1767318912.506155:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940384640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318912.509739:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174
00000100:00100000:1.0:1767318912.509768:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940384896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318912.510987:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940384896:12345-0@lo:400:kworker.0 Request processed in 1073us (16985us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318912.511002:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174
00000100:00100000:2.0:1767318912.511142:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940384896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318913.014143:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318913.014172:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940385152:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318913.014278:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318913.014824:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385152
00000100:00100000:3.0:1767318913.014835:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385152
00000100:00100000:3.0:1767318913.014898:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262
00000100:00100000:3.0:1767318913.014910:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940385152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318913.014944:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318913.015020:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940385152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (741us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318913.015039:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262
00000100:00100000:1.0:1767318913.015807:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940385152:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318913.134579:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318913.453858:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318914.030570:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940385280:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318914.030649:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318914.030804:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385280
00000100:00100000:0.0:1767318914.030813:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385280
00000100:00100000:0.0:1767318914.030883:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263
00000100:00100000:0.0:1767318914.030893:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940385280:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318914.030927:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318914.030964:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318914.030981:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940385280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318914.030989:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263
00000100:00100000:1.0:1767318914.031358:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940385280:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318914.156917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318914.477379:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318915.181627:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318915.500987:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318916.204981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318916.525245:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318917.193997:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318917.194050:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318917.194146:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289280
00000100:00100000:1.0:1767318917.194156:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289280
00000100:00100000:1.0:1767318917.194235:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289152
00000100:00100000:1.0:1767318917.194239:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289152
00000100:00100000:1.0:1767318917.194259:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4175
00000100:00100000:1.0:1767318917.194270:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894289280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318917.194343:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894289280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318917.194351:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4175
00000100:00100000:1.0:1767318917.194370:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16644
00000100:00100000:1.0:1767318917.194374:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894289152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318917.194395:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318917.194419:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894289152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (368us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318917.194424:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16644
00000100:00080000:2.0:1767318917.194929:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318917.228904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318917.548996:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318917.613911:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318917.613924:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318917.613928:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318917.613932:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318917.613936:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318917.613944:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4162
00000100:00080000:1.0:1767318917.613949:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318917.613955:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318917.614001:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212300 x1853163940385408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318917.614080:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940385408:0@lo:38:kworker.0
00000100:00100000:0.0:1767318917.614157:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318917.614297:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318917.614301:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318917.614304:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318917.614308:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4162
00000100:00080000:1.0:1767318917.614310:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318917.614314:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318917.614334:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08700 x1853163940385536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318917.614389:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385408
00000100:00100000:3.0:1767318917.614397:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385408
00000100:00100000:3.0:1767318917.614453:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16645
00000100:00100000:3.0:1767318917.614461:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940385408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318917.614484:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318917.615025:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940385536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318917.615063:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318917.615236:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318917.615240:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318917.615242:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318917.615246:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4162
00000100:00080000:1.0:1767318917.615249:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318917.615253:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318917.615267:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08000 x1853163940386048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318917.615285:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318917.615288:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318917.615290:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318917.615293:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4162
00000100:00080000:1.0:1767318917.615295:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318917.615298:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318917.615309:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0a680 x1853163940386304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318917.615340:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940385920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318917.615370:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318917.615395:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318917.615400:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940386176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318917.615420:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318917.615463:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385920
00000100:00100000:1.0:1767318917.615468:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385920
00000100:00100000:1.0:1767318917.615515:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386176
00000100:00100000:1.0:1767318917.615517:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386176
00000100:00100000:1.0:1767318917.615538:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176
00000100:00100000:1.0:1767318917.615546:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940385920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318917.615593:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940385920:12345-0@lo:400:kworker.0 Request processed in 46us (221us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318917.615600:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176
00000100:00100000:1.0:1767318917.615616:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177
00000100:00100000:1.0:1767318917.615623:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940386176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318917.615650:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940386176:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318917.615655:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177
00000100:00100000:3.0:1767318917.616218:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940385408:12345-0@lo:38:kworker.0 Request processed in 1753us (2058us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318917.616227:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16645
00000100:00100000:3.0:1767318917.616286:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940385792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616322:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318917.616355:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318917.616361:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940385664:0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616382:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318917.616421:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385792
00000100:00100000:3.0:1767318917.616426:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385792
00000100:00100000:3.0:1767318917.616469:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385664
00000100:00100000:3.0:1767318917.616472:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385664
00000100:00100000:3.0:1767318917.616492:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729
00000100:00100000:3.0:1767318917.616500:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940385792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616537:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940385792:12345-0@lo:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318917.616543:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729
00000100:00100000:3.0:1767318917.616555:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730
00000100:00100000:3.0:1767318917.616561:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940385664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616587:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940385664:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318917.616593:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730
00000100:00100000:3.0:1767318917.616636:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940385664:0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616647:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940385792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616730:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940386176:0@lo:400:kworker.0
00000100:00100000:3.0:1767318917.616742:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940385920:0@lo:400:kworker.0
00000100:00080000:1.0:1767318917.618899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318917.618912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318917.618915:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318917.620531:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940385536
00000100:00100000:2.0:1767318917.620547:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940385536
00000100:00100000:2.0:1767318917.620601:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044
00000100:00100000:2.0:1767318917.620608:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940385536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318917.620631:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318917.620718:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940385536:12345-0@lo:38:kworker.0 Request processed in 109us (5654us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318917.620724:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044
00000100:00080000:0.0:1767318917.623870:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318917.623883:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318917.623888:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940385408:0@lo:38:kworker.0
00000100:00100000:0.0:1767318917.623924:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940386048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318917.623994:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318917.624123:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940386304:0@lo:38:kworker.0
00000100:00100000:0.0:1767318917.624165:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318917.624371:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318917.624377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318917.624380:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940385536:0@lo:38:kworker.0
00000100:00100000:3.0:1767318917.624507:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386048
00000100:00100000:3.0:1767318917.624515:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386048
00000100:00100000:3.0:1767318917.634347:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386304
00000100:00100000:3.0:1767318917.634363:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386304
00000100:00100000:1.0:1767318917.638289:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16646
00000100:00100000:1.0:1767318917.638303:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940386048:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318917.638331:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318917.638426:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940386048:12345-0@lo:38:kworker.0 Request processed in 123us (14431us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318917.638434:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16646
00000100:00100000:1.0:1767318917.638468:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16647
00000100:00100000:1.0:1767318917.638472:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940386304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318917.638481:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318917.638506:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940386304:12345-0@lo:38:kworker.0 Request processed in 31us (14356us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318917.638511:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16647
00000100:00080000:0.0:1767318917.638604:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318917.638610:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318917.638614:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940386048:0@lo:38:kworker.0
00000100:00080000:0.0:1767318917.638634:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318917.638638:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318917.638641:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940386304:0@lo:38:kworker.0
00000100:00100000:3.0:1767318918.127507:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940386432:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318918.127582:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318918.127806:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386432
00000100:00100000:0.0:1767318918.127814:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386432
00000100:00100000:0.0:1767318918.127877:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264
00000100:00100000:0.0:1767318918.127888:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940386432:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318918.127918:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318918.127968:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940386432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318918.127975:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264
00000100:00100000:3.0:1767318918.128116:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940386432:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318918.252900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318918.575316:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318919.149325:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940386560:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318919.149400:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318919.149545:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386560
00000100:00100000:0.0:1767318919.149554:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386560
00000100:00100000:0.0:1767318919.149626:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265
00000100:00100000:0.0:1767318919.149636:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940386560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318919.149673:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318919.149720:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940386560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (319us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318919.149727:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265
00000100:00080000:1.0:1767318919.149886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318919.149926:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940386560:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318919.277300:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318919.597956:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318920.302696:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318920.622579:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318921.327832:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318921.645117:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318922.315681:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318922.315734:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318922.315818:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289536
00000100:00100000:0.0:1767318922.315829:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289536
00000100:00100000:0.0:1767318922.315901:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289408
00000100:00100000:0.0:1767318922.315904:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289408
00000100:00080000:2.0:1767318922.315926:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318922.315927:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4178
00000100:00100000:0.0:1767318922.315938:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894289536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318922.315943:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16648
00000100:00100000:2.0:1767318922.315948:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894289408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318922.315970:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318922.316314:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894289536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 376us (642us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318922.316324:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4178
00000100:00100000:2.0:1767318922.319053:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894289408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 3087us (3302us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318922.319069:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16648
00000100:00100000:2.0:1767318922.350941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318922.669090:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318922.733223:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318922.733233:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318922.733237:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318922.733241:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318922.733246:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318922.733254:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4167
00000100:00080000:2.0:1767318922.733259:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318922.733265:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318922.733309:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940386688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318922.733338:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318922.733342:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318922.733344:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318922.733347:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4167
00000100:00080000:2.0:1767318922.733350:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318922.733353:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318922.733367:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940386816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318922.733435:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318922.733439:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318922.733440:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318922.733444:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4167
00000100:00080000:2.0:1767318922.733447:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318922.733450:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318922.733461:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194380 x1853163940387328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318922.733476:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318922.733479:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318922.733480:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318922.733483:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4167
00000100:00080000:2.0:1767318922.733486:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318922.733489:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318922.733500:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940387584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318922.733525:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940387072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.733589:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318922.733652:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318922.733657:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940386944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.733691:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318922.733716:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940387200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.733740:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318922.733757:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318922.733761:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940387456:0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.733811:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318922.733837:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387200
00000100:00100000:2.0:1767318922.733845:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387200
00000100:00100000:2.0:1767318922.733893:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387456
00000100:00100000:2.0:1767318922.733896:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387456
00000100:00100000:2.0:1767318922.733916:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179
00000100:00100000:2.0:1767318922.733923:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940387200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.733968:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940387200:12345-0@lo:400:kworker.0 Request processed in 45us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318922.733975:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179
00000100:00100000:2.0:1767318922.733990:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4180
00000100:00100000:2.0:1767318922.733996:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940387456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.734020:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940387456:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0
00000100:00080000:1.0:1767318922.734196:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318922.734236:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4180
00000100:00100000:2.0:1767318922.734274:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940387456:0@lo:400:kworker.0
00000100:00100000:2.0:1767318922.734284:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940387200:0@lo:400:kworker.0
00000100:00100000:3.0:1767318922.734432:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387072
00000100:00100000:3.0:1767318922.734437:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387072
00000100:00100000:3.0:1767318922.734482:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386944
00000100:00100000:3.0:1767318922.734485:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386944
00000100:00100000:3.0:1767318922.734507:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731
00000100:00100000:3.0:1767318922.734513:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940387072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318922.734552:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940387072:12345-0@lo:400:kworker.0 Request processed in 38us (962us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318922.734559:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731
00000100:00100000:3.0:1767318922.734571:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732
00000100:00100000:3.0:1767318922.734576:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940386944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318922.734601:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940386944:12345-0@lo:400:kworker.0 Request processed in 24us (909us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318922.734606:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732
00000100:00100000:3.0:1767318922.734637:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940386944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318922.734645:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940387072:0@lo:400:kworker.0
00000100:00080000:1.0:1767318922.734757:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318922.734760:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318922.734812:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940386688:0@lo:38:kworker.0
00000100:00100000:0.0:1767318922.734843:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318922.734870:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940386816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318922.734891:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318922.734913:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940387328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318922.734930:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318922.734943:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940387584:0@lo:38:kworker.0
00000100:00100000:0.0:1767318922.734960:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318922.734983:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386688
00000100:00100000:0.0:1767318922.734987:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386688
00000100:00100000:0.0:1767318922.735004:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387328
00000100:00100000:0.0:1767318922.735007:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387328
00000100:00100000:0.0:1767318922.735016:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387584
00000100:00100000:0.0:1767318922.735017:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387584
00000100:00100000:1.0:1767318922.735309:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940386816
00000100:00100000:1.0:1767318922.735313:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940386816
00000100:00100000:1.0:1767318922.735336:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045
00000100:00100000:1.0:1767318922.735340:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940386816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318922.735358:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318922.735411:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940386816:12345-0@lo:38:kworker.0 Request processed in 55us (504us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318922.735418:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045
00000100:00100000:1.0:1767318922.735450:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16649
00000100:00100000:1.0:1767318922.735455:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940386688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318922.735465:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318922.735489:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940386688:12345-0@lo:38:kworker.0 Request processed in 33us (646us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318922.735495:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16649
00000100:00100000:1.0:1767318922.735508:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16650
00000100:00100000:1.0:1767318922.735511:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940387328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318922.735520:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318922.735542:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940387328:12345-0@lo:38:kworker.0 Request processed in 29us (610us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318922.735547:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16650
00000100:00080000:1.0:1767318922.735587:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318922.735593:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318922.735597:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940386688:0@lo:38:kworker.0
00000100:00080000:1.0:1767318922.735605:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318922.735609:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318922.735611:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940386816:0@lo:38:kworker.0
00000100:00080000:1.0:1767318922.735618:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318922.735622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318922.735625:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940387328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318922.735806:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16651
00000100:00100000:0.0:1767318922.735811:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940387584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318922.735821:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318922.735855:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940387584:12345-0@lo:38:kworker.0 Request processed in 42us (893us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318922.735860:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16651
00000100:00080000:0.0:1767318922.735882:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318922.735885:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318922.735888:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940387584:0@lo:38:kworker.0
00000100:00100000:3.0:1767318923.245942:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318923.245975:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940387712:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318923.246058:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318923.246378:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387712
00000100:00100000:0.0:1767318923.246387:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387712
00000100:00100000:0.0:1767318923.246437:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:0.0:1767318923.246446:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940387712:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318923.246478:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318923.246544:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940387712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (478us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318923.246552:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:3.0:1767318923.246887:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940387712:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318923.372923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318923.694283:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318924.270203:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318924.270233:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940387840:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318924.270322:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318924.270407:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387840
00000100:00100000:1.0:1767318924.270415:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387840
00000100:00100000:1.0:1767318924.270483:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267
00000100:00100000:1.0:1767318924.270493:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940387840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318924.270522:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318924.270579:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940387840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (256us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318924.270586:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267
00000100:00080000:1.0:1767318924.270607:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318924.270641:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940387840:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318924.396891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318924.720723:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318925.421027:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318925.741154:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318926.407952:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767318926.407986:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894289664 offset 0 length 520: 4
00000100:00100000:1.0:1767318926.408035:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318926.413318:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289920
00000100:00100000:3.0:1767318926.413339:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289920
00000100:00100000:3.0:1767318926.413682:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894289792
00000100:00100000:3.0:1767318926.413687:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894289792
00000100:00100000:3.0:1767318926.413724:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4181
00000100:00100000:3.0:1767318926.413740:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894289920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318926.413901:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894289920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 165us (5958us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318926.413921:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4181
00000100:00080000:1.0:1767318926.417189:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318926.422053:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16652
00000100:00100000:2.0:1767318926.422070:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894289792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318926.422113:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318926.422187:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894289792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 118us (14149us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318926.422196:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16652
00000100:00100000:2.0:1767318926.446700:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318926.765186:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318927.468936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318927.790325:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318927.853222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318927.853236:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318927.853239:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318927.853244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318927.853250:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318927.853261:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4172
00000100:00080000:0.0:1767318927.853267:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318927.853277:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318927.853335:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8380 x1853163940387968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318927.853367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318927.853371:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318927.853373:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318927.853377:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4172
00000100:00080000:0.0:1767318927.853380:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318927.853384:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318927.853399:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9c00 x1853163940388096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318927.853468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318927.853472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318927.853474:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318927.853478:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4172
00000100:00080000:0.0:1767318927.853481:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318927.853485:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318927.853496:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8a80 x1853163940388608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318927.853513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318927.853516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318927.853518:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318927.853522:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4172
00000100:00080000:0.0:1767318927.853525:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318927.853530:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767318927.853541:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940388864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318927.853976:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940388480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.854146:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940388352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318927.854257:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940388224:0@lo:400:kworker.0
00000100:00100000:3.0:1767318927.854474:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940387968:0@lo:38:kworker.0
00000100:00100000:1.0:1767318927.855472:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318927.855764:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940388736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.856196:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318927.856262:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388736
00000100:00100000:1.0:1767318927.856272:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388736
00000100:00100000:1.0:1767318927.856360:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4182
00000100:00100000:1.0:1767318927.856372:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940388736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.856434:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940388736:12345-0@lo:400:kworker.0 Request processed in 64us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318927.856447:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4182
00000100:00080000:1.0:1767318927.856475:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318927.856515:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940388736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.856558:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388352
00000100:00100000:1.0:1767318927.856562:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388352
00000100:00100000:1.0:1767318927.856600:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733
00000100:00100000:1.0:1767318927.856607:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940388352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.856646:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940388352:12345-0@lo:400:kworker.0 Request processed in 40us (1179us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318927.856652:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733
00000100:00080000:1.0:1767318927.856666:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318927.856686:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940388352:0@lo:400:kworker.0
00000100:00100000:0.0:1767318927.859710:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318927.860007:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388480
00000100:00100000:1.0:1767318927.860019:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388480
00000100:00100000:1.0:1767318927.860126:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183
00000100:00100000:1.0:1767318927.860138:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940388480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318927.860210:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940388480:12345-0@lo:400:kworker.0 Request processed in 74us (513us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318927.860218:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183
00000100:00080000:0.0:1767318927.860301:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318927.860348:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940388480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318927.860508:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318927.860599:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388224
00000100:00100000:1.0:1767318927.860604:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388224
00000100:00100000:1.0:1767318927.860695:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734
00000100:00100000:1.0:1767318927.860704:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940388224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318927.860729:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318927.860759:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940388224:12345-0@lo:400:kworker.0 Request processed in 55us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318927.860767:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940388096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318927.860768:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734
00000100:00100000:2.0:1767318927.860870:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940388224:0@lo:400:kworker.0
00000100:00100000:2.0:1767318927.860915:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940387968
00000100:00100000:2.0:1767318927.860919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940387968
00000100:00100000:2.0:1767318927.860951:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16653
00000100:00100000:2.0:1767318927.860956:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940387968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318927.860981:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318927.861239:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318927.861314:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318927.861334:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940387968:12345-0@lo:38:kworker.0 Request processed in 374us (604us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318927.861342:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16653
00000100:00100000:0.0:1767318927.861399:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388096
00000100:00100000:0.0:1767318927.861403:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388096
00000100:00100000:3.0:1767318927.861425:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940388608:0@lo:38:kworker.0
00000100:00100000:0.0:1767318927.861441:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046
00000100:00100000:0.0:1767318927.861448:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940388096:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318927.861458:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767318927.861462:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318927.861476:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940388864:0@lo:38:kworker.0
00000100:00100000:0.0:1767318927.861500:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940388096:12345-0@lo:38:kworker.0 Request processed in 52us (186us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318927.861508:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046
00000100:00100000:2.0:1767318927.861598:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388608
00000100:00100000:2.0:1767318927.861603:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388608
00000100:00100000:3.0:1767318927.861660:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318927.861663:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16654
00000100:00100000:2.0:1767318927.861669:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940388608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318927.861685:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318927.861717:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940388608:12345-0@lo:38:kworker.0 Request processed in 46us (260us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318927.861723:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16654
00000100:00100000:2.0:1767318927.861852:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388864
00000100:00100000:2.0:1767318927.861856:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388864
00000100:00100000:2.0:1767318927.861886:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16655
00000100:00100000:2.0:1767318927.861890:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940388864:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318927.861900:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318927.861925:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940388864:12345-0@lo:38:kworker.0 Request processed in 34us (266us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318927.861931:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16655
00000100:00080000:3.0:1767318927.861964:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318927.861972:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318927.861977:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940387968:0@lo:38:kworker.0
00000100:00080000:3.0:1767318927.862001:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318927.862004:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318927.862007:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940388096:0@lo:38:kworker.0
00000100:00080000:3.0:1767318927.862016:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318927.862019:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318927.862022:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940388608:0@lo:38:kworker.0
00000100:00080000:3.0:1767318927.862028:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318927.862031:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318927.862034:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940388864:0@lo:38:kworker.0
00000100:00100000:1.0:1767318928.365153:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318928.365192:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940388992:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318928.365292:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318928.372945:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940388992
00000100:00100000:0.0:1767318928.372968:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940388992
00000100:00100000:0.0:1767318928.373054:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268
00000100:00100000:0.0:1767318928.373066:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940388992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318928.373129:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318928.373264:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940388992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (7972us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318928.373274:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268
00000100:00100000:2.0:1767318928.373486:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940388992:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318928.492945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318928.813089:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318929.389301:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940389120:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318929.389382:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318929.389543:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389120
00000100:00100000:1.0:1767318929.389551:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389120
00000100:00100000:1.0:1767318929.389619:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767318929.389629:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940389120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318929.389671:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318929.389732:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940389120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (349us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318929.389740:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767318929.389805:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940389120:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318929.394526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318929.517696:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318929.837447:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318930.541537:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318930.862204:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318931.526195:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318931.527689:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318931.536456:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290176
00000100:00100000:2.0:1767318931.536472:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290176
00000100:00080000:3.0:1767318931.536587:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318931.536844:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290048
00000100:00100000:2.0:1767318931.536849:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290048
00000100:00100000:2.0:1767318931.536889:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4184
00000100:00100000:2.0:1767318931.536900:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318931.536997:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (10811us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318931.537006:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4184
00000100:00100000:2.0:1767318931.537027:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16656
00000100:00100000:2.0:1767318931.537031:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894290048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318931.537066:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318931.537093:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894290048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (9409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318931.537099:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16656
00000100:00100000:2.0:1767318931.565142:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318931.887562:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318932.588919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318932.909110:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318932.973428:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318907/real 1767318907]  req@ffff93cf45221500 x1853163940382720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318932 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318932.973465:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45221500 x1853163940382720/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318932 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318932.973486:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318932.973495:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318932.973498:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940382720:0@lo:250:kworker.0
00000100:00080000:2.0:1767318932.973577:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318932.973582:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318932.973585:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318932.973590:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4157
00000100:00080000:2.0:1767318932.973600:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318932.973606:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318932.973643:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940389248/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318932.973669:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318932.973673:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318932.973675:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318932.973678:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4177
00000100:00080000:2.0:1767318932.973681:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318932.973685:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318932.973702:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194380 x1853163940389376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318932.973711:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318932.973714:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318932.973715:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318932.973718:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4177
00000100:00080000:2.0:1767318932.973720:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318932.973723:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318932.973735:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940389504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318932.973832:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318932.973835:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318932.973837:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318932.973841:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4177
00000100:00080000:2.0:1767318932.973844:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318932.973847:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318932.973858:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196300 x1853163940390016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318932.973874:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318932.973876:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318932.973878:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318932.973881:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4177
00000100:00080000:2.0:1767318932.973884:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318932.973887:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318932.973898:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00380 x1853163940390272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318932.973933:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940389888:0@lo:400:kworker.0
00000100:00100000:2.0:1767318932.973997:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318932.974054:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318932.974060:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940390144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318932.974080:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318932.974204:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940389632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974236:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318932.974264:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318932.974270:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940389760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974288:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318932.974321:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389632
00000100:00100000:1.0:1767318932.974328:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389632
00000100:00100000:1.0:1767318932.974376:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389760
00000100:00100000:1.0:1767318932.974379:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389760
00000100:00100000:1.0:1767318932.974396:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735
00000100:00100000:1.0:1767318932.974403:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940389632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974452:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940389632:12345-0@lo:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318932.974460:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735
00000100:00100000:1.0:1767318932.974474:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736
00000100:00100000:1.0:1767318932.974480:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940389760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974505:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940389760:12345-0@lo:400:kworker.0 Request processed in 25us (216us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318932.974510:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736
00000100:00080000:1.0:1767318932.974525:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318932.974528:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318932.974554:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940389760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974564:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940389632:0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974582:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389888
00000100:00100000:1.0:1767318932.974585:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389888
00000100:00080000:1.0:1767318932.974600:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318932.974620:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390144
00000100:00100000:1.0:1767318932.974624:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390144
00000100:00080000:1.0:1767318932.974635:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318932.974651:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4185
00000100:00100000:1.0:1767318932.974657:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940389888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974689:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940389888:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318932.974695:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4185
00000100:00100000:1.0:1767318932.974707:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4186
00000100:00100000:1.0:1767318932.974713:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940390144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318932.974746:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940390144:12345-0@lo:400:kworker.0 Request processed in 25us (656us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318932.974753:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4186
00000100:00100000:2.0:1767318932.975119:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940390144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318932.975128:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940389888:0@lo:400:kworker.0
00000100:00100000:0.0:1767318932.975381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940389248:0@lo:250:kworker.0
00000400:00000100:0.0:1767318932.975411:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940389248 offset 0 length 520: 4
00000100:00100000:0.0:1767318932.975433:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940389376:0@lo:38:kworker.0
00000100:00100000:0.0:1767318932.975455:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318932.975477:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940389504:0@lo:38:kworker.0
00000100:00100000:0.0:1767318932.975498:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318932.975518:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940390016:0@lo:38:kworker.0
00000100:00100000:0.0:1767318932.975537:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318932.975550:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940390272:0@lo:38:kworker.0
00000100:00100000:0.0:1767318932.975568:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318932.976262:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389376
00000100:00100000:3.0:1767318932.976269:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389376
00000100:00100000:3.0:1767318932.976295:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390016
00000100:00100000:3.0:1767318932.976298:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390016
00000100:00100000:3.0:1767318932.976305:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390272
00000100:00100000:3.0:1767318932.976307:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390272
00000100:00100000:3.0:1767318932.976317:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16657
00000100:00100000:3.0:1767318932.976323:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940389376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318932.976343:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318932.976393:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940389376:12345-0@lo:38:kworker.0 Request processed in 69us (937us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318932.976400:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16657
00000100:00100000:3.0:1767318932.976415:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16658
00000100:00100000:3.0:1767318932.976418:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940390016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318932.976427:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318932.976446:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940390016:12345-0@lo:38:kworker.0 Request processed in 27us (909us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318932.976452:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16658
00000100:00100000:3.0:1767318932.976462:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16659
00000100:00100000:3.0:1767318932.976466:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940390272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318932.976474:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318932.976495:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940390272:12345-0@lo:38:kworker.0 Request processed in 28us (926us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318932.976501:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16659
00000100:00080000:3.0:1767318932.976531:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318932.976536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318932.976540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940389376:0@lo:38:kworker.0
00000100:00080000:3.0:1767318932.976548:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318932.976551:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318932.976554:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940390016:0@lo:38:kworker.0
00000100:00080000:3.0:1767318932.976562:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318932.976564:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318932.976567:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940390272:0@lo:38:kworker.0
00000100:00100000:1.0:1767318932.976658:0:15472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940389504
00000100:00100000:1.0:1767318932.976663:0:15472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940389504
00000100:00100000:1.0:1767318932.976696:0:15472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047
00000100:00100000:1.0:1767318932.976701:0:15472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940389504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318932.976710:0:15472:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318932.976742:0:15472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:7024:x1853163940389504:12345-0@lo:38:kworker.0 Request processed in 39us (1242us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318932.976747:0:15472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047
00000100:00080000:3.0:1767318932.977174:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318932.977179:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318932.977183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940389504:0@lo:38:kworker.0
00000100:00100000:3.0:1767318933.485100:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318933.485130:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940390400:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318933.485217:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318933.485504:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390400
00000100:00100000:0.0:1767318933.485514:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390400
00000100:00100000:0.0:1767318933.485577:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270
00000100:00100000:0.0:1767318933.485587:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940390400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318933.485631:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318933.485685:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940390400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (468us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318933.485692:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270
00000100:00100000:3.0:1767318933.485832:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940390400:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318933.614625:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318933.933395:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318934.509685:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318934.509708:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940390528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318934.509796:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318934.509919:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390528
00000100:00100000:3.0:1767318934.509926:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390528
00000100:00100000:3.0:1767318934.509987:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271
00000100:00100000:3.0:1767318934.509997:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940390528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318934.510037:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318934.510077:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940390528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318934.510083:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271
00000100:00100000:2.0:1767318934.510217:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940390528:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318934.510521:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318934.639248:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318934.957563:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318935.660897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318935.984324:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318936.647268:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318936.647829:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318936.647909:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290304
00000100:00100000:2.0:1767318936.647921:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290432
00000100:00100000:3.0:1767318936.647921:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290304
00000100:00100000:2.0:1767318936.647928:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290432
00000100:00100000:3.0:1767318936.647976:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16660
00000100:00100000:3.0:1767318936.647983:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894290304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318936.648016:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318936.648136:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894290304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 150us (885us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318936.648145:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16660
00000100:00100000:3.0:1767318936.648167:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4187
00000100:00100000:3.0:1767318936.648180:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767318936.648219:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318936.648226:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4187
00000100:00080000:0.0:1767318936.651148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318936.684947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318937.009740:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318937.708973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318938.034325:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318938.093097:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318938.093108:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318938.093111:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318938.093115:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318938.093120:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318938.093128:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4183
00000100:00080000:2.0:1767318938.093133:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318938.093140:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318938.093179:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01500 x1853163940390656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318938.093209:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318938.093213:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318938.093215:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318938.093219:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4183
00000100:00080000:2.0:1767318938.093221:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318938.093225:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318938.093238:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a02d80 x1853163940390784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318938.093320:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318938.093323:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318938.093325:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318938.093328:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4183
00000100:00080000:2.0:1767318938.093330:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318938.093334:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318938.093344:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059880 x1853163940391296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318938.093359:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318938.093362:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318938.093364:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318938.093367:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4183
00000100:00080000:2.0:1767318938.093369:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318938.093373:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318938.093384:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940391552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318938.093413:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940391168:0@lo:400:kworker.0
00000100:00100000:1.0:1767318938.093414:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940391040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318938.093482:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940390656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318938.093488:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940390912:0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.108267:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318938.108353:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318938.108368:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940391424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.108402:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318938.108445:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391168
00000100:00100000:2.0:1767318938.108454:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391168
00000100:00100000:2.0:1767318938.108519:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391424
00000100:00100000:2.0:1767318938.108523:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391424
00000100:00100000:2.0:1767318938.108558:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4188
00000100:00100000:2.0:1767318938.108566:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940391168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.108621:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940391168:12345-0@lo:400:kworker.0 Request processed in 56us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318938.108629:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4188
00000100:00100000:2.0:1767318938.108645:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1767318938.108651:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940391424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.108677:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940391424:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318938.108682:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1767318938.108727:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940391424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.108738:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940391168:0@lo:400:kworker.0
00000100:00080000:2.0:1767318938.108816:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318938.119187:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318938.119392:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391040
00000100:00100000:2.0:1767318938.119403:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391040
00000100:00100000:2.0:1767318938.119486:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737
00000100:00100000:2.0:1767318938.119498:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940391040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.119574:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940391040:12345-0@lo:400:kworker.0 Request processed in 78us (395us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318938.119583:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737
00000100:00100000:1.0:1767318938.119607:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940391040:0@lo:400:kworker.0
00000100:00080000:2.0:1767318938.119609:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318938.119865:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318938.119900:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940390784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318938.119936:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318938.119953:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940391296:0@lo:38:kworker.0
00000100:00100000:3.0:1767318938.119976:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318938.120016:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390656
00000100:00100000:3.0:1767318938.120021:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390656
00000100:00100000:3.0:1767318938.120045:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391296
00000100:00100000:3.0:1767318938.120049:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391296
00000100:00100000:3.0:1767318938.120067:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16661
00000100:00100000:3.0:1767318938.120072:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940390656:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318938.120093:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318938.120127:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940390656:12345-0@lo:38:kworker.0 Request processed in 54us (263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318938.120133:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16661
00000100:00100000:3.0:1767318938.120147:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16662
00000100:00100000:3.0:1767318938.120151:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940391296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318938.120161:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318938.120184:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940391296:12345-0@lo:38:kworker.0 Request processed in 30us (207us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318938.120193:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16662
00000100:00080000:3.0:1767318938.120224:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318938.120229:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318938.120233:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940391296:0@lo:38:kworker.0
00000100:00100000:3.0:1767318938.120239:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940391552:0@lo:38:kworker.0
00000100:00100000:3.0:1767318938.120663:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318938.120734:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318938.120738:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318938.120742:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940390656:0@lo:38:kworker.0
00000100:00100000:1.0:1767318938.121300:0:15473:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390784
00000100:00100000:1.0:1767318938.121307:0:15473:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390784
00000100:00100000:1.0:1767318938.121348:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048
00000100:00100000:1.0:1767318938.121353:0:15473:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0593d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940390784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318938.121369:0:15473:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318938.121418:0:15473:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0593d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7024:x1853163940390784:12345-0@lo:38:kworker.0 Request processed in 63us (1481us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318938.121425:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048
00000100:00080000:3.0:1767318938.121973:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318938.121980:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318938.121998:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940390784:0@lo:38:kworker.0
00000100:00100000:2.0:1767318938.125362:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391552
00000100:00100000:2.0:1767318938.125376:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391552
00000100:00100000:2.0:1767318938.125435:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16663
00000100:00100000:2.0:1767318938.125444:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940391552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318938.125469:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318938.125557:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940391552:12345-0@lo:38:kworker.0 Request processed in 113us (4893us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318938.125564:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16663
00000100:00080000:1.0:1767318938.125950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318938.125958:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318938.125962:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940391552:0@lo:38:kworker.0
00000100:00100000:0.0:1767318938.126526:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318938.126943:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940390912
00000100:00100000:2.0:1767318938.126950:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940390912
00000100:00100000:2.0:1767318938.127031:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738
00000100:00100000:2.0:1767318938.127040:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940390912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318938.127117:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940390912:12345-0@lo:400:kworker.0 Request processed in 78us (593us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318938.127124:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738
00000100:00080000:0.0:1767318938.129185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318938.130175:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940390912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318938.606428:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940391680:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318938.606514:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318938.606754:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391680
00000100:00100000:3.0:1767318938.606765:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391680
00000100:00100000:3.0:1767318938.606849:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272
00000100:00100000:3.0:1767318938.606859:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940391680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318938.606889:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318938.606947:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940391680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (433us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318938.606955:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272
00000100:00100000:1.0:1767318938.607057:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940391680:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318938.733518:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318939.053032:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318939.629187:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940391808:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318939.629257:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318939.629500:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391808
00000100:00100000:0.0:1767318939.629508:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391808
00000100:00100000:0.0:1767318939.629566:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273
00000100:00100000:0.0:1767318939.629574:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940391808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318939.629603:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318939.630878:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940391808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1298us (1614us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318939.630890:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273
00000100:00100000:2.0:1767318939.631065:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940391808:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318939.757728:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318940.077608:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318940.781085:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318941.101083:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318941.771453:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318941.771549:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290560
00000100:00100000:3.0:1767318941.771560:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290560
00000100:00100000:3.0:1767318941.771615:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16664
00000100:00100000:3.0:1767318941.771622:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894290560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318941.771647:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318941.771722:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894290560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 98us (278us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318941.771729:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16664
00000100:00100000:1.0:1767318941.781222:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318941.781491:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290688
00000100:00100000:2.0:1767318941.781501:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290688
00000100:00100000:2.0:1767318941.781587:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4190
00000100:00100000:2.0:1767318941.781597:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318941.781684:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894290688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318941.781692:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4190
00000100:00080000:0.0:1767318941.781983:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318941.806206:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318942.125604:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318942.829699:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318943.149980:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318943.213456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318943.213466:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318943.213469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318943.213473:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318943.213478:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318943.213486:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4188
00000100:00080000:3.0:1767318943.213491:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318943.213499:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318943.213551:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1f80 x1853163940391936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318943.213583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318943.213588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318943.213589:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318943.213593:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4188
00000100:00080000:3.0:1767318943.213596:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318943.213599:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318943.213613:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940392064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318943.213693:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318943.213697:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318943.213698:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318943.213701:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4188
00000100:00080000:3.0:1767318943.213703:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318943.213707:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318943.213717:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0e00 x1853163940392576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318943.213732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318943.213734:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318943.213736:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318943.213739:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4188
00000100:00080000:3.0:1767318943.213741:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318943.213744:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318943.213753:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3480 x1853163940392832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318943.213802:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940392448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318943.213875:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318943.213963:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318943.213970:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940392704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318943.213992:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318943.214024:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392448
00000100:00100000:3.0:1767318943.214032:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392448
00000100:00100000:3.0:1767318943.214084:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392704
00000100:00100000:3.0:1767318943.214087:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392704
00000100:00100000:3.0:1767318943.214113:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4191
00000100:00100000:3.0:1767318943.214121:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940392448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318943.214168:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940392448:12345-0@lo:400:kworker.0 Request processed in 48us (294us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318943.214177:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4191
00000100:00100000:3.0:1767318943.214195:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4192
00000100:00100000:3.0:1767318943.214201:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940392704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318943.214231:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940392704:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318943.214237:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4192
00000100:00100000:3.0:1767318943.214301:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940392704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318943.214312:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940392448:0@lo:400:kworker.0
00000100:00100000:0.0:1767318943.214964:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392320:0@lo:400:kworker.0
00000100:00100000:0.0:1767318943.215016:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318943.215055:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318943.215062:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318943.215083:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318943.215110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318943.215261:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392320
00000100:00100000:2.0:1767318943.215269:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392320
00000100:00100000:2.0:1767318943.215317:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392192
00000100:00100000:2.0:1767318943.215321:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392192
00000100:00100000:2.0:1767318943.215345:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739
00000100:00100000:2.0:1767318943.215353:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318943.215397:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392320:12345-0@lo:400:kworker.0 Request processed in 45us (379us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318943.215404:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739
00000100:00100000:2.0:1767318943.215418:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740
00000100:00100000:2.0:1767318943.215423:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318943.215464:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392192:12345-0@lo:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318943.215470:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740
00000100:00100000:2.0:1767318943.215506:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392192:0@lo:400:kworker.0
00000100:00100000:2.0:1767318943.215529:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392320:0@lo:400:kworker.0
00000100:00080000:0.0:1767318943.216165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318943.216171:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318943.216361:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940391936:0@lo:38:kworker.0
00000100:00100000:1.0:1767318943.216412:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318943.216457:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940392064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318943.216484:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318943.216518:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940392576:0@lo:38:kworker.0
00000100:00100000:1.0:1767318943.216542:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318943.216569:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940392832:0@lo:38:kworker.0
00000100:00100000:1.0:1767318943.216591:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318943.216642:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940391936
00000100:00100000:1.0:1767318943.216648:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940391936
00000100:00100000:1.0:1767318943.216676:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392576
00000100:00100000:1.0:1767318943.216679:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392576
00000100:00100000:1.0:1767318943.216693:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392832
00000100:00100000:1.0:1767318943.216695:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392832
00000100:00100000:1.0:1767318943.216712:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16665
00000100:00100000:1.0:1767318943.216717:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940391936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318943.216739:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318943.216806:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940391936:12345-0@lo:38:kworker.0 Request processed in 87us (393us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318943.216813:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16665
00000100:00100000:1.0:1767318943.216828:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16666
00000100:00100000:1.0:1767318943.216831:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940392576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318943.216840:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318943.216864:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940392576:12345-0@lo:38:kworker.0 Request processed in 31us (322us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318943.216869:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16666
00000100:00100000:1.0:1767318943.216880:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16667
00000100:00100000:1.0:1767318943.216883:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940392832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318943.216892:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318943.217228:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318943.217235:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318943.217239:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940391936:0@lo:38:kworker.0
00000100:00080000:0.0:1767318943.217258:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318943.217262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318943.217265:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940392576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318943.217428:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392064
00000100:00100000:3.0:1767318943.217434:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392064
00000100:00100000:3.0:1767318943.217464:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0
00000100:00100000:3.0:1767318943.217469:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940392064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318943.217481:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318943.217795:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940392064:12345-0@lo:38:kworker.0 Request processed in 323us (1308us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318943.217802:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0
00000100:00100000:1.0:1767318943.220583:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940392832:12345-0@lo:38:kworker.0 Request processed in 3686us (3980us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318943.220600:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16667
00000100:00080000:0.0:1767318943.225473:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318943.225488:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318943.225493:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940392064:0@lo:38:kworker.0
00000100:00080000:0.0:1767318943.225646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318943.225651:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318943.225655:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940392832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318943.730257:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318943.730332:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392960:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318943.730486:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318943.736614:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940392960
00000100:00100000:0.0:1767318943.736628:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940392960
00000100:00100000:0.0:1767318943.736752:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274
00000100:00100000:0.0:1767318943.736765:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318943.736812:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318943.736893:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940392960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (6407us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318943.736898:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274
00000100:00100000:3.0:1767318943.737026:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940392960:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318943.852975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318944.173098:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318944.749197:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318944.749224:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940393088:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318944.749304:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318944.749628:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393088
00000100:00100000:1.0:1767318944.749636:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393088
00000100:00100000:1.0:1767318944.749686:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275
00000100:00100000:1.0:1767318944.749694:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940393088:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318944.749723:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318944.749771:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940393088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318944.749800:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275
00000100:00100000:0.0:1767318944.750089:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940393088:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318944.876909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318945.196963:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318945.904815:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318946.222261:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318946.891190:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318946.891238:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318946.891430:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290944
00000100:00100000:1.0:1767318946.891441:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290944
00000100:00100000:1.0:1767318946.891523:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894290816
00000100:00100000:1.0:1767318946.891527:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894290816
00000100:00100000:1.0:1767318946.891545:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4193
00000100:00100000:1.0:1767318946.891554:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894290944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318946.891768:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16668
00000100:00100000:2.0:1767318946.891822:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894290816:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767318946.891844:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894290944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 288us (661us total) trans 0 rc 0/0
00010000:00020000:2.0:1767318946.891846:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318946.891859:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4193
00000100:00100000:2.0:1767318946.891885:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894290816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 63us (644us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318946.891893:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16668
00000100:00080000:0.0:1767318946.892585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318946.924889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318947.250329:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318947.948931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318948.269044:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318948.333270:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318948.333280:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318948.333283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318948.333287:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318948.333291:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318948.333299:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4193
00000100:00080000:1.0:1767318948.333304:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318948.333311:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318948.333353:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940393216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318948.333640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318948.333644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318948.333646:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318948.333650:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4193
00000100:00080000:1.0:1767318948.333652:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318948.333656:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318948.333673:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ea680 x1853163940393344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318948.333735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318948.333739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318948.333741:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318948.333744:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4193
00000100:00080000:1.0:1767318948.333746:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318948.333750:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318948.333761:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99c00 x1853163940393856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318948.333796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318948.333799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318948.333801:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318948.333804:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4193
00000100:00080000:1.0:1767318948.333806:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318948.333810:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318948.333822:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01c00 x1853163940394112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318948.333881:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940393600:0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.333964:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318948.334024:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318948.334029:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940393472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334063:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318948.334100:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940393984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334126:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318948.334469:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318948.334474:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940393728:0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334493:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318948.334522:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393600
00000100:00100000:1.0:1767318948.334528:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393600
00000100:00100000:1.0:1767318948.334570:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393472
00000100:00100000:1.0:1767318948.334572:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393472
00000100:00100000:1.0:1767318948.334587:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741
00000100:00100000:1.0:1767318948.334593:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940393600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334630:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940393600:12345-0@lo:400:kworker.0 Request processed in 37us (667us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318948.334634:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741
00000100:00100000:1.0:1767318948.334645:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742
00000100:00100000:1.0:1767318948.334648:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940393472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334663:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940393472:12345-0@lo:400:kworker.0 Request processed in 15us (601us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318948.334666:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742
00000100:00100000:1.0:1767318948.334696:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940393472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318948.334703:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940393600:0@lo:400:kworker.0
00000100:00100000:0.0:1767318948.336296:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393984
00000100:00100000:0.0:1767318948.336307:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393984
00000100:00100000:0.0:1767318948.336372:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393728
00000100:00100000:0.0:1767318948.336376:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393728
00000100:00100000:0.0:1767318948.336409:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4194
00000100:00100000:0.0:1767318948.336416:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940393984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318948.336495:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940393984:12345-0@lo:400:kworker.0 Request processed in 80us (2367us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318948.336501:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4194
00000100:00100000:0.0:1767318948.336516:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4195
00000100:00100000:0.0:1767318948.336522:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940393728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318948.336546:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940393728:12345-0@lo:400:kworker.0 Request processed in 24us (2051us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318948.336551:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4195
00000100:00080000:0.0:1767318948.336565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318948.336569:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318948.336571:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318948.336600:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940393728:0@lo:400:kworker.0
00000100:00100000:0.0:1767318948.336608:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940393984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318948.341338:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940393216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318948.341418:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318948.341463:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940393344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318948.341487:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318948.341517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940393856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318948.341540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318948.341570:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940394112:0@lo:38:kworker.0
00000100:00100000:2.0:1767318948.341591:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318948.341636:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393216
00000100:00100000:2.0:1767318948.341644:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393216
00000100:00100000:2.0:1767318948.341676:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393856
00000100:00100000:2.0:1767318948.341679:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393856
00000100:00100000:2.0:1767318948.341691:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394112
00000100:00100000:2.0:1767318948.341694:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394112
00000100:00100000:2.0:1767318948.341711:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16669
00000100:00100000:2.0:1767318948.341718:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940393216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318948.341743:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318948.341810:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940393216:12345-0@lo:38:kworker.0 Request processed in 91us (391us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318948.341818:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16669
00000100:00100000:3.0:1767318948.341965:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16670
00000100:00100000:3.0:1767318948.341971:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940393856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318948.341982:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318948.342012:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940393856:12345-0@lo:38:kworker.0 Request processed in 40us (471us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318948.342017:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16670
00000100:00100000:3.0:1767318948.342033:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16671
00000100:00100000:3.0:1767318948.342037:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940394112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318948.342045:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318948.342064:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940394112:12345-0@lo:38:kworker.0 Request processed in 26us (473us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318948.342069:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16671
00000100:00080000:3.0:1767318948.342142:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318948.342147:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318948.342151:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940393216:0@lo:38:kworker.0
00000100:00080000:3.0:1767318948.342160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318948.342163:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318948.342166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940393856:0@lo:38:kworker.0
00000100:00080000:3.0:1767318948.342172:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318948.342175:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318948.342177:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940394112:0@lo:38:kworker.0
00000100:00100000:1.0:1767318948.342451:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940393344
00000100:00100000:1.0:1767318948.342457:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940393344
00000100:00100000:1.0:1767318948.342495:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1
00000100:00100000:1.0:1767318948.342501:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940393344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318948.342512:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318948.342560:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940393344:12345-0@lo:38:kworker.0 Request processed in 59us (1071us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318948.342566:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1
00000100:00080000:2.0:1767318948.342662:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318948.342667:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318948.342670:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940393344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318948.845586:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940394240:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318948.845670:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318948.845810:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394240
00000100:00100000:0.0:1767318948.845826:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394240
00000100:00100000:0.0:1767318948.845875:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276
00000100:00100000:0.0:1767318948.845884:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940394240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318948.845922:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318948.845976:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940394240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318948.845984:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276
00000100:00100000:3.0:1767318948.846834:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940394240:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318948.974437:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318949.295754:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318949.871253:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318949.871276:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940394368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318949.871345:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318949.871428:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394368
00000100:00100000:2.0:1767318949.871437:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394368
00000100:00100000:2.0:1767318949.871501:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277
00000100:00100000:2.0:1767318949.871510:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940394368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318949.871539:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318949.871601:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940394368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318949.871607:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277
00000100:00100000:3.0:1767318949.871747:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940394368:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318949.996913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318950.317606:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1767318950.985215:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894291072 offset 0 length 520: 4
00000100:00100000:0.0:1767318950.991467:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318950.991655:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291200
00000100:00100000:3.0:1767318950.991660:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318950.991667:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291200
00000100:00100000:2.0:1767318950.991738:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291328
00000100:00100000:2.0:1767318950.991742:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291328
00000100:00100000:2.0:1767318950.991834:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4196
00000100:00100000:2.0:1767318950.991845:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894291328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318950.991934:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894291328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318950.991941:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4196
00000100:00100000:2.0:1767318950.991960:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16672
00000100:00100000:2.0:1767318950.991964:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894291200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318950.991986:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318950.992013:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894291200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (556us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318950.992019:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16672
00000100:00080000:3.0:1767318950.992042:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318951.020987:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318951.341044:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318952.044902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318952.365104:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318953.068981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318953.389126:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318953.454793:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318953.454804:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318953.454807:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318953.454811:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318953.454815:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318953.454823:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4198
00000100:00080000:2.0:1767318953.454829:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318953.454836:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318953.454976:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940394496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318953.455003:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318953.455007:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318953.455009:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318953.455012:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4198
00000100:00080000:2.0:1767318953.455014:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318953.455017:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318953.455031:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940394624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318953.455085:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318953.455090:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318953.455092:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318953.455095:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4198
00000100:00080000:2.0:1767318953.455098:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318953.455102:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318953.455115:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839f80 x1853163940395136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318953.455129:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318953.455132:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318953.455133:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318953.455137:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4198
00000100:00080000:2.0:1767318953.455139:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318953.455142:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318953.455151:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b800 x1853163940395392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318953.455176:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940395264:0@lo:400:kworker.0
00000100:00100000:2.0:1767318953.455248:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318953.455312:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318953.455319:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940395008:0@lo:400:kworker.0
00000100:00100000:2.0:1767318953.455340:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318953.455486:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940394752:0@lo:400:kworker.0
00000100:00100000:3.0:1767318953.455522:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318953.455559:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318953.455565:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940394880:0@lo:400:kworker.0
00000100:00100000:3.0:1767318953.455585:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318953.455623:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394752
00000100:00100000:3.0:1767318953.455644:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394752
00000100:00100000:3.0:1767318953.455704:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394880
00000100:00100000:3.0:1767318953.455708:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394880
00000100:00100000:3.0:1767318953.455728:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743
00000100:00100000:3.0:1767318953.455738:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940394752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318953.455814:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940394752:12345-0@lo:400:kworker.0 Request processed in 78us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318953.455823:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743
00000100:00100000:3.0:1767318953.455844:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744
00000100:00100000:3.0:1767318953.455863:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940394880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318953.455890:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940394880:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318953.455896:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744
00000100:00080000:3.0:1767318953.455918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318953.455922:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318953.455949:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940394880:0@lo:400:kworker.0
00000100:00100000:3.0:1767318953.455959:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940394752:0@lo:400:kworker.0
00000100:00100000:0.0:1767318953.456144:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395264
00000100:00100000:0.0:1767318953.456148:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395264
00000100:00100000:0.0:1767318953.456206:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395008
00000100:00100000:0.0:1767318953.456210:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395008
00000100:00100000:0.0:1767318953.456233:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4197
00000100:00100000:0.0:1767318953.456240:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940395264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318953.456282:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940395264:12345-0@lo:400:kworker.0 Request processed in 43us (1033us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318953.456289:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4197
00000100:00100000:0.0:1767318953.456302:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4198
00000100:00100000:0.0:1767318953.456308:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940395008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318953.456336:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940395008:12345-0@lo:400:kworker.0 Request processed in 29us (995us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318953.456342:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4198
00000100:00100000:0.0:1767318953.456374:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940395008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318953.456384:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940395264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318953.456410:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940394496:0@lo:38:kworker.0
00000100:00100000:0.0:1767318953.456437:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318953.456454:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940394624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318953.456478:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318953.456496:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940395136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318953.456516:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318953.456530:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940395392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318953.456548:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318953.456579:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394624
00000100:00100000:0.0:1767318953.456583:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394624
00000100:00100000:0.0:1767318953.456600:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2
00000100:00100000:0.0:1767318953.456604:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940394624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318953.456624:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318953.456675:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940394624:12345-0@lo:38:kworker.0 Request processed in 68us (196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318953.456681:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2
00000100:00100000:0.0:1767318953.456696:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940394496
00000100:00100000:0.0:1767318953.456700:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940394496
00000100:00100000:0.0:1767318953.456718:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395136
00000100:00100000:0.0:1767318953.456721:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395136
00000100:00100000:0.0:1767318953.456732:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395392
00000100:00100000:0.0:1767318953.456734:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395392
00000100:00100000:0.0:1767318953.456744:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16673
00000100:00100000:0.0:1767318953.456748:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940394496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318953.456758:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318953.456808:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940394496:12345-0@lo:38:kworker.0 Request processed in 58us (370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318953.456814:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16673
00000100:00100000:0.0:1767318953.456826:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16674
00000100:00100000:0.0:1767318953.456830:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940395136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318953.456839:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318953.456875:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940395136:12345-0@lo:38:kworker.0 Request processed in 43us (358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318953.456881:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16674
00000100:00100000:0.0:1767318953.456892:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16675
00000100:00100000:0.0:1767318953.456896:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940395392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318953.456905:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318953.456928:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940395392:12345-0@lo:38:kworker.0 Request processed in 31us (379us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318953.456934:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16675
00000100:00080000:0.0:1767318953.456970:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318953.456975:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318953.456979:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940394496:0@lo:38:kworker.0
00000100:00080000:0.0:1767318953.456987:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318953.456990:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318953.456993:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940394624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318953.457000:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318953.457003:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318953.457006:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940395136:0@lo:38:kworker.0
00000100:00080000:0.0:1767318953.457012:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318953.457016:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318953.457018:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940395392:0@lo:38:kworker.0
00000100:00080000:3.0:1767318953.458651:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318953.967364:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318953.967389:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940395520:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318953.967861:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318953.971221:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395520
00000100:00100000:0.0:1767318953.971237:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395520
00000100:00100000:0.0:1767318953.971457:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278
00000100:00100000:0.0:1767318953.971472:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940395520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318953.971509:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318953.971601:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940395520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (3741us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318953.971608:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278
00000100:00100000:1.0:1767318953.971707:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940395520:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318954.092913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318954.414214:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318954.989530:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940395648:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318954.989597:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318954.990884:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395648
00000100:00100000:3.0:1767318954.990895:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395648
00000100:00100000:3.0:1767318954.990957:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279
00000100:00100000:3.0:1767318954.990967:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940395648:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318954.990999:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318954.991069:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940395648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1471us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318954.991077:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279
00000100:00100000:1.0:1767318954.991298:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940395648:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318955.117604:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318955.437965:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318956.102003:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318956.102095:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291584
00000100:00100000:1.0:1767318956.102105:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291584
00000100:00100000:1.0:1767318956.102188:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4199
00000100:00100000:1.0:1767318956.102198:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894291584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767318956.102212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318956.102287:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894291584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (297us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318956.102296:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4199
00000100:00100000:0.0:1767318956.105020:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318956.105277:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291456
00000100:00100000:1.0:1767318956.105287:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291456
00000100:00100000:1.0:1767318956.105349:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16676
00000100:00100000:1.0:1767318956.105359:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894291456:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318956.105388:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318956.105448:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894291456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 89us (447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318956.105456:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16676
00000100:00100000:2.0:1767318956.140894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318956.461028:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318957.165091:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318957.486714:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318957.549078:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318932/real 1767318932]  req@ffff93cf519ac000 x1853163940389248/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318957.549114:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf519ac000 x1853163940389248/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318957 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318957.549134:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318957.549239:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318957.549244:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940389248:0@lo:250:kworker.0
00000100:00080000:2.0:1767318957.554203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318957.554222:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318957.554228:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318957.554238:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4183
00000100:00080000:2.0:1767318957.554242:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318957.554251:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318957.554571:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839500 x1853163940395776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318957.554604:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318957.554608:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318957.554610:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318957.554613:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4203
00000100:00080000:2.0:1767318957.554616:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318957.554620:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318957.554640:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838380 x1853163940395904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318957.554650:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318957.554653:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318957.554655:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318957.554659:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4203
00000100:00080000:2.0:1767318957.554661:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318957.554664:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318957.554676:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838a80 x1853163940396032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318957.554794:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940396160:0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.554880:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318957.555003:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940395776:0@lo:250:kworker.0
00000400:00000100:0.0:1767318957.555029:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940395776 offset 0 length 520: 4
00000100:00100000:0.0:1767318957.555049:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940395904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318957.555075:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318957.555095:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940396032:0@lo:38:kworker.0
00000100:00100000:0.0:1767318957.555116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318957.555161:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940395904
00000100:00100000:0.0:1767318957.555169:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940395904
00000100:00100000:0.0:1767318957.555204:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16677
00000100:00100000:0.0:1767318957.555210:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940395904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318957.555231:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318957.555272:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940395904:12345-0@lo:38:kworker.0 Request processed in 60us (195us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318957.555303:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16677
00000100:00100000:0.0:1767318957.555474:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396032
00000100:00100000:0.0:1767318957.555479:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396032
00000100:00100000:0.0:1767318957.555500:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3
00000100:00100000:0.0:1767318957.555506:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940396032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318957.555517:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318957.555546:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940396032:12345-0@lo:38:kworker.0 Request processed in 39us (428us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318957.555553:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3
00000100:00100000:0.0:1767318957.555572:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940396288:0@lo:400:kworker.0
00000100:00100000:0.0:1767318957.555597:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318957.555634:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396160
00000100:00100000:0.0:1767318957.555639:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396160
00000100:00100000:0.0:1767318957.555682:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396288
00000100:00100000:0.0:1767318957.555685:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396288
00000100:00100000:0.0:1767318957.555707:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745
00000100:00100000:0.0:1767318957.555714:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940396160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.555851:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746
00000100:00100000:1.0:1767318957.555861:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940396288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.555904:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940396288:12345-0@lo:400:kworker.0 Request processed in 45us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318957.555910:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746
00000100:00100000:1.0:1767318957.555948:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940396288:0@lo:400:kworker.0
00000100:00080000:1.0:1767318957.555975:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.555980:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.555984:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940395904:0@lo:38:kworker.0
00000100:00080000:1.0:1767318957.555991:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.556007:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.556010:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940396032:0@lo:38:kworker.0
00000100:00080000:1.0:1767318957.556057:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318957.556061:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318957.560643:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:2.0:1767318957.560664:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318957.560669:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318957.560673:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318957.560681:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4203
00000100:00080000:2.0:1767318957.560685:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318957.560692:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318957.560719:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940396544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318957.561338:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318957.561372:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940396672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.561442:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.561496:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396672
00000100:00100000:3.0:1767318957.561504:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396672
00000100:00100000:3.0:1767318957.561569:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4200
00000100:00100000:3.0:1767318957.561587:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940396672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.561641:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940396672:12345-0@lo:400:kworker.0 Request processed in 63us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318957.561647:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4200
00000100:00080000:3.0:1767318957.561670:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318957.561700:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940396672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.561756:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940396544:0@lo:38:kworker.0
00000100:00100000:3.0:1767318957.561817:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.561847:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396544
00000100:00100000:3.0:1767318957.561851:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396544
00000100:00100000:3.0:1767318957.563543:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16678
00000100:00100000:3.0:1767318957.563555:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940396544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318957.563579:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318957.563658:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940396544:12345-0@lo:38:kworker.0 Request processed in 103us (1850us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318957.563665:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16678
00000100:00080000:3.0:1767318957.563732:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318957.563746:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318957.563758:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940396544:0@lo:38:kworker.0
00000100:00100000:1.0:1767318957.566740:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940396416:0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.566855:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318957.567013:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767318957.567015:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396416
00000100:00080000:2.0:1767318957.567019:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318957.567025:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767318957.567028:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396416
00000100:00080000:2.0:1767318957.567032:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4203
00000100:00080000:2.0:1767318957.567037:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318957.567044:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318957.567079:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839180 x1853163940396800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318957.567111:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201
00000100:00100000:3.0:1767318957.567122:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940396416:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318957.567138:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318957.567173:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940396800:0@lo:38:kworker.0
00000100:00100000:3.0:1767318957.567195:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940396416:12345-0@lo:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318957.567205:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201
00000100:00100000:2.0:1767318957.567220:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318957.567666:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940396416:0@lo:400:kworker.0
00000100:00100000:0.0:1767318957.568488:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940396160:12345-0@lo:400:kworker.0 Request processed in 12769us (13603us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318957.568500:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745
00000100:00100000:3.0:1767318957.571135:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396800
00000100:00100000:3.0:1767318957.571149:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396800
00000100:00100000:3.0:1767318957.571272:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16679
00000100:00100000:3.0:1767318957.571280:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940396800:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318957.571305:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318957.571410:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940396800:12345-0@lo:38:kworker.0 Request processed in 129us (4196us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318957.571417:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16679
00000100:00100000:3.0:1767318957.571466:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940396160:0@lo:400:kworker.0
00000100:00080000:1.0:1767318957.572946:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.572957:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.572961:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940396800:0@lo:38:kworker.0
00000100:00100000:2.0:1767318958.189006:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318958.509184:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318959.085950:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940396928:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318959.086055:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318959.091246:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940396928
00000100:00100000:0.0:1767318959.091265:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940396928
00000100:00100000:0.0:1767318959.091613:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280
00000100:00100000:0.0:1767318959.091624:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940396928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318959.091661:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767318959.092192:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940396928:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318959.092278:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940396928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 655us (6228us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318959.092297:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280
00000100:00080000:2.0:1767318959.094899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318959.212884:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318959.533354:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318960.111838:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940397056:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318960.111913:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318960.112024:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397056
00000100:00100000:0.0:1767318960.112032:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397056
00000100:00100000:0.0:1767318960.112088:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281
00000100:00100000:0.0:1767318960.112097:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940397056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318960.112127:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767318960.112956:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318960.116127:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940397056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4019us (4201us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318960.116144:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281
00000100:00100000:1.0:1767318960.121129:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940397056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318960.237053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318960.559612:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318961.226131:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318961.226442:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318961.227708:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291840
00000100:00100000:0.0:1767318961.227722:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291840
00000100:00100000:0.0:1767318961.227873:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291712
00000100:00100000:0.0:1767318961.227877:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291712
00000100:00100000:0.0:1767318961.227904:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4202
00000100:00100000:0.0:1767318961.227914:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894291840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318961.227998:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894291840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (1878us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318961.228006:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4202
00000100:00100000:0.0:1767318961.228028:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16680
00000100:00100000:0.0:1767318961.228033:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894291712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318961.228055:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318961.228082:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894291712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (1641us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318961.228089:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16680
00000100:00080000:2.0:1767318961.230509:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318961.262814:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318961.581117:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318962.284921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318962.605678:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318962.670216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318962.670227:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318962.670231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318962.670234:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318962.670239:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318962.670245:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4207
00000100:00080000:1.0:1767318962.670259:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318962.670267:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318962.670308:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194a80 x1853163940397184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318962.670337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318962.670341:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318962.670343:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318962.670347:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4207
00000100:00080000:1.0:1767318962.670350:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318962.670354:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318962.670367:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194700 x1853163940397312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318962.670439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318962.670443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318962.670445:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318962.670449:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4207
00000100:00080000:1.0:1767318962.670452:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318962.670455:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318962.670466:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194e00 x1853163940397824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318962.670481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318962.670484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318962.670486:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318962.670490:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4207
00000100:00080000:1.0:1767318962.670493:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318962.670496:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318962.670504:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940397440:0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.670508:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9a300 x1853163940398080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318962.670535:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940397952:0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.670581:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318962.670581:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318962.670648:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940397184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.670733:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318962.670739:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940397696:0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.670789:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.670825:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397952
00000100:00100000:1.0:1767318962.670832:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397952
00000100:00100000:1.0:1767318962.670888:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397696
00000100:00100000:1.0:1767318962.670892:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397696
00000100:00100000:1.0:1767318962.670918:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203
00000100:00100000:1.0:1767318962.670925:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940397952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.670974:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940397952:12345-0@lo:400:kworker.0 Request processed in 49us (396us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318962.670981:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203
00000100:00100000:1.0:1767318962.670996:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204
00000100:00100000:1.0:1767318962.671012:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940397696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.671037:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940397696:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318962.671042:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204
00000100:00100000:1.0:1767318962.671073:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940397696:0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.671082:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940397952:0@lo:400:kworker.0
00000100:00080000:1.0:1767318962.671125:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318962.671206:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940397568:0@lo:400:kworker.0
00000100:00100000:0.0:1767318962.671236:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318962.671281:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397440
00000100:00100000:0.0:1767318962.671285:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397440
00000100:00100000:0.0:1767318962.671317:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397568
00000100:00100000:0.0:1767318962.671320:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397568
00000100:00100000:0.0:1767318962.671341:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747
00000100:00100000:0.0:1767318962.671347:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940397440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318962.671376:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940397440:12345-0@lo:400:kworker.0 Request processed in 30us (800us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318962.671383:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747
00000100:00100000:0.0:1767318962.671395:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748
00000100:00100000:0.0:1767318962.671400:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940397568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318962.671430:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940397568:12345-0@lo:400:kworker.0 Request processed in 29us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318962.671435:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748
00000100:00100000:0.0:1767318962.671468:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940397568:0@lo:400:kworker.0
00000100:00080000:0.0:1767318962.671481:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318962.671483:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318962.678457:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940397440:0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.679243:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318962.680022:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940397312:0@lo:38:kworker.0
00000100:00100000:2.0:1767318962.680067:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318962.680103:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940397824:0@lo:38:kworker.0
00000100:00100000:2.0:1767318962.680819:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318962.680895:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397312
00000100:00100000:3.0:1767318962.680906:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397312
00000100:00100000:3.0:1767318962.680965:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4
00000100:00100000:3.0:1767318962.680973:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940397312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318962.681006:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318962.681050:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940397312:12345-0@lo:38:kworker.0 Request processed in 76us (981us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318962.681056:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4
00000100:00100000:2.0:1767318962.686108:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940398080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318962.686189:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318962.686370:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397184
00000100:00100000:0.0:1767318962.686380:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397184
00000100:00100000:0.0:1767318962.686426:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940397824
00000100:00100000:0.0:1767318962.686429:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940397824
00000100:00100000:0.0:1767318962.686457:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681
00000100:00100000:0.0:1767318962.686464:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940397184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318962.686487:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318962.686534:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940397184:12345-0@lo:38:kworker.0 Request processed in 69us (7293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318962.686541:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681
00000100:00100000:0.0:1767318962.686559:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16682
00000100:00100000:0.0:1767318962.686563:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940397824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318962.686572:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318962.686594:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940397824:12345-0@lo:38:kworker.0 Request processed in 30us (5779us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318962.686599:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16682
00000100:00080000:2.0:1767318962.689020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318962.689033:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318962.689038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940397184:0@lo:38:kworker.0
00000100:00080000:2.0:1767318962.689053:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318962.689056:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318962.689059:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940397312:0@lo:38:kworker.0
00000100:00080000:2.0:1767318962.689069:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318962.689072:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318962.689075:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940397824:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.694285:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398080
00000100:00100000:1.0:1767318962.694301:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398080
00000100:00100000:1.0:1767318962.694431:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16683
00000100:00100000:1.0:1767318962.694440:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940398080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318962.694466:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318962.694562:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940398080:12345-0@lo:38:kworker.0 Request processed in 122us (8372us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318962.694570:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16683
00000100:00080000:2.0:1767318962.694658:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318962.694663:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318962.694668:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940398080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318963.308917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318963.631331:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318964.205167:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940398208:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318964.205246:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318964.205455:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398208
00000100:00100000:0.0:1767318964.205464:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398208
00000100:00100000:0.0:1767318964.205528:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282
00000100:00100000:0.0:1767318964.205537:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940398208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318964.205570:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318964.205620:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940398208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (374us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318964.205627:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282
00000100:00080000:1.0:1767318964.205684:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318964.206120:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940398208:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318964.332902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318964.654107:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318965.229064:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318965.229090:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940398336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318965.229162:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318965.229409:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398336
00000100:00100000:3.0:1767318965.229418:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398336
00000100:00100000:3.0:1767318965.229484:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283
00000100:00100000:3.0:1767318965.229495:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940398336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318965.229524:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318965.229629:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940398336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318965.229636:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283
00000100:00080000:1.0:1767318965.229701:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318965.231198:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940398336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318965.357010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318965.677037:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318966.342221:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318966.342367:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292096
00000100:00100000:1.0:1767318966.342381:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292096
00000100:00100000:1.0:1767318966.342478:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4205
00000100:00100000:1.0:1767318966.342494:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894292096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318966.342587:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894292096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (378us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318966.342595:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4205
00000100:00080000:0.0:1767318966.343148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318966.343465:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318966.343763:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894291968
00000100:00100000:3.0:1767318966.343770:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894291968
00000100:00100000:3.0:1767318966.343865:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16684
00000100:00100000:3.0:1767318966.343873:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894291968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318966.343897:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318966.343961:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894291968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 86us (499us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318966.343968:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16684
00000100:00100000:2.0:1767318966.381658:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318966.702485:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318967.405602:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318967.725103:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318967.792545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318967.792555:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318967.792558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318967.792562:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318967.792566:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318967.792574:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4212
00000100:00080000:3.0:1767318967.792579:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318967.792585:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318967.792630:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0a80 x1853163940398464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318967.792662:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318967.792665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318967.792667:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318967.792670:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4212
00000100:00080000:3.0:1767318967.792672:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318967.792675:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318967.792689:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940398592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318967.792767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318967.792788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318967.792791:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318967.792795:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4212
00000100:00080000:3.0:1767318967.792798:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767318967.792802:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940398720:0@lo:400:kworker.0
00000100:00080000:3.0:1767318967.792805:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318967.792823:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940399104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318967.792840:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318967.792843:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318967.792845:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318967.792848:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4212
00000100:00080000:3.0:1767318967.792850:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318967.792854:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318967.792865:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a03b80 x1853163940399360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318967.792884:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318967.792897:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940399232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318967.792938:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318967.792971:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318967.792971:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318967.792983:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940398848:0@lo:400:kworker.0
00000100:00100000:3.0:1767318967.792985:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940398976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.793019:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318967.793027:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318967.793069:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399232
00000100:00100000:3.0:1767318967.793077:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399232
00000100:00100000:2.0:1767318967.793079:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398720
00000100:00100000:2.0:1767318967.793085:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398720
00000100:00100000:3.0:1767318967.793132:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398976
00000100:00100000:3.0:1767318967.793137:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398976
00000100:00100000:2.0:1767318967.793148:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398848
00000100:00100000:2.0:1767318967.793153:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398848
00000100:00100000:2.0:1767318967.793177:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749
00000100:00100000:2.0:1767318967.793185:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940398720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.793232:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940398720:12345-0@lo:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318967.793239:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749
00000100:00100000:2.0:1767318967.793254:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750
00000100:00100000:2.0:1767318967.793259:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940398848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.793295:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940398848:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318967.793302:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750
00000100:00100000:1.0:1767318967.793308:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206
00000100:00100000:1.0:1767318967.793322:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940399232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.793351:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940398848:0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.793364:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940398720:0@lo:400:kworker.0
00000100:00100000:1.0:1767318967.793372:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940399232:12345-0@lo:400:kworker.0 Request processed in 53us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318967.793381:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206
00000100:00080000:2.0:1767318967.793404:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318967.793410:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318967.793413:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940398464:0@lo:38:kworker.0
00000100:00080000:2.0:1767318967.793414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318967.793441:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940399232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318967.793449:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318967.793470:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940398592:0@lo:38:kworker.0
00000100:00100000:1.0:1767318967.793497:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318967.793525:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940399104:0@lo:38:kworker.0
00000100:00100000:1.0:1767318967.793544:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318967.793558:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940399360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318967.793574:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318967.793601:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398464
00000100:00100000:1.0:1767318967.793606:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398464
00000100:00100000:1.0:1767318967.793621:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399104
00000100:00100000:1.0:1767318967.793624:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399104
00000100:00100000:1.0:1767318967.793631:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399360
00000100:00100000:1.0:1767318967.793633:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399360
00000100:00100000:1.0:1767318967.793642:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685
00000100:00100000:1.0:1767318967.793646:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940398464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318967.793665:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318967.793695:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940398464:12345-0@lo:38:kworker.0 Request processed in 47us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318967.793701:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685
00000100:00100000:1.0:1767318967.793724:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686
00000100:00100000:1.0:1767318967.793728:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940399104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318967.793738:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318967.793761:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940399104:12345-0@lo:38:kworker.0 Request processed in 31us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318967.793767:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686
00000100:00100000:1.0:1767318967.793797:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16687
00000100:00100000:1.0:1767318967.793800:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940399360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318967.793809:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318967.793830:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940399360:12345-0@lo:38:kworker.0 Request processed in 28us (255us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318967.793835:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16687
00000100:00080000:1.0:1767318967.793859:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318967.793863:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318967.793866:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940398464:0@lo:38:kworker.0
00000100:00080000:1.0:1767318967.793873:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318967.793875:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318967.793878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940399104:0@lo:38:kworker.0
00000100:00080000:1.0:1767318967.793887:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318967.793890:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318967.793892:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940399360:0@lo:38:kworker.0
00000100:00100000:3.0:1767318967.794075:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207
00000100:00100000:3.0:1767318967.794083:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940398976:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318967.794206:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940398592
00000100:00100000:2.0:1767318967.794211:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940398592
00000100:00100000:2.0:1767318967.794232:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5
00000100:00100000:2.0:1767318967.794237:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940398592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318967.794247:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318967.794277:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940398592:12345-0@lo:38:kworker.0 Request processed in 39us (780us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318967.794283:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5
00000100:00080000:2.0:1767318967.794307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318967.794311:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318967.794313:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940398592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318967.794497:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940398976:12345-0@lo:400:kworker.0 Request processed in 415us (1471us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318967.794503:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207
00000100:00100000:1.0:1767318967.807396:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940398976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318968.428974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318968.751160:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318969.325207:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940399488:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318969.325278:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318969.325572:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399488
00000100:00100000:0.0:1767318969.325581:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399488
00000100:00080000:2.0:1767318969.325691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318969.326073:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284
00000100:00100000:0.0:1767318969.326085:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940399488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318969.326118:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318969.326185:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940399488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (906us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318969.326192:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1767318969.326280:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940399488:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318969.453139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318969.775500:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318970.349227:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940399616:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318970.349299:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318970.349367:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399616
00000100:00100000:0.0:1767318970.349376:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399616
00000100:00100000:0.0:1767318970.349453:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285
00000100:00100000:0.0:1767318970.349462:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940399616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318970.349492:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318970.349561:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940399616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (251us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318970.349569:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285
00000100:00100000:2.0:1767318970.349713:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940399616:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318970.352206:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318970.476909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318970.797123:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318971.467925:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318971.467981:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318971.468052:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292224
00000100:00100000:0.0:1767318971.468062:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292224
00000100:00100000:0.0:1767318971.468164:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292352
00000100:00100000:0.0:1767318971.468168:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292352
00000100:00080000:2.0:1767318971.468253:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318971.468300:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4208
00000100:00100000:1.0:1767318971.468312:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894292352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318971.468398:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894292352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (415us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318971.468406:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4208
00000100:00100000:1.0:1767318971.468442:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16688
00000100:00100000:1.0:1767318971.468447:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894292224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318971.468468:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318971.468497:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894292224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (582us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318971.468504:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16688
00000100:00100000:2.0:1767318971.500897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318971.821039:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318972.524908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318972.846063:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318972.908917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318972.908929:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318972.908932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318972.908937:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318972.908942:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318972.908950:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4217
00000100:00080000:3.0:1767318972.908955:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318972.908963:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767318972.909009:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940399744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318972.909038:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318972.909042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318972.909044:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318972.909057:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4217
00000100:00080000:3.0:1767318972.909060:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318972.909064:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318972.909071:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940399744:0@lo:38:kworker.0
00000100:00100000:3.0:1767318972.909085:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ed80 x1853163940399872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318972.909152:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318972.909160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318972.909165:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318972.909168:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318972.909173:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4217
00000100:00080000:3.0:1767318972.909176:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318972.909181:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318972.909190:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318972.909197:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ea00 x1853163940400384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318972.909211:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940399872:0@lo:38:kworker.0
00000100:00080000:3.0:1767318972.909221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318972.909226:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318972.909228:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318972.909233:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4217
00000100:00080000:3.0:1767318972.909236:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767318972.909242:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318972.909244:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318972.909248:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318972.909262:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ca80 x1853163940400640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318972.909290:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940400384:0@lo:38:kworker.0
00000100:00100000:2.0:1767318972.909291:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318972.909304:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318972.909307:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940400512:0@lo:400:kworker.0
00000100:00100000:1.0:1767318972.909315:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318972.909335:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940400640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318972.909347:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318972.909364:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318972.909410:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400000
00000100:00100000:2.0:1767318972.909428:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400000
00000100:00100000:0.0:1767318972.909464:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400128
00000100:00100000:0.0:1767318972.909470:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400128
00000100:00100000:3.0:1767318972.909533:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318972.909538:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399744
00000100:00100000:3.0:1767318972.909542:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940400256:0@lo:400:kworker.0
00000100:00100000:1.0:1767318972.909543:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399744
00000100:00100000:1.0:1767318972.909570:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400384
00000100:00100000:1.0:1767318972.909573:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400384
00000100:00100000:3.0:1767318972.909579:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318972.909709:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400512
00000100:00100000:1.0:1767318972.909714:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400512
00000100:00100000:0.0:1767318972.909733:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751
00000100:00100000:0.0:1767318972.909744:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318972.909818:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400128:12345-0@lo:400:kworker.0 Request processed in 76us (472us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318972.909824:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751
00000100:00100000:0.0:1767318972.909841:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752
00000100:00100000:0.0:1767318972.909847:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318972.909876:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400000:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318972.909882:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752
00000100:00080000:2.0:1767318972.910171:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318972.910177:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318972.910179:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318972.910188:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940399872
00000100:00100000:2.0:1767318972.910193:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940399872
00000100:00100000:2.0:1767318972.910213:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6
00000100:00100000:2.0:1767318972.910218:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940399872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318972.910237:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318972.910269:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940399872:12345-0@lo:38:kworker.0 Request processed in 49us (1025us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318972.910275:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6
00000100:00100000:2.0:1767318972.910311:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400128:0@lo:400:kworker.0
00000100:00100000:2.0:1767318972.910321:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318972.912043:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400256
00000100:00100000:2.0:1767318972.912137:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4209
00000100:00100000:1.0:1767318972.912148:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689
00000100:00100000:1.0:1767318972.912158:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940399744:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318972.912161:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940400512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318972.912162:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400256
00010000:00020000:1.0:1767318972.912183:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318972.912222:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4210
00000100:00100000:3.0:1767318972.912232:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940400256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318972.912252:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940399744:12345-0@lo:38:kworker.0 Request processed in 93us (3100us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318972.912260:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940400512:12345-0@lo:400:kworker.0 Request processed in 110us (2896us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318972.912263:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689
00000100:00100000:2.0:1767318972.912275:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4209
00000100:00100000:3.0:1767318972.912277:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940400256:12345-0@lo:400:kworker.0 Request processed in 46us (2702us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318972.912287:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4210
00000100:00100000:2.0:1767318972.912304:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690
00000100:00100000:2.0:1767318972.912312:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940400384:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767318972.912324:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767318972.912325:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318972.912344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318972.912802:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940400384:12345-0@lo:38:kworker.0 Request processed in 490us (3487us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318972.912810:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690
00000100:00100000:2.0:1767318972.912823:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400640
00000100:00100000:2.0:1767318972.912827:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400640
00000100:00100000:2.0:1767318972.912848:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16691
00000100:00100000:2.0:1767318972.912853:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940400640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318972.912867:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318972.912973:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940400640:12345-0@lo:38:kworker.0 Request processed in 117us (631us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318972.912977:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318972.912982:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16691
00000100:00080000:1.0:1767318972.912987:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318972.912993:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940399872:0@lo:38:kworker.0
00000100:00080000:1.0:1767318972.913006:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318972.913010:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318972.913012:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940399744:0@lo:38:kworker.0
00000100:00080000:1.0:1767318972.913244:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318972.913250:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318972.913253:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940400384:0@lo:38:kworker.0
00000100:00080000:1.0:1767318972.913264:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318972.913268:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318972.913271:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940400640:0@lo:38:kworker.0
00000100:00100000:3.0:1767318972.913368:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940400256:0@lo:400:kworker.0
00000100:00100000:3.0:1767318972.913392:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940400512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318973.548903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318973.869279:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318974.445016:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400768:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318974.445093:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318974.445206:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400768
00000100:00100000:1.0:1767318974.445215:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400768
00000100:00100000:1.0:1767318974.445275:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286
00000100:00100000:1.0:1767318974.445284:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400768:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318974.445316:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767318974.445821:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318974.453753:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8456us (8645us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318974.453785:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286
00000100:00100000:2.0:1767318974.458898:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400768:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318974.572923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318974.894434:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318975.469459:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318975.469483:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318975.469556:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318975.469686:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940400896
00000100:00100000:1.0:1767318975.469695:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940400896
00000100:00100000:1.0:1767318975.469793:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287
00000100:00100000:1.0:1767318975.469803:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318975.469833:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767318975.469880:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940400896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (323us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318975.469887:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287
00000100:00100000:2.0:1767318975.469981:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940400896:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318975.470653:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318975.596941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318975.917159:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767318976.582038:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894292480 offset 0 length 520: 4
00000100:00100000:0.0:1767318976.582091:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318976.582138:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318976.582231:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292608
00000100:00100000:2.0:1767318976.582242:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292608
00000100:00100000:2.0:1767318976.582290:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292736
00000100:00100000:2.0:1767318976.582293:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292736
00000100:00100000:2.0:1767318976.582355:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4211
00000100:00100000:2.0:1767318976.582365:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894292736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767318976.582444:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894292736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318976.582451:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4211
00000100:00100000:2.0:1767318976.582469:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16692
00000100:00100000:2.0:1767318976.582474:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894292608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767318976.582494:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318976.582522:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894292608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318976.582528:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16692
00000100:00080000:3.0:1767318976.582844:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318976.621723:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318976.941951:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318977.645210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318977.965158:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318978.029747:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318978.029760:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318978.029763:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318978.029767:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318978.029788:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318978.029798:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1767318978.029803:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318978.029811:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318978.030049:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940401024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318978.030069:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318978.030072:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318978.030074:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318978.030078:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1767318978.030081:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318978.030084:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318978.030099:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940401152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318978.030162:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318978.030166:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318978.030168:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318978.030171:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1767318978.030174:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318978.030179:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318978.030189:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171f80 x1853163940401664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318978.030203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318978.030205:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318978.030207:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318978.030211:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1767318978.030213:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318978.030216:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318978.030299:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170700 x1853163940401920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318978.030337:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940401536:0@lo:400:kworker.0
00000100:00100000:2.0:1767318978.030405:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318978.030469:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318978.030475:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940401792:0@lo:400:kworker.0
00000100:00100000:2.0:1767318978.030498:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318978.030597:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401536
00000100:00100000:0.0:1767318978.030605:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401536
00000100:00100000:0.0:1767318978.030678:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401792
00000100:00100000:0.0:1767318978.030682:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401792
00000100:00100000:0.0:1767318978.030708:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4212
00000100:00100000:0.0:1767318978.030716:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940401536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318978.030792:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940401536:12345-0@lo:400:kworker.0 Request processed in 57us (367us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318978.030800:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4212
00000100:00100000:0.0:1767318978.030817:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213
00000100:00100000:0.0:1767318978.030824:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940401792:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318978.031172:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318978.031252:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940401792:0@lo:400:kworker.0
00000100:00100000:2.0:1767318978.031264:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940401536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318978.031316:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940401792:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318978.031323:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213
00000100:00100000:3.0:1767318978.031396:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940401280:0@lo:400:kworker.0
00000100:00100000:3.0:1767318978.031437:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318978.031475:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318978.031481:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940401408:0@lo:400:kworker.0
00000100:00100000:3.0:1767318978.031503:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318978.031723:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401280
00000100:00100000:0.0:1767318978.031728:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401280
00000100:00100000:0.0:1767318978.031793:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401408
00000100:00100000:0.0:1767318978.031796:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401408
00000100:00100000:0.0:1767318978.031818:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753
00000100:00100000:0.0:1767318978.031825:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940401280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318978.031882:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940401280:12345-0@lo:400:kworker.0 Request processed in 57us (444us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318978.031888:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753
00000100:00100000:0.0:1767318978.031901:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754
00000100:00100000:0.0:1767318978.031907:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940401408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318978.031945:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940401408:12345-0@lo:400:kworker.0 Request processed in 34us (436us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318978.031951:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754
00000100:00100000:0.0:1767318978.031983:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940401408:0@lo:400:kworker.0
00000100:00100000:0.0:1767318978.031992:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940401280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318978.032218:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940401024:0@lo:38:kworker.0
00000100:00100000:1.0:1767318978.032257:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318978.032283:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940401152:0@lo:38:kworker.0
00000100:00100000:1.0:1767318978.032307:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318978.032326:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940401664:0@lo:38:kworker.0
00000100:00100000:1.0:1767318978.032345:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318978.032360:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940401920:0@lo:38:kworker.0
00000100:00100000:1.0:1767318978.032378:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318978.032413:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401152
00000100:00100000:1.0:1767318978.032417:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401152
00000100:00100000:1.0:1767318978.032439:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7
00000100:00100000:1.0:1767318978.032443:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940401152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318978.032462:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318978.032497:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940401152:12345-0@lo:38:kworker.0 Request processed in 52us (189us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318978.032503:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7
00000100:00100000:1.0:1767318978.032528:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401024
00000100:00100000:1.0:1767318978.032531:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401024
00000100:00100000:1.0:1767318978.032554:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401664
00000100:00100000:1.0:1767318978.032557:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401664
00000100:00100000:1.0:1767318978.032569:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940401920
00000100:00100000:1.0:1767318978.032572:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940401920
00000100:00100000:1.0:1767318978.032581:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16693
00000100:00100000:1.0:1767318978.032585:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318978.032594:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318978.032619:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401024:12345-0@lo:38:kworker.0 Request processed in 33us (363us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318978.032636:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16693
00000100:00100000:1.0:1767318978.032652:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694
00000100:00100000:1.0:1767318978.032656:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401664:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318978.032665:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318978.032693:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401664:12345-0@lo:38:kworker.0 Request processed in 35us (347us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318978.032701:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694
00000100:00100000:1.0:1767318978.032712:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16695
00000100:00100000:1.0:1767318978.032715:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318978.032725:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318978.032747:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940401920:12345-0@lo:38:kworker.0 Request processed in 29us (367us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318978.032751:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16695
00000100:00080000:1.0:1767318978.032840:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318978.032847:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318978.032850:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940401024:0@lo:38:kworker.0
00000100:00080000:3.0:1767318978.032966:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318978.032971:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318978.033025:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318978.033029:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318978.033032:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940401152:0@lo:38:kworker.0
00000100:00080000:1.0:1767318978.033040:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318978.033043:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318978.033045:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940401664:0@lo:38:kworker.0
00000100:00080000:1.0:1767318978.033052:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318978.033055:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318978.033057:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940401920:0@lo:38:kworker.0
00000100:00100000:2.0:1767318978.669604:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318978.989177:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318979.565934:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940402048:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318979.566020:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318979.566754:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402048
00000100:00100000:2.0:1767318979.566763:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402048
00000100:00100000:2.0:1767318979.566845:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288
00000100:00100000:2.0:1767318979.566856:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940402048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318979.566891:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767318979.569655:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940402048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2791us (3624us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318979.569670:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288
00000100:00100000:3.0:1767318979.573536:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940402048:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318979.693453:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318980.013150:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318980.589870:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318980.589895:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940402176:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318980.589963:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318980.590281:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402176
00000100:00100000:3.0:1767318980.590291:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402176
00000100:00100000:3.0:1767318980.590361:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289
00000100:00100000:3.0:1767318980.590373:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940402176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318980.590402:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767318980.590458:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940402176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318980.590465:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289
00000100:00080000:2.0:1767318980.590526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318980.591358:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940402176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318980.718425:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318981.040114:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318981.712506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318981.712626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318981.713339:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292992
00000100:00100000:0.0:1767318981.713351:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292992
00000100:00100000:0.0:1767318981.713455:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894292864
00000100:00100000:0.0:1767318981.713459:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894292864
00000100:00100000:3.0:1767318981.713484:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4214
00000100:00100000:3.0:1767318981.713503:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894292992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767318981.713581:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318981.713606:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894292992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (1107us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318981.720278:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16696
00000100:00100000:0.0:1767318981.720293:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894292864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318981.721566:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318981.721698:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894292864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1404us (9069us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318981.721710:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16696
00000100:00100000:3.0:1767318981.726054:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4214
00000100:00100000:2.0:1767318981.741905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318982.061568:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318982.126893:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318957/real 1767318957]  req@ffff93cf51839500 x1853163940395776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318982 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318982.126926:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51839500 x1853163940395776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318982 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318982.126946:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318982.126970:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318982.126974:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940395776:0@lo:250:kworker.0
00000100:00080000:1.0:1767318982.127083:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318982.127089:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318982.127093:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318982.127098:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4207
00000100:00080000:1.0:1767318982.127102:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318982.127109:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318982.127159:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d197b80 x1853163940402304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318982.127187:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318982.127191:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318982.127193:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318982.127198:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4228
00000100:00080000:1.0:1767318982.127201:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318982.127204:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318982.127223:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196680 x1853163940402432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318982.127224:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940402304:0@lo:250:kworker.0
00000100:00080000:1.0:1767318982.127241:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318982.127245:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318982.127247:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318982.127250:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4228
00000100:00080000:1.0:1767318982.127253:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318982.127258:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767318982.127273:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940402560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:2.0:1767318982.127291:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940402304 offset 0 length 520: 4
00000100:00080000:1.0:1767318982.127338:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767318982.127340:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940402432:0@lo:38:kworker.0
00000100:00080000:1.0:1767318982.127344:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318982.127348:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318982.127353:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4228
00000100:00080000:1.0:1767318982.127356:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318982.127361:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318982.127376:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318982.127380:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead180 x1853163940403072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318982.127401:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940402560:0@lo:38:kworker.0
00000100:00080000:1.0:1767318982.127402:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318982.127408:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318982.127410:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318982.127414:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4228
00000100:00080000:1.0:1767318982.127417:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318982.127422:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318982.127427:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318982.127438:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf100 x1853163940403328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318982.127447:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940403072:0@lo:38:kworker.0
00000100:00100000:2.0:1767318982.127469:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318982.127482:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940403200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318982.127497:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940403328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318982.127525:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318982.127532:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940402688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318982.127561:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318982.127562:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318982.127571:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940402944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318982.127597:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318982.127604:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940402816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.127615:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318982.127634:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318982.127654:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402560
00000100:00100000:1.0:1767318982.127662:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402560
00000100:00100000:2.0:1767318982.127666:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402688
00000100:00100000:2.0:1767318982.127671:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402688
00000100:00100000:1.0:1767318982.127701:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8
00000100:00100000:1.0:1767318982.127710:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940402560:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318982.127713:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402816
00000100:00100000:2.0:1767318982.127717:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402816
00010000:00020000:1.0:1767318982.127733:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318982.127738:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755
00000100:00100000:2.0:1767318982.127746:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940402688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.127800:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940402560:12345-0@lo:38:kworker.0 Request processed in 65us (347us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318982.127810:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8
00000100:00100000:1.0:1767318982.127838:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402432
00000100:00100000:1.0:1767318982.127842:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402432
00000100:00100000:1.0:1767318982.127864:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403072
00000100:00100000:1.0:1767318982.127868:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403072
00000100:00100000:1.0:1767318982.127882:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403200
00000100:00100000:1.0:1767318982.127885:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403200
00000100:00100000:1.0:1767318982.127904:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940402944
00000100:00100000:1.0:1767318982.127907:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940402944
00000100:00100000:1.0:1767318982.127923:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4215
00000100:00100000:1.0:1767318982.127929:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940403200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.127970:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940403200:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318982.127976:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4215
00000100:00100000:1.0:1767318982.127989:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4216
00000100:00100000:1.0:1767318982.127995:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940402944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.128024:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940402944:12345-0@lo:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318982.128030:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4216
00000100:00100000:1.0:1767318982.128042:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16697
00000100:00100000:1.0:1767318982.128045:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940402432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318982.128055:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318982.128078:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940402432:12345-0@lo:38:kworker.0 Request processed in 31us (703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318982.128084:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16697
00000100:00100000:1.0:1767318982.128094:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16698
00000100:00100000:1.0:1767318982.128097:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940403072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318982.128106:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318982.128126:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940403072:12345-0@lo:38:kworker.0 Request processed in 27us (656us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318982.128131:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16698
00000100:00100000:1.0:1767318982.128168:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940402944:0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.128177:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940403200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.128194:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318982.128213:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318982.128216:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318982.128219:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940403072:0@lo:38:kworker.0
00000100:00080000:1.0:1767318982.128226:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318982.128229:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318982.128232:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940402432:0@lo:38:kworker.0
00000100:00080000:1.0:1767318982.128238:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318982.128240:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318982.128243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940402560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318982.128263:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403328
00000100:00100000:1.0:1767318982.128265:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403328
00000100:00100000:1.0:1767318982.128280:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16699
00000100:00100000:1.0:1767318982.128284:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940403328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318982.128293:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318982.128316:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940403328:12345-0@lo:38:kworker.0 Request processed in 31us (121us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318982.128324:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16699
00000100:00080000:1.0:1767318982.128342:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318982.128345:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318982.128348:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940403328:0@lo:38:kworker.0
00000100:00080000:1.0:1767318982.128387:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318982.128393:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318982.128394:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318982.128975:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940402688:12345-0@lo:400:kworker.0 Request processed in 1228us (1411us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318982.128984:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755
00000100:00100000:2.0:1767318982.129006:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756
00000100:00100000:2.0:1767318982.129015:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940402816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318982.129047:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940402816:12345-0@lo:400:kworker.0 Request processed in 34us (1413us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318982.129052:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756
00000100:00100000:1.0:1767318982.132014:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940402816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318982.132032:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940402688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318982.765028:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318983.087129:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318983.788901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318984.111339:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318984.687897:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940403456:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318984.687985:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318984.688177:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403456
00000100:00100000:0.0:1767318984.688186:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403456
00000100:00100000:0.0:1767318984.688263:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290
00000100:00100000:0.0:1767318984.688273:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940403456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318984.688306:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318984.688363:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940403456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318984.688370:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290
00000100:00100000:3.0:1767318984.688574:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940403456:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318984.689095:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318984.813426:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318985.133428:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318985.709315:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318985.709341:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940403584:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318985.709426:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318985.713386:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403584
00000100:00100000:0.0:1767318985.713403:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403584
00000100:00100000:0.0:1767318985.713515:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767318985.713526:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940403584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318985.713575:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767318985.713684:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940403584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (4257us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318985.713690:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291
00000100:00080000:1.0:1767318985.713747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318985.713845:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940403584:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318985.837022:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318986.157249:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318986.822567:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318986.822646:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293248
00000100:00100000:0.0:1767318986.822660:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293248
00000100:00100000:0.0:1767318986.822748:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4217
00000100:00100000:0.0:1767318986.822760:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767318986.822890:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 132us (334us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318986.822898:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4217
00000100:00080000:1.0:1767318986.823265:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318986.827840:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767318986.832465:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293120
00000100:00100000:3.0:1767318986.832486:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293120
00000100:00100000:3.0:1767318986.832555:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16700
00000100:00100000:3.0:1767318986.832567:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894293120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767318986.832597:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318986.833006:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894293120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 440us (5174us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318986.833015:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16700
00000100:00100000:2.0:1767318986.861735:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318987.180926:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318987.247500:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318987.247516:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318987.247519:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318987.247523:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318987.247528:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318987.247547:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4232
00000100:00080000:2.0:1767318987.247551:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318987.247559:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318987.247602:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173100 x1853163940403712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318987.247638:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318987.247643:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318987.247644:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318987.247648:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4232
00000100:00080000:2.0:1767318987.247651:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318987.247654:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318987.247668:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940403840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318987.247740:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318987.247743:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318987.247745:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318987.247748:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4232
00000100:00080000:2.0:1767318987.247750:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318987.247754:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318987.247765:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940404352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318987.247847:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318987.247932:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318987.247958:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940403968:0@lo:400:kworker.0
00000100:00100000:0.0:1767318987.247988:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318987.248013:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404096
00000100:00100000:0.0:1767318987.248016:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403968
00000100:00100000:0.0:1767318987.248021:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403968
00000100:00100000:3.0:1767318987.248021:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404096
00000100:00100000:3.0:1767318987.248075:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757
00000100:00100000:3.0:1767318987.248086:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404096:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318987.248118:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318987.248122:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318987.248124:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318987.248128:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4232
00000100:00080000:2.0:1767318987.248131:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318987.248135:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318987.248146:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011c00 x1853163940404608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318987.248160:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404096:12345-0@lo:400:kworker.0 Request processed in 77us (227us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318987.248167:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757
00000100:00100000:2.0:1767318987.248173:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940404224:0@lo:400:kworker.0
00000100:00100000:2.0:1767318987.248203:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318987.248222:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318987.248227:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940404480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318987.248247:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318987.248285:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404224
00000100:00100000:2.0:1767318987.248289:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404224
00000100:00100000:3.0:1767318987.248319:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318987.248370:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404480
00000100:00100000:3.0:1767318987.248374:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404480
00000100:00100000:0.0:1767318987.251313:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758
00000100:00100000:0.0:1767318987.251759:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940403968:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318987.251903:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318987.251910:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318987.251913:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318987.251944:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940403712:0@lo:38:kworker.0
00000100:00100000:1.0:1767318987.252017:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318987.252052:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940403840:0@lo:38:kworker.0
00000100:00100000:1.0:1767318987.252080:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318987.252097:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940404352:0@lo:38:kworker.0
00000100:00100000:1.0:1767318987.252117:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318987.252133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940404608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318987.252153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318987.252186:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403840
00000100:00100000:1.0:1767318987.252192:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403840
00000100:00100000:1.0:1767318987.252218:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9
00000100:00100000:1.0:1767318987.252223:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940403840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318987.252242:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318987.252283:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940403840:12345-0@lo:38:kworker.0 Request processed in 58us (202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318987.252290:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9
00000100:00100000:1.0:1767318987.252310:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940403712
00000100:00100000:1.0:1767318987.252314:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940403712
00000100:00100000:0.0:1767318987.252492:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940403968:12345-0@lo:400:kworker.0 Request processed in 1167us (4502us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318987.252500:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758
00000100:00100000:0.0:1767318987.252557:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940403968:0@lo:400:kworker.0
00000100:00100000:1.0:1767318987.252641:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404352
00000100:00100000:1.0:1767318987.252645:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404352
00000100:00100000:1.0:1767318987.252655:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404608
00000100:00100000:1.0:1767318987.252657:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404608
00000100:00100000:1.0:1767318987.252667:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16701
00000100:00100000:1.0:1767318987.252671:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940403712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318987.252681:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318987.252708:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940403712:12345-0@lo:38:kworker.0 Request processed in 36us (691us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318987.252714:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16701
00000100:00100000:1.0:1767318987.252725:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16702
00000100:00100000:1.0:1767318987.252728:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940404352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318987.252737:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318987.252757:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940404352:12345-0@lo:38:kworker.0 Request processed in 27us (640us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318987.252763:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16702
00000100:00100000:1.0:1767318987.253144:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16703
00000100:00100000:1.0:1767318987.253149:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940404608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318987.253161:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318987.253192:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940404608:12345-0@lo:38:kworker.0 Request processed in 41us (1037us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318987.253274:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318987.253279:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318987.253282:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940403712:0@lo:38:kworker.0
00000100:00080000:0.0:1767318987.253292:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318987.253295:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318987.253298:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940403840:0@lo:38:kworker.0
00000100:00080000:0.0:1767318987.253305:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318987.253308:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318987.253310:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940404352:0@lo:38:kworker.0
00000100:00080000:0.0:1767318987.253317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318987.253320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318987.253323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940404608:0@lo:38:kworker.0
00000100:00100000:2.0:1767318987.253631:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4218
00000100:00100000:2.0:1767318987.253642:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940404224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318987.253687:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940404224:12345-0@lo:400:kworker.0 Request processed in 47us (5483us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318987.253693:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4218
00000100:00100000:2.0:1767318987.253723:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940404224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318987.253958:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16703
00000100:00100000:3.0:1767318987.255107:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4219
00000100:00100000:3.0:1767318987.255119:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940404480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318987.255190:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940404480:12345-0@lo:400:kworker.0 Request processed in 74us (6942us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318987.255196:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4219
00000100:00100000:2.0:1767318987.255291:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940404480:0@lo:400:kworker.0
00000100:00100000:2.0:1767318987.887272:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318988.205690:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318988.908922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318989.232126:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318989.806874:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318989.806913:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404736:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318989.806990:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318989.807186:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404736
00000100:00100000:0.0:1767318989.807198:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404736
00000100:00100000:0.0:1767318989.807269:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292
00000100:00100000:0.0:1767318989.807289:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404736:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318989.807320:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318989.807367:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318989.807374:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292
00000100:00080000:3.0:1767318989.807561:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318989.807597:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404736:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318989.932909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318990.253017:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318990.829213:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404864:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318990.829298:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318990.830436:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404864
00000100:00100000:2.0:1767318990.830447:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404864
00000100:00100000:2.0:1767318990.830562:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293
00000100:00100000:2.0:1767318990.830575:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318990.830609:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318990.830684:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940404864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1384us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318990.830692:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293
00000100:00080000:3.0:1767318990.830765:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318990.833842:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940404864:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318990.957692:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318991.277031:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318991.942076:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318991.942201:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293504
00000100:00100000:1.0:1767318991.942212:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293504
00000100:00100000:1.0:1767318991.942320:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4220
00000100:00100000:1.0:1767318991.942331:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318991.942431:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318991.942440:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4220
00000100:00080000:3.0:1767318991.942725:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318991.946039:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767318991.946159:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293376
00000100:00100000:0.0:1767318991.946170:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293376
00000100:00100000:0.0:1767318991.946223:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16704
00000100:00100000:0.0:1767318991.946231:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894293376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767318991.946256:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318991.946337:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894293376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 104us (306us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318991.946345:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16704
00000100:00100000:2.0:1767318991.981028:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318992.304092:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318992.365441:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318992.365453:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318992.365456:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318992.365460:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318992.365465:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318992.365473:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4237
00000100:00080000:2.0:1767318992.365478:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318992.365485:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318992.365538:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940404992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318992.365558:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318992.365562:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318992.365563:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318992.365567:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4237
00000100:00080000:2.0:1767318992.365569:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318992.365573:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318992.365588:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940405120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318992.365659:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318992.365663:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318992.365665:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318992.365668:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4237
00000100:00080000:2.0:1767318992.365671:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318992.365675:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318992.365688:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940405632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318992.365705:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318992.365708:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318992.365710:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318992.365713:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4237
00000100:00080000:2.0:1767318992.365715:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318992.365719:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318992.365730:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940405888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318992.365801:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940405248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.365872:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318992.365950:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318992.365957:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940405376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.365982:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318992.366061:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940405504:0@lo:400:kworker.0
00000100:00100000:1.0:1767318992.366097:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318992.366125:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318992.366131:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940405760:0@lo:400:kworker.0
00000100:00100000:1.0:1767318992.366153:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318992.366292:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405504
00000100:00100000:3.0:1767318992.366300:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405504
00000100:00100000:3.0:1767318992.366357:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405760
00000100:00100000:3.0:1767318992.366361:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405760
00000100:00100000:3.0:1767318992.366395:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4221
00000100:00100000:3.0:1767318992.366405:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940405504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.366472:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940405504:12345-0@lo:400:kworker.0 Request processed in 69us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318992.366480:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4221
00000100:00100000:3.0:1767318992.366508:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222
00000100:00100000:3.0:1767318992.366515:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940405760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.366542:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940405760:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318992.366548:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222
00000100:00100000:3.0:1767318992.366593:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940405760:0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.366604:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940405504:0@lo:400:kworker.0
00000100:00080000:1.0:1767318992.366691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318992.366882:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405248
00000100:00100000:2.0:1767318992.366887:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405248
00000100:00100000:2.0:1767318992.366932:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405376
00000100:00100000:2.0:1767318992.366935:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405376
00000100:00100000:2.0:1767318992.366957:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759
00000100:00100000:2.0:1767318992.366965:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940405248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318992.367006:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940405248:12345-0@lo:400:kworker.0 Request processed in 42us (1133us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318992.367013:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759
00000100:00100000:2.0:1767318992.367026:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760
00000100:00100000:2.0:1767318992.367032:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940405376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318992.367058:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940405376:12345-0@lo:400:kworker.0 Request processed in 27us (1076us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318992.367063:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760
00000100:00080000:1.0:1767318992.367125:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318992.367128:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318992.367192:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940405376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318992.367202:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940405248:0@lo:400:kworker.0
00000100:00100000:0.0:1767318992.367321:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940404992:0@lo:38:kworker.0
00000100:00100000:0.0:1767318992.367353:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318992.367379:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940405120:0@lo:38:kworker.0
00000100:00100000:0.0:1767318992.367415:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318992.367429:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940405632:0@lo:38:kworker.0
00000100:00100000:1.0:1767318992.367557:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405120
00000100:00100000:1.0:1767318992.367561:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405120
00000100:00100000:1.0:1767318992.367584:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10
00000100:00100000:1.0:1767318992.367589:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940405120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318992.367606:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318992.367638:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940405120:12345-0@lo:38:kworker.0 Request processed in 48us (223us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318992.367643:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10
00000100:00100000:1.0:1767318992.367683:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940404992
00000100:00100000:1.0:1767318992.367687:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940404992
00000100:00100000:1.0:1767318992.367706:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16705
00000100:00100000:1.0:1767318992.367711:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940404992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318992.367720:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318992.367744:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940404992:12345-0@lo:38:kworker.0 Request processed in 32us (390us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318992.367749:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16705
00000100:00100000:0.0:1767318992.367902:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318992.367930:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940405888:0@lo:38:kworker.0
00000100:00100000:0.0:1767318992.367951:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318992.367985:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318992.367990:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318992.367994:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940404992:0@lo:38:kworker.0
00000100:00080000:0.0:1767318992.368002:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318992.368005:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318992.368008:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940405120:0@lo:38:kworker.0
00000100:00100000:3.0:1767318992.368064:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405632
00000100:00100000:3.0:1767318992.368068:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405632
00000100:00100000:3.0:1767318992.368093:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940405888
00000100:00100000:3.0:1767318992.368096:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940405888
00000100:00100000:3.0:1767318992.368112:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16706
00000100:00100000:3.0:1767318992.368116:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940405632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318992.368126:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318992.368154:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940405632:12345-0@lo:38:kworker.0 Request processed in 36us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318992.368160:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16706
00000100:00100000:3.0:1767318992.368174:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16707
00000100:00100000:3.0:1767318992.368177:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940405888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318992.368186:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318992.368209:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940405888:12345-0@lo:38:kworker.0 Request processed in 30us (258us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318992.368214:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16707
00000100:00080000:0.0:1767318992.368362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318992.368366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318992.368369:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940405632:0@lo:38:kworker.0
00000100:00080000:0.0:1767318992.368376:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318992.368378:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318992.368381:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940405888:0@lo:38:kworker.0
00000100:00100000:2.0:1767318993.005087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318993.325035:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318994.028980:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318994.349127:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318994.929323:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940406016:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318994.929400:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318994.929565:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406016
00000100:00100000:0.0:1767318994.929574:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406016
00000100:00080000:1.0:1767318994.929640:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318994.929642:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294
00000100:00100000:0.0:1767318994.929652:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940406016:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318994.929683:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767318994.929742:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940406016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (342us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318994.929749:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294
00000100:00100000:3.0:1767318994.929844:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940406016:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318995.053408:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318995.373326:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318995.949767:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940406144:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318995.949873:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318995.950081:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406144
00000100:00100000:2.0:1767318995.950090:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406144
00000100:00100000:2.0:1767318995.950166:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295
00000100:00100000:2.0:1767318995.950176:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940406144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318995.950210:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767318995.950263:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940406144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (389us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318995.950269:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295
00000100:00080000:3.0:1767318995.951133:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318995.951178:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940406144:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318996.076938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767318996.398573:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318997.063016:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767318997.063084:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767318997.063177:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293760
00000100:00100000:1.0:1767318997.063187:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293760
00000100:00100000:1.0:1767318997.063261:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894293632
00000100:00100000:1.0:1767318997.063264:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894293632
00000100:00100000:1.0:1767318997.063282:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4223
00000100:00100000:1.0:1767318997.063291:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767318997.063373:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894293760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318997.063381:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4223
00000100:00100000:1.0:1767318997.063400:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16708
00000100:00100000:1.0:1767318997.063405:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894293632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767318997.063427:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318997.063474:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894293632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 58us (380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318997.063481:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16708
00000100:00080000:3.0:1767318997.063694:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318997.100939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767318997.421297:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318997.484919:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318997.484932:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318997.484934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318997.484938:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318997.484944:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318997.484952:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4242
00000100:00080000:2.0:1767318997.484957:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318997.484965:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318997.485005:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940406272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318997.485021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318997.485025:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318997.485027:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318997.485030:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4242
00000100:00080000:2.0:1767318997.485033:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318997.485036:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940406272:0@lo:38:kworker.0
00000100:00080000:2.0:1767318997.485038:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318997.485058:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940406400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318997.485116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318997.485139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318997.485143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318997.485145:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767318997.485149:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940406528:0@lo:400:kworker.0
00000100:00080000:2.0:1767318997.485152:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4242
00000100:00080000:2.0:1767318997.485157:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318997.485162:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318997.485178:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012300 x1853163940406912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318997.485198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767318997.485198:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318997.485204:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940406400:0@lo:38:kworker.0
00000100:00080000:2.0:1767318997.485206:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318997.485211:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318997.485217:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4242
00000100:00080000:2.0:1767318997.485220:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318997.485224:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767318997.485239:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010380 x1853163940407168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318997.485239:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318997.485250:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318997.485251:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940406656:0@lo:400:kworker.0
00000100:00100000:0.0:1767318997.485281:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940406912:0@lo:38:kworker.0
00000100:00100000:2.0:1767318997.485288:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940406784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318997.485288:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318997.485316:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318997.485334:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318997.485339:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406528
00000100:00100000:0.0:1767318997.485348:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940407168:0@lo:38:kworker.0
00000100:00100000:3.0:1767318997.485348:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406528
00000100:00100000:2.0:1767318997.485359:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318997.485367:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940407040:0@lo:400:kworker.0
00000100:00100000:0.0:1767318997.485380:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318997.485404:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406272
00000100:00100000:2.0:1767318997.485409:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406272
00000100:00100000:3.0:1767318997.485424:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406656
00000100:00100000:3.0:1767318997.485429:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406656
00000100:00100000:0.0:1767318997.485435:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406912
00000100:00100000:2.0:1767318997.485436:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406784
00000100:00100000:2.0:1767318997.485441:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406784
00000100:00100000:0.0:1767318997.485453:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406912
00000100:00100000:3.0:1767318997.485471:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761
00000100:00100000:0.0:1767318997.485484:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407168
00000100:00100000:3.0:1767318997.485485:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940406528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318997.485490:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224
00000100:00100000:0.0:1767318997.485491:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407168
00000100:00100000:2.0:1767318997.485503:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940406784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318997.485513:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16709
00000100:00100000:0.0:1767318997.485520:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940406272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318997.485538:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318997.485548:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940406528:12345-0@lo:400:kworker.0 Request processed in 68us (350us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318997.485556:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940406784:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318997.485561:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761
00000100:00100000:2.0:1767318997.485570:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224
00000100:00100000:3.0:1767318997.485586:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762
00000100:00100000:0.0:1767318997.485587:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940406272:12345-0@lo:38:kworker.0 Request processed in 63us (469us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318997.485594:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16710
00000100:00100000:3.0:1767318997.485600:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940406656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318997.485604:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16709
00000100:00100000:2.0:1767318997.485605:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940406912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318997.485620:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318997.485627:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16711
00000100:00100000:0.0:1767318997.485632:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940407168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318997.485642:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318997.485654:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940406912:12345-0@lo:38:kworker.0 Request processed in 50us (339us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318997.485662:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16710
00000100:00100000:0.0:1767318997.485676:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940407168:12345-0@lo:38:kworker.0 Request processed in 41us (294us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318997.485706:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318997.485740:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940406784:0@lo:400:kworker.0
00000100:00100000:2.0:1767318997.485760:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407040
00000100:00100000:2.0:1767318997.485763:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407040
00000100:00100000:3.0:1767318997.485804:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940406656:12345-0@lo:400:kworker.0 Request processed in 207us (516us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318997.485812:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762
00000100:00100000:2.0:1767318997.485828:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225
00000100:00100000:2.0:1767318997.485838:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940407040:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318997.485838:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318997.485845:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318997.485849:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318997.485873:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940406656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318997.485904:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940406400
00000100:00100000:1.0:1767318997.485909:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940406400
00000100:00100000:1.0:1767318997.485933:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11
00000100:00100000:1.0:1767318997.485939:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940406400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318997.485950:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318997.485996:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16711
00000100:00100000:2.0:1767318997.487319:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940407040:12345-0@lo:400:kworker.0 Request processed in 1476us (1605us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318997.487330:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225
00000100:00100000:2.0:1767318997.487403:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940407040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318997.492131:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940406528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318997.492319:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940406400:12345-0@lo:38:kworker.0 Request processed in 6377us (7072us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318997.492328:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11
00000100:00080000:0.0:1767318997.492416:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318997.492422:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318997.492426:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940407168:0@lo:38:kworker.0
00000100:00080000:0.0:1767318997.492437:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318997.492442:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318997.492454:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940406400:0@lo:38:kworker.0
00000100:00080000:0.0:1767318997.492465:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318997.492468:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318997.492471:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940406912:0@lo:38:kworker.0
00000100:00080000:0.0:1767318997.492481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318997.492483:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318997.492486:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940406272:0@lo:38:kworker.0
00000100:00100000:2.0:1767318998.125710:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318998.445489:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318999.148906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767318999.469044:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319000.053175:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319000.053210:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940407296:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319000.053308:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319000.060921:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407296
00000100:00100000:0.0:1767319000.060942:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407296
00000100:00100000:0.0:1767319000.061070:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296
00000100:00100000:0.0:1767319000.061081:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940407296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319000.061123:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319000.061429:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319000.061699:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940407296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 617us (8387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319000.061710:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296
00000100:00100000:1.0:1767319000.066811:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940407296:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319000.174242:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319000.498676:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319001.069118:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940407424:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319001.069186:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319001.069512:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407424
00000100:00100000:3.0:1767319001.069521:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407424
00000100:00100000:3.0:1767319001.069585:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297
00000100:00100000:3.0:1767319001.069594:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940407424:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319001.069622:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319001.069671:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940407424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (484us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319001.069679:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297
00000100:00080000:1.0:1767319001.069804:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319001.069840:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940407424:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319001.158506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319001.158571:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294144
00000100:00100000:0.0:1767319001.158584:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294144
00000100:00100000:0.0:1767319001.158683:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4226
00000100:00100000:0.0:1767319001.158695:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894294144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319001.158805:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894294144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 113us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319001.158813:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4226
00000100:00080000:1.0:1767319001.158928:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767319001.160699:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894293888 offset 0 length 520: 4
00000100:00100000:1.0:1767319001.160748:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319001.160874:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294016
00000100:00100000:2.0:1767319001.160885:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294016
00000100:00100000:2.0:1767319001.160938:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16712
00000100:00100000:2.0:1767319001.160948:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894294016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319001.160977:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319001.161052:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894294016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (302us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319001.161060:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16712
00000100:00100000:2.0:1767319001.196885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319001.517082:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319002.220905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319002.541175:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319002.611323:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319002.611333:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319002.611336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319002.611340:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319002.611344:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319002.611352:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4247
00000100:00080000:2.0:1767319002.611356:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319002.611363:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319002.611469:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940407552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319002.611501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319002.611505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319002.611506:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319002.611510:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4247
00000100:00080000:2.0:1767319002.611512:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319002.611516:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319002.611530:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940407680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319002.611603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319002.611607:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319002.611608:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319002.611612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4247
00000100:00080000:2.0:1767319002.611615:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319002.611619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319002.611626:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940408064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.611630:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940408192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319002.611644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319002.611647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319002.611649:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319002.611652:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4247
00000100:00080000:2.0:1767319002.611655:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319002.611658:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319002.611672:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839500 x1853163940408448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319002.611719:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.611816:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319002.611823:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940408320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.611850:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319002.611866:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940407808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.611881:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940407552:0@lo:38:kworker.0
00000100:00100000:3.0:1767319002.611914:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.611921:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.611968:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940407680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319002.611985:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319002.611995:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940407936:0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.611999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.612022:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940408192:0@lo:38:kworker.0
00000100:00100000:3.0:1767319002.612032:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.612055:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319002.612079:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407808
00000100:00100000:3.0:1767319002.612087:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407808
00000100:00100000:3.0:1767319002.612137:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407936
00000100:00100000:3.0:1767319002.612140:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407936
00000100:00100000:3.0:1767319002.612164:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763
00000100:00100000:3.0:1767319002.612172:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940407808:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.612199:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408064
00000100:00100000:2.0:1767319002.612205:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408064
00000100:00100000:0.0:1767319002.612246:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940408448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319002.612332:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407680
00000100:00100000:3.0:1767319002.612334:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940407808:12345-0@lo:400:kworker.0 Request processed in 160us (418us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319002.612337:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407680
00000100:00100000:3.0:1767319002.612347:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763
00000100:00100000:1.0:1767319002.612372:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12
00000100:00100000:3.0:1767319002.612373:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764
00000100:00100000:1.0:1767319002.612381:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940407680:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319002.612386:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940407936:12345-0@lo:400:kworker.0
00010000:00020000:1.0:1767319002.612415:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319002.612433:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940407936:12345-0@lo:400:kworker.0 Request processed in 50us (401us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319002.612441:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764
00000100:00100000:1.0:1767319002.612459:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940407680:12345-0@lo:38:kworker.0 Request processed in 78us (461us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319002.612467:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12
00000100:00080000:3.0:1767319002.612467:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319002.612475:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319002.612506:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408320
00000100:00100000:1.0:1767319002.612511:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408320
00000100:00100000:2.0:1767319002.612567:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940407552
00000100:00100000:2.0:1767319002.612571:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940407552
00000100:00100000:2.0:1767319002.612586:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408192
00000100:00100000:2.0:1767319002.612588:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408192
00000100:00100000:2.0:1767319002.612597:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227
00000100:00100000:2.0:1767319002.612604:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940408064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.612643:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940408064:12345-0@lo:400:kworker.0 Request processed in 40us (924us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319002.612651:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227
00000100:00080000:3.0:1767319002.613061:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319002.613098:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940407936:0@lo:400:kworker.0
00000100:00100000:3.0:1767319002.613109:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940407808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319002.613166:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16713
00000100:00100000:3.0:1767319002.613171:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940407552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319002.613184:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319002.613216:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940407552:12345-0@lo:38:kworker.0 Request processed in 44us (1299us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319002.613221:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16713
00000100:00100000:3.0:1767319002.613235:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16714
00000100:00100000:3.0:1767319002.613238:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940408192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319002.613246:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319002.613268:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940408192:12345-0@lo:38:kworker.0 Request processed in 28us (1214us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319002.613275:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16714
00000100:00100000:3.0:1767319002.613353:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940408064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.618333:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228
00000100:00100000:1.0:1767319002.618360:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940408320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.618505:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940408320:12345-0@lo:400:kworker.0 Request processed in 161us (6655us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319002.618513:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228
00000100:00100000:1.0:1767319002.618598:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940408320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.620408:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319002.620501:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319002.620509:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319002.620513:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940407552:0@lo:38:kworker.0
00000100:00080000:0.0:1767319002.620528:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319002.620532:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319002.620535:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940407680:0@lo:38:kworker.0
00000100:00080000:0.0:1767319002.620546:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319002.620549:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319002.620553:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940408192:0@lo:38:kworker.0
00000100:00100000:3.0:1767319002.620640:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408448
00000100:00100000:3.0:1767319002.620657:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408448
00000100:00100000:3.0:1767319002.620697:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16715
00000100:00100000:3.0:1767319002.620706:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940408448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319002.620732:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319002.620850:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940408448:12345-0@lo:38:kworker.0 Request processed in 142us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319002.620857:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16715
00000100:00080000:0.0:1767319002.621458:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319002.621464:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319002.621468:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940408448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319003.244917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319003.565766:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319004.268896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319004.589206:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319005.169805:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319005.169827:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940408576:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319005.169898:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319005.170099:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408576
00000100:00100000:2.0:1767319005.170107:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408576
00000100:00100000:2.0:1767319005.170173:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298
00000100:00100000:2.0:1767319005.170182:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940408576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319005.170215:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319005.170268:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940408576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319005.170275:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298
00000100:00080000:3.0:1767319005.170331:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319005.170402:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940408576:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319005.294039:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319005.613023:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319006.189279:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940408704:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319006.189347:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319006.189722:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408704
00000100:00100000:0.0:1767319006.189731:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408704
00000100:00100000:0.0:1767319006.189851:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299
00000100:00100000:0.0:1767319006.189861:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940408704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319006.189889:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319006.190104:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319006.190455:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940408704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 594us (1104us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319006.190463:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299
00000100:00100000:1.0:1767319006.190536:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940408704:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319006.282253:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319006.282311:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319006.282466:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294400
00000100:00100000:3.0:1767319006.282477:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294400
00000100:00080000:2.0:1767319006.282607:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319006.282686:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294272
00000100:00100000:3.0:1767319006.282691:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294272
00000100:00100000:1.0:1767319006.286347:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4229
00000100:00100000:1.0:1767319006.286385:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894294400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319006.286482:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894294400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 121us (4238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319006.286491:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4229
00000100:00100000:1.0:1767319006.286521:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16716
00000100:00100000:1.0:1767319006.286526:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894294272:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319006.286548:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319006.286573:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894294272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (4262us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319006.286580:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16716
00000100:00100000:2.0:1767319006.316875:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319006.637402:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319007.340884:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319007.665910:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319007.725857:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318982/real 1767318982]  req@ffff93d06d197b80 x1853163940402304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319007 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319007.725896:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d197b80 x1853163940402304/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319007 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319007.725918:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.725928:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00080000:3.0:1767319007.725932:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319007.725933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940402304:0@lo:250:kworker.0
00000100:00080000:3.0:1767319007.725944:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319007.725948:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319007.736473:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4232
00000100:00080000:3.0:1767319007.736482:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319007.736491:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319007.736534:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940408832/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319007.736574:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319007.736578:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319007.736581:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319007.736587:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4252
00000100:00080000:3.0:1767319007.736598:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319007.736602:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319007.736617:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940408960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319007.736626:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319007.736629:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319007.736631:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319007.736634:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4252
00000100:00080000:3.0:1767319007.736637:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319007.736640:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319007.736650:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940409088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319007.736721:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319007.736734:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319007.736736:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319007.736739:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4252
00000100:00080000:3.0:1767319007.736741:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319007.736746:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319007.736758:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010e00 x1853163940409600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319007.736787:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319007.736790:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319007.736792:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319007.736796:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4252
00000100:00080000:3.0:1767319007.736798:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319007.736801:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319007.736809:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940409216:0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.736822:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978000 x1853163940409856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319007.736852:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940409472:0@lo:400:kworker.0
00000100:00100000:1.0:1767319007.736879:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319007.736880:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319007.736957:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940408832:0@lo:250:kworker.0
00000100:00100000:3.0:1767319007.737047:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319007.737054:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940409728:0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.737078:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319007.737112:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409216
00000100:00100000:3.0:1767319007.737125:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409216
00000100:00100000:3.0:1767319007.737182:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765
00000100:00100000:3.0:1767319007.737194:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940409216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.737243:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940409216:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319007.737250:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765
00000100:00080000:3.0:1767319007.737275:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319007.737294:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409472
00000100:00100000:3.0:1767319007.737298:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409472
00000100:00100000:3.0:1767319007.737326:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409728
00000100:00100000:3.0:1767319007.737330:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409728
00000100:00100000:3.0:1767319007.737363:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230
00000100:00100000:3.0:1767319007.737369:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940409472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.737404:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940409472:12345-0@lo:400:kworker.0 Request processed in 35us (522us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319007.737409:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230
00000100:00100000:3.0:1767319007.737420:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231
00000100:00100000:3.0:1767319007.737426:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940409728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.737451:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940409728:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319007.737455:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231
00000100:00080000:3.0:1767319007.737475:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319007.737502:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940409728:0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.737513:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940409472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.737623:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940409344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.737653:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319007.737957:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409344
00000100:00100000:3.0:1767319007.737962:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409344
00000100:00100000:3.0:1767319007.738001:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766
00000100:00100000:3.0:1767319007.738008:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940409344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319007.738047:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940409344:12345-0@lo:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319007.738053:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766
00000100:00100000:0.0:1767319007.738318:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940409344:0@lo:400:kworker.0
00000400:00000100:2.0:1767319007.739950:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940408832 offset 0 length 520: 4
00000100:00100000:1.0:1767319007.739962:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940409216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.739985:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940408960:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.740029:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319007.740208:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940409088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.740239:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319007.740267:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940409600:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.740286:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319007.740335:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409088
00000100:00100000:3.0:1767319007.740341:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409088
00000100:00100000:3.0:1767319007.740387:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13
00000100:00100000:3.0:1767319007.740394:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940409088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319007.740414:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319007.740447:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940409088:12345-0@lo:38:kworker.0 Request processed in 52us (207us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319007.740454:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13
00000100:00100000:2.0:1767319007.740736:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940409856:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.740757:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.740892:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940408960
00000100:00100000:0.0:1767319007.740896:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940408960
00000100:00100000:0.0:1767319007.740928:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409600
00000100:00100000:0.0:1767319007.740930:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409600
00000100:00100000:0.0:1767319007.740946:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16717
00000100:00100000:0.0:1767319007.740951:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940408960:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319007.740962:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319007.740988:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940408960:12345-0@lo:38:kworker.0 Request processed in 37us (959us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319007.740994:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16717
00000100:00100000:0.0:1767319007.741004:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16718
00000100:00100000:0.0:1767319007.741008:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940409600:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319007.741016:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319007.741177:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940409600:12345-0@lo:38:kworker.0 Request processed in 166us (888us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319007.741183:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16718
00000100:00080000:2.0:1767319007.741266:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.741271:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319007.741274:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940408960:0@lo:38:kworker.0
00000100:00080000:2.0:1767319007.741283:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.741286:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319007.741288:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940409088:0@lo:38:kworker.0
00000100:00080000:2.0:1767319007.741295:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.741298:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319007.741301:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940409600:0@lo:38:kworker.0
00000100:00100000:0.0:1767319007.741370:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409856
00000100:00100000:0.0:1767319007.741374:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409856
00000100:00100000:0.0:1767319007.741398:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16719
00000100:00100000:0.0:1767319007.741402:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940409856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319007.741411:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319007.741446:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940409856:12345-0@lo:38:kworker.0 Request processed in 42us (687us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319007.741451:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16719
00000100:00080000:2.0:1767319007.741539:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.741542:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319007.741545:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940409856:0@lo:38:kworker.0
00000100:00100000:0.0:1767319008.371514:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319008.690015:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319009.389046:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319009.709821:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319010.285284:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319010.285310:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940409984:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319010.285412:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319010.285503:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940409984
00000100:00100000:1.0:1767319010.285515:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940409984
00000100:00100000:1.0:1767319010.285611:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300
00000100:00100000:1.0:1767319010.285622:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940409984:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319010.285658:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767319010.285669:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319010.285714:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940409984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319010.285724:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300
00000100:00100000:2.0:1767319010.285833:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940409984:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319010.413570:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319010.733267:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319011.310669:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319011.310701:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940410112:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319011.310824:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319011.310970:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410112
00000100:00100000:3.0:1767319011.311124:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410112
00000100:00100000:3.0:1767319011.311222:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301
00000100:00100000:3.0:1767319011.311238:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940410112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319011.311280:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319011.311514:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940410112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 281us (690us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319011.311524:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301
00000100:00080000:1.0:1767319011.311915:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319011.312253:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940410112:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319011.398698:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319011.398955:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294528
00000100:00100000:1.0:1767319011.398969:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294528
00000100:00100000:1.0:1767319011.399098:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16720
00000100:00100000:1.0:1767319011.399108:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894294528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319011.399140:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319011.399230:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894294528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 122us (547us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319011.399238:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16720
00000100:00100000:1.0:1767319011.400291:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319011.400454:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294656
00000100:00100000:3.0:1767319011.400462:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294656
00000100:00100000:3.0:1767319011.400549:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4232
00000100:00100000:3.0:1767319011.400559:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894294656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319011.400641:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894294656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (352us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319011.400651:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4232
00000100:00080000:1.0:1767319011.401210:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319011.436962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319011.757736:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319012.460907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319012.781186:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319012.845108:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319012.845141:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319012.845144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319012.845150:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319012.845156:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319012.845167:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4257
00000100:00080000:2.0:1767319012.845174:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319012.845182:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319012.845523:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940410240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319012.845556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319012.845560:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319012.845562:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319012.845567:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4257
00000100:00080000:2.0:1767319012.845569:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319012.845574:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319012.845589:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940410368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319012.847789:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940410496:0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.847887:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319012.847962:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319012.847970:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940410624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.847993:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319012.848037:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410496
00000100:00100000:3.0:1767319012.848044:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410496
00000100:00100000:3.0:1767319012.848095:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410624
00000100:00100000:3.0:1767319012.848099:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410624
00000100:00100000:3.0:1767319012.848122:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767
00000100:00100000:3.0:1767319012.848131:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940410496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.848184:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940410496:12345-0@lo:400:kworker.0 Request processed in 54us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319012.848194:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767
00000100:00100000:3.0:1767319012.848212:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768
00000100:00100000:3.0:1767319012.848218:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940410624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.848245:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940410624:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319012.848251:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768
00000100:00100000:3.0:1767319012.848298:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940410624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.848323:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940410496:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.852852:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940410752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.853162:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319012.853237:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319012.853255:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940410240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319012.853284:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319012.853318:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940410368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319012.853346:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319012.853384:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410368
00000100:00100000:1.0:1767319012.853391:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410368
00000100:00100000:1.0:1767319012.853433:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14
00000100:00100000:1.0:1767319012.853440:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940410368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319012.853462:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319012.853505:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940410368:12345-0@lo:38:kworker.0 Request processed in 64us (157us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319012.853512:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14
00000100:00080000:1.0:1767319012.853555:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319012.853561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319012.853564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940410368:0@lo:38:kworker.0
00000100:00100000:3.0:1767319012.853668:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410752
00000100:00100000:3.0:1767319012.853672:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410752
00000100:00100000:3.0:1767319012.853812:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410240
00000100:00100000:3.0:1767319012.853816:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410240
00000100:00100000:3.0:1767319012.853833:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4233
00000100:00100000:3.0:1767319012.853844:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940410752:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319012.853878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319012.853889:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767319012.853891:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940410752:12345-0@lo:400:kworker.0 Request processed in 49us (728us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319012.853895:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767319012.853905:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4233
00000100:00100000:3.0:1767319012.853923:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16721
00000100:00100000:3.0:1767319012.853927:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940410240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319012.853938:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319012.853965:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940410240:12345-0@lo:38:kworker.0 Request processed in 37us (680us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319012.853971:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16721
00000100:00080000:2.0:1767319012.853985:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4257
00000100:00080000:2.0:1767319012.853990:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319012.854000:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319012.854044:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940410880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319012.854076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319012.854079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319012.854082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319012.854086:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4257
00000100:00080000:2.0:1767319012.854088:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319012.854092:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319012.854102:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1c00 x1853163940411136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319012.854219:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940411008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.854282:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319012.854351:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411008
00000100:00100000:0.0:1767319012.854359:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411008
00000100:00100000:0.0:1767319012.854407:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4234
00000100:00100000:0.0:1767319012.854417:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940411008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319012.854478:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940411008:12345-0@lo:400:kworker.0 Request processed in 64us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319012.854487:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4234
00000100:00100000:2.0:1767319012.854535:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940411008:0@lo:400:kworker.0
00000100:00080000:1.0:1767319012.854878:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319012.854914:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940410752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.854942:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940410880:0@lo:38:kworker.0
00000100:00100000:1.0:1767319012.854973:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319012.855007:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940411136:0@lo:38:kworker.0
00000100:00100000:1.0:1767319012.855031:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319012.855061:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319012.855066:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319012.855070:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940410240:0@lo:38:kworker.0
00000100:00100000:0.0:1767319012.856545:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940410880
00000100:00100000:0.0:1767319012.856555:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940410880
00000100:00100000:0.0:1767319012.856610:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16722
00000100:00100000:0.0:1767319012.856618:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940410880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319012.856639:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319012.856734:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940410880:12345-0@lo:38:kworker.0 Request processed in 115us (1758us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319012.856741:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16722
00000100:00100000:0.0:1767319012.856759:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411136
00000100:00100000:0.0:1767319012.856762:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411136
00000100:00100000:0.0:1767319012.856815:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16723
00000100:00100000:0.0:1767319012.856819:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940411136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319012.856830:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319012.856859:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940411136:12345-0@lo:38:kworker.0 Request processed in 38us (1827us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319012.856864:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16723
00000100:00080000:1.0:1767319012.857275:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319012.857282:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319012.857286:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940410880:0@lo:38:kworker.0
00000100:00080000:1.0:1767319012.857297:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319012.857302:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319012.857313:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940411136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319013.484919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319013.811660:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319014.508913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319014.834015:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319015.405363:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319015.405390:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940411264:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319015.405463:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319015.405598:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411264
00000100:00100000:2.0:1767319015.405609:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411264
00000100:00100000:2.0:1767319015.405680:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302
00000100:00100000:2.0:1767319015.405689:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940411264:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319015.405719:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319015.405790:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940411264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319015.405799:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302
00000100:00080000:1.0:1767319015.405861:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319015.405878:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940411264:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319015.534613:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319015.855669:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319016.429349:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940411392:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319016.429432:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.429581:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411392
00000100:00100000:2.0:1767319016.429590:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411392
00000100:00100000:2.0:1767319016.429659:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303
00000100:00100000:2.0:1767319016.429669:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940411392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319016.429701:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319016.429747:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940411392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319016.429754:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303
00000100:00080000:1.0:1767319016.429891:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319016.429925:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940411392:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319016.527516:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319016.527756:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319016.528057:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294784
00000100:00100000:3.0:1767319016.528067:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294784
00000100:00100000:1.0:1767319016.528118:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894294912
00000100:00100000:1.0:1767319016.528122:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894294912
00000100:00100000:1.0:1767319016.528222:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4235
00000100:00100000:1.0:1767319016.528232:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894294912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319016.528326:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894294912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (569us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319016.528335:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4235
00000100:00100000:1.0:1767319016.528352:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16724
00000100:00100000:1.0:1767319016.528356:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894294784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319016.528378:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319016.528403:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894294784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (898us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319016.528409:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16724
00000100:00080000:2.0:1767319016.528568:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319016.558486:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319016.879160:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319017.580910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319017.902911:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319017.964908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319017.964920:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319017.964923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319017.964927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319017.964932:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319017.964942:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4262
00000100:00080000:2.0:1767319017.964948:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319017.964955:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319017.964995:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940411520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319017.965018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319017.965022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319017.965024:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319017.965027:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4262
00000100:00080000:2.0:1767319017.965030:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319017.965033:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319017.965046:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940411648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319017.965113:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319017.965117:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319017.965119:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319017.965122:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4262
00000100:00080000:2.0:1767319017.965125:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319017.965130:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319017.965139:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0380 x1853163940412160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319017.965154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319017.965157:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319017.965158:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319017.965162:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4262
00000100:00080000:2.0:1767319017.965164:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319017.965167:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319017.965176:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1f80 x1853163940412416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319017.965324:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940411776:0@lo:400:kworker.0
00000100:00100000:3.0:1767319017.965396:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319017.965464:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319017.965470:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940411904:0@lo:400:kworker.0
00000100:00100000:3.0:1767319017.965492:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319017.965528:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411776
00000100:00100000:3.0:1767319017.965535:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411776
00000100:00100000:3.0:1767319017.965595:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411904
00000100:00100000:3.0:1767319017.965599:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411904
00000100:00100000:3.0:1767319017.965623:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769
00000100:00100000:3.0:1767319017.965631:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940411776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319017.965684:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940411776:12345-0@lo:400:kworker.0 Request processed in 53us (287us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319017.965692:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769
00000100:00100000:3.0:1767319017.965709:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770
00000100:00100000:3.0:1767319017.965715:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940411904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319017.965741:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940411904:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319017.965746:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770
00000100:00080000:3.0:1767319017.965765:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319017.965829:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940411904:0@lo:400:kworker.0
00000100:00100000:3.0:1767319017.965839:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940411776:0@lo:400:kworker.0
00000100:00100000:0.0:1767319017.965971:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940412032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319017.966009:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319017.966043:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319017.966048:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940412288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319017.966070:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319017.966143:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412032
00000100:00100000:2.0:1767319017.966147:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412032
00000100:00100000:2.0:1767319017.966188:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412288
00000100:00100000:2.0:1767319017.966191:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412288
00000100:00100000:2.0:1767319017.966211:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4236
00000100:00100000:2.0:1767319017.966217:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940412032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319017.966254:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940412032:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319017.966270:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4236
00000100:00100000:2.0:1767319017.966283:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4237
00000100:00100000:2.0:1767319017.966289:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940412288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319017.966314:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940412288:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319017.966320:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4237
00000100:00100000:1.0:1767319017.966428:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940411520:0@lo:38:kworker.0
00000100:00100000:1.0:1767319017.966459:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319017.966477:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940411648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319017.966500:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319017.966515:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940412160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319017.966533:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319017.966545:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940412416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319017.966564:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319017.966592:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411648
00000100:00100000:1.0:1767319017.966596:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411648
00000100:00100000:1.0:1767319017.966617:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15
00000100:00100000:1.0:1767319017.966621:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940411648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319017.966640:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319017.966672:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940411648:12345-0@lo:38:kworker.0 Request processed in 49us (171us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319017.966678:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15
00000100:00080000:1.0:1767319017.966708:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319017.966713:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319017.966717:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940411648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319017.966734:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940411520
00000100:00100000:1.0:1767319017.966737:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940411520
00000100:00100000:1.0:1767319017.966748:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412160
00000100:00100000:1.0:1767319017.966751:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412160
00000100:00100000:1.0:1767319017.966758:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412416
00000100:00100000:1.0:1767319017.966760:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412416
00000100:00100000:1.0:1767319017.966769:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16725
00000100:00100000:1.0:1767319017.966792:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940411520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319017.966803:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319017.966830:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940411520:12345-0@lo:38:kworker.0 Request processed in 38us (370us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319017.966837:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16725
00000100:00100000:1.0:1767319017.966849:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16726
00000100:00100000:1.0:1767319017.966852:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940412160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319017.966860:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319017.966883:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940412160:12345-0@lo:38:kworker.0 Request processed in 28us (349us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319017.966889:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16726
00000100:00100000:1.0:1767319017.966899:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16727
00000100:00100000:1.0:1767319017.966902:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940412416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319017.966910:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319017.966928:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940412416:12345-0@lo:38:kworker.0 Request processed in 25us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319017.966933:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16727
00000100:00080000:1.0:1767319017.966952:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319017.966955:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319017.966958:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940411520:0@lo:38:kworker.0
00000100:00080000:1.0:1767319017.966964:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319017.966967:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319017.966970:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940412160:0@lo:38:kworker.0
00000100:00080000:1.0:1767319017.966976:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319017.966980:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319017.966982:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940412416:0@lo:38:kworker.0
00000100:00080000:0.0:1767319017.967102:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319017.967125:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940412288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319017.967135:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940412032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319018.604929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319018.925183:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319019.629205:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319019.949641:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319020.525259:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940412544:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319020.525345:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319020.525553:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412544
00000100:00100000:0.0:1767319020.525562:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412544
00000100:00100000:0.0:1767319020.525644:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304
00000100:00100000:0.0:1767319020.525654:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940412544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319020.525684:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319020.525746:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940412544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (401us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319020.525754:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304
00000100:00100000:1.0:1767319020.525940:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940412544:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319020.526005:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319020.652910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319020.975471:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319021.551003:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940412672:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319021.551092:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319021.551490:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412672
00000100:00100000:3.0:1767319021.551498:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412672
00000100:00100000:3.0:1767319021.551584:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305
00000100:00100000:3.0:1767319021.551595:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940412672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319021.551630:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319021.551693:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940412672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (600us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319021.551699:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305
00000100:00080000:0.0:1767319021.551761:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319021.551891:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940412672:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319021.639634:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319021.639689:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295168
00000100:00100000:3.0:1767319021.639701:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295168
00000100:00100000:2.0:1767319021.641038:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767319021.641437:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319021.642286:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295040
00000100:00100000:1.0:1767319021.642298:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295040
00000100:00100000:1.0:1767319021.642508:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16728
00000100:00100000:1.0:1767319021.642516:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894295040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319021.642555:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319021.642660:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894295040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 142us (1637us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319021.642668:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16728
00000100:00100000:3.0:1767319021.644302:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4238
00000100:00100000:3.0:1767319021.644321:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894295168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319021.644393:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894295168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (4771us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319021.644401:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4238
00000100:00100000:0.0:1767319021.676974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319022.000154:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319022.700904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319023.021821:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319023.085677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319023.085687:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319023.085690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319023.085694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319023.085699:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319023.085706:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4267
00000100:00080000:0.0:1767319023.085710:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319023.085716:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319023.085756:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ca80 x1853163940412800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319023.085804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319023.085808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319023.085810:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319023.085813:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4267
00000100:00080000:0.0:1767319023.085816:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319023.085819:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319023.085833:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219c700 x1853163940412928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319023.085895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319023.085899:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319023.085901:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319023.085905:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4267
00000100:00080000:0.0:1767319023.085907:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319023.085911:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319023.085930:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940413440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319023.085946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319023.085950:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319023.085952:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319023.085955:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4267
00000100:00080000:0.0:1767319023.085957:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319023.085961:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319023.085971:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940413696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319023.086046:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940413312:0@lo:400:kworker.0
00000100:00100000:2.0:1767319023.086103:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940413056:0@lo:400:kworker.0
00000100:00100000:1.0:1767319023.086111:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319023.086144:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319023.086208:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319023.086261:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319023.086300:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413056
00000100:00100000:3.0:1767319023.086307:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413056
00000100:00100000:3.0:1767319023.086358:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413184
00000100:00100000:3.0:1767319023.086361:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413184
00000100:00100000:1.0:1767319023.086505:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319023.086512:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940413568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319023.086539:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319023.086567:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413312
00000100:00100000:1.0:1767319023.086571:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413312
00000100:00100000:1.0:1767319023.086610:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413568
00000100:00100000:1.0:1767319023.086613:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413568
00000100:00100000:1.0:1767319023.086637:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239
00000100:00100000:1.0:1767319023.086645:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940413312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319023.086698:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940413312:12345-0@lo:400:kworker.0 Request processed in 54us (587us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319023.086705:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239
00000100:00100000:1.0:1767319023.086723:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240
00000100:00100000:1.0:1767319023.086729:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940413568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319023.086755:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940413568:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319023.086761:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240
00000100:00100000:1.0:1767319023.086804:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940412800:0@lo:38:kworker.0
00000100:00100000:1.0:1767319023.086828:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319023.086845:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940412928:0@lo:38:kworker.0
00000100:00100000:1.0:1767319023.086870:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319023.086887:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940413440:0@lo:38:kworker.0
00000100:00100000:1.0:1767319023.086907:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319023.086921:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940413696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319023.086940:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319023.086982:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412928
00000100:00100000:1.0:1767319023.086986:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412928
00000100:00100000:1.0:1767319023.087006:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16
00000100:00100000:1.0:1767319023.087011:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940412928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319023.087029:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319023.087062:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940412928:12345-0@lo:38:kworker.0 Request processed in 49us (190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319023.087068:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16
00000100:00100000:1.0:1767319023.087083:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940412800
00000100:00100000:1.0:1767319023.087087:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940412800
00000100:00100000:1.0:1767319023.087104:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413440
00000100:00100000:1.0:1767319023.087106:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413440
00000100:00100000:1.0:1767319023.087113:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413696
00000100:00100000:1.0:1767319023.087116:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413696
00000100:00100000:1.0:1767319023.087125:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16729
00000100:00100000:1.0:1767319023.087129:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940412800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319023.087138:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319023.087163:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940412800:12345-0@lo:38:kworker.0 Request processed in 32us (334us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319023.087169:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16729
00000100:00100000:1.0:1767319023.087180:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16730
00000100:00100000:1.0:1767319023.087183:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940413440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319023.087192:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319023.087224:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940413440:12345-0@lo:38:kworker.0 Request processed in 39us (317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319023.087230:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16730
00000100:00100000:1.0:1767319023.087241:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16731
00000100:00100000:1.0:1767319023.087245:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940413696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319023.087253:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319023.087274:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940413696:12345-0@lo:38:kworker.0 Request processed in 29us (334us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319023.087279:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16731
00000100:00080000:1.0:1767319023.087320:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319023.087324:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319023.087328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940412800:0@lo:38:kworker.0
00000100:00080000:1.0:1767319023.087336:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319023.087339:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319023.087342:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940412928:0@lo:38:kworker.0
00000100:00080000:1.0:1767319023.087348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319023.087351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319023.087354:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940413440:0@lo:38:kworker.0
00000100:00080000:1.0:1767319023.087360:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319023.087363:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319023.087365:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940413696:0@lo:38:kworker.0
00000100:00100000:3.0:1767319023.088142:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771
00000100:00100000:3.0:1767319023.088152:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940413056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319023.088200:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940413056:12345-0@lo:400:kworker.0 Request processed in 50us (2055us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319023.088206:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771
00000100:00100000:3.0:1767319023.088229:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772
00000100:00100000:3.0:1767319023.088236:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319023.088270:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413184:12345-0@lo:400:kworker.0 Request processed in 35us (2008us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319023.088275:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772
00000100:00080000:3.0:1767319023.088294:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319023.088298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319023.088301:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319023.088333:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319023.088763:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940413568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319023.088803:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940413312:0@lo:400:kworker.0
00000100:00100000:2.0:1767319023.088936:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940413056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319023.724869:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319024.047799:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319024.748909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319025.069250:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319025.645144:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319025.645171:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413824:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319025.645268:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319025.645647:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413824
00000100:00100000:1.0:1767319025.645656:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413824
00000100:00100000:1.0:1767319025.645738:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306
00000100:00100000:1.0:1767319025.645748:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319025.645798:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319025.645867:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (597us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319025.645875:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306
00000100:00100000:0.0:1767319025.646013:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413824:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319025.646074:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319025.774143:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319026.093071:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319026.669238:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413952:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319026.669322:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.669739:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940413952
00000100:00100000:2.0:1767319026.669748:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940413952
00000100:00100000:2.0:1767319026.669877:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307
00000100:00100000:2.0:1767319026.669887:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319026.669918:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319026.670312:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319026.670363:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940413952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 475us (1038us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319026.670371:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307
00000100:00100000:0.0:1767319026.671040:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940413952:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319026.759208:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319026.759289:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319026.759323:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894295552 offset 0 length 520: 4
00000100:00100000:1.0:1767319026.759414:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295424
00000100:00100000:1.0:1767319026.759424:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295424
00000100:00100000:1.0:1767319026.759492:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295296
00000100:00100000:1.0:1767319026.759496:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295296
00000100:00100000:1.0:1767319026.759518:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4241
00000100:00100000:1.0:1767319026.759527:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894295424:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319026.759596:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894295424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (396us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319026.759605:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4241
00000100:00100000:1.0:1767319026.759623:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16732
00000100:00100000:1.0:1767319026.759628:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894295296:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319026.759649:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319026.759674:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894295296:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (385us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319026.759681:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16732
00000100:00080000:3.0:1767319026.759957:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319026.797343:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319027.117740:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319027.820925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319028.144825:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319028.204904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319028.204914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319028.204918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319028.204922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319028.204926:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319028.204934:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4273
00000100:00080000:0.0:1767319028.204938:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319028.204945:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319028.204983:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5880 x1853163940414080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319028.205008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319028.205011:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319028.205012:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319028.205015:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4273
00000100:00080000:0.0:1767319028.205017:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319028.205020:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319028.205036:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7b80 x1853163940414208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319028.205101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319028.205105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319028.205106:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319028.205109:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4273
00000100:00080000:0.0:1767319028.205111:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319028.205115:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319028.205125:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940414720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319028.205140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319028.205143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319028.205145:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319028.205149:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4273
00000100:00080000:0.0:1767319028.205152:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319028.205155:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319028.205161:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940414464:0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.205176:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf480 x1853163940414976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319028.205200:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940414848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319028.205477:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319028.205546:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319028.205553:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940414336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319028.205577:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319028.205606:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414464
00000100:00100000:3.0:1767319028.205612:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414464
00000100:00100000:3.0:1767319028.205655:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414336
00000100:00100000:3.0:1767319028.205659:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414336
00000100:00100000:3.0:1767319028.205683:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773
00000100:00100000:3.0:1767319028.205693:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940414464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.205713:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.205747:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319028.205754:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940414592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.205803:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.205828:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414848
00000100:00100000:0.0:1767319028.205832:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414848
00000100:00100000:0.0:1767319028.206266:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414592
00000100:00100000:0.0:1767319028.206270:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414592
00000100:00100000:0.0:1767319028.206291:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4242
00000100:00100000:0.0:1767319028.206304:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940414848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.206338:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940414848:12345-0@lo:400:kworker.0 Request processed in 42us (626us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319028.206346:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4242
00000100:00100000:0.0:1767319028.206363:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243
00000100:00100000:0.0:1767319028.206369:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940414592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.206396:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940414592:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319028.206402:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243
00000100:00100000:0.0:1767319028.206438:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940414592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.206450:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940414848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.206489:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940414080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319028.206508:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.206525:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940414208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319028.206540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.206550:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940414720:0@lo:38:kworker.0
00000100:00100000:0.0:1767319028.206567:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.206589:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940414976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319028.206608:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319028.206644:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414080
00000100:00100000:0.0:1767319028.206647:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414080
00000100:00100000:0.0:1767319028.206660:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414720
00000100:00100000:0.0:1767319028.206662:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414720
00000100:00100000:0.0:1767319028.206665:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414976
00000100:00100000:0.0:1767319028.206667:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414976
00000100:00100000:0.0:1767319028.206672:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16733
00000100:00100000:0.0:1767319028.206675:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319028.206690:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319028.206718:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414080:12345-0@lo:38:kworker.0 Request processed in 41us (209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319028.206724:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16733
00000100:00100000:0.0:1767319028.206735:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16734
00000100:00100000:0.0:1767319028.206739:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414720:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319028.206748:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319028.206770:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414720:12345-0@lo:38:kworker.0 Request processed in 29us (201us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319028.206800:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16734
00000100:00100000:0.0:1767319028.206809:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16735
00000100:00100000:0.0:1767319028.206811:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414976:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319028.206818:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319028.207358:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940414976:12345-0@lo:38:kworker.0 Request processed in 22us (227us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319028.207368:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16735
00000100:00080000:0.0:1767319028.207411:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319028.207415:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319028.207417:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940414080:0@lo:38:kworker.0
00000100:00080000:0.0:1767319028.207423:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319028.207425:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319028.207427:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940414720:0@lo:38:kworker.0
00000100:00080000:0.0:1767319028.207431:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319028.207433:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319028.207435:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940414976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319028.207466:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940414208
00000100:00100000:0.0:1767319028.207469:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940414208
00000100:00100000:0.0:1767319028.207485:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17
00000100:00100000:0.0:1767319028.207488:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940414208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319028.207495:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319028.207520:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940414208:12345-0@lo:38:kworker.0 Request processed in 31us (979us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319028.207523:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17
00000100:00080000:0.0:1767319028.207541:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319028.207544:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319028.207545:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940414208:0@lo:38:kworker.0
00000100:00100000:3.0:1767319028.220702:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940414464:12345-0@lo:400:kworker.0 Request processed in 58us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319028.220720:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773
00000100:00100000:0.0:1767319028.220737:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774
00000100:00100000:0.0:1767319028.220760:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940414336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.220857:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940414336:12345-0@lo:400:kworker.0 Request processed in 111us (15280us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319028.220862:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774
00000100:00100000:0.0:1767319028.220902:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940414336:0@lo:400:kworker.0
00000100:00100000:0.0:1767319028.220911:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940414464:0@lo:400:kworker.0
00000100:00080000:3.0:1767319028.221805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319028.221814:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319028.221818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319028.844906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319029.165184:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319029.868948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319030.189202:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319030.765011:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940415104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319030.765083:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319030.765233:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415104
00000100:00100000:3.0:1767319030.765243:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415104
00000100:00100000:3.0:1767319030.765303:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308
00000100:00100000:3.0:1767319030.765314:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940415104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319030.765496:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767319030.765677:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319030.765983:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940415104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 670us (898us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319030.765991:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308
00000100:00100000:2.0:1767319030.766082:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940415104:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319030.895533:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319031.213037:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319031.791807:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319031.791841:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940415232:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319031.791920:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319031.793885:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415232
00000100:00100000:3.0:1767319031.793901:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415232
00000100:00100000:3.0:1767319031.793984:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309
00000100:00100000:3.0:1767319031.793995:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940415232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319031.794029:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319031.794116:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940415232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2195us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319031.794124:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309
00000100:00100000:3.0:1767319031.794202:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940415232:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319031.795654:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319031.879612:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319031.879663:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319031.881297:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295808
00000100:00100000:1.0:1767319031.881311:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295808
00000100:00100000:1.0:1767319031.881445:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295680
00000100:00100000:1.0:1767319031.881450:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295680
00000100:00100000:1.0:1767319031.881477:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4244
00000100:00100000:1.0:1767319031.881487:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894295808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319031.881573:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894295808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (1970us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319031.881582:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4244
00000100:00100000:1.0:1767319031.881601:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16736
00000100:00100000:1.0:1767319031.881605:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894295680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319031.881626:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319031.881649:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894295680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (1985us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319031.881655:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16736
00000100:00080000:3.0:1767319031.882473:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319031.916915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319032.237970:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319032.300925:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319007/real 1767319007]  req@ffff93cf52013480 x1853163940408832/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319032 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319032.300961:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf52013480 x1853163940408832/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319032 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319032.300987:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319032.301009:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319032.301013:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940408832:0@lo:250:kworker.0
00000100:00080000:3.0:1767319032.301630:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319032.301636:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319032.301639:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319032.301644:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4257
00000100:00080000:3.0:1767319032.301649:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319032.301654:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319032.301688:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940415360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319032.301720:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319032.301724:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319032.301725:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319032.301729:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4278
00000100:00080000:3.0:1767319032.301731:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319032.301734:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319032.301747:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940415488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319032.301756:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319032.301759:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319032.301761:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319032.301764:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4278
00000100:00080000:3.0:1767319032.301766:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319032.301768:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319032.301801:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010380 x1853163940415616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319032.301859:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319032.301862:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319032.301864:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319032.301867:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4278
00000100:00080000:3.0:1767319032.301870:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319032.301873:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319032.301892:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8000 x1853163940416128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319032.301906:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319032.301909:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319032.301910:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319032.301913:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4278
00000100:00080000:3.0:1767319032.301916:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319032.301918:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319032.301926:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940416384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319032.301952:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940416000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319032.301959:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940415744:0@lo:400:kworker.0
00000100:00100000:1.0:1767319032.302021:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319032.302076:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319032.302083:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940415872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319032.302105:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319032.302169:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415744
00000100:00100000:1.0:1767319032.302175:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415744
00000100:00100000:1.0:1767319032.302230:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415872
00000100:00100000:1.0:1767319032.302233:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415872
00000100:00100000:0.0:1767319032.302273:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940416256:0@lo:400:kworker.0
00000100:00100000:0.0:1767319032.302355:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319032.302848:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775
00000100:00100000:1.0:1767319032.302861:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940415744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319032.302915:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940415744:12345-0@lo:400:kworker.0 Request processed in 59us (894us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319032.302923:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775
00000100:00100000:1.0:1767319032.302939:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776
00000100:00100000:1.0:1767319032.302945:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940415872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319032.302967:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940415872:12345-0@lo:400:kworker.0 Request processed in 23us (861us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319032.302973:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776
00000100:00100000:2.0:1767319032.304088:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319032.304198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319032.304225:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416256
00000100:00100000:2.0:1767319032.304239:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416256
00000100:00100000:2.0:1767319032.304282:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416000
00000100:00100000:2.0:1767319032.304285:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416000
00000100:00100000:2.0:1767319032.304317:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245
00000100:00100000:2.0:1767319032.304325:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940416256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319032.304381:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940416256:12345-0@lo:400:kworker.0 Request processed in 57us (2027us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319032.304387:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245
00000100:00100000:2.0:1767319032.304402:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246
00000100:00100000:2.0:1767319032.304409:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940416000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319032.304440:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940416000:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319032.304445:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246
00000100:00080000:2.0:1767319032.304463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319032.304491:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940416000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319032.304530:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940415360:0@lo:250:kworker.0
00000400:00000100:2.0:1767319032.304557:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940415360 offset 0 length 520: 4
00000100:00100000:2.0:1767319032.304579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940415488:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.304598:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319032.304614:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940415616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.304915:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319032.304935:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940416128:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.304957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319032.304973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940416384:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.304991:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319032.305021:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415488
00000100:00100000:2.0:1767319032.305024:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415488
00000100:00100000:2.0:1767319032.305105:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416128
00000100:00100000:2.0:1767319032.305109:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416128
00000100:00100000:2.0:1767319032.305117:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416384
00000100:00100000:2.0:1767319032.305119:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416384
00000100:00100000:2.0:1767319032.305138:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737
00000100:00100000:2.0:1767319032.305143:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940415488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319032.305161:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319032.305194:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940415488:12345-0@lo:38:kworker.0 Request processed in 50us (595us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319032.305201:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737
00000100:00100000:2.0:1767319032.305446:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16738
00000100:00100000:2.0:1767319032.305450:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940416128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319032.305459:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319032.305484:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940416128:12345-0@lo:38:kworker.0 Request processed in 32us (526us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319032.305489:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16738
00000100:00100000:2.0:1767319032.305499:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16739
00000100:00100000:2.0:1767319032.305503:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940416384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319032.305511:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319032.305533:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940416384:12345-0@lo:38:kworker.0 Request processed in 28us (540us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319032.305538:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16739
00000100:00100000:2.0:1767319032.305574:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940416256:0@lo:400:kworker.0
00000100:00080000:2.0:1767319032.305602:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319032.305606:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319032.305610:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940415488:0@lo:38:kworker.0
00000100:00080000:2.0:1767319032.305833:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319032.305837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319032.305841:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940416128:0@lo:38:kworker.0
00000100:00080000:2.0:1767319032.305850:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319032.305853:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319032.305856:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940416384:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.305910:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940415616
00000100:00100000:2.0:1767319032.305913:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940415616
00000100:00100000:2.0:1767319032.305933:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18
00000100:00100000:2.0:1767319032.305937:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940415616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319032.305947:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319032.305973:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940415616:12345-0@lo:38:kworker.0 Request processed in 35us (1058us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319032.305979:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18
00000100:00080000:2.0:1767319032.305996:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319032.305999:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319032.306002:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940415616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319032.306394:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940415872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319032.306405:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940415744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319032.944347:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319033.264190:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319033.964903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319034.286678:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319034.991656:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319035.311803:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319035.885194:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940416512:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319035.885274:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319035.885487:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416512
00000100:00100000:3.0:1767319035.885495:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416512
00000100:00100000:3.0:1767319035.885558:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310
00000100:00100000:3.0:1767319035.885568:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940416512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319035.885598:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319035.885651:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940416512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (377us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319035.885658:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310
00000100:00080000:2.0:1767319035.885792:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319035.885947:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940416512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319036.013802:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319036.332996:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319036.909200:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940416640:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319036.909282:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319036.910323:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416640
00000100:00100000:0.0:1767319036.910333:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416640
00000100:00100000:0.0:1767319036.910749:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311
00000100:00100000:0.0:1767319036.910761:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940416640:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319036.910895:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767319036.911914:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319036.912293:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940416640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1531us (3006us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319036.912302:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311
00000100:00100000:1.0:1767319036.912970:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940416640:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319037.004188:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319037.004271:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296064
00000100:00100000:3.0:1767319037.004284:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296064
00000100:00100000:3.0:1767319037.004424:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4247
00000100:00100000:3.0:1767319037.004439:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894296064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319037.004605:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894296064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 170us (428us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319037.004615:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4247
00000100:00080000:2.0:1767319037.004794:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319037.004869:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319037.009108:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894295936
00000100:00100000:3.0:1767319037.009123:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894295936
00000100:00100000:3.0:1767319037.009173:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16740
00000100:00100000:3.0:1767319037.009182:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894295936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319037.009209:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319037.009280:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894295936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 98us (4411us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319037.009288:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16740
00000100:00100000:0.0:1767319037.036907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319037.359182:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319037.421089:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319037.421100:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319037.421104:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319037.421108:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319037.421113:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319037.421121:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4282
00000100:00080000:2.0:1767319037.421132:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319037.421139:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319037.421190:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0380 x1853163940416768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319037.421208:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319037.421211:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319037.421213:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319037.421216:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4282
00000100:00080000:2.0:1767319037.421219:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319037.421222:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319037.421239:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012300 x1853163940416896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319037.421299:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319037.421303:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319037.421304:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319037.421308:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4282
00000100:00080000:2.0:1767319037.421310:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319037.421313:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319037.421324:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940417408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319037.421340:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319037.421343:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319037.421345:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319037.421348:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4282
00000100:00080000:2.0:1767319037.421350:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319037.421354:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319037.421364:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940417664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319037.421392:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421461:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319037.421524:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319037.421531:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421553:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319037.421576:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940417280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421599:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319037.421616:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319037.421621:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940417536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421640:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319037.421668:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417280
00000100:00100000:2.0:1767319037.421674:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417280
00000100:00100000:2.0:1767319037.421724:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417536
00000100:00100000:2.0:1767319037.421727:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417536
00000100:00100000:2.0:1767319037.421748:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4248
00000100:00100000:2.0:1767319037.421756:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940417280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421828:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940417280:12345-0@lo:400:kworker.0 Request processed in 71us (226us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319037.421835:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4248
00000100:00100000:2.0:1767319037.421850:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4249
00000100:00100000:2.0:1767319037.421855:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940417536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421872:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940417536:12345-0@lo:400:kworker.0 Request processed in 18us (232us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319037.421876:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4249
00000100:00080000:2.0:1767319037.421886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319037.421908:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940417536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.421915:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940417280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319037.421990:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417152
00000100:00100000:1.0:1767319037.421994:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417152
00000100:00100000:1.0:1767319037.422028:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417024
00000100:00100000:1.0:1767319037.422031:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417024
00000100:00100000:1.0:1767319037.422054:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777
00000100:00100000:1.0:1767319037.422058:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319037.422123:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417152:12345-0@lo:400:kworker.0 Request processed in 63us (662us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319037.422129:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777
00000100:00100000:1.0:1767319037.422142:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778
00000100:00100000:1.0:1767319037.422149:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417024:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319037.422171:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319037.422173:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417024:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319037.422179:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778
00000100:00100000:2.0:1767319037.422194:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319037.422204:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417152:0@lo:400:kworker.0
00000100:00100000:0.0:1767319037.422315:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940416768:0@lo:38:kworker.0
00000100:00100000:0.0:1767319037.422346:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319037.422416:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940416896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319037.422441:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319037.422465:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940417408:0@lo:38:kworker.0
00000100:00100000:0.0:1767319037.422485:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319037.422530:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416896
00000100:00100000:2.0:1767319037.422535:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416896
00000100:00100000:2.0:1767319037.422563:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19
00000100:00100000:2.0:1767319037.422568:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940416896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319037.422587:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319037.422616:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940416896:12345-0@lo:38:kworker.0 Request processed in 46us (174us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319037.422622:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19
00000100:00100000:0.0:1767319037.423144:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940417664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319037.423169:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319037.423281:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940416768
00000100:00100000:3.0:1767319037.423287:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940416768
00000100:00100000:3.0:1767319037.423314:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417408
00000100:00100000:3.0:1767319037.423317:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417408
00000100:00100000:3.0:1767319037.423333:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16741
00000100:00100000:3.0:1767319037.423338:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940416768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319037.423352:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319037.423385:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940416768:12345-0@lo:38:kworker.0 Request processed in 46us (1038us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319037.423393:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16741
00000100:00100000:3.0:1767319037.423406:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16742
00000100:00100000:3.0:1767319037.423410:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940417408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319037.423419:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319037.423442:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940417408:12345-0@lo:38:kworker.0 Request processed in 30us (956us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319037.423448:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16742
00000100:00080000:0.0:1767319037.423530:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319037.423535:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319037.423538:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940416768:0@lo:38:kworker.0
00000100:00080000:0.0:1767319037.423547:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319037.423550:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319037.423552:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940416896:0@lo:38:kworker.0
00000100:00080000:0.0:1767319037.423558:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319037.423561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319037.423563:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940417408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319037.423676:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417664
00000100:00100000:3.0:1767319037.423681:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417664
00000100:00100000:3.0:1767319037.423708:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16743
00000100:00100000:3.0:1767319037.423712:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940417664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319037.423722:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319037.423750:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940417664:12345-0@lo:38:kworker.0 Request processed in 36us (580us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319037.423756:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16743
00000100:00080000:0.0:1767319037.423856:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319037.423861:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319037.423863:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940417664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319038.060910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319038.381187:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319039.087568:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319039.405734:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319040.109392:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319040.431211:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319041.005118:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319041.005150:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417792:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319041.005317:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319041.005408:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417792
00000100:00100000:3.0:1767319041.005419:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417792
00000100:00100000:3.0:1767319041.005492:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312
00000100:00100000:3.0:1767319041.005504:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319041.005537:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767319041.005562:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319041.005592:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940417792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319041.005600:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312
00000100:00100000:2.0:1767319041.005627:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940417792:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319041.133072:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319041.453324:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319042.032291:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319042.032320:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940417920:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319042.032401:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319042.032809:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940417920
00000100:00100000:3.0:1767319042.032817:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940417920
00000100:00100000:3.0:1767319042.032887:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313
00000100:00100000:3.0:1767319042.032900:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940417920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319042.032933:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319042.032989:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940417920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (587us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319042.032996:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313
00000100:00100000:2.0:1767319042.033315:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940417920:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319042.033435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319042.118842:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319042.118931:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319042.119028:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296320
00000100:00100000:1.0:1767319042.119045:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296320
00000100:00100000:1.0:1767319042.119115:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296192
00000100:00100000:1.0:1767319042.119119:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296192
00000100:00100000:1.0:1767319042.119137:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4250
00000100:00100000:1.0:1767319042.119148:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319042.119218:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319042.119229:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4250
00000100:00100000:1.0:1767319042.119249:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16744
00000100:00100000:1.0:1767319042.119253:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894296192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319042.119272:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319042.119295:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894296192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 41us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319042.119302:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16744
00000100:00080000:2.0:1767319042.119444:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319042.157807:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319042.477094:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319042.542766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319042.542796:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319042.542798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319042.542802:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319042.542806:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319042.542814:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4287
00000100:00080000:2.0:1767319042.542818:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319042.542825:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319042.542865:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940418048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319042.542895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319042.542899:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319042.542901:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319042.542905:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4287
00000100:00080000:2.0:1767319042.542907:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319042.542911:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319042.542924:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013480 x1853163940418176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319042.542973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319042.542976:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319042.542978:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319042.542982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4287
00000100:00080000:2.0:1767319042.542984:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319042.542987:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319042.542996:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940418560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319042.543017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319042.543020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319042.543022:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319042.543025:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4287
00000100:00080000:2.0:1767319042.543028:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319042.543060:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319042.543074:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38a80 x1853163940418816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319042.543105:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940418432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.543165:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319042.543223:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319042.543228:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940418304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.543252:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319042.543286:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418304
00000100:00100000:2.0:1767319042.543294:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418304
00000100:00100000:2.0:1767319042.543336:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779
00000100:00100000:2.0:1767319042.543343:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940418304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.543388:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940418304:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319042.543396:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779
00000100:00100000:2.0:1767319042.543436:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940418304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.543456:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940418688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.543476:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319042.543690:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418432
00000100:00100000:3.0:1767319042.543695:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418432
00000100:00100000:3.0:1767319042.543741:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418688
00000100:00100000:3.0:1767319042.543745:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418688
00000100:00100000:3.0:1767319042.543766:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4251
00000100:00100000:3.0:1767319042.543799:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940418432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319042.543838:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940418432:12345-0@lo:400:kworker.0 Request processed in 66us (672us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319042.543845:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4251
00000100:00100000:3.0:1767319042.543859:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4252
00000100:00100000:3.0:1767319042.543866:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940418688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319042.543893:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940418688:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319042.543899:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4252
00000100:00100000:0.0:1767319042.544070:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940418048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319042.544101:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319042.544126:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940418176:0@lo:38:kworker.0
00000100:00100000:0.0:1767319042.544148:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319042.544172:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940418560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319042.544191:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319042.544205:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940418816:0@lo:38:kworker.0
00000100:00100000:0.0:1767319042.544222:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319042.544246:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418048
00000100:00100000:0.0:1767319042.544250:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418048
00000100:00100000:0.0:1767319042.544265:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418560
00000100:00100000:0.0:1767319042.544268:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418560
00000100:00100000:0.0:1767319042.544280:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418816
00000100:00100000:0.0:1767319042.544283:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418816
00000100:00100000:0.0:1767319042.544296:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16745
00000100:00100000:0.0:1767319042.544300:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319042.544318:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319042.544347:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418048:12345-0@lo:38:kworker.0 Request processed in 46us (246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319042.544354:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16745
00000100:00100000:0.0:1767319042.544366:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16746
00000100:00100000:0.0:1767319042.544370:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319042.544380:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319042.544399:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418560:12345-0@lo:38:kworker.0 Request processed in 28us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319042.544405:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16746
00000100:00100000:0.0:1767319042.544414:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16747
00000100:00100000:0.0:1767319042.544418:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319042.544425:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319042.544443:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940418816:12345-0@lo:38:kworker.0 Request processed in 24us (220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319042.544449:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16747
00000100:00080000:0.0:1767319042.544476:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319042.544481:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319042.544484:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940418048:0@lo:38:kworker.0
00000100:00080000:0.0:1767319042.544492:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319042.544496:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319042.544498:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940418560:0@lo:38:kworker.0
00000100:00080000:0.0:1767319042.544505:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319042.544507:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319042.544511:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940418816:0@lo:38:kworker.0
00000100:00080000:2.0:1767319042.545435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319042.545473:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940418432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.545503:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940418688:0@lo:400:kworker.0
00000100:00100000:3.0:1767319042.545848:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418176
00000100:00100000:3.0:1767319042.545855:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418176
00000100:00100000:3.0:1767319042.545893:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20
00000100:00100000:3.0:1767319042.545899:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940418176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319042.545916:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319042.545979:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940418176:12345-0@lo:38:kworker.0 Request processed in 79us (1829us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319042.545987:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20
00000100:00080000:0.0:1767319042.546411:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319042.546418:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319042.546422:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940418176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319043.180920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319043.500985:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319044.204900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319044.529525:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319045.229277:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319045.558230:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319046.127526:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319046.127569:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940418944:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319046.127676:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319046.128053:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940418944
00000100:00100000:3.0:1767319046.128066:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940418944
00000100:00080000:2.0:1767319046.128122:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319046.128148:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314
00000100:00100000:3.0:1767319046.128159:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940418944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319046.128199:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319046.128265:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940418944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (602us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319046.128274:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314
00000100:00100000:2.0:1767319046.128335:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940418944:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319046.255297:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319046.573057:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319047.149235:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940419072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319047.149313:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319047.149647:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419072
00000100:00100000:0.0:1767319047.149666:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419072
00000100:00100000:0.0:1767319047.152156:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315
00000100:00100000:0.0:1767319047.152182:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940419072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319047.152217:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319047.161696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319047.161927:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940419072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9752us (12606us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319047.161940:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315
00000100:00100000:2.0:1767319047.162264:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940419072:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319047.238570:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319047.238628:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319047.239216:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296448
00000100:00100000:3.0:1767319047.239228:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296448
00000100:00100000:3.0:1767319047.239313:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296576
00000100:00100000:3.0:1767319047.239318:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296576
00000100:00100000:3.0:1767319047.239366:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4253
00000100:00100000:3.0:1767319047.239381:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319047.239485:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (845us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319047.239495:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4253
00000100:00100000:3.0:1767319047.239516:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16748
00000100:00100000:3.0:1767319047.239520:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894296448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319047.239545:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319047.239578:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894296448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (1023us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319047.239584:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16748
00000100:00080000:1.0:1767319047.240686:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319047.278030:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319047.597193:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319047.663227:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.663237:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319047.663240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.663243:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.663247:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.663255:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4292
00000100:00080000:0.0:1767319047.663260:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.663267:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319047.663311:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940419200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.663345:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.663350:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.663351:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.663354:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4292
00000100:00080000:0.0:1767319047.663357:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.663360:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319047.663375:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0380 x1853163940419328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.663432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.663435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.663436:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.663439:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4292
00000100:00080000:0.0:1767319047.663442:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.663445:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319047.663456:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3fb80 x1853163940419712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.663470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.663472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.663474:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.663477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4292
00000100:00080000:0.0:1767319047.663479:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.663482:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319047.663492:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3df80 x1853163940419968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319047.663519:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940419840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319047.663582:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940419456:0@lo:400:kworker.0
00000100:00100000:0.0:1767319047.663587:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.663654:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940419200:0@lo:38:kworker.0
00000100:00100000:3.0:1767319047.663690:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319047.663718:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940419584:0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.663745:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319047.663753:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419456
00000100:00100000:3.0:1767319047.663760:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419456
00000100:00100000:2.0:1767319047.663797:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419840
00000100:00100000:2.0:1767319047.663800:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419840
00000100:00100000:2.0:1767319047.663829:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419584
00000100:00100000:3.0:1767319047.663829:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780
00000100:00100000:2.0:1767319047.663832:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419584
00000100:00100000:3.0:1767319047.663837:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940419456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.663848:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4254
00000100:00100000:2.0:1767319047.663853:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940419840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.663881:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940419840:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319047.663888:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4254
00000100:00100000:2.0:1767319047.663903:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4255
00000100:00100000:2.0:1767319047.663908:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940419584:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.663937:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940419584:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319047.663943:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4255
00000100:00100000:2.0:1767319047.663980:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940419584:0@lo:400:kworker.0
00000100:00080000:2.0:1767319047.664048:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319047.664121:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940419840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319047.664180:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940419456:12345-0@lo:400:kworker.0 Request processed in 343us (489us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319047.664187:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780
00000100:00100000:2.0:1767319047.664362:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940419456:0@lo:400:kworker.0
00000100:00100000:1.0:1767319047.672277:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.672370:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940419328:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.672417:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.672453:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940419712:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.672473:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.672496:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940419968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.672518:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.672585:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419200
00000100:00100000:1.0:1767319047.672595:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419200
00000100:00100000:1.0:1767319047.672636:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419712
00000100:00100000:1.0:1767319047.672639:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419712
00000100:00100000:1.0:1767319047.672651:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419968
00000100:00100000:1.0:1767319047.672653:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419968
00000100:00100000:1.0:1767319047.672670:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16749
00000100:00100000:1.0:1767319047.672676:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.672698:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.672763:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419200:12345-0@lo:38:kworker.0 Request processed in 84us (497us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.672770:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16749
00000100:00100000:1.0:1767319047.672809:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16750
00000100:00100000:1.0:1767319047.672813:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.672823:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.672859:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419712:12345-0@lo:38:kworker.0 Request processed in 44us (384us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.672865:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16750
00000100:00100000:1.0:1767319047.672876:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16751
00000100:00100000:1.0:1767319047.672880:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.672888:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.672909:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940419968:12345-0@lo:38:kworker.0 Request processed in 27us (390us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.672914:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16751
00000100:00080000:1.0:1767319047.672956:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.672960:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.672963:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940419200:0@lo:38:kworker.0
00000100:00080000:1.0:1767319047.672973:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.672976:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.672978:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940419712:0@lo:38:kworker.0
00000100:00080000:1.0:1767319047.672984:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.672999:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.673001:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940419968:0@lo:38:kworker.0
00000100:00100000:3.0:1767319047.673126:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940419328
00000100:00100000:3.0:1767319047.673130:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940419328
00000100:00100000:3.0:1767319047.673158:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21
00000100:00100000:3.0:1767319047.673163:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940419328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319047.673173:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319047.673203:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940419328:12345-0@lo:38:kworker.0 Request processed in 39us (786us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319047.673208:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21
00000100:00080000:1.0:1767319047.674710:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.674720:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.674724:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940419328:0@lo:38:kworker.0
00000100:00100000:2.0:1767319048.300900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319048.621027:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319049.324898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319049.645255:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319050.348921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319050.669523:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319051.249146:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319051.249170:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940420096:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319051.249269:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319051.249438:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420096
00000100:00100000:0.0:1767319051.249447:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420096
00000100:00100000:0.0:1767319051.249521:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316
00000100:00100000:0.0:1767319051.249531:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940420096:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319051.249564:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319051.249612:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940420096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (344us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319051.249620:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316
00000100:00080000:1.0:1767319051.249679:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319051.252295:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940420096:0@lo:13:osp-pre-1-1.0
00000400:00000100:1.0:1767319051.336015:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894296704 offset 0 length 520: 4
00000100:00100000:1.0:1767319051.336069:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319051.336116:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319051.336215:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296832
00000100:00100000:2.0:1767319051.336227:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296832
00000100:00100000:2.0:1767319051.336276:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894296960
00000100:00100000:2.0:1767319051.336280:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894296960
00000100:00100000:2.0:1767319051.336332:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4256
00000100:00100000:2.0:1767319051.336343:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296960:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319051.336423:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894296960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319051.336430:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4256
00000100:00100000:2.0:1767319051.336447:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16752
00000100:00100000:2.0:1767319051.336452:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894296832:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319051.336473:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319051.336499:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894296832:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319051.336505:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16752
00000100:00080000:1.0:1767319051.336680:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319051.373002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319051.693181:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319052.273266:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940420224:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319052.273346:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.273518:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420224
00000100:00100000:3.0:1767319052.273527:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420224
00000100:00100000:3.0:1767319052.273598:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317
00000100:00100000:3.0:1767319052.273610:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940420224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319052.273653:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319052.273711:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940420224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.273720:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317
00000100:00100000:2.0:1767319052.273768:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940420224:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319052.273919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319052.397008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319052.719051:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319052.781145:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319052.781157:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319052.781160:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319052.781166:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319052.781171:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319052.781190:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4297
00000100:00080000:3.0:1767319052.781195:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319052.781204:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319052.781257:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa680 x1853163940420352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319052.781287:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319052.781291:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319052.781292:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319052.781296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4297
00000100:00080000:3.0:1767319052.781298:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319052.781303:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319052.781316:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940420480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319052.781372:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319052.781375:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319052.781377:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319052.781380:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4297
00000100:00080000:3.0:1767319052.781382:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319052.781386:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319052.781395:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb100 x1853163940420864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319052.781417:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319052.781421:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319052.781423:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319052.781426:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4297
00000100:00080000:3.0:1767319052.781428:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319052.781431:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319052.781441:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940421120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319052.781469:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940420992:0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.781552:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.781628:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420992
00000100:00100000:3.0:1767319052.781636:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420992
00000100:00100000:2.0:1767319052.781700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940420352:0@lo:38:kworker.0
00000100:00100000:3.0:1767319052.781714:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4257
00000100:00100000:3.0:1767319052.781730:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940420992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319052.781740:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319052.781768:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940420480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319052.781830:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.781838:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940420992:12345-0@lo:400:kworker.0 Request processed in 113us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.781847:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4257
00000100:00100000:2.0:1767319052.781852:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940420864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319052.781868:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420352
00000100:00100000:3.0:1767319052.781873:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420352
00000100:00100000:2.0:1767319052.781878:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319052.781902:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940421120:0@lo:38:kworker.0
00000100:00100000:2.0:1767319052.781924:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319052.781982:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940420736:0@lo:400:kworker.0
00000100:00100000:1.0:1767319052.782023:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420480
00000100:00100000:1.0:1767319052.782026:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420480
00000100:00100000:1.0:1767319052.782052:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22
00000100:00100000:1.0:1767319052.782057:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940420480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319052.782080:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319052.782115:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940420480:12345-0@lo:38:kworker.0 Request processed in 56us (286us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319052.782124:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22
00000100:00080000:1.0:1767319052.782142:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319052.782185:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940420608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319052.782219:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319052.787990:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319052.788011:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319052.788018:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940420480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319052.788080:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.789234:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420864
00000100:00100000:3.0:1767319052.789247:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420864
00000100:00100000:3.0:1767319052.789289:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421120
00000100:00100000:3.0:1767319052.789293:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421120
00000100:00100000:3.0:1767319052.789309:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16753
00000100:00100000:3.0:1767319052.789317:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940420352:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319052.789341:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319052.789419:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420736
00000100:00100000:2.0:1767319052.789424:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420736
00000100:00100000:3.0:1767319052.789430:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940420352:12345-0@lo:38:kworker.0 Request processed in 111us (7688us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319052.789440:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16753
00000100:00100000:3.0:1767319052.789465:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16754
00000100:00100000:3.0:1767319052.789469:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940420864:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319052.789475:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4258
00010000:00020000:3.0:1767319052.789481:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319052.789485:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940420736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.789512:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940420864:12345-0@lo:38:kworker.0 Request processed in 40us (7633us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319052.789520:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16754
00000100:00100000:2.0:1767319052.789534:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940420736:12345-0@lo:400:kworker.0 Request processed in 52us (1453us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.789538:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16755
00000100:00100000:2.0:1767319052.789547:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4258
00000100:00100000:3.0:1767319052.789549:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940421120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319052.789561:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319052.789563:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319052.789587:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940420736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.789598:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940421120:12345-0@lo:38:kworker.0 Request processed in 49us (7671us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319052.789606:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16755
00000100:00080000:2.0:1767319052.789612:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319052.789617:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319052.789620:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940420352:0@lo:38:kworker.0
00000100:00080000:2.0:1767319052.789627:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319052.789630:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319052.789633:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940420864:0@lo:38:kworker.0
00000100:00080000:2.0:1767319052.789654:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319052.789654:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940420992:0@lo:400:kworker.0
00000100:00080000:2.0:1767319052.789664:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319052.789669:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940421120:0@lo:38:kworker.0
00000100:00100000:3.0:1767319052.789687:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940420608
00000100:00100000:3.0:1767319052.789693:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940420608
00000100:00100000:3.0:1767319052.789734:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781
00000100:00100000:3.0:1767319052.789741:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940420608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.789808:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940420608:12345-0@lo:400:kworker.0 Request processed in 68us (7588us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.789815:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781
00000100:00100000:2.0:1767319052.792373:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940420608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319053.421107:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319053.741166:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319054.448168:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319054.767136:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319055.469104:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319055.789027:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319056.365800:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940421248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319056.365876:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319056.366090:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421248
00000100:00100000:0.0:1767319056.366098:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421248
00000100:00100000:0.0:1767319056.366162:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1767319056.366170:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940421248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319056.366201:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319056.366256:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940421248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (379us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319056.366263:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318
00000100:00100000:1.0:1767319056.366344:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940421248:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319056.366523:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319056.456002:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319056.456106:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297216
00000100:00100000:0.0:1767319056.456119:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297216
00000100:00100000:0.0:1767319056.456202:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4259
00000100:00100000:0.0:1767319056.456213:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319056.456299:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (310us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319056.456307:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4259
00000100:00080000:2.0:1767319056.456565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319056.467243:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319056.468005:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297088
00000100:00100000:2.0:1767319056.468017:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297088
00000100:00100000:2.0:1767319056.468075:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16756
00000100:00100000:2.0:1767319056.468083:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894297088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319056.468107:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319056.468180:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894297088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (947us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319056.468187:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16756
00000100:00100000:2.0:1767319056.492928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319056.813307:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319057.393128:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940421376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319057.393221:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319057.393880:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421376
00000100:00100000:3.0:1767319057.393889:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421376
00000100:00100000:3.0:1767319057.393975:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319
00000100:00100000:3.0:1767319057.393985:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940421376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319057.394016:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319057.394071:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940421376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (850us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319057.394079:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319
00000100:00080000:2.0:1767319057.394153:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319057.394193:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940421376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319057.516916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319057.837258:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319057.900941:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319032/real 1767319032]  req@ffff93cf52010a80 x1853163940415360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319057.900979:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf52010a80 x1853163940415360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319057.901000:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319057.901025:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319057.901029:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940415360:0@lo:250:kworker.0
00000100:00080000:2.0:1767319057.901981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319057.901988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319057.901992:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319057.901998:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4282
00000100:00080000:2.0:1767319057.902003:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319057.902010:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319057.902046:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940421504/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319057.902074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319057.902078:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319057.902080:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319057.902083:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4302
00000100:00080000:2.0:1767319057.902086:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319057.902090:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319057.902109:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940421632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319057.902119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319057.902122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319057.902124:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319057.902127:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4302
00000100:00080000:2.0:1767319057.902130:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319057.902133:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319057.902157:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adfb80 x1853163940421760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319057.902227:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319057.902231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319057.902233:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319057.902237:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4302
00000100:00080000:2.0:1767319057.902240:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319057.902243:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319057.902253:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf800 x1853163940422144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319057.902267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319057.902270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319057.902272:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319057.902276:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4302
00000100:00080000:2.0:1767319057.902278:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319057.902281:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319057.902291:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc380 x1853163940422400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319057.902318:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940422272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.902381:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319057.902453:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319057.902460:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940422016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.902483:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319057.902521:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422272
00000100:00100000:2.0:1767319057.902543:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422272
00000100:00100000:2.0:1767319057.902601:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422016
00000100:00100000:2.0:1767319057.902605:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422016
00000100:00100000:2.0:1767319057.902633:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4260
00000100:00100000:2.0:1767319057.902643:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940422272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.902696:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940422272:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319057.902704:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4260
00000100:00100000:2.0:1767319057.902722:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4261
00000100:00100000:2.0:1767319057.902729:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940422016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.902757:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940422016:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319057.902763:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4261
00000100:00080000:2.0:1767319057.902827:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319057.902860:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940422016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.902871:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940422272:0@lo:400:kworker.0
00000100:00100000:3.0:1767319057.903164:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940421888:0@lo:400:kworker.0
00000100:00100000:3.0:1767319057.903202:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.904579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940421504:0@lo:250:kworker.0
00000400:00000100:0.0:1767319057.904640:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940421504 offset 0 length 520: 4
00000100:00100000:0.0:1767319057.904682:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940421632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319057.904718:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.904758:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940421760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319057.904822:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.904844:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940422144:0@lo:38:kworker.0
00000100:00100000:0.0:1767319057.904866:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.904887:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940422400:0@lo:38:kworker.0
00000100:00100000:0.0:1767319057.904927:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.904980:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421632
00000100:00100000:0.0:1767319057.904990:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421632
00000100:00100000:0.0:1767319057.905033:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422144
00000100:00100000:0.0:1767319057.905035:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422144
00000100:00100000:0.0:1767319057.905048:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422400
00000100:00100000:0.0:1767319057.905050:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422400
00000100:00100000:0.0:1767319057.905070:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16757
00000100:00100000:0.0:1767319057.905078:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940421632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319057.905105:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319057.905149:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940421632:12345-0@lo:38:kworker.0 Request processed in 71us (431us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319057.905156:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16757
00000100:00100000:0.0:1767319057.905172:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758
00000100:00100000:0.0:1767319057.905175:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940422144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319057.905185:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319057.905204:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940422144:12345-0@lo:38:kworker.0 Request processed in 27us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319057.905210:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758
00000100:00100000:0.0:1767319057.905219:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759
00000100:00100000:0.0:1767319057.905223:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940422400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319057.905231:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319057.905249:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940422400:12345-0@lo:38:kworker.0 Request processed in 25us (323us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319057.905256:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759
00000100:00080000:0.0:1767319057.905295:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319057.905301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319057.905304:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940421632:0@lo:38:kworker.0
00000100:00080000:0.0:1767319057.905314:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319057.905318:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319057.905321:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940422144:0@lo:38:kworker.0
00000100:00080000:0.0:1767319057.905328:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319057.905331:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319057.905334:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940422400:0@lo:38:kworker.0
00000100:00100000:2.0:1767319057.906067:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421888
00000100:00100000:2.0:1767319057.906075:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421888
00000100:00100000:2.0:1767319057.906127:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782
00000100:00100000:2.0:1767319057.906135:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940421888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319057.906220:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940421888:12345-0@lo:400:kworker.0 Request processed in 86us (3017us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319057.906227:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782
00000100:00100000:0.0:1767319057.906437:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940421888:0@lo:400:kworker.0
00000100:00100000:1.0:1767319057.906600:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940421760
00000100:00100000:1.0:1767319057.906605:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940421760
00000100:00100000:1.0:1767319057.906638:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23
00000100:00100000:1.0:1767319057.906646:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940421760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319057.906662:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319057.906698:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940421760:12345-0@lo:38:kworker.0 Request processed in 52us (1876us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319057.906705:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23
00000100:00080000:0.0:1767319057.906744:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319057.906754:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319057.906757:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940421760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319058.540925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319058.863164:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319059.567854:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319059.886884:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319060.589213:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319060.909027:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319061.486730:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319061.486767:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940422528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319061.486888:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319061.487170:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422528
00000100:00100000:0.0:1767319061.487181:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422528
00000100:00100000:0.0:1767319061.487253:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320
00000100:00100000:0.0:1767319061.487263:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940422528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319061.487296:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319061.487344:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940422528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (456us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319061.487352:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320
00000100:00080000:2.0:1767319061.487413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319061.487643:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940422528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319061.574414:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319061.574461:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319061.574561:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297472
00000100:00100000:2.0:1767319061.574570:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297472
00000100:00100000:2.0:1767319061.574636:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297344
00000100:00100000:2.0:1767319061.574640:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297344
00000100:00100000:2.0:1767319061.574658:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4262
00000100:00100000:2.0:1767319061.574668:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319061.574755:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (351us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319061.574766:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4262
00000100:00100000:2.0:1767319061.574818:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16760
00000100:00100000:2.0:1767319061.574823:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894297344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319061.574867:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319061.574897:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894297344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 72us (435us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319061.574903:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16760
00000100:00080000:3.0:1767319061.575259:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319061.612934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319061.933209:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319062.509494:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940422656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319062.509572:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.509715:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422656
00000100:00100000:3.0:1767319062.509724:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422656
00000100:00100000:3.0:1767319062.509814:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321
00000100:00100000:3.0:1767319062.509824:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940422656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319062.509863:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319062.509911:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940422656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319062.509918:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321
00000100:00080000:2.0:1767319062.510035:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319062.510198:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940422656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319062.637012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319062.957380:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319063.021954:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319063.021966:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319063.021969:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319063.021974:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319063.021979:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319063.021988:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4307
00000100:00080000:3.0:1767319063.021993:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319063.022001:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319063.022041:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa300 x1853163940422784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319063.022072:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319063.022076:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319063.022078:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319063.022081:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4307
00000100:00080000:3.0:1767319063.022083:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319063.022087:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319063.022101:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940422912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319063.022166:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319063.022170:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319063.022171:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319063.022175:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4307
00000100:00080000:3.0:1767319063.022177:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319063.022181:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319063.022194:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966d80 x1853163940423424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319063.022211:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319063.022213:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423040:0@lo:400:kworker.0
00000100:00080000:3.0:1767319063.022216:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319063.022220:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319063.022225:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4307
00000100:00080000:3.0:1767319063.022228:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319063.022232:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319063.022244:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964700 x1853163940423680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319063.022275:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940423296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.022334:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319063.022334:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319063.022411:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319063.022417:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940422784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.022421:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319063.022469:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319063.022470:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319063.022498:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940422912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319063.022526:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319063.022539:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423040
00000100:00100000:1.0:1767319063.022547:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940423424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.022549:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423040
00000100:00100000:1.0:1767319063.022574:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319063.022595:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940423680:0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.022611:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423168
00000100:00100000:2.0:1767319063.022616:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423168
00000100:00100000:1.0:1767319063.022621:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319063.022647:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783
00000100:00100000:2.0:1767319063.022659:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319063.022661:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423296
00000100:00100000:1.0:1767319063.022667:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423296
00000100:00100000:1.0:1767319063.022701:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422784
00000100:00100000:1.0:1767319063.022704:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422784
00000100:00100000:1.0:1767319063.022721:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423424
00000100:00100000:1.0:1767319063.022724:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423424
00000100:00100000:2.0:1767319063.022732:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423040:12345-0@lo:400:kworker.0 Request processed in 74us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319063.022733:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423680
00000100:00100000:1.0:1767319063.022738:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423680
00000100:00100000:2.0:1767319063.022745:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783
00000100:00100000:1.0:1767319063.022752:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4263
00000100:00100000:1.0:1767319063.022762:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940423296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.022768:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784
00000100:00100000:2.0:1767319063.022803:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319063.022827:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940423296:12345-0@lo:400:kworker.0 Request processed in 66us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319063.022836:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4263
00000100:00100000:2.0:1767319063.022857:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423168:12345-0@lo:400:kworker.0 Request processed in 45us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319063.022865:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761
00000100:00100000:2.0:1767319063.022867:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784
00000100:00100000:1.0:1767319063.022875:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940422784:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.022896:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762
00010000:00020000:1.0:1767319063.022898:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319063.022936:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940422784:12345-0@lo:38:kworker.0 Request processed in 60us (471us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319063.022942:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761
00000100:00100000:1.0:1767319063.022953:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763
00000100:00100000:1.0:1767319063.022957:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940423680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319063.022966:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319063.022975:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940423424:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319063.022988:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940423680:12345-0@lo:38:kworker.0 Request processed in 29us (367us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767319063.022991:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319063.022998:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763
00000100:00100000:0.0:1767319063.023085:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940423552:0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.023116:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940423424:12345-0@lo:38:kworker.0 Request processed in 209us (540us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319063.023120:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319063.023126:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762
00000100:00080000:1.0:1767319063.023130:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319063.023136:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940422784:0@lo:38:kworker.0
00000100:00080000:1.0:1767319063.023153:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319063.023158:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319063.023161:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940423424:0@lo:38:kworker.0
00000100:00080000:2.0:1767319063.023165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319063.023169:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319063.023172:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319063.023175:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319063.023181:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940423680:0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.023202:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423168:0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.023219:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319063.023575:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940423296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.023808:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940422912
00000100:00100000:2.0:1767319063.023814:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940422912
00000100:00100000:2.0:1767319063.023839:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24
00000100:00100000:2.0:1767319063.023844:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940422912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319063.023866:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319063.024036:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940422912:12345-0@lo:38:kworker.0 Request processed in 189us (1508us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319063.024042:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24
00000100:00080000:1.0:1767319063.027356:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319063.027369:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319063.027374:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319063.027377:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940422912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319063.027580:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423552
00000100:00100000:2.0:1767319063.027588:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423552
00000100:00100000:2.0:1767319063.027732:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4264
00000100:00080000:0.0:1767319063.027742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319063.027758:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940423552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.027864:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940423552:12345-0@lo:400:kworker.0 Request processed in 109us (492us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319063.027873:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4264
00000100:00100000:0.0:1767319063.027900:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940423552:0@lo:400:kworker.0
00000100:00100000:2.0:1767319063.661026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319063.981251:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319064.687870:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319065.005237:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319065.708924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319066.032515:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319066.605175:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319066.605244:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319066.605430:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423808
00000100:00100000:0.0:1767319066.605439:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423808
00000100:00100000:0.0:1767319066.605528:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322
00000100:00100000:0.0:1767319066.605537:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319066.605566:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319066.605614:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940423808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319066.605621:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322
00000100:00100000:1.0:1767319066.605688:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940423808:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319066.608357:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319066.694693:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319066.694750:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319066.694866:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297600
00000100:00100000:3.0:1767319066.694877:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297600
00000100:00100000:3.0:1767319066.694934:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297728
00000100:00100000:3.0:1767319066.694938:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297728
00000100:00100000:3.0:1767319066.695003:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4265
00000100:00100000:3.0:1767319066.695015:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894297728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319066.695085:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894297728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319066.695100:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4265
00000100:00100000:3.0:1767319066.695120:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16764
00000100:00100000:3.0:1767319066.695124:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894297600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319066.695157:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319066.695187:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894297600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 61us (505us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319066.695196:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16764
00000100:00080000:2.0:1767319066.695585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319066.733309:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319067.053271:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319067.632377:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940423936:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319067.632453:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319067.633126:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940423936
00000100:00100000:0.0:1767319067.633135:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940423936
00000100:00100000:0.0:1767319067.633215:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323
00000100:00100000:0.0:1767319067.633225:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940423936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319067.633257:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319067.633491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319067.634331:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940423936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1103us (1872us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319067.634345:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323
00000100:00100000:1.0:1767319067.634463:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940423936:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319067.757314:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319068.077472:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319068.141216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319068.141227:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319068.141230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319068.141235:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319068.141239:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319068.141247:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4313
00000100:00080000:3.0:1767319068.141251:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319068.141258:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319068.141309:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940424064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319068.141337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319068.141340:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319068.141342:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319068.141345:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4313
00000100:00080000:3.0:1767319068.141347:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319068.141350:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319068.141364:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940424192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319068.141428:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319068.141484:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319068.141499:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940424448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319068.141572:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.142104:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424448
00000100:00100000:2.0:1767319068.142112:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424448
00000100:00100000:2.0:1767319068.142169:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785
00000100:00100000:2.0:1767319068.142180:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940424448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319068.142242:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940424448:12345-0@lo:400:kworker.0 Request processed in 65us (670us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319068.142250:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785
00000100:00100000:2.0:1767319068.142499:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940424064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319068.142528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.142548:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940424192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319068.142568:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.142597:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424192
00000100:00100000:2.0:1767319068.142602:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424192
00000100:00100000:2.0:1767319068.142621:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25
00000100:00100000:2.0:1767319068.142627:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940424192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319068.142645:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319068.142678:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940424192:12345-0@lo:38:kworker.0 Request processed in 50us (108us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319068.142684:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25
00000100:00080000:2.0:1767319068.142715:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319068.142720:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319068.142723:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940424192:0@lo:38:kworker.0
00000100:00100000:1.0:1767319068.142820:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424064
00000100:00100000:1.0:1767319068.142824:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424064
00000100:00100000:1.0:1767319068.142856:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16765
00000100:00100000:1.0:1767319068.142861:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940424064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319068.142871:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319068.142919:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940424064:12345-0@lo:38:kworker.0 Request processed in 56us (390us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319068.142925:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16765
00000100:00100000:1.0:1767319068.142961:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940424448:0@lo:400:kworker.0
00000100:00080000:1.0:1767319068.142982:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319068.142986:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319068.142989:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940424064:0@lo:38:kworker.0
00000100:00100000:0.0:1767319068.152042:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940424320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319068.152122:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319068.152256:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424320
00000100:00100000:1.0:1767319068.152264:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424320
00000100:00100000:1.0:1767319068.152358:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786
00000100:00100000:1.0:1767319068.152368:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940424320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319068.152426:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940424320:12345-0@lo:400:kworker.0 Request processed in 59us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319068.152434:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786
00000100:00080000:2.0:1767319068.152570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319068.152655:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940424320:0@lo:400:kworker.0
00000100:00080000:3.0:1767319068.156121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319068.156129:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319068.156132:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319068.156140:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4313
00000100:00080000:3.0:1767319068.156145:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319068.156151:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319068.156173:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964e00 x1853163940424704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319068.156204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319068.156207:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319068.156208:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319068.156212:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4313
00000100:00080000:3.0:1767319068.156214:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319068.156217:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319068.156230:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940424960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319068.156276:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940424704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319068.156354:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319068.156384:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940424960:0@lo:38:kworker.0
00000100:00100000:3.0:1767319068.156406:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.156515:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940424576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319068.156545:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.156574:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319068.156580:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940424832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319068.156615:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319068.156647:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424704
00000100:00100000:2.0:1767319068.156656:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424704
00000100:00100000:2.0:1767319068.156690:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424960
00000100:00100000:2.0:1767319068.156694:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424960
00000100:00100000:2.0:1767319068.156709:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424576
00000100:00100000:2.0:1767319068.156712:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424576
00000100:00100000:2.0:1767319068.156743:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940424832
00000100:00100000:2.0:1767319068.156745:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940424832
00000100:00100000:2.0:1767319068.156810:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4266
00000100:00100000:2.0:1767319068.156819:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940424576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319068.156878:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940424576:12345-0@lo:400:kworker.0 Request processed in 59us (330us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319068.156894:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4266
00000100:00100000:1.0:1767319068.156907:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267
00000100:00100000:2.0:1767319068.156918:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16766
00000100:00100000:1.0:1767319068.156922:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940424832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319068.156930:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940424704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319068.156953:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319068.156968:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940424832:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319068.156990:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267
00000100:00100000:2.0:1767319068.156996:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940424704:12345-0@lo:38:kworker.0 Request processed in 65us (639us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319068.157005:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16766
00000100:00100000:1.0:1767319068.157014:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16767
00000100:00100000:1.0:1767319068.157020:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940424960:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767319068.157032:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767319068.157046:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319068.157069:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940424832:0@lo:400:kworker.0
00000100:00100000:1.0:1767319068.157076:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940424960:12345-0@lo:38:kworker.0 Request processed in 54us (667us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319068.157083:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16767
00000100:00100000:2.0:1767319068.157088:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940424576:0@lo:400:kworker.0
00000100:00080000:2.0:1767319068.157124:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319068.157129:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319068.157132:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940424704:0@lo:38:kworker.0
00000100:00080000:2.0:1767319068.157145:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319068.157148:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319068.157151:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940424960:0@lo:38:kworker.0
00000100:00100000:2.0:1767319068.780916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319069.102083:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319069.808966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319070.125930:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319070.833026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319071.149305:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319071.725167:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940425088:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319071.725259:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319071.725558:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425088
00000100:00100000:0.0:1767319071.725567:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425088
00000100:00100000:0.0:1767319071.725633:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324
00000100:00100000:0.0:1767319071.725642:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940425088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319071.725682:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319071.725727:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940425088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (468us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319071.725734:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324
00000100:00080000:3.0:1767319071.725954:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319071.726105:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940425088:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319071.815132:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319071.815373:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297984
00000100:00100000:0.0:1767319071.815384:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297984
00000100:00080000:2.0:1767319071.815678:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319071.817305:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4268
00000100:00100000:0.0:1767319071.817330:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319071.817881:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894297984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 560us (2759us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319071.817890:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4268
00000100:00100000:2.0:1767319071.819820:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319071.823759:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894297856
00000100:00100000:3.0:1767319071.823951:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894297856
00000100:00100000:3.0:1767319071.824074:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16768
00000100:00100000:3.0:1767319071.824083:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894297856:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319071.824118:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319071.824212:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894297856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 128us (4400us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319071.824220:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16768
00000100:00100000:2.0:1767319071.852924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319072.174350:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319072.749562:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319072.749588:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940425216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319072.749670:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319072.750215:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425216
00000100:00100000:3.0:1767319072.750226:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425216
00000100:00100000:3.0:1767319072.750311:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325
00000100:00100000:3.0:1767319072.750323:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940425216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319072.750355:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319072.750424:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940425216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (753us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319072.750431:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325
00000100:00080000:0.0:1767319072.750648:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319072.751130:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940425216:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319072.876940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319073.198271:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319073.261112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319073.261121:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319073.261123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319073.261127:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319073.261131:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319073.261147:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4318
00000100:00080000:3.0:1767319073.261152:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319073.261159:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319073.261203:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966680 x1853163940425344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319073.261228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319073.261231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319073.261232:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319073.261235:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4318
00000100:00080000:3.0:1767319073.261236:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319073.261239:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319073.261249:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940425472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319073.261303:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319073.261379:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319073.261393:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940425728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.261466:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319073.261548:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425728
00000100:00100000:0.0:1767319073.261555:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425728
00000100:00100000:0.0:1767319073.261602:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787
00000100:00100000:0.0:1767319073.261609:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940425728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.261654:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940425728:12345-0@lo:400:kworker.0 Request processed in 44us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319073.261661:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787
00000100:00100000:0.0:1767319073.261713:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940425728:0@lo:400:kworker.0
00000100:00100000:2.0:1767319073.261841:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940425344:0@lo:38:kworker.0
00000100:00100000:2.0:1767319073.261877:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319073.261907:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940425472:0@lo:38:kworker.0
00000100:00100000:2.0:1767319073.261929:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319073.262276:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425344
00000100:00100000:0.0:1767319073.262280:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425344
00000100:00100000:0.0:1767319073.262312:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16769
00000100:00100000:0.0:1767319073.262317:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940425344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319073.262337:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319073.262372:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940425344:12345-0@lo:38:kworker.0 Request processed in 54us (494us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319073.262376:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16769
00000100:00080000:0.0:1767319073.262397:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319073.262402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319073.262406:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940425344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319073.262437:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425472
00000100:00100000:0.0:1767319073.262441:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425472
00000100:00100000:0.0:1767319073.262458:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26
00000100:00100000:0.0:1767319073.262463:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940425472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319073.262473:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319073.262501:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940425472:12345-0@lo:38:kworker.0 Request processed in 36us (570us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319073.262510:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26
00000100:00080000:0.0:1767319073.262531:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319073.262535:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319073.262538:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940425472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319073.263403:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940425600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319073.263456:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319073.263568:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425600
00000100:00100000:0.0:1767319073.263574:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425600
00000100:00100000:0.0:1767319073.263679:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788
00000100:00100000:0.0:1767319073.263696:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940425600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.263741:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940425600:12345-0@lo:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319073.263747:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788
00000100:00100000:1.0:1767319073.264535:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940425600:0@lo:400:kworker.0
00000100:00080000:3.0:1767319073.264676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319073.264681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1767319073.267232:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319073.267259:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940425856:0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.267344:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319073.267431:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425856
00000100:00100000:0.0:1767319073.267440:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425856
00000100:00080000:3.0:1767319073.267509:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319073.267515:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4318
00000100:00080000:3.0:1767319073.267519:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319073.267524:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319073.267555:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964700 x1853163940425984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319073.267581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319073.267584:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319073.267585:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319073.267588:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4318
00000100:00080000:3.0:1767319073.267590:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319073.267592:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319073.267599:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967100 x1853163940426240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319073.267620:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940425984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319073.267652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319073.267671:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940426240:0@lo:38:kworker.0
00000100:00100000:3.0:1767319073.267706:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319073.267737:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940425984
00000100:00100000:3.0:1767319073.267740:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940425984
00000100:00100000:3.0:1767319073.267803:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426240
00000100:00100000:3.0:1767319073.267807:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426240
00000100:00100000:3.0:1767319073.267831:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16770
00000100:00100000:3.0:1767319073.267838:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940425984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319073.267860:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319073.267900:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940425984:12345-0@lo:38:kworker.0 Request processed in 61us (247us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319073.267907:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16770
00000100:00100000:3.0:1767319073.267923:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16771
00000100:00100000:3.0:1767319073.267927:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940426240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319073.267936:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319073.267958:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940426240:12345-0@lo:38:kworker.0 Request processed in 29us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319073.267961:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16771
00000100:00080000:3.0:1767319073.267995:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319073.267998:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319073.268000:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940425984:0@lo:38:kworker.0
00000100:00080000:3.0:1767319073.268005:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319073.268007:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319073.268009:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940426240:0@lo:38:kworker.0
00000100:00100000:3.0:1767319073.268235:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940426112:0@lo:400:kworker.0
00000100:00100000:3.0:1767319073.268255:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319073.268285:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426112
00000100:00100000:3.0:1767319073.268289:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426112
00000100:00080000:2.0:1767319073.268346:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319073.268352:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319073.269682:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4269
00000100:00100000:0.0:1767319073.269706:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940425856:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.270309:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940425856:12345-0@lo:400:kworker.0 Request processed in 606us (2963us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319073.270318:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4269
00000100:00100000:0.0:1767319073.270356:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4270
00000100:00100000:0.0:1767319073.270362:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940426112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.270398:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940426112:12345-0@lo:400:kworker.0 Request processed in 37us (2141us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319073.270451:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940425856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319073.270479:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940426112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319073.274349:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4270
00000100:00100000:2.0:1767319073.901079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319074.221028:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319074.925256:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319075.245225:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319075.911195:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319075.911396:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298368
00000100:00100000:2.0:1767319075.911407:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298368
00000100:00100000:2.0:1767319075.911489:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4271
00000100:00100000:2.0:1767319075.911499:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894298368:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319075.911592:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894298368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (409us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319075.911600:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4271
00000100:00080000:0.0:1767319075.911680:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319075.912419:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894298112 offset 0 length 520: 4
00000100:00100000:2.0:1767319075.912457:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319075.912524:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298240
00000100:00100000:3.0:1767319075.912529:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298240
00000100:00100000:3.0:1767319075.912570:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16772
00000100:00100000:3.0:1767319075.912577:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894298240:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319075.912602:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319075.912980:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894298240:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 399us (519us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319075.912989:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16772
00000100:00100000:2.0:1767319075.949093:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319076.270167:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319076.847767:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319076.847815:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940426368:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319076.847911:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319076.847961:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426368
00000100:00100000:0.0:1767319076.847970:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426368
00000100:00100000:0.0:1767319076.848026:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326
00000100:00100000:0.0:1767319076.848035:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940426368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319076.848066:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319076.848123:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940426368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (212us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319076.848140:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326
00000100:00100000:1.0:1767319076.848802:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940426368:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319076.849007:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319076.973217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319077.294565:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319077.869305:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940426496:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319077.869378:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319077.870297:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426496
00000100:00100000:0.0:1767319077.870307:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426496
00000100:00100000:0.0:1767319077.870407:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327
00000100:00100000:0.0:1767319077.870417:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940426496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319077.870447:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319077.870533:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319077.876949:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940426496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6522us (7559us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319077.876965:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327
00000100:00100000:1.0:1767319077.877702:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940426496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319077.996946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319078.317149:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319078.380982:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319078.380993:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319078.380996:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319078.381000:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319078.381005:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319078.381013:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4323
00000100:00080000:3.0:1767319078.381019:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319078.381025:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319078.381179:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940426624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319078.381258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940426624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.381336:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319078.381427:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319078.381431:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319078.381433:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319078.381437:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4323
00000100:00080000:3.0:1767319078.381439:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319078.381444:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319078.381460:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940426752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319078.381535:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426624
00000100:00100000:1.0:1767319078.381565:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426624
00000100:00100000:1.0:1767319078.381605:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16773
00000100:00100000:1.0:1767319078.381612:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940426624:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.381892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940426752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.381929:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767319078.381963:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319078.382075:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319078.382079:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319078.382081:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319078.382086:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4323
00000100:00080000:3.0:1767319078.382088:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319078.382092:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319078.382104:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940427264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319078.382118:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319078.382120:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319078.382122:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319078.382125:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4323
00000100:00080000:3.0:1767319078.382127:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319078.382130:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319078.382138:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940427520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319078.382159:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940427136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319078.382307:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426752
00000100:00100000:2.0:1767319078.382313:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426752
00000100:00100000:2.0:1767319078.382340:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27
00000100:00100000:2.0:1767319078.382346:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940426752:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319078.382357:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319078.382809:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940426624:12345-0@lo:38:kworker.0 Request processed in 1195us (1471us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319078.382818:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16773
00000100:00100000:1.0:1767319078.382848:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940426880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383248:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319078.383290:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319078.383297:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940427392:0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383322:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319078.383374:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427136
00000100:00100000:3.0:1767319078.383379:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427136
00000100:00100000:3.0:1767319078.383423:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427392
00000100:00100000:3.0:1767319078.383426:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427392
00000100:00100000:3.0:1767319078.383451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4272
00000100:00100000:3.0:1767319078.383458:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940427136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383502:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940427136:12345-0@lo:400:kworker.0 Request processed in 45us (254us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319078.383508:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4272
00000100:00100000:3.0:1767319078.383523:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4273
00000100:00100000:3.0:1767319078.383530:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940427392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383555:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940427392:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319078.383560:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4273
00000100:00100000:3.0:1767319078.383604:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940427392:0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383616:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940427136:0@lo:400:kworker.0
00000100:00080000:3.0:1767319078.383652:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319078.383688:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940427008:0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383731:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319078.383800:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427008
00000100:00100000:3.0:1767319078.383804:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427008
00000100:00100000:3.0:1767319078.383835:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789
00000100:00100000:3.0:1767319078.383842:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940427008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319078.383876:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940427008:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319078.383883:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789
00000100:00100000:3.0:1767319078.383912:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940427008:0@lo:400:kworker.0
00000100:00080000:0.0:1767319078.384617:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319078.384624:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319078.384627:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940426624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.384648:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940427264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.384696:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319078.384787:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940427520:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.384812:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319078.384879:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940426752:12345-0@lo:38:kworker.0 Request processed in 2530us (2948us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319078.384890:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27
00000100:00080000:0.0:1767319078.385441:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319078.385447:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319078.385450:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940426752:0@lo:38:kworker.0
00000100:00100000:3.0:1767319078.385541:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427264
00000100:00100000:3.0:1767319078.385547:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427264
00000100:00100000:3.0:1767319078.385583:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427520
00000100:00100000:3.0:1767319078.385586:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427520
00000100:00100000:3.0:1767319078.385604:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16774
00000100:00100000:3.0:1767319078.385610:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940427264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319078.385629:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319078.385768:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16775
00000100:00100000:0.0:1767319078.385789:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940427520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319078.385800:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319078.385832:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940427520:12345-0@lo:38:kworker.0 Request processed in 42us (1019us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319078.385838:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16775
00000100:00080000:0.0:1767319078.385868:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319078.385872:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319078.385875:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940427520:0@lo:38:kworker.0
00000100:00100000:3.0:1767319078.385965:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940427264:12345-0@lo:38:kworker.0 Request processed in 354us (1269us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319078.385967:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319078.385972:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16774
00000100:00100000:1.0:1767319078.386003:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940426880
00000100:00100000:1.0:1767319078.386007:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940426880
00000100:00080000:0.0:1767319078.386037:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319078.386042:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319078.386045:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940427264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319078.386084:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790
00000100:00100000:0.0:1767319078.386092:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940426880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319078.386129:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940426880:12345-0@lo:400:kworker.0 Request processed in 38us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319078.386136:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790
00000100:00100000:1.0:1767319078.386152:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940426880:0@lo:400:kworker.0
00000100:00080000:3.0:1767319078.386353:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319079.020895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319079.341291:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319080.046233:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319080.365014:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319081.038472:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319081.038592:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319081.038746:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298624
00000100:00100000:3.0:1767319081.038756:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298624
00000100:00100000:3.0:1767319081.038879:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298496
00000100:00100000:3.0:1767319081.038883:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298496
00000100:00100000:3.0:1767319081.038905:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4274
00000100:00080000:0.0:1767319081.038908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319081.038917:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894298624:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319081.038934:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16776
00000100:00100000:0.0:1767319081.038941:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894298496:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319081.038964:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319081.038992:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894298624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (528us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319081.039003:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4274
00000100:00100000:0.0:1767319081.039004:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894298496:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 59us (417us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319081.039015:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16776
00000100:00100000:2.0:1767319081.069020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319081.389315:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319081.965461:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940427648:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319081.965566:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319081.970581:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427648
00000100:00100000:3.0:1767319081.970597:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427648
00000100:00100000:3.0:1767319081.970664:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328
00000100:00100000:3.0:1767319081.970708:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940427648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319081.970744:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767319081.970891:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319081.972464:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940427648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1781us (6887us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319081.972476:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328
00000100:00100000:2.0:1767319081.972719:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940427648:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319082.092938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319082.416609:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319082.477111:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319057/real 1767319057]  req@ffff93cf52010a80 x1853163940421504/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319082.477137:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf52010a80 x1853163940421504/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319082.477153:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319082.477175:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319082.477178:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940421504:0@lo:250:kworker.0
00000100:00080000:3.0:1767319082.478375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.478383:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319082.478386:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.478392:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4307
00000100:00080000:3.0:1767319082.478396:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.478402:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319082.478437:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760df80 x1853163940427776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.478466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.478470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.478472:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.478476:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4328
00000100:00080000:3.0:1767319082.478478:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.478480:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319082.478496:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e300 x1853163940427904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.478505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.478508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.478509:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.478512:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4328
00000100:00080000:3.0:1767319082.478514:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.478517:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319082.478528:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940428032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.478597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.478601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.478603:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.478606:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4328
00000100:00080000:3.0:1767319082.478609:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.478613:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319082.478623:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ce00 x1853163940428544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.478637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.478640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.478642:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.478645:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4328
00000100:00080000:3.0:1767319082.478647:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.478650:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319082.478661:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c700 x1853163940428800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319082.478700:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940428288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.478769:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.478951:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940428672:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.478980:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.479033:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319082.479039:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940428160:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.479071:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428672
00000100:00100000:2.0:1767319082.479086:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428672
00000100:00100000:2.0:1767319082.479133:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4275
00000100:00100000:2.0:1767319082.479140:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940428672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.479183:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940428672:12345-0@lo:400:kworker.0 Request processed in 44us (202us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319082.479189:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4275
00000100:00100000:2.0:1767319082.479219:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940428416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.479238:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.479262:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428416
00000100:00100000:2.0:1767319082.479264:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428416
00000100:00100000:2.0:1767319082.479284:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4276
00000100:00100000:2.0:1767319082.479289:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940428416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.479317:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940428416:12345-0@lo:400:kworker.0 Request processed in 28us (78us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319082.479323:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4276
00000100:00100000:2.0:1767319082.479355:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940428416:0@lo:400:kworker.0
00000100:00080000:0.0:1767319082.479487:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319082.479503:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940427776:0@lo:250:kworker.0
00000400:00000100:0.0:1767319082.479525:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940427776 offset 0 length 520: 4
00000100:00100000:0.0:1767319082.479540:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940427904:0@lo:38:kworker.0
00000100:00100000:0.0:1767319082.479556:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319082.479579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940428032:0@lo:38:kworker.0
00000100:00100000:0.0:1767319082.479610:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319082.479626:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940428544:0@lo:38:kworker.0
00000100:00100000:0.0:1767319082.479643:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319082.479656:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940428800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319082.479685:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319082.479715:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428032
00000100:00100000:0.0:1767319082.479719:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428032
00000100:00100000:0.0:1767319082.479739:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28
00000100:00100000:0.0:1767319082.479744:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940428032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319082.479762:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319082.479816:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940428032:12345-0@lo:38:kworker.0 Request processed in 59us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319082.479821:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28
00000100:00100000:0.0:1767319082.479900:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940427904
00000100:00100000:0.0:1767319082.479903:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940427904
00000100:00100000:0.0:1767319082.479918:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428544
00000100:00100000:0.0:1767319082.479920:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428544
00000100:00100000:0.0:1767319082.479927:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428800
00000100:00100000:0.0:1767319082.479928:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428800
00000100:00100000:0.0:1767319082.479934:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16777
00000100:00100000:0.0:1767319082.479937:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940427904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319082.479944:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319082.479962:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940427904:12345-0@lo:38:kworker.0 Request processed in 24us (405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319082.479965:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16777
00000100:00100000:0.0:1767319082.479972:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16778
00000100:00100000:0.0:1767319082.479974:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940428544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319082.479980:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319082.479990:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940428544:12345-0@lo:38:kworker.0 Request processed in 15us (348us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319082.479994:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16778
00000100:00100000:0.0:1767319082.480002:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16779
00000100:00100000:0.0:1767319082.480006:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940428800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319082.480016:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319082.480036:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940428800:12345-0@lo:38:kworker.0 Request processed in 28us (351us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319082.480041:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16779
00000100:00100000:3.0:1767319082.480222:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428288
00000100:00100000:3.0:1767319082.480225:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428288
00000100:00100000:3.0:1767319082.480250:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791
00000100:00100000:3.0:1767319082.480255:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940428288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.480279:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940428288:12345-0@lo:400:kworker.0 Request processed in 25us (1510us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319082.480283:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791
00000100:00100000:3.0:1767319082.480302:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940428288:0@lo:400:kworker.0
00000100:00080000:3.0:1767319082.480322:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319082.480561:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319082.480566:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319082.480569:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940427904:0@lo:38:kworker.0
00000100:00080000:0.0:1767319082.480581:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319082.480584:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319082.480587:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940428032:0@lo:38:kworker.0
00000100:00080000:0.0:1767319082.480595:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319082.480597:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319082.480600:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940428544:0@lo:38:kworker.0
00000100:00080000:0.0:1767319082.480607:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319082.480610:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319082.480612:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940428800:0@lo:38:kworker.0
00000100:00100000:2.0:1767319082.481146:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.481185:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940428672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319082.481244:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428160
00000100:00100000:1.0:1767319082.481249:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428160
00000100:00100000:1.0:1767319082.481283:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792
00000100:00100000:1.0:1767319082.481288:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940428160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319082.481336:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940428160:12345-0@lo:400:kworker.0 Request processed in 48us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319082.481342:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792
00000100:00100000:2.0:1767319082.481713:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940428160:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.989106:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319082.989135:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940428928:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319082.989215:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319082.989310:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940428928
00000100:00100000:3.0:1767319082.989320:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940428928
00000100:00100000:3.0:1767319082.989382:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329
00000100:00100000:3.0:1767319082.989393:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940428928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319082.989427:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319082.989483:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940428928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319082.989490:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329
00000100:00100000:0.0:1767319082.990613:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940428928:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319083.117727:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319083.437225:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319084.141768:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319084.461982:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319085.165451:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319085.487061:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319086.152336:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319086.152439:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298752
00000100:00100000:2.0:1767319086.152448:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298752
00000100:00100000:2.0:1767319086.152500:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16780
00000100:00100000:2.0:1767319086.152508:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894298752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319086.152534:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319086.152600:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894298752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (275us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319086.152607:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16780
00000100:00100000:3.0:1767319086.153085:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319086.153220:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894298880
00000100:00100000:2.0:1767319086.153225:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894298880
00000100:00100000:2.0:1767319086.153277:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4277
00000100:00100000:2.0:1767319086.153284:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894298880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319086.153329:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894298880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319086.153336:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4277
00000100:00080000:3.0:1767319086.153385:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319086.188932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319086.511007:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319087.093949:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940429056:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319087.094029:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319087.094192:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429056
00000100:00100000:0.0:1767319087.094201:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429056
00000100:00100000:0.0:1767319087.094266:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330
00000100:00100000:0.0:1767319087.094273:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940429056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319087.094305:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319087.094359:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940429056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319087.094366:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330
00000100:00080000:3.0:1767319087.094478:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319087.094514:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940429056:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319087.213499:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319087.533013:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319087.597787:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319087.597797:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319087.597800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319087.597804:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319087.597808:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319087.597816:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4332
00000100:00080000:3.0:1767319087.597821:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319087.597828:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319087.597874:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760fb80 x1853163940429184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319087.597904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319087.597908:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319087.597910:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319087.597913:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4332
00000100:00080000:3.0:1767319087.597915:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319087.597918:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319087.597930:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d500 x1853163940429312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319087.597990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319087.597993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319087.597995:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319087.597999:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4332
00000100:00080000:3.0:1767319087.598001:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319087.598005:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319087.598015:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940429696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319087.598030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319087.598033:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319087.598035:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319087.598038:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4332
00000100:00080000:3.0:1767319087.598040:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319087.598044:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319087.598054:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940429952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319087.598083:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940429568:0@lo:400:kworker.0
00000100:00100000:3.0:1767319087.598153:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319087.598213:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319087.598219:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940429824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319087.598243:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319087.598277:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429568
00000100:00100000:3.0:1767319087.598284:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429568
00000100:00100000:3.0:1767319087.598334:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429824
00000100:00100000:3.0:1767319087.598337:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429824
00000100:00100000:3.0:1767319087.598366:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4278
00000100:00100000:3.0:1767319087.598375:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940429568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319087.598557:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4279
00000100:00100000:1.0:1767319087.598567:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940429824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319087.598603:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940429824:12345-0@lo:400:kworker.0 Request processed in 38us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319087.598609:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4279
00000100:00080000:1.0:1767319087.598684:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319087.598692:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319087.598701:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940429440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319087.598732:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319087.598800:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429440
00000100:00100000:1.0:1767319087.598804:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429440
00000100:00100000:1.0:1767319087.598842:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793
00000100:00100000:1.0:1767319087.598850:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940429440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319087.598873:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940429184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319087.598888:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940429440:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319087.598895:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793
00000100:00100000:0.0:1767319087.598910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319087.598936:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940429312:0@lo:38:kworker.0
00000100:00100000:3.0:1767319087.598951:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940429568:12345-0@lo:400:kworker.0 Request processed in 49us (270us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319087.598962:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4278
00000100:00100000:0.0:1767319087.598964:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319087.598978:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429184
00000100:00100000:3.0:1767319087.598982:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429184
00000100:00100000:0.0:1767319087.598988:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940429696:0@lo:38:kworker.0
00000100:00100000:0.0:1767319087.599010:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319087.601828:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429696
00000100:00100000:0.0:1767319087.601843:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940429952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319087.601843:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429696
00000100:00100000:0.0:1767319087.601898:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319087.601917:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429952
00000100:00100000:2.0:1767319087.601923:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429952
00000100:00100000:2.0:1767319087.601948:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16781
00000100:00100000:2.0:1767319087.602001:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940429184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319087.602022:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319087.602066:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940429184:12345-0@lo:38:kworker.0 Request processed in 111us (3157us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319087.602330:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16782
00000100:00100000:0.0:1767319087.602337:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940429696:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319087.602340:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16783
00000100:00100000:3.0:1767319087.602349:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940429952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319087.602351:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767319087.602366:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319087.602414:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16781
00000100:00100000:2.0:1767319087.602583:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940429312
00000100:00100000:2.0:1767319087.602587:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940429312
00000100:00100000:2.0:1767319087.602606:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29
00000100:00100000:2.0:1767319087.602611:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940429312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319087.602634:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319087.602713:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319087.602791:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940429952:12345-0@lo:38:kworker.0 Request processed in 422us (874us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319087.602799:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16783
00000100:00100000:3.0:1767319087.602852:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940429824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319087.602863:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940429568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319087.603070:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940429312:12345-0@lo:38:kworker.0 Request processed in 457us (4108us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319087.603076:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29
00000100:00080000:2.0:1767319087.603108:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319087.603113:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319087.603116:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940429184:0@lo:38:kworker.0
00000100:00080000:2.0:1767319087.603124:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319087.603127:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319087.603130:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940429312:0@lo:38:kworker.0
00000100:00080000:2.0:1767319087.603137:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319087.603140:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319087.603143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940429952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319087.609719:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940429440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319087.609720:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940429696:12345-0@lo:38:kworker.0 Request processed in 7372us (10698us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319087.609739:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16782
00000100:00080000:2.0:1767319087.609831:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319087.609837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319087.609840:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940429696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319088.109584:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940430080:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319088.109674:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319088.109864:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430080
00000100:00100000:2.0:1767319088.109873:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430080
00000100:00100000:2.0:1767319088.109930:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331
00000100:00100000:2.0:1767319088.109939:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940430080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319088.109970:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319088.115531:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940430080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5582us (5845us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319088.115548:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331
00000100:00100000:1.0:1767319088.116810:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940430080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319088.236930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319088.557581:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319089.260967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319089.581121:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319090.284910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319090.605495:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319091.274399:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319091.274448:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319091.274898:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299136
00000100:00100000:0.0:1767319091.274909:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299136
00000100:00100000:0.0:1767319091.274991:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299008
00000100:00100000:0.0:1767319091.274994:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299008
00000100:00100000:0.0:1767319091.275024:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4280
00000100:00100000:0.0:1767319091.275034:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894299136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319091.275128:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894299136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (741us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319091.275135:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4280
00000100:00100000:0.0:1767319091.275157:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16784
00000100:00100000:0.0:1767319091.275162:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894299008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319091.275183:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319091.275208:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894299008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (761us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319091.275214:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16784
00000100:00080000:2.0:1767319091.276046:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319091.309049:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319091.629743:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319092.205110:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940430208:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319092.205200:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.205388:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430208
00000100:00100000:3.0:1767319092.205395:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430208
00000100:00100000:3.0:1767319092.205454:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332
00000100:00100000:3.0:1767319092.205461:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940430208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319092.205489:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319092.205533:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940430208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (333us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319092.205541:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332
00000100:00080000:2.0:1767319092.205761:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319092.205827:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940430208:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319092.333020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319092.653095:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319092.717450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319092.717460:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319092.717463:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319092.717466:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319092.717480:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319092.717488:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4337
00000100:00080000:2.0:1767319092.717494:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319092.717501:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319092.717545:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940430336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319092.717562:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319092.717566:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319092.717568:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319092.717571:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4337
00000100:00080000:2.0:1767319092.717604:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319092.717609:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319092.717623:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940430464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319092.717675:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319092.717678:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319092.717680:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319092.717684:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4337
00000100:00080000:2.0:1767319092.717686:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319092.717690:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319092.717700:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94380 x1853163940430848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319092.717729:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319092.717732:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319092.717734:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319092.717738:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4337
00000100:00080000:2.0:1767319092.717740:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319092.717743:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319092.717753:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb97b80 x1853163940431104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319092.717787:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319092.717799:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940430720:0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.717882:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319092.717943:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319092.717950:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940430592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.717975:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319092.718011:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430720
00000100:00100000:1.0:1767319092.718018:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430720
00000100:00100000:1.0:1767319092.718075:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4281
00000100:00100000:2.0:1767319092.718078:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940430976:0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.718084:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940430720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319092.718104:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319092.718131:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940430720:12345-0@lo:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319092.718138:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4281
00000100:00100000:2.0:1767319092.718144:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430976
00000100:00100000:2.0:1767319092.718147:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430976
00000100:00100000:1.0:1767319092.718161:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430592
00000100:00100000:1.0:1767319092.718164:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430592
00000100:00100000:2.0:1767319092.718173:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4282
00000100:00100000:2.0:1767319092.718178:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940430976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.718186:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794
00000100:00100000:1.0:1767319092.718191:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940430592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319092.718209:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940430976:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319092.718215:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940430592:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319092.718215:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4282
00000100:00100000:1.0:1767319092.718220:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794
00000100:00080000:2.0:1767319092.718230:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319092.718234:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319092.718421:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940430592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319092.718536:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940430336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319092.719392:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940430976:0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.721078:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940430720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319092.721514:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319092.721562:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940430464:0@lo:38:kworker.0
00000100:00100000:0.0:1767319092.721604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319092.721636:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940430848:0@lo:38:kworker.0
00000100:00100000:0.0:1767319092.721659:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319092.721682:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940431104:0@lo:38:kworker.0
00000100:00100000:0.0:1767319092.721702:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319092.721811:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430336
00000100:00100000:1.0:1767319092.721818:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430336
00000100:00100000:1.0:1767319092.721860:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430848
00000100:00100000:1.0:1767319092.721864:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430848
00000100:00100000:1.0:1767319092.721878:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431104
00000100:00100000:1.0:1767319092.721881:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431104
00000100:00100000:1.0:1767319092.721894:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16785
00000100:00100000:1.0:1767319092.721906:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940430336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319092.721927:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319092.721970:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940430336:12345-0@lo:38:kworker.0 Request processed in 68us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319092.722022:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940430464
00000100:00100000:3.0:1767319092.722026:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940430464
00000100:00100000:3.0:1767319092.722048:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30
00000100:00100000:3.0:1767319092.722053:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940430464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319092.722062:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319092.722090:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940430464:12345-0@lo:38:kworker.0 Request processed in 36us (486us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319092.722097:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30
00000100:00100000:2.0:1767319092.728066:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16786
00000100:00100000:2.0:1767319092.728082:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940430848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319092.728109:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319092.728193:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940430848:12345-0@lo:38:kworker.0 Request processed in 113us (6532us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319092.728200:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16786
00000100:00100000:2.0:1767319092.728233:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16787
00000100:00100000:2.0:1767319092.728238:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940431104:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319092.728248:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319092.728276:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940431104:12345-0@lo:38:kworker.0 Request processed in 37us (6572us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319092.728281:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16787
00000100:00080000:2.0:1767319092.728359:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319092.728560:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319092.728565:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940430336:0@lo:38:kworker.0
00000100:00080000:2.0:1767319092.728738:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319092.728743:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319092.728746:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940430464:0@lo:38:kworker.0
00000100:00080000:2.0:1767319092.728755:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319092.728758:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319092.728760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940430848:0@lo:38:kworker.0
00000100:00080000:2.0:1767319092.728767:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319092.728770:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319092.728791:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940431104:0@lo:38:kworker.0
00000100:00100000:1.0:1767319092.729143:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16785
00000100:00100000:2.0:1767319093.229547:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940431232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319093.229642:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319093.229809:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431232
00000100:00100000:0.0:1767319093.229819:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431232
00000100:00100000:0.0:1767319093.229880:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333
00000100:00100000:0.0:1767319093.229890:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940431232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319093.229923:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319093.235223:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940431232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5319us (5566us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319093.235242:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333
00000100:00100000:2.0:1767319093.240902:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940431232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319093.356971:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319093.677133:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319094.381020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319094.701044:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319095.405217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319095.724994:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319096.392186:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319096.392251:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319096.392344:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299264
00000100:00100000:2.0:1767319096.392357:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299264
00000100:00100000:2.0:1767319096.392408:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299392
00000100:00100000:2.0:1767319096.392411:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299392
00000100:00100000:2.0:1767319096.392462:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4283
00000100:00100000:2.0:1767319096.392472:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894299392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319096.392552:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894299392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (289us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319096.392561:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4283
00000100:00100000:2.0:1767319096.392579:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16788
00000100:00100000:2.0:1767319096.392583:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894299264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319096.392604:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319096.392643:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894299264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (467us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319096.392649:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16788
00000100:00080000:0.0:1767319096.392839:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319096.428968:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319096.749139:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319097.326914:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319097.326939:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940431360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319097.327012:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319097.327201:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431360
00000100:00100000:0.0:1767319097.327212:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431360
00000100:00100000:0.0:1767319097.327289:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334
00000100:00100000:0.0:1767319097.327299:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940431360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319097.327347:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319097.327396:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940431360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (384us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319097.327404:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334
00000100:00080000:2.0:1767319097.327749:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319097.327806:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940431360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319097.452902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319097.774754:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319097.837329:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319097.837342:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319097.837345:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319097.837349:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319097.837353:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319097.837361:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4342
00000100:00080000:3.0:1767319097.837366:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319097.837373:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319097.837411:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940431488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319097.837439:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319097.837442:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319097.837444:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319097.837447:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4342
00000100:00080000:3.0:1767319097.837450:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319097.837452:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319097.837462:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966d80 x1853163940431616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319097.837525:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319097.837556:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319097.837558:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319097.837561:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4342
00000100:00080000:3.0:1767319097.837564:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319097.837568:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319097.837579:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940432000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319097.837593:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319097.837596:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319097.837598:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319097.837601:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4342
00000100:00080000:3.0:1767319097.837603:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319097.837606:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319097.837613:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940432256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319097.837636:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940432128:0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.837792:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940431744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.837830:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319097.837946:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319097.837976:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319097.837982:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940431872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319097.838004:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319097.838073:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432128
00000100:00100000:0.0:1767319097.838081:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432128
00000100:00100000:0.0:1767319097.838140:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431872
00000100:00100000:0.0:1767319097.838144:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431872
00000100:00100000:0.0:1767319097.838167:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4284
00000100:00100000:0.0:1767319097.838175:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940432128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.838229:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940432128:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319097.838237:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4284
00000100:00100000:0.0:1767319097.838256:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4285
00000100:00100000:0.0:1767319097.838261:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940431872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.838288:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940431872:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319097.838293:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4285
00000100:00100000:0.0:1767319097.838329:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940431872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.838340:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940432128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319097.838413:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940431488:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.838445:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319097.838473:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940431616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.838497:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319097.838541:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940432000:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.838563:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319097.838578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940432256:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.838596:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319097.838623:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431488
00000100:00100000:2.0:1767319097.838627:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431488
00000100:00100000:2.0:1767319097.838642:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432000
00000100:00100000:2.0:1767319097.838644:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432000
00000100:00100000:2.0:1767319097.838652:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432256
00000100:00100000:2.0:1767319097.838654:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432256
00000100:00100000:2.0:1767319097.838662:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16789
00000100:00100000:2.0:1767319097.838667:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940431488:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319097.838797:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16790
00000100:00100000:0.0:1767319097.838802:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940432000:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319097.838887:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431744
00000100:00100000:1.0:1767319097.838891:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431744
00000100:00100000:1.0:1767319097.838920:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795
00000100:00100000:1.0:1767319097.838925:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940431744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.838962:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940431744:12345-0@lo:400:kworker.0 Request processed in 37us (1132us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319097.838968:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795
00000100:00100000:1.0:1767319097.838986:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16791
00000100:00100000:1.0:1767319097.838990:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940432256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319097.839029:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319097.839058:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940431488:12345-0@lo:38:kworker.0 Request processed in 390us (612us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319097.839064:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16789
00000100:00100000:2.0:1767319097.839083:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940431616
00000100:00100000:2.0:1767319097.839086:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940431616
00000100:00100000:2.0:1767319097.839102:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31
00000100:00100000:2.0:1767319097.839106:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940431616:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767319097.839147:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319097.839152:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319097.839261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319097.839267:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319097.839271:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940431488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319097.839335:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940431744:0@lo:400:kworker.0
00010000:00020000:0.0:1767319097.843087:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319097.843197:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940432000:12345-0@lo:38:kworker.0 Request processed in 4391us (4630us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319097.843209:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16790
00000100:00080000:3.0:1767319097.843382:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319097.843388:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319097.843393:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940432000:0@lo:38:kworker.0
00010000:00020000:1.0:1767319097.848205:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319097.848314:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940432256:12345-0@lo:38:kworker.0 Request processed in 9318us (9713us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319097.848326:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16791
00000100:00080000:3.0:1767319097.848478:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319097.848499:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319097.848504:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940432256:0@lo:38:kworker.0
00010000:00020000:2.0:1767319097.848854:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319097.848908:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940431616:12345-0@lo:38:kworker.0 Request processed in 9800us (10409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319097.848917:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31
00000100:00080000:3.0:1767319097.848989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319097.848993:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319097.848997:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940431616:0@lo:38:kworker.0
00000100:00100000:1.0:1767319098.349059:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940432384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319098.349142:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319098.349186:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432384
00000100:00100000:3.0:1767319098.349195:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432384
00000100:00100000:3.0:1767319098.349247:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335
00000100:00100000:3.0:1767319098.349258:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940432384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319098.349289:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319098.349339:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940432384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (196us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319098.349347:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335
00000100:00100000:1.0:1767319098.349503:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940432384:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319098.478737:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319098.797246:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319099.501150:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319099.821032:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319100.524887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319100.845290:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319101.517356:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319101.517404:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767319101.517429:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894299776 offset 0 length 520: 4
00000100:00100000:3.0:1767319101.517540:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299520
00000100:00100000:3.0:1767319101.517551:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299520
00000100:00100000:3.0:1767319101.517603:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299648
00000100:00100000:3.0:1767319101.517606:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299648
00000100:00100000:3.0:1767319101.517652:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4286
00000100:00100000:3.0:1767319101.517664:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894299648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319101.517752:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894299648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319101.517759:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4286
00000100:00100000:3.0:1767319101.517823:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16792
00000100:00100000:3.0:1767319101.517828:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894299520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319101.517846:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319101.517871:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894299520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (525us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319101.517876:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16792
00000100:00080000:3.0:1767319101.517892:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319101.548855:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319101.871914:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319102.455338:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940432512:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319102.455416:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319102.455896:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432512
00000100:00100000:0.0:1767319102.455904:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432512
00000100:00100000:0.0:1767319102.455985:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336
00000100:00100000:0.0:1767319102.455997:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940432512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319102.456036:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319102.456101:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940432512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (684us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319102.456110:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336
00000100:00080000:3.0:1767319102.456355:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319102.456397:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940432512:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319102.572975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319102.893007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319102.957230:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319102.957241:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319102.957244:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319102.957247:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319102.957252:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319102.957259:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4347
00000100:00080000:2.0:1767319102.957264:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319102.957270:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319102.957310:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940432640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319102.957341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319102.957345:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319102.957347:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319102.957351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4347
00000100:00080000:2.0:1767319102.957354:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319102.957357:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319102.957371:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b480 x1853163940432768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319102.957432:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319102.957436:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319102.957438:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319102.957441:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4347
00000100:00080000:2.0:1767319102.957444:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319102.957448:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319102.957458:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940433152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319102.957480:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319102.957513:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319102.957514:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319102.957518:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4347
00000100:00080000:2.0:1767319102.957521:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319102.957524:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319102.957538:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211500 x1853163940433408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319102.957771:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940433024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319102.957867:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319102.957939:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319102.957945:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940432896:0@lo:400:kworker.0
00000100:00100000:0.0:1767319102.957970:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319102.958054:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940433280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319102.958084:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319102.958168:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433024
00000100:00100000:0.0:1767319102.958176:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433024
00000100:00100000:0.0:1767319102.958235:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433280
00000100:00100000:0.0:1767319102.958238:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433280
00000100:00100000:0.0:1767319102.958263:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4287
00000100:00100000:0.0:1767319102.958272:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940433024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319102.958323:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940433024:12345-0@lo:400:kworker.0 Request processed in 52us (456us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319102.958331:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4287
00000100:00100000:0.0:1767319102.958347:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4288
00000100:00100000:0.0:1767319102.958354:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940433280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319102.958387:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940433280:12345-0@lo:400:kworker.0 Request processed in 34us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319102.958405:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4288
00000100:00100000:0.0:1767319102.958450:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940433024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319102.958478:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940433280:0@lo:400:kworker.0
00000100:00080000:1.0:1767319102.958690:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319102.958802:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432896
00000100:00100000:3.0:1767319102.958807:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432896
00000100:00100000:3.0:1767319102.958860:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796
00000100:00100000:3.0:1767319102.958870:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940432896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319102.958920:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940432896:12345-0@lo:400:kworker.0 Request processed in 53us (948us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319102.958926:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796
00000100:00100000:3.0:1767319102.958952:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940432640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.958978:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.958997:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940432768:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.959022:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.959039:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940433152:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.959058:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.959071:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940433408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.959090:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.959116:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432768
00000100:00100000:3.0:1767319102.959120:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432768
00000100:00100000:3.0:1767319102.959138:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32
00000100:00100000:3.0:1767319102.959143:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940432768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319102.959161:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319102.959192:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940432768:12345-0@lo:38:kworker.0 Request processed in 47us (169us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319102.959197:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32
00000100:00100000:3.0:1767319102.959216:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940432640
00000100:00100000:3.0:1767319102.959220:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940432640
00000100:00100000:3.0:1767319102.959234:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433152
00000100:00100000:3.0:1767319102.959236:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433152
00000100:00100000:3.0:1767319102.959248:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433408
00000100:00100000:3.0:1767319102.959250:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433408
00000100:00100000:3.0:1767319102.959263:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16793
00000100:00100000:3.0:1767319102.959267:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940432640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319102.959277:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319102.959304:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940432640:12345-0@lo:38:kworker.0 Request processed in 34us (324us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319102.959309:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16793
00000100:00100000:3.0:1767319102.959320:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16794
00000100:00100000:3.0:1767319102.959324:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940433152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319102.959333:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319102.959354:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940433152:12345-0@lo:38:kworker.0 Request processed in 29us (295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319102.959359:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16794
00000100:00100000:3.0:1767319102.959369:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16795
00000100:00100000:3.0:1767319102.959373:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940433408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319102.959381:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319102.959418:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940433408:12345-0@lo:38:kworker.0 Request processed in 44us (327us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319102.959424:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16795
00000100:00080000:3.0:1767319102.959453:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319102.959458:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319102.959461:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940432640:0@lo:38:kworker.0
00000100:00080000:3.0:1767319102.959468:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319102.959471:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319102.959474:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940432768:0@lo:38:kworker.0
00000100:00080000:3.0:1767319102.959480:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319102.959493:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319102.959496:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940433152:0@lo:38:kworker.0
00000100:00080000:3.0:1767319102.959504:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319102.959506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319102.959510:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940433408:0@lo:38:kworker.0
00000100:00080000:1.0:1767319102.959595:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319102.959855:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940432896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319103.470359:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319103.470381:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940433536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319103.470446:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319103.470535:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433536
00000100:00100000:3.0:1767319103.470543:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433536
00000100:00100000:3.0:1767319103.470599:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337
00000100:00100000:3.0:1767319103.470606:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940433536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319103.470636:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319103.470688:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940433536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (230us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319103.470694:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337
00000100:00100000:3.0:1767319103.470746:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940433536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319103.599068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319103.917116:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319104.620890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319104.941109:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319105.644920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319105.965541:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319106.632930:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319106.633252:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894299904
00000100:00100000:2.0:1767319106.633262:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894299904
00000100:00100000:2.0:1767319106.633312:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16796
00000100:00100000:2.0:1767319106.633319:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894299904:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319106.633345:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319106.633539:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894299904:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 217us (617us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319106.633547:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16796
00000100:00100000:3.0:1767319106.635858:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319106.635957:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300032
00000100:00100000:0.0:1767319106.635967:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300032
00000100:00100000:0.0:1767319106.636056:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4289
00000100:00100000:0.0:1767319106.636066:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894300032:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319106.636144:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894300032:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319106.636152:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4289
00000100:00080000:1.0:1767319106.636991:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319106.669371:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319106.989087:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319107.053040:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319082/real 1767319082]  req@ffff93d04760df80 x1853163940427776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319107 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319107.053075:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04760df80 x1853163940427776/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319107 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319107.053094:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319107.053161:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319107.053166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940427776:0@lo:250:kworker.0
00000100:00080000:2.0:1767319107.055534:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.055544:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319107.055548:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.055555:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4332
00000100:00080000:2.0:1767319107.055560:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.055567:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319107.055609:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210700 x1853163940433664/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319107.055709:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940433664:0@lo:250:kworker.0
00000400:00000100:1.0:1767319107.055768:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940433664 offset 0 length 520: 4
00000100:00080000:2.0:1767319107.057665:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.057674:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.057678:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.057684:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4352
00000100:00080000:2.0:1767319107.057688:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.057694:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319107.057726:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213100 x1853163940433792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319107.059183:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940433792:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.059257:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319107.059417:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433792
00000100:00100000:0.0:1767319107.059426:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433792
00000100:00100000:0.0:1767319107.059497:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16797
00000100:00100000:0.0:1767319107.059505:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940433792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319107.059528:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319107.059586:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940433792:12345-0@lo:38:kworker.0 Request processed in 79us (328us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319107.059592:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16797
00000100:00080000:3.0:1767319107.059770:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319107.059803:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319107.059807:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940433792:0@lo:38:kworker.0
00000100:00080000:2.0:1767319107.060189:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.060194:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.060197:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.060202:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4352
00000100:00080000:2.0:1767319107.060206:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.060210:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319107.060239:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210a80 x1853163940433920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319107.060289:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940433920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319107.060332:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319107.060412:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940433920
00000100:00100000:0.0:1767319107.060417:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940433920
00000100:00100000:0.0:1767319107.060459:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33
00000100:00100000:0.0:1767319107.060465:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940433920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319107.060480:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319107.062607:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.062614:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.062618:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.062625:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4352
00000100:00080000:2.0:1767319107.062630:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.062636:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319107.062655:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7fb80 x1853163940434432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319107.062743:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.062826:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.062868:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319107.062874:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.062896:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.062931:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434048
00000100:00100000:1.0:1767319107.062938:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434048
00000100:00100000:1.0:1767319107.062995:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434176
00000100:00100000:1.0:1767319107.062998:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434176
00000100:00100000:1.0:1767319107.063025:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797
00000100:00100000:1.0:1767319107.063034:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063086:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434048:12345-0@lo:400:kworker.0 Request processed in 53us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319107.063093:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797
00000100:00100000:1.0:1767319107.063110:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798
00000100:00100000:1.0:1767319107.063117:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063144:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434176:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319107.063149:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798
00000100:00080000:1.0:1767319107.063172:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319107.063176:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319107.063203:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063214:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063253:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940434304:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063281:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.063313:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434304
00000100:00100000:1.0:1767319107.063316:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434304
00000100:00100000:1.0:1767319107.063348:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4290
00000100:00100000:1.0:1767319107.063354:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940434304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.063386:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940434304:12345-0@lo:400:kworker.0 Request processed in 32us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319107.063391:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4290
00000100:00100000:1.0:1767319107.063415:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940434304:0@lo:400:kworker.0
00000100:00080000:1.0:1767319107.063428:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319107.063806:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940434432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319107.063837:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.063902:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434432
00000100:00100000:1.0:1767319107.063906:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434432
00000100:00100000:1.0:1767319107.063929:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16798
00000100:00100000:1.0:1767319107.063933:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940434432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319107.063951:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319107.063982:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940434432:12345-0@lo:38:kworker.0 Request processed in 47us (144us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319107.063988:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16798
00000100:00100000:0.0:1767319107.067964:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940433920:12345-0@lo:38:kworker.0 Request processed in 7488us (7622us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319107.067980:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33
00000100:00080000:3.0:1767319107.068107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319107.068113:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319107.068117:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940433920:0@lo:38:kworker.0
00000100:00080000:3.0:1767319107.068149:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319107.068153:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319107.068155:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940434432:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.069713:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940434560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.069798:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319107.069960:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434560
00000100:00100000:0.0:1767319107.069968:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434560
00000100:00100000:0.0:1767319107.070043:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291
00000100:00100000:0.0:1767319107.070053:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940434560:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319107.070135:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319107.071174:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.071182:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.071186:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.071193:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4352
00000100:00080000:2.0:1767319107.071198:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.071203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319107.071233:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7f480 x1853163940434688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319107.071284:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940434688:0@lo:38:kworker.0
00000100:00100000:2.0:1767319107.071329:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319107.071374:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434688
00000100:00100000:2.0:1767319107.071379:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434688
00000100:00100000:2.0:1767319107.071420:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16799
00000100:00100000:2.0:1767319107.071426:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940434688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319107.071457:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319107.071494:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940434688:12345-0@lo:38:kworker.0 Request processed in 67us (165us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319107.071500:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16799
00000100:00080000:2.0:1767319107.071536:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319107.071541:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319107.071544:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940434688:0@lo:38:kworker.0
00000100:00100000:0.0:1767319107.075278:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940434560:12345-0@lo:400:kworker.0 Request processed in 5217us (5470us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319107.075294:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4291
00000100:00100000:1.0:1767319107.075607:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940434560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319107.565178:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434816:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319107.565254:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319107.565335:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434816
00000100:00100000:3.0:1767319107.565344:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434816
00000100:00100000:3.0:1767319107.565406:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338
00000100:00100000:3.0:1767319107.565416:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434816:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319107.565469:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319107.566253:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 835us (995us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319107.566262:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338
00000100:00100000:1.0:1767319107.570118:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434816:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319107.692926:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319108.013060:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319108.589098:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319108.589123:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434944:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319108.589206:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319108.589320:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940434944
00000100:00100000:3.0:1767319108.589330:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940434944
00000100:00100000:3.0:1767319108.589398:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339
00000100:00100000:3.0:1767319108.589406:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319108.589456:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319108.589523:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940434944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (311us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319108.589530:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339
00000100:00100000:1.0:1767319108.589831:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940434944:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319108.717328:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319109.038767:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319109.740909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319110.061463:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319110.767595:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319111.086742:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319111.750690:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319111.752235:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319111.753724:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300160
00000100:00100000:0.0:1767319111.753738:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300160
00000100:00100000:0.0:1767319111.753811:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300288
00000100:00100000:0.0:1767319111.753815:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300288
00000100:00100000:0.0:1767319111.753877:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4292
00000100:00100000:0.0:1767319111.753887:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894300288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319111.753972:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894300288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (1744us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319111.753979:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4292
00000100:00100000:0.0:1767319111.754002:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16800
00000100:00100000:0.0:1767319111.754006:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894300160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319111.754026:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319111.754050:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894300160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (3372us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319111.754057:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16800
00000100:00080000:1.0:1767319111.754888:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319111.788908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319112.109039:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319112.173520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319112.173535:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319112.173538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319112.173543:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319112.173549:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319112.173559:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4357
00000100:00080000:0.0:1767319112.173565:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319112.173573:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319112.173624:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940435072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319112.173656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319112.173660:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319112.173662:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319112.173666:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4357
00000100:00080000:0.0:1767319112.173668:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319112.173672:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319112.173685:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940435200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319112.173758:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940435328:0@lo:400:kworker.0
00000100:00100000:3.0:1767319112.173874:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319112.173930:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435328
00000100:00100000:1.0:1767319112.173941:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435328
00000100:00100000:1.0:1767319112.174006:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799
00000100:00100000:1.0:1767319112.174017:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940435328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319112.174111:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940435072:0@lo:38:kworker.0
00000100:00100000:2.0:1767319112.174161:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319112.174186:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940435200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319112.174211:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319112.174244:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435072
00000100:00100000:2.0:1767319112.174249:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435072
00000100:00100000:2.0:1767319112.174274:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16801
00000100:00100000:2.0:1767319112.174280:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940435072:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319112.174316:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319112.174355:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940435072:12345-0@lo:38:kworker.0 Request processed in 73us (193us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319112.174362:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16801
00000100:00080000:2.0:1767319112.174419:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319112.174425:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319112.174429:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940435072:0@lo:38:kworker.0
00000100:00080000:2.0:1767319112.174478:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319112.174499:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435200
00000100:00100000:2.0:1767319112.174502:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435200
00000100:00100000:2.0:1767319112.174524:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34
00000100:00100000:2.0:1767319112.174528:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940435200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319112.174539:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319112.174569:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940435200:12345-0@lo:38:kworker.0 Request processed in 39us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319112.174576:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34
00000100:00080000:2.0:1767319112.174600:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319112.174604:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319112.174607:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940435200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319112.175083:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940435456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319112.175115:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319112.175215:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435456
00000100:00100000:3.0:1767319112.175219:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435456
00000100:00100000:3.0:1767319112.175258:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800
00000100:00100000:3.0:1767319112.175268:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940435456:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319112.175318:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940435456:12345-0@lo:400:kworker.0 Request processed in 52us (201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319112.175324:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800
00000100:00100000:3.0:1767319112.175359:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940435456:0@lo:400:kworker.0
00000100:00080000:3.0:1767319112.175380:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319112.180095:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319112.180102:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319112.180105:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319112.180113:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4357
00000100:00080000:0.0:1767319112.180119:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319112.180125:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319112.180148:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2a00 x1853163940435712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319112.180171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319112.180175:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319112.180176:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319112.180180:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4357
00000100:00080000:0.0:1767319112.180182:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319112.180185:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319112.180192:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3800 x1853163940435968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319112.180236:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940435840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.180305:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.180356:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319112.180362:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940435584:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.180384:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.180445:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435840
00000100:00100000:0.0:1767319112.180453:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435840
00000100:00100000:0.0:1767319112.180503:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435584
00000100:00100000:0.0:1767319112.180506:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435584
00000100:00080000:3.0:1767319112.180564:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319112.182594:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4293
00000100:00100000:0.0:1767319112.182616:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940435840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.182686:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940435840:12345-0@lo:400:kworker.0 Request processed in 80us (2382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.182692:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4293
00000100:00100000:0.0:1767319112.182707:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4294
00000100:00100000:0.0:1767319112.182711:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940435584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.182727:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940435584:12345-0@lo:400:kworker.0 Request processed in 16us (2343us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.182730:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4294
00000100:00100000:3.0:1767319112.184765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940435712:0@lo:38:kworker.0
00000100:00100000:3.0:1767319112.184855:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319112.184891:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940435968:0@lo:38:kworker.0
00000100:00100000:3.0:1767319112.184913:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319112.184949:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435712
00000100:00100000:3.0:1767319112.184956:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435712
00000100:00100000:3.0:1767319112.184983:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940435968
00000100:00100000:3.0:1767319112.184986:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940435968
00000100:00100000:3.0:1767319112.184997:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16802
00000100:00100000:3.0:1767319112.185003:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940435712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319112.185023:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319112.185066:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940435712:12345-0@lo:38:kworker.0 Request processed in 61us (209us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319112.185073:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16802
00000100:00100000:3.0:1767319112.185101:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16803
00000100:00100000:3.0:1767319112.185104:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940435968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319112.185113:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319112.185134:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940435968:12345-0@lo:38:kworker.0 Request processed in 28us (220us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319112.185140:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16803
00000100:00080000:3.0:1767319112.185176:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319112.185181:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319112.185184:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940435712:0@lo:38:kworker.0
00000100:00080000:3.0:1767319112.185193:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319112.185196:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319112.185199:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940435968:0@lo:38:kworker.0
00000100:00100000:3.0:1767319112.185279:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940435584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319112.185289:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940435840:0@lo:400:kworker.0
00000100:00100000:2.0:1767319112.188492:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940435328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319112.193876:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940435328:12345-0@lo:400:kworker.0 Request processed in 19849us (19989us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319112.193893:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799
00000100:00100000:2.0:1767319112.684990:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940436096:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319112.685066:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319112.685219:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436096
00000100:00100000:1.0:1767319112.685228:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436096
00000100:00100000:1.0:1767319112.685287:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340
00000100:00100000:1.0:1767319112.685296:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940436096:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319112.685329:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319112.685533:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940436096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 238us (466us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319112.685541:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340
00000100:00100000:2.0:1767319112.685609:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940436096:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319112.812933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319113.134705:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319113.709145:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319113.709172:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940436224:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319113.709254:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319113.710218:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436224
00000100:00100000:0.0:1767319113.710227:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436224
00000100:00100000:0.0:1767319113.710285:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341
00000100:00100000:0.0:1767319113.710295:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940436224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319113.710325:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319113.710403:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940436224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319113.710411:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1767319113.710543:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940436224:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319113.836915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319114.157004:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319114.860881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319115.181093:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319115.884951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319116.205711:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319116.871064:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319116.871515:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319116.885591:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300544
00000100:00100000:0.0:1767319116.885610:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300544
00000100:00100000:0.0:1767319116.885768:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300416
00000100:00100000:0.0:1767319116.885787:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300416
00000100:00100000:0.0:1767319116.885817:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4295
00000100:00100000:0.0:1767319116.885829:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894300544:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319116.885917:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894300544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (14862us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319116.885925:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4295
00000100:00100000:0.0:1767319116.885946:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16804
00000100:00100000:0.0:1767319116.885951:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894300416:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319116.885972:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319116.886002:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894300416:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (14489us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319116.886009:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16804
00000100:00080000:2.0:1767319116.888185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319116.908905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319117.229070:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319117.293058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319117.293069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319117.293073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319117.293077:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319117.293082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319117.293090:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4362
00000100:00080000:0.0:1767319117.293095:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319117.293102:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319117.293146:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3100 x1853163940436352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319117.293171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319117.293174:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319117.293176:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319117.293179:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4362
00000100:00080000:0.0:1767319117.293182:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319117.293185:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319117.293197:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2d80 x1853163940436480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319117.293277:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319117.293281:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319117.293283:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319117.293286:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4362
00000100:00080000:0.0:1767319117.293288:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319117.293292:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319117.293303:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940436992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319117.293325:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319117.293328:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319117.293330:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319117.293333:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4362
00000100:00080000:0.0:1767319117.293336:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319117.293339:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319117.293365:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2a00 x1853163940437248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319117.293481:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940436736:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.293554:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319117.293611:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319117.293616:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940436608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.293635:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319117.293665:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436736
00000100:00100000:2.0:1767319117.293672:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436736
00000100:00100000:2.0:1767319117.293720:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436608
00000100:00100000:2.0:1767319117.293723:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436608
00000100:00100000:2.0:1767319117.293741:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801
00000100:00100000:2.0:1767319117.293748:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940436736:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.293931:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940436736:12345-0@lo:400:kworker.0 Request processed in 182us (375us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319117.293939:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801
00000100:00100000:2.0:1767319117.293955:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802
00000100:00100000:2.0:1767319117.293961:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940436608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.293987:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940436608:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319117.293992:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802
00000100:00100000:2.0:1767319117.294009:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940437120:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.294032:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319117.294048:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319117.294053:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940436864:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.294070:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319117.294089:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319117.294093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319117.294119:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940436608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.294128:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940436736:0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.294217:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437120
00000100:00100000:0.0:1767319117.294222:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437120
00000100:00100000:0.0:1767319117.294263:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436864
00000100:00100000:0.0:1767319117.294266:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436864
00000100:00100000:0.0:1767319117.294285:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4296
00000100:00100000:0.0:1767319117.294290:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940437120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.294326:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940437120:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.294333:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4296
00000100:00100000:0.0:1767319117.294345:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4297
00000100:00100000:0.0:1767319117.294362:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940436864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.294389:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940436864:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.294395:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4297
00000100:00080000:2.0:1767319117.294577:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319117.294599:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940436864:0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.294609:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940437120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319117.294992:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940436352:0@lo:38:kworker.0
00000100:00100000:3.0:1767319117.295025:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319117.295054:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940436480:0@lo:38:kworker.0
00000100:00100000:3.0:1767319117.295078:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319117.295099:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940436992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319117.295137:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319117.295153:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940437248:0@lo:38:kworker.0
00000100:00100000:3.0:1767319117.295174:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319117.295210:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436352
00000100:00100000:3.0:1767319117.295214:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436352
00000100:00100000:3.0:1767319117.295236:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436992
00000100:00100000:3.0:1767319117.295239:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436992
00000100:00100000:3.0:1767319117.295251:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437248
00000100:00100000:3.0:1767319117.295253:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437248
00000100:00100000:3.0:1767319117.295263:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16805
00000100:00100000:3.0:1767319117.295269:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940436352:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319117.295287:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319117.295321:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940436352:12345-0@lo:38:kworker.0 Request processed in 51us (295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319117.295327:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16805
00000100:00100000:3.0:1767319117.295341:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16806
00000100:00100000:3.0:1767319117.295345:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940436992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319117.295364:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319117.295386:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940436992:12345-0@lo:38:kworker.0 Request processed in 40us (263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319117.295392:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16806
00000100:00100000:3.0:1767319117.295403:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16807
00000100:00100000:3.0:1767319117.295406:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940437248:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319117.295415:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319117.295436:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940437248:12345-0@lo:38:kworker.0 Request processed in 28us (260us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319117.295449:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16807
00000100:00100000:2.0:1767319117.295472:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940436480
00000100:00100000:2.0:1767319117.295476:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940436480
00000100:00080000:3.0:1767319117.295483:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.295487:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.295491:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940436352:0@lo:38:kworker.0
00000100:00100000:2.0:1767319117.295495:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35
00000100:00080000:3.0:1767319117.295499:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319117.295500:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940436480:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767319117.295502:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.295505:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940436992:0@lo:38:kworker.0
00010000:00020000:2.0:1767319117.295510:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319117.295511:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.295513:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.295516:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940437248:0@lo:38:kworker.0
00000100:00080000:3.0:1767319117.295534:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319117.295536:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940436480:12345-0@lo:38:kworker.0 Request processed in 35us (457us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319117.295537:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.295540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940436480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319117.295542:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35
00000100:00100000:0.0:1767319117.806702:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319117.806724:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940437376:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319117.806823:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319117.806897:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437376
00000100:00100000:0.0:1767319117.806906:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437376
00000100:00100000:0.0:1767319117.806960:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342
00000100:00100000:0.0:1767319117.806969:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940437376:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319117.807144:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319117.807191:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940437376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 224us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.807199:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342
00000100:00100000:0.0:1767319117.807262:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940437376:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319117.935687:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319118.253000:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319118.829100:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319118.829134:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940437504:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319118.829213:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319118.829535:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437504
00000100:00100000:3.0:1767319118.829543:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437504
00000100:00100000:3.0:1767319118.829604:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343
00000100:00100000:3.0:1767319118.829615:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940437504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319118.829645:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319118.829702:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940437504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (488us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319118.829710:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343
00000100:00100000:1.0:1767319118.829890:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940437504:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319118.957156:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319119.277221:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319119.980928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319120.301318:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319121.005423:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319121.325081:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319121.990554:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319121.990834:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300800
00000100:00100000:2.0:1767319121.990855:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300800
00000100:00100000:2.0:1767319121.990934:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4298
00000100:00100000:2.0:1767319121.990944:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894300800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319121.991022:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894300800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319121.991031:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4298
00000100:00080000:3.0:1767319121.991512:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319122.000492:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319122.000675:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894300672
00000100:00100000:1.0:1767319122.000685:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894300672
00000100:00100000:1.0:1767319122.000737:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16808
00000100:00100000:1.0:1767319122.000745:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894300672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319122.000802:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319122.000877:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894300672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 131us (398us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319122.000885:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16808
00000100:00100000:2.0:1767319122.031100:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319122.349039:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319122.413212:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319122.413222:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319122.413225:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319122.413229:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319122.413232:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319122.413248:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4367
00000100:00080000:2.0:1767319122.413253:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319122.413267:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319122.413325:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ca80 x1853163940437632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319122.413351:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319122.413355:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319122.413357:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319122.413361:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4367
00000100:00080000:2.0:1767319122.413363:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319122.413367:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319122.413382:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7fb80 x1853163940437760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319122.413461:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940438016:0@lo:400:kworker.0
00000100:00080000:2.0:1767319122.413462:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319122.413470:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319122.413472:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319122.413476:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4367
00000100:00080000:2.0:1767319122.413479:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319122.413482:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319122.413494:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940438272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319122.413514:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319122.413517:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319122.413519:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319122.413523:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4367
00000100:00080000:2.0:1767319122.413525:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319122.413529:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319122.413541:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319122.413544:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2d80 x1853163940438528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319122.413573:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940438400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.413608:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319122.413615:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319122.413631:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940437888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319122.413643:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319122.413652:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940438144:0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.413660:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319122.413686:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319122.413712:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438400
00000100:00100000:3.0:1767319122.413721:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438400
00000100:00100000:3.0:1767319122.413805:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4299
00000100:00100000:3.0:1767319122.413817:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940438400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.413870:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940438400:12345-0@lo:400:kworker.0 Request processed in 57us (258us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319122.413877:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4299
00000100:00100000:3.0:1767319122.413893:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438144
00000100:00100000:3.0:1767319122.413897:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438144
00000100:00100000:3.0:1767319122.413922:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4300
00000100:00100000:3.0:1767319122.413927:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940438144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.413956:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940438144:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319122.413961:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4300
00000100:00100000:1.0:1767319122.414133:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438016
00000100:00100000:1.0:1767319122.414139:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438016
00000100:00100000:1.0:1767319122.414171:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437888
00000100:00100000:1.0:1767319122.414174:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437888
00000100:00100000:1.0:1767319122.414195:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803
00000100:00100000:1.0:1767319122.414202:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940438016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.414258:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940438016:12345-0@lo:400:kworker.0 Request processed in 55us (717us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319122.414265:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803
00000100:00100000:3.0:1767319122.414277:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940438144:0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.414285:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804
00000100:00100000:1.0:1767319122.414293:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940437888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.414296:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940438400:0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.414340:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940437888:12345-0@lo:400:kworker.0 Request processed in 48us (679us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319122.414347:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804
00000100:00100000:1.0:1767319122.414396:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940437888:0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.414406:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940438016:0@lo:400:kworker.0
00000100:00100000:0.0:1767319122.414540:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940437632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.414570:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.414599:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940437760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.414619:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.414648:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940438272:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.414668:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.414683:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940438528:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.414702:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.414733:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437632
00000100:00100000:0.0:1767319122.414738:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437632
00000100:00100000:0.0:1767319122.414758:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438272
00000100:00100000:0.0:1767319122.414760:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438272
00000100:00100000:0.0:1767319122.414793:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438528
00000100:00100000:0.0:1767319122.414796:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438528
00000100:00100000:0.0:1767319122.414814:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16809
00000100:00100000:0.0:1767319122.414818:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940437632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319122.414852:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319122.414885:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940437632:12345-0@lo:38:kworker.0 Request processed in 65us (313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319122.414891:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16809
00000100:00100000:0.0:1767319122.414904:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16810
00000100:00100000:0.0:1767319122.414908:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940438272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319122.414916:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319122.414940:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940438272:12345-0@lo:38:kworker.0 Request processed in 31us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319122.414945:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16810
00000100:00100000:0.0:1767319122.414955:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16811
00000100:00100000:0.0:1767319122.414958:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940438528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319122.414966:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319122.414985:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940438528:12345-0@lo:38:kworker.0 Request processed in 26us (283us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319122.414990:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16811
00000100:00080000:0.0:1767319122.415024:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319122.415029:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319122.415032:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940437632:0@lo:38:kworker.0
00000100:00080000:0.0:1767319122.415039:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319122.415042:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319122.415044:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940438272:0@lo:38:kworker.0
00000100:00080000:0.0:1767319122.415051:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319122.415054:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319122.415057:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940438528:0@lo:38:kworker.0
00000100:00080000:2.0:1767319122.415209:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319122.415214:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319122.415217:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319122.415274:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940437760
00000100:00100000:1.0:1767319122.415279:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940437760
00000100:00100000:1.0:1767319122.415320:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36
00000100:00100000:1.0:1767319122.415325:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940437760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319122.415335:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319122.415376:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940437760:12345-0@lo:38:kworker.0 Request processed in 49us (755us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319122.415381:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36
00000100:00080000:0.0:1767319122.415736:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319122.415741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319122.415744:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940437760:0@lo:38:kworker.0
00000100:00100000:3.0:1767319122.925082:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940438656:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319122.925158:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.925364:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438656
00000100:00100000:0.0:1767319122.925374:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438656
00000100:00100000:0.0:1767319122.925439:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344
00000100:00100000:0.0:1767319122.925450:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940438656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319122.925479:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319122.925537:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940438656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319122.925544:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1767319122.925645:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940438656:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319123.052903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319123.373278:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319123.949342:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940438784:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319123.949420:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319123.949545:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438784
00000100:00100000:3.0:1767319123.949553:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438784
00000100:00100000:3.0:1767319123.951628:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345
00000100:00100000:3.0:1767319123.951653:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940438784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319123.951689:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319123.951767:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940438784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (2347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319123.951789:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345
00000100:00100000:1.0:1767319123.952071:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940438784:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319124.077045:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319124.398721:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319125.101105:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319125.422145:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767319126.086539:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894300928 offset 0 length 520: 4
00000100:00100000:0.0:1767319126.086584:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319126.086665:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319126.086757:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301056
00000100:00100000:3.0:1767319126.086768:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301056
00000100:00100000:3.0:1767319126.086841:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301184
00000100:00100000:3.0:1767319126.086845:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301184
00000100:00100000:3.0:1767319126.086891:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4301
00000100:00100000:3.0:1767319126.086903:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894301184:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319126.086970:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16812
00000100:00100000:3.0:1767319126.086977:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894301184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (309us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319126.086985:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894301056:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:3.0:1767319126.086992:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4301
00010000:00020000:2.0:1767319126.087010:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319126.087018:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319126.087045:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894301056:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 62us (459us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319126.087053:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16812
00000100:00100000:2.0:1767319126.125101:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319126.446078:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319127.148909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319127.471070:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319127.533229:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319127.533240:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319127.533243:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319127.533246:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319127.533251:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319127.533267:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4372
00000100:00080000:3.0:1767319127.533272:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319127.533279:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319127.533321:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b480 x1853163940438912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319127.533391:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940438912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319127.533468:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319127.533608:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319127.533613:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319127.533615:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319127.533618:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4372
00000100:00080000:3.0:1767319127.533621:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319127.533625:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319127.533654:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b800 x1853163940439040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319127.533766:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940438912
00000100:00100000:2.0:1767319127.533797:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940438912
00000100:00100000:2.0:1767319127.533844:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16813
00000100:00100000:2.0:1767319127.533851:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940438912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319127.533872:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319127.536678:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940439040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319127.536761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319127.536908:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439040
00000100:00100000:1.0:1767319127.536916:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439040
00000100:00100000:1.0:1767319127.536954:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37
00000100:00100000:1.0:1767319127.536962:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940439040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319127.536986:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319127.537033:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940439040:12345-0@lo:38:kworker.0 Request processed in 70us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319127.537040:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37
00000100:00080000:3.0:1767319127.547653:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319127.547661:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319127.547666:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319127.547674:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4372
00000100:00080000:3.0:1767319127.547679:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319127.547687:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319127.547707:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead180 x1853163940439552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319127.547727:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319127.547730:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319127.547731:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319127.547735:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4372
00000100:00080000:3.0:1767319127.547737:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319127.547740:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319127.547752:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5f80 x1853163940439808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319127.547810:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.547883:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319127.547946:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319127.547953:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439168:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.547977:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319127.548003:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940439424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548029:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319127.548048:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319127.548053:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940439680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548075:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319127.548109:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439296
00000100:00100000:3.0:1767319127.548117:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439296
00000100:00100000:3.0:1767319127.548190:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439168
00000100:00100000:3.0:1767319127.548193:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439168
00000100:00100000:3.0:1767319127.548219:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805
00000100:00100000:3.0:1767319127.548230:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548292:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439296:12345-0@lo:400:kworker.0 Request processed in 65us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319127.548300:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805
00000100:00100000:3.0:1767319127.548318:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806
00000100:00100000:3.0:1767319127.548324:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548350:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439168:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319127.548355:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806
00000100:00100000:3.0:1767319127.548377:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439424
00000100:00100000:3.0:1767319127.548381:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439424
00000100:00100000:3.0:1767319127.548405:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439680
00000100:00100000:3.0:1767319127.548408:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439680
00000100:00100000:3.0:1767319127.548434:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4302
00000100:00100000:3.0:1767319127.548440:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940439424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548472:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940439424:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319127.548478:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4302
00000100:00100000:3.0:1767319127.548490:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4303
00000100:00100000:3.0:1767319127.548495:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940439680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548518:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940439680:12345-0@lo:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319127.548523:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4303
00000100:00080000:3.0:1767319127.548548:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319127.548553:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319127.548555:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319127.548582:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940439680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548593:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940439424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548618:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439168:0@lo:400:kworker.0
00000100:00100000:3.0:1767319127.548627:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319127.553031:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940438912:12345-0@lo:38:kworker.0 Request processed in 19168us (19550us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319127.553047:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16813
00000100:00080000:0.0:1767319127.557094:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319127.557108:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319127.557113:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940438912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319127.557337:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940439552:0@lo:38:kworker.0
00000100:00100000:0.0:1767319127.557413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319127.557528:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940439808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319127.557553:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319127.570929:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319127.570945:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319127.570950:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940439040:0@lo:38:kworker.0
00000100:00100000:2.0:1767319127.583558:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439552
00000100:00100000:2.0:1767319127.583574:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439552
00000100:00100000:2.0:1767319127.583650:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439808
00000100:00100000:2.0:1767319127.583654:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439808
00000100:00100000:2.0:1767319127.583681:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16814
00000100:00100000:2.0:1767319127.583689:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940439552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319127.583712:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319127.583904:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16815
00000100:00100000:1.0:1767319127.583910:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940439808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319127.583921:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319127.583988:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940439552:12345-0@lo:38:kworker.0 Request processed in 297us (26573us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319127.583996:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16814
00000100:00100000:1.0:1767319127.585748:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940439808:12345-0@lo:38:kworker.0 Request processed in 1725us (28081us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319127.585761:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16815
00000100:00080000:2.0:1767319127.588471:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319127.588485:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319127.592505:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940439552:0@lo:38:kworker.0
00000100:00080000:2.0:1767319127.592551:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319127.592556:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319127.592559:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940439808:0@lo:38:kworker.0
00000100:00100000:3.0:1767319128.045489:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319128.048549:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439936:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319128.048635:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319128.049031:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940439936
00000100:00100000:0.0:1767319128.049042:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940439936
00000100:00100000:0.0:1767319128.049098:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346
00000100:00100000:0.0:1767319128.049107:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439936:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319128.049161:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319128.049524:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940439936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 417us (887us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319128.049532:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346
00000100:00100000:1.0:1767319128.053127:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940439936:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319128.172974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319128.494093:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319129.069363:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940440064:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319129.069448:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319129.070466:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440064
00000100:00100000:3.0:1767319129.070478:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440064
00000100:00100000:3.0:1767319129.070558:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347
00000100:00100000:3.0:1767319129.070566:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940440064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319129.070595:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319129.070664:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940440064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1216us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319129.070671:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347
00000100:00100000:2.0:1767319129.071302:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940440064:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319129.072435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319129.197328:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319129.516986:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319130.220920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319130.544702:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319131.208424:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319131.208642:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301440
00000100:00100000:1.0:1767319131.208654:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301440
00000100:00100000:1.0:1767319131.208742:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4304
00000100:00100000:1.0:1767319131.208752:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894301440:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319131.208882:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894301440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 131us (466us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319131.208890:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4304
00000100:00080000:0.0:1767319131.209099:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319131.209944:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319131.210021:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301312
00000100:00100000:0.0:1767319131.210028:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301312
00000100:00100000:0.0:1767319131.210064:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16816
00000100:00100000:0.0:1767319131.210070:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301312:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319131.210101:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319131.210150:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301312:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 79us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319131.210157:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16816
00000100:00100000:2.0:1767319131.244902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319131.565016:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319132.268988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319132.589142:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319132.653414:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319132.653424:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319132.653427:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319132.653431:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319132.653435:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319132.653452:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4377
00000100:00080000:2.0:1767319132.653457:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319132.653464:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319132.653505:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2300 x1853163940440192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319132.653540:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319132.653544:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319132.653546:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319132.653550:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4377
00000100:00080000:2.0:1767319132.653552:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319132.653556:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319132.653570:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0380 x1853163940440320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319132.653640:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319132.653644:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319132.653645:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319132.653649:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4377
00000100:00080000:2.0:1767319132.653651:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319132.653655:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319132.653673:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940440832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319132.653688:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319132.653691:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319132.653693:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319132.653696:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4377
00000100:00080000:2.0:1767319132.653698:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319132.653701:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319132.653710:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940441088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319132.653740:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940440960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319132.653834:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319132.653894:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319132.653900:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940440704:0@lo:400:kworker.0
00000100:00100000:2.0:1767319132.653921:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319132.653999:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940440576:0@lo:400:kworker.0
00000100:00100000:1.0:1767319132.654031:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319132.654063:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319132.654068:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940440448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319132.654087:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319132.654115:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440960
00000100:00100000:1.0:1767319132.654122:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440960
00000100:00100000:1.0:1767319132.654164:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440704
00000100:00100000:1.0:1767319132.654168:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440704
00000100:00100000:1.0:1767319132.654193:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4305
00000100:00100000:1.0:1767319132.654200:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940440960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319132.654280:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940440960:12345-0@lo:400:kworker.0 Request processed in 79us (445us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319132.654287:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4305
00000100:00100000:1.0:1767319132.654315:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4306
00000100:00100000:1.0:1767319132.654323:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940440704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319132.654350:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940440704:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319132.654355:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4306
00000100:00100000:1.0:1767319132.654393:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940440704:0@lo:400:kworker.0
00000100:00100000:1.0:1767319132.654402:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940440960:0@lo:400:kworker.0
00000100:00080000:0.0:1767319132.654745:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319132.654759:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940440192:0@lo:38:kworker.0
00000100:00100000:0.0:1767319132.654812:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319132.654838:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940440320:0@lo:38:kworker.0
00000100:00100000:0.0:1767319132.654862:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319132.654881:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940440832:0@lo:38:kworker.0
00000100:00100000:0.0:1767319132.654901:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319132.654917:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940441088:0@lo:38:kworker.0
00000100:00100000:0.0:1767319132.654937:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319132.654967:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440320
00000100:00100000:0.0:1767319132.654972:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440320
00000100:00100000:0.0:1767319132.654994:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38
00000100:00100000:0.0:1767319132.654999:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940440320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319132.655017:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319132.655050:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940440320:12345-0@lo:38:kworker.0 Request processed in 50us (187us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319132.655056:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38
00000100:00100000:0.0:1767319132.655077:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440192
00000100:00100000:0.0:1767319132.655081:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440192
00000100:00100000:0.0:1767319132.655096:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440832
00000100:00100000:0.0:1767319132.655099:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440832
00000100:00100000:0.0:1767319132.655111:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441088
00000100:00100000:0.0:1767319132.655113:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441088
00000100:00100000:0.0:1767319132.655123:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16817
00000100:00100000:0.0:1767319132.655128:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940440192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319132.655138:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319132.655162:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940440192:12345-0@lo:38:kworker.0 Request processed in 33us (351us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319132.655168:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16817
00000100:00100000:0.0:1767319132.655180:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16818
00000100:00100000:0.0:1767319132.655183:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940440832:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319132.655192:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319132.655226:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940440832:12345-0@lo:38:kworker.0 Request processed in 41us (323us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319132.655232:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16818
00000100:00100000:0.0:1767319132.655242:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16819
00000100:00100000:0.0:1767319132.655246:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940441088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319132.655255:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319132.655276:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940441088:12345-0@lo:38:kworker.0 Request processed in 28us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319132.655281:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16819
00000100:00080000:0.0:1767319132.655483:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319132.655489:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319132.655492:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940440192:0@lo:38:kworker.0
00000100:00080000:0.0:1767319132.655500:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319132.655504:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319132.655507:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940440320:0@lo:38:kworker.0
00000100:00080000:0.0:1767319132.655514:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319132.655517:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319132.655519:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940440832:0@lo:38:kworker.0
00000100:00080000:0.0:1767319132.655526:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319132.655529:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319132.655532:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940441088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319132.655621:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440576
00000100:00100000:2.0:1767319132.655626:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440576
00000100:00100000:2.0:1767319132.655667:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940440448
00000100:00100000:2.0:1767319132.655672:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940440448
00000100:00100000:2.0:1767319132.655690:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807
00000100:00100000:2.0:1767319132.655696:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940440576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319132.655739:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940440576:12345-0@lo:400:kworker.0 Request processed in 43us (1707us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319132.655745:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807
00000100:00100000:2.0:1767319132.655756:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808
00000100:00100000:2.0:1767319132.655762:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940440448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319132.655810:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940440448:12345-0@lo:400:kworker.0 Request processed in 48us (1722us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319132.655816:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808
00000100:00100000:2.0:1767319132.655848:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940440448:0@lo:400:kworker.0
00000100:00100000:2.0:1767319132.655858:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940440576:0@lo:400:kworker.0
00000100:00080000:0.0:1767319132.656148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319132.656152:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319133.165332:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319133.165355:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940441216:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319133.165423:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.165658:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441216
00000100:00100000:1.0:1767319133.165668:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441216
00000100:00100000:1.0:1767319133.165728:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348
00000100:00100000:1.0:1767319133.165739:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940441216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319133.165771:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319133.165850:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940441216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (427us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319133.165856:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348
00000100:00100000:2.0:1767319133.166394:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940441216:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319133.293914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319133.616150:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319133.677079:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319107/real 1767319107]  req@ffff93d071210700 x1853163940433664/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319133.677125:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d071210700 x1853163940433664/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319133.677145:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319133.677235:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319133.677239:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940433664:0@lo:250:kworker.0
00000100:00080000:2.0:1767319133.678406:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.678413:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319133.678418:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.678423:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4357
00000100:00080000:2.0:1767319133.678428:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.678433:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319133.678675:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170700 x1853163940441344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319133.679345:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940441344:0@lo:250:kworker.0
00000400:00000100:0.0:1767319133.679401:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940441344 offset 0 length 520: 4
00000100:00080000:2.0:1767319133.679485:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.679489:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.679491:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.679495:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4382
00000100:00080000:2.0:1767319133.679498:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.679502:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319133.679522:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171f80 x1853163940441472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319133.679562:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940441472:0@lo:38:kworker.0
00000100:00100000:0.0:1767319133.679593:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319133.679706:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.679711:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.679713:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.679717:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4382
00000100:00080000:2.0:1767319133.679720:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.679724:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319133.679750:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940441600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319133.679829:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.679833:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.679834:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.679838:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4382
00000100:00080000:2.0:1767319133.679841:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.679844:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319133.679856:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ed80 x1853163940441984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319133.679871:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.679873:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.679875:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.679878:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4382
00000100:00080000:2.0:1767319133.679880:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.679883:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319133.679891:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940442240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319133.679916:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940441856:0@lo:400:kworker.0
00000100:00100000:0.0:1767319133.680125:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940441600:0@lo:38:kworker.0
00000100:00100000:0.0:1767319133.680154:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319133.680186:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940441984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319133.680230:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441600
00000100:00100000:0.0:1767319133.680242:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441600
00000100:00100000:0.0:1767319133.680277:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39
00000100:00100000:0.0:1767319133.680284:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940441600:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319133.680305:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319133.680346:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940441600:12345-0@lo:38:kworker.0 Request processed in 61us (191us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319133.680354:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39
00000100:00100000:3.0:1767319133.682580:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940441728:0@lo:400:kworker.0
00000100:00100000:3.0:1767319133.682665:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319133.682806:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940442112:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.683218:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319133.683275:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441728
00000100:00100000:0.0:1767319133.683284:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441728
00000100:00100000:0.0:1767319133.683348:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809
00000100:00100000:0.0:1767319133.683357:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940441728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319133.683426:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940441728:12345-0@lo:400:kworker.0 Request processed in 69us (761us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319133.683432:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809
00000100:00100000:0.0:1767319133.683475:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940441728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319133.684855:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.685068:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441472
00000100:00100000:1.0:1767319133.685075:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441472
00000100:00100000:1.0:1767319133.685114:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441856
00000100:00100000:1.0:1767319133.685118:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441856
00000100:00100000:1.0:1767319133.685150:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4307
00000100:00100000:1.0:1767319133.685159:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940441856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319133.685249:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940441856:12345-0@lo:400:kworker.0 Request processed in 90us (2030us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319133.685256:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4307
00000100:00100000:1.0:1767319133.685274:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16820
00000100:00100000:1.0:1767319133.685279:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940441472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319133.685302:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319133.685327:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940441472:12345-0@lo:38:kworker.0 Request processed in 47us (5733us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319133.685332:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16820
00000100:00100000:2.0:1767319133.685499:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940441856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319133.685658:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.685724:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940442240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.685769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319133.685851:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442112
00000100:00100000:3.0:1767319133.685856:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442112
00000100:00100000:3.0:1767319133.685887:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940441984
00000100:00100000:3.0:1767319133.685890:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940441984
00000100:00100000:3.0:1767319133.685907:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4308
00000100:00100000:3.0:1767319133.685913:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940442112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319133.685965:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940442112:12345-0@lo:400:kworker.0 Request processed in 52us (1115us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319133.685971:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4308
00000100:00100000:3.0:1767319133.685987:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16821
00000100:00100000:3.0:1767319133.685991:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940441984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319133.686002:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319133.686025:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940441984:12345-0@lo:38:kworker.0 Request processed in 33us (367us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319133.686031:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16821
00000100:00080000:1.0:1767319133.686383:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.686390:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.686394:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940441472:0@lo:38:kworker.0
00000100:00080000:1.0:1767319133.686422:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.686426:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.686429:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940441600:0@lo:38:kworker.0
00000100:00080000:1.0:1767319133.686436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.686440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.686442:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940441984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319133.686481:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442240
00000100:00100000:0.0:1767319133.686485:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442240
00000100:00100000:2.0:1767319133.686520:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16822
00000100:00100000:2.0:1767319133.686525:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940442240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319133.686538:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319133.686582:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940442240:12345-0@lo:38:kworker.0 Request processed in 55us (812us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319133.686589:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16822
00000100:00080000:3.0:1767319133.686669:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319133.686674:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319133.686677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940442240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.686895:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940442112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319134.192100:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940442368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319134.192184:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319134.192556:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442368
00000100:00100000:1.0:1767319134.192564:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442368
00000100:00100000:1.0:1767319134.192639:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349
00000100:00100000:1.0:1767319134.192648:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940442368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319134.192677:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319134.192744:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319134.193458:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940442368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 809us (1282us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319134.193469:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349
00000100:00100000:0.0:1767319134.195116:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940442368:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319134.316900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319134.637119:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319135.340906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319135.663232:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319136.327492:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319136.327813:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301696
00000100:00100000:0.0:1767319136.327825:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301696
00000100:00100000:0.0:1767319136.327949:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4309
00000100:00100000:0.0:1767319136.327960:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894301696:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319136.328051:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894301696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (568us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319136.328058:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4309
00000100:00080000:3.0:1767319136.337159:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319136.337340:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319136.337960:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301568
00000100:00100000:1.0:1767319136.337970:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301568
00000100:00100000:1.0:1767319136.338021:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16823
00000100:00100000:1.0:1767319136.338029:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301568:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319136.338054:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319136.338125:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301568:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (792us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319136.338285:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16823
00000100:00100000:2.0:1767319136.365598:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319136.685305:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319137.391400:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319137.711804:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319138.287362:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319138.287387:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940442496:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319138.287468:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.287967:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442496
00000100:00100000:1.0:1767319138.287977:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442496
00000100:00100000:1.0:1767319138.288054:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350
00000100:00100000:1.0:1767319138.288064:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940442496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319138.288097:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319138.288148:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940442496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (683us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319138.288155:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350
00000100:00100000:3.0:1767319138.288305:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940442496:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319138.288330:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319138.416113:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319138.733490:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319138.796991:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319138.797003:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319138.797005:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319138.797009:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319138.797013:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319138.797021:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4383
00000100:00080000:2.0:1767319138.797026:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319138.797033:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319138.797089:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ea00 x1853163940442624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319138.797114:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319138.797117:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319138.797119:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319138.797123:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4383
00000100:00080000:2.0:1767319138.797126:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319138.797129:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319138.797142:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940442752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319138.797229:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940442880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319138.797261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940442624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319138.797298:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319138.797298:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319138.797337:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319138.797340:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319138.797342:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319138.797346:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4383
00000100:00080000:2.0:1767319138.797349:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319138.797353:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319138.797365:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ca80 x1853163940443136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319138.797389:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319138.797392:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319138.797394:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319138.797397:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4383
00000100:00080000:2.0:1767319138.797399:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319138.797402:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319138.797413:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ed80 x1853163940443392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319138.797431:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319138.797440:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940443264:0@lo:400:kworker.0
00000100:00100000:3.0:1767319138.799381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940442752:0@lo:38:kworker.0
00000100:00100000:3.0:1767319138.799436:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319138.799475:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940443136:0@lo:38:kworker.0
00000100:00100000:3.0:1767319138.799502:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319138.799524:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940443392:0@lo:38:kworker.0
00000100:00100000:3.0:1767319138.799560:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319138.799600:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442624
00000100:00100000:3.0:1767319138.799609:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442624
00000100:00100000:3.0:1767319138.799640:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443136
00000100:00100000:3.0:1767319138.799644:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443136
00000100:00100000:3.0:1767319138.799658:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443392
00000100:00100000:3.0:1767319138.799661:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443392
00000100:00100000:1.0:1767319138.800289:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940443008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.800327:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.800372:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442752
00000100:00100000:1.0:1767319138.800376:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442752
00000100:00100000:1.0:1767319138.800402:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40
00000100:00100000:1.0:1767319138.800410:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940442752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.800431:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.800474:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940442752:12345-0@lo:38:kworker.0 Request processed in 64us (1038us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.800482:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40
00000100:00100000:1.0:1767319138.800523:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443008
00000100:00100000:1.0:1767319138.800527:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443008
00000100:00100000:3.0:1767319138.800593:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16824
00000100:00100000:3.0:1767319138.800600:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940442624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319138.800612:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.800637:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4310
00000100:00100000:3.0:1767319138.800645:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940442624:12345-0@lo:38:kworker.0 Request processed in 44us (3346us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.800858:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940443008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.800907:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940443008:12345-0@lo:400:kworker.0 Request processed in 53us (579us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319138.801025:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940442880
00000100:00100000:0.0:1767319138.801031:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940442880
00000100:00100000:0.0:1767319138.801061:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810
00000100:00100000:0.0:1767319138.801068:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940442880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319138.801118:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940442880:12345-0@lo:400:kworker.0 Request processed in 51us (3819us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319138.801125:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810
00000100:00100000:2.0:1767319138.804024:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319138.804265:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443264
00000100:00100000:2.0:1767319138.804274:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443264
00000100:00100000:3.0:1767319138.804642:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16824
00000100:00100000:1.0:1767319138.804898:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4310
00000100:00100000:1.0:1767319138.804923:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16825
00000100:00100000:1.0:1767319138.804932:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940443136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.805042:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.805094:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940443136:12345-0@lo:38:kworker.0 Request processed in 163us (5590us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.805180:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16825
00000100:00100000:1.0:1767319138.805195:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16826
00000100:00100000:1.0:1767319138.805200:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940443392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.805210:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.805237:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940443392:12345-0@lo:38:kworker.0 Request processed in 35us (5676us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.805315:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16826
00000100:00100000:1.0:1767319138.805364:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940443008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.805510:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940442880:0@lo:400:kworker.0
00000100:00080000:1.0:1767319138.805565:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.805571:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.805575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940443136:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.805582:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.805586:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.805589:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940443392:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.805599:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.805601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.805605:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940442624:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.805614:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.805617:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.805620:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940442752:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.805725:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319138.805731:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319138.806216:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4311
00000100:00100000:3.0:1767319138.806232:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940443264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319138.806286:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940443264:12345-0@lo:400:kworker.0 Request processed in 63us (2271us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319138.806292:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4311
00000100:00100000:0.0:1767319138.806479:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940443264:0@lo:400:kworker.0
00000100:00100000:3.0:1767319139.309105:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319139.309132:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940443520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319139.309231:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319139.309264:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443520
00000100:00100000:1.0:1767319139.309274:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443520
00000100:00100000:1.0:1767319139.309326:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767319139.309337:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940443520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319139.309369:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319139.309430:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940443520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (199us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319139.309437:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351
00000100:00100000:3.0:1767319139.309609:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940443520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319139.437060:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319139.757093:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319140.460921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319140.781525:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319141.452347:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319141.452540:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301952
00000100:00100000:3.0:1767319141.452550:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301952
00000100:00100000:3.0:1767319141.452639:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4312
00000100:00100000:3.0:1767319141.452652:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894301952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767319141.452852:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319141.453439:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894301952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 788us (1099us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319141.453450:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4312
00000100:00100000:0.0:1767319141.454217:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319141.454354:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894301824
00000100:00100000:3.0:1767319141.454361:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894301824
00000100:00100000:3.0:1767319141.454397:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16827
00000100:00100000:3.0:1767319141.454403:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319141.454424:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319141.454475:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894301824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 69us (259us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319141.454482:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16827
00000100:00100000:2.0:1767319141.484938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319141.807678:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319142.509065:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319142.828994:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319143.405038:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940443648:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319143.405109:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319143.405463:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443648
00000100:00100000:0.0:1767319143.405472:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443648
00000100:00100000:0.0:1767319143.405580:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352
00000100:00100000:0.0:1767319143.405590:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940443648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319143.405620:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319143.405678:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940443648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (566us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319143.405685:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352
00000100:00100000:2.0:1767319143.405821:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940443648:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319143.405880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319143.532904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319143.853335:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319143.917440:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319143.917451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319143.917454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319143.917458:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319143.917462:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319143.917471:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4388
00000100:00080000:2.0:1767319143.917475:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319143.917482:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319143.917520:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47979180 x1853163940443776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319143.917548:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319143.917553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319143.917554:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319143.917558:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4388
00000100:00080000:2.0:1767319143.917560:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319143.917563:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319143.917574:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978a80 x1853163940443904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319143.917627:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319143.917631:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319143.917633:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319143.917636:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4388
00000100:00080000:2.0:1767319143.917638:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319143.917642:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319143.917653:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940444288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319143.917666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319143.917669:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319143.917670:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319143.917673:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4388
00000100:00080000:2.0:1767319143.917675:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319143.917678:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319143.917685:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195500 x1853163940444544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319143.917761:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940444416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.917856:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319143.917931:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319143.917938:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940444160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.917960:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319143.918004:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444416
00000100:00100000:0.0:1767319143.918012:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444416
00000100:00100000:0.0:1767319143.918060:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444160
00000100:00100000:0.0:1767319143.918063:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444160
00000100:00100000:0.0:1767319143.918097:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4313
00000100:00100000:0.0:1767319143.918104:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940444416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918161:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940444416:12345-0@lo:400:kworker.0 Request processed in 57us (304us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319143.918168:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4313
00000100:00100000:0.0:1767319143.918184:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4314
00000100:00100000:0.0:1767319143.918201:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940444160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918229:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940444160:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319143.918235:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4314
00000100:00100000:0.0:1767319143.918274:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940444160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918285:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940444416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918304:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319143.918310:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918335:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319143.918378:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444032
00000100:00100000:0.0:1767319143.918381:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444032
00000100:00100000:0.0:1767319143.918406:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811
00000100:00100000:0.0:1767319143.918412:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319143.918443:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444032:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319143.918447:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811
00000100:00100000:0.0:1767319143.918466:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319143.919484:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940443776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319143.919537:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319143.919567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940443904:0@lo:38:kworker.0
00000100:00100000:2.0:1767319143.919574:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443776
00000100:00100000:2.0:1767319143.919579:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443776
00000100:00100000:3.0:1767319143.919591:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319143.919608:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940444288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319143.919612:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16828
00000100:00100000:2.0:1767319143.919618:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940443776:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319143.919629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767319143.919635:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319143.919645:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940444544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319143.919661:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319143.919665:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940443776:12345-0@lo:38:kworker.0 Request processed in 48us (129us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319143.919672:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16828
00000100:00100000:2.0:1767319143.919681:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444288
00000100:00100000:2.0:1767319143.919683:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444288
00000100:00080000:3.0:1767319143.919686:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319143.919690:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319143.919694:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444544
00000100:00100000:3.0:1767319143.919694:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940443776:0@lo:38:kworker.0
00000100:00100000:2.0:1767319143.919696:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444544
00000100:00100000:2.0:1767319143.919704:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16829
00000100:00100000:2.0:1767319143.919708:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940444288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319143.919717:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319143.919717:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16830
00000100:00100000:3.0:1767319143.919721:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940444544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319143.919730:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319143.919874:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319143.919880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319143.919909:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940443904
00000100:00100000:1.0:1767319143.919913:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940443904
00000100:00100000:1.0:1767319143.919935:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41
00000100:00100000:1.0:1767319143.919940:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940443904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319143.919950:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319143.920186:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940444288:12345-0@lo:38:kworker.0 Request processed in 476us (555us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319143.920276:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16829
00000100:00100000:3.0:1767319143.920430:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940444544:12345-0@lo:38:kworker.0 Request processed in 706us (766us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319143.920436:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16830
00000100:00100000:1.0:1767319143.920486:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940443904:12345-0@lo:38:kworker.0 Request processed in 544us (893us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319143.920492:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41
00000100:00080000:0.0:1767319143.921600:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319143.921608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319143.921612:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940444288:0@lo:38:kworker.0
00000100:00080000:0.0:1767319143.921631:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319143.921634:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319143.921636:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940444544:0@lo:38:kworker.0
00000100:00080000:0.0:1767319143.921660:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319143.921663:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319143.921667:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940443904:0@lo:38:kworker.0
00000100:00100000:0.0:1767319144.431904:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444672:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319144.431992:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319144.434242:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444672
00000100:00100000:3.0:1767319144.434255:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444672
00000100:00100000:3.0:1767319144.434328:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353
00000100:00100000:3.0:1767319144.434338:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319144.434371:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319144.434447:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (2455us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319144.434455:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353
00000100:00100000:1.0:1767319144.435184:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444672:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319144.557042:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319144.877809:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319145.581026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319145.906043:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319146.570710:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319146.570843:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319146.575304:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302208
00000100:00100000:3.0:1767319146.575317:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302208
00000100:00100000:3.0:1767319146.575501:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302080
00000100:00100000:3.0:1767319146.575504:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302080
00000100:00100000:3.0:1767319146.575526:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4315
00000100:00100000:3.0:1767319146.575533:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894302208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319146.575615:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894302208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (4916us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319146.575621:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4315
00000100:00100000:3.0:1767319146.575636:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16831
00000100:00100000:3.0:1767319146.575639:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894302080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319146.575656:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319146.575671:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894302080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 32us (4830us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319146.575675:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16831
00000100:00080000:2.0:1767319146.576097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319146.611719:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319146.925060:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319147.629217:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319147.950961:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319148.525217:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319148.525439:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444800:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319148.525530:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319148.525896:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444800
00000100:00100000:0.0:1767319148.525907:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444800
00000100:00100000:0.0:1767319148.526020:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354
00000100:00100000:0.0:1767319148.526031:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319148.526209:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319148.526272:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940444800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 243us (740us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319148.526279:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354
00000100:00100000:1.0:1767319148.526523:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940444800:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319148.527140:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319148.652893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319148.974371:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319149.037203:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319149.037214:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319149.037217:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319149.037221:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319149.037225:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319149.037477:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4393
00000100:00080000:3.0:1767319149.037482:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319149.037489:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319149.037528:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183ad80 x1853163940444928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319149.037580:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940444928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319149.037644:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319149.037698:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319149.037702:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319149.037704:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319149.037708:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4393
00000100:00080000:3.0:1767319149.037710:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319149.037714:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319149.037728:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838380 x1853163940445056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319149.037817:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319149.037820:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319149.037822:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319149.037826:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4393
00000100:00080000:3.0:1767319149.037829:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319149.037832:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319149.037844:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940445568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319149.037860:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319149.037864:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319149.037865:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319149.037868:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4393
00000100:00080000:3.0:1767319149.037871:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319149.037874:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319149.037886:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d180 x1853163940445824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319149.037909:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940445696:0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.037944:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940445440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.037980:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940445312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.038007:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319149.038074:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319149.038080:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940445184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.038103:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319149.038135:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445312
00000100:00100000:3.0:1767319149.038142:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445312
00000100:00100000:3.0:1767319149.038189:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445184
00000100:00100000:3.0:1767319149.038204:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445184
00000100:00100000:3.0:1767319149.038239:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812
00000100:00100000:3.0:1767319149.038254:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940445312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.038302:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940445312:12345-0@lo:400:kworker.0 Request processed in 54us (293us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319149.038310:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812
00000100:00100000:3.0:1767319149.038327:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813
00000100:00100000:3.0:1767319149.038332:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940445184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.038359:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940445184:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319149.038364:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813
00000100:00100000:3.0:1767319149.038404:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940445184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.038415:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940445312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319149.038508:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940445056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319149.038534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319149.038554:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940445568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319149.038576:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319149.038637:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319149.038684:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445056
00000100:00100000:3.0:1767319149.038689:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445056
00000100:00100000:3.0:1767319149.038717:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42
00000100:00100000:3.0:1767319149.038722:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940445056:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319149.038738:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319149.038766:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940445056:12345-0@lo:38:kworker.0 Request processed in 42us (230us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319149.038787:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42
00000100:00100000:2.0:1767319149.039183:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319149.039203:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940445824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319149.039437:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940444928
00000100:00100000:1.0:1767319149.039442:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940444928
00000100:00100000:1.0:1767319149.039474:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445568
00000100:00100000:1.0:1767319149.039478:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445568
00000100:00100000:1.0:1767319149.039496:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16832
00000100:00100000:1.0:1767319149.039502:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940444928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319149.039514:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319149.039548:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940444928:12345-0@lo:38:kworker.0 Request processed in 46us (1903us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319149.039553:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16832
00000100:00100000:1.0:1767319149.039566:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16833
00000100:00100000:1.0:1767319149.039570:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940445568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319149.039578:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319149.039599:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940445568:12345-0@lo:38:kworker.0 Request processed in 28us (1023us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319149.039604:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16833
00000100:00100000:3.0:1767319149.045055:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445696
00000100:00100000:3.0:1767319149.045084:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445696
00000100:00100000:3.0:1767319149.045162:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4316
00000100:00100000:3.0:1767319149.045173:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940445696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319149.045263:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319149.045309:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319149.045316:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319149.045320:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940444928:0@lo:38:kworker.0
00000100:00080000:0.0:1767319149.045350:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319149.045354:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319149.045357:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940445056:0@lo:38:kworker.0
00000100:00080000:0.0:1767319149.045370:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319149.045374:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319149.045377:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940445568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319149.045411:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445824
00000100:00100000:0.0:1767319149.045415:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445824
00000100:00100000:0.0:1767319149.045438:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16834
00000100:00100000:0.0:1767319149.045442:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940445824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319149.045466:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319149.045502:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940445824:12345-0@lo:38:kworker.0 Request processed in 58us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319149.045511:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16834
00000100:00080000:0.0:1767319149.045538:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319149.045543:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319149.045546:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940445824:0@lo:38:kworker.0
00000100:00080000:2.0:1767319149.045609:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319149.045957:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940445696:12345-0@lo:400:kworker.0 Request processed in 786us (6774us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319149.045967:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4316
00000100:00100000:3.0:1767319149.046005:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940445696:0@lo:400:kworker.0
00000100:00100000:0.0:1767319149.046530:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319149.046584:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445440
00000100:00100000:3.0:1767319149.046589:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445440
00000100:00100000:3.0:1767319149.046746:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4317
00000100:00100000:3.0:1767319149.046753:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940445440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319149.046963:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940445440:12345-0@lo:400:kworker.0 Request processed in 210us (1004us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319149.046971:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4317
00000100:00100000:1.0:1767319149.047425:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940445440:0@lo:400:kworker.0
00000100:00080000:2.0:1767319149.053530:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319149.550355:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940445952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319149.550429:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319149.550585:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940445952
00000100:00100000:0.0:1767319149.550594:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940445952
00000100:00100000:0.0:1767319149.550655:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355
00000100:00100000:0.0:1767319149.550664:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940445952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319149.550696:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319149.554490:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940445952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3815us (4048us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319149.554506:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355
00000100:00100000:2.0:1767319149.554683:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940445952:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319149.677320:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319149.999231:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319150.700909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319151.026210:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319151.686191:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319151.686389:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302464
00000100:00100000:1.0:1767319151.686399:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302464
00000100:00100000:1.0:1767319151.686518:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4318
00000100:00100000:1.0:1767319151.686529:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894302464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319151.686610:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894302464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319151.686618:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4318
00000100:00080000:2.0:1767319151.686813:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319151.694492:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319151.694534:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894302592 offset 0 length 520: 4
00000100:00100000:1.0:1767319151.694628:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302336
00000100:00100000:1.0:1767319151.694637:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302336
00000100:00100000:1.0:1767319151.694724:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16835
00000100:00100000:1.0:1767319151.694733:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894302336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319151.694756:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319151.694868:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894302336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 134us (383us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319151.694878:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16835
00000100:00100000:0.0:1767319151.725175:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319152.045860:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319152.748903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319153.069107:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319153.645069:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319153.645100:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940446080:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319153.645179:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319153.645339:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446080
00000100:00100000:0.0:1767319153.645348:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446080
00000100:00100000:0.0:1767319153.645418:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356
00000100:00100000:0.0:1767319153.645429:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940446080:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319153.645429:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:0.0:1767319153.645462:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319153.645515:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940446080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319153.645523:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356
00000100:00100000:2.0:1767319153.645633:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940446080:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319153.773476:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319154.093057:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319154.157097:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319154.157106:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319154.157109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319154.157113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319154.157116:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319154.157124:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4399
00000100:00080000:2.0:1767319154.157129:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319154.157135:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319154.157177:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196300 x1853163940446208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319154.157203:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319154.157207:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319154.157210:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319154.157216:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4399
00000100:00080000:2.0:1767319154.157220:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319154.157226:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319154.157234:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940446208:0@lo:38:kworker.0
00000100:00100000:2.0:1767319154.157247:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1f80 x1853163940446336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319154.157300:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319154.157338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319154.157342:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319154.157345:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319154.157349:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4399
00000100:00080000:2.0:1767319154.157352:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319154.157356:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319154.157358:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940446336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319154.157373:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3df80 x1853163940446848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319154.157387:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319154.157397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319154.157401:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319154.157402:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319154.157406:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4399
00000100:00080000:2.0:1767319154.157409:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319154.157413:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319154.157421:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940446848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319154.157429:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38e00 x1853163940447104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319154.157443:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319154.157460:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940446720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319154.157466:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940447104:0@lo:38:kworker.0
00000100:00100000:2.0:1767319154.157506:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319154.157510:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446336
00000100:00100000:0.0:1767319154.157517:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446336
00000100:00100000:2.0:1767319154.157539:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319154.157548:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43
00000100:00100000:2.0:1767319154.157552:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940446976:0@lo:400:kworker.0
00000100:00100000:0.0:1767319154.157558:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940446336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319154.157579:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319154.157598:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319154.157634:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940446336:12345-0@lo:38:kworker.0 Request processed in 76us (247us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319154.157639:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446208
00000100:00100000:0.0:1767319154.157643:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43
00000100:00100000:2.0:1767319154.157646:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446208
00000100:00100000:2.0:1767319154.157671:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446848
00000100:00100000:2.0:1767319154.157674:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446848
00000100:00100000:0.0:1767319154.157676:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446720
00000100:00100000:0.0:1767319154.157681:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446720
00000100:00100000:2.0:1767319154.157692:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446976
00000100:00100000:2.0:1767319154.157696:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446976
00000100:00100000:0.0:1767319154.157722:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4319
00000100:00100000:2.0:1767319154.157730:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4320
00000100:00100000:0.0:1767319154.157733:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940446720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319154.157742:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940446976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319154.157801:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940446720:12345-0@lo:400:kworker.0 Request processed in 71us (297us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319154.157808:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4319
00000100:00100000:2.0:1767319154.157812:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940446976:12345-0@lo:400:kworker.0 Request processed in 71us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319154.157822:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4320
00000100:00100000:1.0:1767319154.157873:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940446464:0@lo:400:kworker.0
00000100:00100000:1.0:1767319154.157905:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319154.157934:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319154.157940:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940446592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319154.157960:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319154.158226:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446464
00000100:00100000:3.0:1767319154.158230:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446464
00000100:00100000:3.0:1767319154.158258:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940446592
00000100:00100000:3.0:1767319154.158261:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940446592
00000100:00100000:3.0:1767319154.158281:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814
00000100:00100000:3.0:1767319154.158288:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940446464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319154.158342:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940446464:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319154.158348:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814
00000100:00100000:3.0:1767319154.158362:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815
00000100:00100000:3.0:1767319154.158369:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940446592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319154.158397:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940446592:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319154.158403:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815
00000100:00100000:3.0:1767319154.158444:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940446592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319154.158456:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940446464:0@lo:400:kworker.0
00000100:00080000:3.0:1767319154.158493:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319154.158498:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319154.158520:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940446976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319154.158529:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940446720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319154.159141:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16836
00000100:00100000:0.0:1767319154.159149:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940446208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319154.159165:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319154.159204:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940446208:12345-0@lo:38:kworker.0 Request processed in 55us (1904us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319154.159210:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16836
00000100:00100000:0.0:1767319154.159226:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16837
00000100:00100000:0.0:1767319154.159229:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940446848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319154.159238:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319154.159262:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940446848:12345-0@lo:38:kworker.0 Request processed in 31us (1820us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319154.159267:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16837
00000100:00100000:0.0:1767319154.159315:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319154.159346:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319154.159351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319154.159354:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940446848:0@lo:38:kworker.0
00000100:00080000:0.0:1767319154.159362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319154.159365:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319154.159367:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940446336:0@lo:38:kworker.0
00000100:00080000:0.0:1767319154.159375:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319154.159377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319154.159379:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940446208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319154.159496:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447104
00000100:00100000:0.0:1767319154.159501:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447104
00000100:00100000:0.0:1767319154.159525:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16838
00000100:00100000:0.0:1767319154.159529:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940447104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319154.159539:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319154.159567:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940447104:12345-0@lo:38:kworker.0 Request processed in 36us (251us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319154.159576:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16838
00000100:00080000:0.0:1767319154.159743:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319154.159747:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319154.159750:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940447104:0@lo:38:kworker.0
00000100:00100000:1.0:1767319154.669511:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940447232:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319154.669583:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319154.669960:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447232
00000100:00100000:3.0:1767319154.669969:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447232
00000100:00100000:3.0:1767319154.670059:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357
00000100:00100000:3.0:1767319154.670069:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940447232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319154.670099:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319154.670158:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940447232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (575us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319154.670165:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357
00000100:00100000:1.0:1767319154.670378:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940447232:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319154.796916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319155.117066:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319155.820932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319156.141386:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319156.807112:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319156.807163:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319156.807339:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302848
00000100:00100000:3.0:1767319156.807351:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302848
00000100:00100000:2.0:1767319156.807392:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302720
00000100:00100000:2.0:1767319156.807399:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302720
00000100:00100000:3.0:1767319156.807445:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4321
00000100:00100000:3.0:1767319156.807468:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894302848:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319156.807562:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894302848:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319156.807569:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4321
00000100:00100000:3.0:1767319156.807589:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16839
00000100:00100000:3.0:1767319156.807594:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894302720:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319156.807616:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319156.807643:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894302720:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (479us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319156.807649:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16839
00000100:00080000:0.0:1767319156.807697:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319156.845064:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319157.165954:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319157.869302:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319158.190290:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319158.252902:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319133/real 1767319133]  req@ffff93cf47170700 x1853163940441344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319158 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319158.252959:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47170700 x1853163940441344/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319158 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319158.252991:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319158.253028:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319158.253035:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940441344:0@lo:250:kworker.0
00000100:00080000:2.0:1767319158.256166:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319158.256176:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319158.256180:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319158.256186:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4383
00000100:00080000:2.0:1767319158.256190:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319158.256196:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319158.256231:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91180 x1853163940447360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319158.256258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319158.256261:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319158.256262:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319158.256265:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4404
00000100:00080000:2.0:1767319158.256267:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319158.256270:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319158.256282:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93480 x1853163940447488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319158.256289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319158.256291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319158.256292:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319158.256294:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4404
00000100:00080000:2.0:1767319158.256295:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319158.256297:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319158.256304:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92300 x1853163940447616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319158.256358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319158.256361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319158.256363:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319158.256369:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4404
00000100:00100000:3.0:1767319158.256369:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940447872:0@lo:400:kworker.0
00000100:00080000:2.0:1767319158.256372:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319158.256380:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319158.256394:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99f80 x1853163940448128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319158.256410:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940447744:0@lo:400:kworker.0
00000100:00080000:2.0:1767319158.256415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319158.256420:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319158.256422:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319158.256426:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4404
00000100:00080000:2.0:1767319158.256429:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319158.256433:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319158.256449:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319158.256453:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940448384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319158.256475:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940448000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319158.256487:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940447360:0@lo:250:kworker.0
00000100:00100000:0.0:1767319158.256512:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:2.0:1767319158.256518:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940447360 offset 0 length 520: 4
00000100:00100000:2.0:1767319158.256545:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940447488:0@lo:38:kworker.0
00000100:00100000:0.0:1767319158.256568:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447872
00000100:00100000:0.0:1767319158.256577:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447872
00000100:00100000:2.0:1767319158.256577:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319158.256595:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940447616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319158.256615:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319158.256626:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940448128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319158.256640:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816
00000100:00100000:0.0:1767319158.256653:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940447872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319158.256653:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319158.256672:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940448384:0@lo:38:kworker.0
00000100:00100000:2.0:1767319158.256704:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319158.256714:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940447872:12345-0@lo:400:kworker.0 Request processed in 66us (266us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319158.256723:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816
00000100:00080000:2.0:1767319158.256748:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319158.256754:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448000
00000100:00100000:0.0:1767319158.256759:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448000
00000100:00100000:2.0:1767319158.256764:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447488
00000100:00100000:2.0:1767319158.256770:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447488
00000100:00100000:3.0:1767319158.256816:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447616
00000100:00100000:3.0:1767319158.256822:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447616
00000100:00100000:2.0:1767319158.256823:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448128
00000100:00100000:2.0:1767319158.256828:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448128
00000100:00100000:1.0:1767319158.256869:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940448256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319158.256932:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319158.256947:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44
00000100:00100000:3.0:1767319158.256952:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940447616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319158.256969:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319158.257019:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940447616:12345-0@lo:38:kworker.0 Request processed in 65us (403us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319158.257025:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44
00000100:00100000:3.0:1767319158.257076:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940447872:0@lo:400:kworker.0
00000100:00080000:3.0:1767319158.257106:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319158.257110:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319158.257113:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940447616:0@lo:38:kworker.0
00000100:00100000:0.0:1767319158.269433:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448384
00000100:00100000:0.0:1767319158.269451:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448384
00000100:00100000:0.0:1767319158.269507:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448256
00000100:00100000:0.0:1767319158.269512:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448256
00000100:00100000:0.0:1767319158.269553:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4322
00000100:00100000:0.0:1767319158.269564:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940448000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319158.269669:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940448000:12345-0@lo:400:kworker.0 Request processed in 106us (13157us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319158.269676:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4322
00000100:00100000:0.0:1767319158.269695:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4323
00000100:00100000:0.0:1767319158.269702:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940448256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319158.269738:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16840
00000100:00100000:2.0:1767319158.269748:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940447488:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319158.269754:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940448256:12345-0@lo:400:kworker.0 Request processed in 50us (12820us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319158.269763:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4323
00010000:00020000:2.0:1767319158.269794:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319158.269799:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16841
00000100:00100000:0.0:1767319158.269806:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940448128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319158.269817:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319158.269859:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940447488:12345-0@lo:38:kworker.0 Request processed in 110us (13280us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319158.269865:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940448128:12345-0@lo:38:kworker.0 Request processed in 56us (13212us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319158.269872:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16840
00000100:00100000:0.0:1767319158.269879:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16841
00000100:00100000:2.0:1767319158.269895:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16842
00000100:00100000:2.0:1767319158.269902:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940448384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319158.269913:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319158.269938:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319158.269944:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940448384:12345-0@lo:38:kworker.0 Request processed in 41us (13239us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319158.269950:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16842
00000100:00100000:0.0:1767319158.269958:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319158.270020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319158.270024:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319158.270027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940447488:0@lo:38:kworker.0
00000100:00080000:2.0:1767319158.270034:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319158.270036:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319158.270038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940448128:0@lo:38:kworker.0
00000100:00080000:2.0:1767319158.270044:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319158.270046:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319158.270047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940448384:0@lo:38:kworker.0
00000100:00100000:2.0:1767319158.270080:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940447744
00000100:00100000:2.0:1767319158.270083:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940447744
00000100:00100000:2.0:1767319158.270112:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817
00000100:00080000:0.0:1767319158.270116:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319158.270117:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940447744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319158.270996:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940447744:12345-0@lo:400:kworker.0 Request processed in 874us (1035us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319158.271005:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817
00000100:00100000:2.0:1767319158.271051:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940448000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319158.271252:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940447744:0@lo:400:kworker.0
00000100:00100000:2.0:1767319158.271767:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940448256:0@lo:400:kworker.0
00000100:00100000:0.0:1767319158.766016:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940448512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319158.766090:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319158.766195:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448512
00000100:00100000:1.0:1767319158.766204:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448512
00000100:00100000:1.0:1767319158.766259:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358
00000100:00100000:1.0:1767319158.766268:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940448512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319158.766298:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319158.766351:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940448512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319158.766359:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358
00000100:00100000:0.0:1767319158.766440:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940448512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319158.892909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319159.213063:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319159.789176:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319159.789203:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940448640:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319159.789274:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319159.789484:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448640
00000100:00100000:3.0:1767319159.789494:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448640
00000100:00100000:3.0:1767319159.789595:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359
00000100:00100000:3.0:1767319159.789605:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940448640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319159.789657:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319159.789715:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940448640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (440us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319159.789721:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359
00000100:00100000:2.0:1767319159.789833:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940448640:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319159.918186:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319160.237933:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319160.944387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319161.261017:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319161.929535:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319161.929687:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303104
00000100:00100000:1.0:1767319161.929697:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303104
00000100:00100000:1.0:1767319161.929828:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4324
00000100:00100000:1.0:1767319161.929840:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894303104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319161.929922:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894303104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (408us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319161.929931:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4324
00000100:00080000:0.0:1767319161.930350:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319161.930720:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319161.937021:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894302976
00000100:00100000:1.0:1767319161.937038:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894302976
00000100:00100000:1.0:1767319161.937116:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16843
00000100:00100000:1.0:1767319161.937125:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894302976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319161.937482:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319161.937640:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894302976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 512us (6920us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319161.937648:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16843
00000100:00100000:0.0:1767319161.965002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319162.285011:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319162.992168:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319163.309009:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319163.373768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319163.373804:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319163.373807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319163.373811:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319163.373816:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319163.373823:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4408
00000100:00080000:0.0:1767319163.373827:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319163.373833:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319163.373874:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940448768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319163.373902:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319163.373906:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319163.373908:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319163.373911:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4408
00000100:00080000:0.0:1767319163.373913:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319163.373916:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319163.373943:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940448896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319163.374007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319163.374010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319163.374012:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319163.374015:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4408
00000100:00080000:0.0:1767319163.374018:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319163.374021:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319163.374033:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940449408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319163.374047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319163.374050:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319163.374052:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319163.374055:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4408
00000100:00080000:0.0:1767319163.374057:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319163.374061:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319163.374069:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940449664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319163.374096:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940449536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374157:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319163.374216:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319163.374222:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940449024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374249:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319163.374279:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940449280:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374320:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319163.374339:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319163.374344:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940449152:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374364:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319163.374397:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449024
00000100:00100000:0.0:1767319163.374404:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449024
00000100:00100000:0.0:1767319163.374449:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449152
00000100:00100000:0.0:1767319163.374452:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449152
00000100:00100000:0.0:1767319163.374470:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818
00000100:00100000:0.0:1767319163.374477:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940449024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374521:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940449024:12345-0@lo:400:kworker.0 Request processed in 44us (271us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319163.374529:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818
00000100:00100000:0.0:1767319163.374544:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819
00000100:00100000:0.0:1767319163.374549:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940449152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.374579:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940449152:12345-0@lo:400:kworker.0 Request processed in 30us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319163.374584:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819
00000100:00080000:0.0:1767319163.374600:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319163.374603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319163.374738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940448768:0@lo:38:kworker.0
00000100:00100000:3.0:1767319163.374767:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319163.374804:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940448896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319163.374832:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319163.374848:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940449408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319163.374868:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319163.374880:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940449664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319163.374898:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319163.374926:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449536
00000100:00100000:3.0:1767319163.374940:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449536
00000100:00100000:3.0:1767319163.374972:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449280
00000100:00100000:3.0:1767319163.374976:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449280
00000100:00100000:3.0:1767319163.374991:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448768
00000100:00100000:3.0:1767319163.374994:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448768
00000100:00100000:3.0:1767319163.375002:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449408
00000100:00100000:3.0:1767319163.375004:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449408
00000100:00100000:3.0:1767319163.375011:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449664
00000100:00100000:3.0:1767319163.375013:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449664
00000100:00100000:3.0:1767319163.375022:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4325
00000100:00100000:3.0:1767319163.375028:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940449536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319163.375057:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940449536:12345-0@lo:400:kworker.0 Request processed in 30us (900us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319163.375063:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4325
00000100:00100000:3.0:1767319163.375075:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4326
00000100:00100000:3.0:1767319163.375081:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940449280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319163.375107:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940449280:12345-0@lo:400:kworker.0 Request processed in 26us (787us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319163.375112:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4326
00000100:00100000:3.0:1767319163.375123:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16844
00000100:00100000:3.0:1767319163.375127:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940448768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319163.375142:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319163.375168:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940448768:12345-0@lo:38:kworker.0 Request processed in 40us (400us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319163.375174:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16844
00000100:00100000:3.0:1767319163.375184:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16845
00000100:00100000:3.0:1767319163.375188:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940449408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319163.375197:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319163.375216:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940449408:12345-0@lo:38:kworker.0 Request processed in 27us (348us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319163.375222:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16845
00000100:00100000:3.0:1767319163.375232:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16846
00000100:00100000:3.0:1767319163.375236:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940449664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319163.375244:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319163.375263:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940449664:12345-0@lo:38:kworker.0 Request processed in 26us (364us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319163.375268:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16846
00000100:00100000:3.0:1767319163.375285:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940448896
00000100:00100000:3.0:1767319163.375288:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940448896
00000100:00100000:3.0:1767319163.375305:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45
00000100:00100000:3.0:1767319163.375309:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940448896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319163.375319:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319163.375340:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940448896:12345-0@lo:38:kworker.0 Request processed in 30us (507us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319163.375345:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45
00000100:00080000:3.0:1767319163.375499:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319163.375521:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319163.375526:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319163.375530:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940448768:0@lo:38:kworker.0
00000100:00080000:3.0:1767319163.375539:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319163.375542:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319163.375544:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940448896:0@lo:38:kworker.0
00000100:00080000:3.0:1767319163.375551:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319163.375554:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319163.375556:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940449408:0@lo:38:kworker.0
00000100:00080000:3.0:1767319163.375563:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319163.375566:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319163.375569:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940449664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319163.375635:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940449024:0@lo:400:kworker.0
00000100:00100000:3.0:1767319163.375645:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940449536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.375891:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940449152:0@lo:400:kworker.0
00000100:00100000:0.0:1767319163.375902:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940449280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319163.885118:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940449792:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319163.885196:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319163.885414:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449792
00000100:00100000:1.0:1767319163.885424:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449792
00000100:00100000:1.0:1767319163.885480:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360
00000100:00100000:1.0:1767319163.885490:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940449792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319163.885519:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319163.885572:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940449792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319163.885579:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360
00000100:00100000:2.0:1767319163.885739:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940449792:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319164.012934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319164.333122:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319164.910356:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319164.910380:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940449920:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319164.910446:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319164.910644:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940449920
00000100:00100000:1.0:1767319164.910653:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940449920
00000100:00100000:1.0:1767319164.910704:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361
00000100:00100000:1.0:1767319164.910714:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940449920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319164.910750:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319164.910850:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940449920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (403us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319164.910858:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361
00000100:00100000:0.0:1767319164.911047:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940449920:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319165.036901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319165.357601:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319166.061059:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319166.381462:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319167.047538:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319167.047592:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319167.047683:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303232
00000100:00100000:3.0:1767319167.047694:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303232
00000100:00100000:3.0:1767319167.047738:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303360
00000100:00100000:3.0:1767319167.047742:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303360
00000100:00100000:3.0:1767319167.047831:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4327
00000100:00100000:3.0:1767319167.047844:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894303360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319167.047928:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894303360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319167.047936:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4327
00000100:00100000:0.0:1767319167.047951:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16847
00000100:00100000:0.0:1767319167.047961:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894303232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319167.047982:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319167.048025:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894303232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (485us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319167.048033:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16847
00000100:00080000:1.0:1767319167.048665:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319167.084891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319167.406078:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319168.110353:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319168.429007:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319168.492955:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319168.492966:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319168.492969:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319168.492973:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319168.492977:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319168.492985:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4413
00000100:00080000:0.0:1767319168.492989:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319168.492997:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319168.493034:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411500 x1853163940450048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319168.493068:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319168.493071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319168.493073:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319168.493076:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4413
00000100:00080000:0.0:1767319168.493078:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319168.493082:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319168.493097:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073413800 x1853163940450176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319168.493147:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319168.493151:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319168.493153:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319168.493156:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4413
00000100:00080000:0.0:1767319168.493159:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319168.493161:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319168.493175:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411f80 x1853163940450688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319168.493189:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319168.493191:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319168.493193:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319168.493196:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4413
00000100:00080000:0.0:1767319168.493198:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319168.493201:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319168.493209:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073413100 x1853163940450944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319168.493246:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940450304:0@lo:400:kworker.0
00000100:00100000:0.0:1767319168.493308:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319168.493367:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319168.493373:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940450816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319168.493397:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319168.493572:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940450048:0@lo:38:kworker.0
00000100:00100000:1.0:1767319168.493600:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319168.493626:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940450176:0@lo:38:kworker.0
00000100:00100000:1.0:1767319168.493649:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319168.493665:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940450688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319168.493683:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319168.493698:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940450944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319168.493717:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319168.493749:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450176
00000100:00100000:1.0:1767319168.493757:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450176
00000100:00100000:1.0:1767319168.493818:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46
00000100:00100000:1.0:1767319168.493824:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940450176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319168.493843:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319168.493881:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940450176:12345-0@lo:38:kworker.0 Request processed in 55us (231us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319168.493903:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46
00000100:00100000:1.0:1767319168.493925:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450816
00000100:00100000:1.0:1767319168.493928:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450816
00000100:00100000:1.0:1767319168.493966:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450048
00000100:00100000:1.0:1767319168.493969:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450048
00000100:00100000:1.0:1767319168.493981:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450688
00000100:00100000:1.0:1767319168.493984:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450688
00000100:00100000:1.0:1767319168.493992:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450944
00000100:00100000:1.0:1767319168.493994:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450944
00000100:00100000:1.0:1767319168.494004:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4328
00000100:00100000:1.0:1767319168.494010:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940450816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319168.494053:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940450816:12345-0@lo:400:kworker.0 Request processed in 43us (654us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319168.494059:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4328
00000100:00100000:1.0:1767319168.494072:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16848
00000100:00100000:1.0:1767319168.494076:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450048:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319168.494086:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319168.494108:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450048:12345-0@lo:38:kworker.0 Request processed in 31us (508us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319168.494113:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16848
00000100:00100000:1.0:1767319168.494123:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16849
00000100:00100000:1.0:1767319168.494127:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319168.494145:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319168.494166:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450688:12345-0@lo:38:kworker.0 Request processed in 38us (482us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319168.494170:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16849
00000100:00100000:1.0:1767319168.494181:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16850
00000100:00100000:1.0:1767319168.494184:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319168.494192:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319168.494212:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940450944:12345-0@lo:38:kworker.0 Request processed in 26us (494us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319168.494217:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16850
00000100:00080000:1.0:1767319168.494245:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319168.494273:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940450816:0@lo:400:kworker.0
00000100:00080000:1.0:1767319168.494303:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319168.494307:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319168.494310:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940450048:0@lo:38:kworker.0
00000100:00080000:1.0:1767319168.494317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319168.494320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319168.494322:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940450176:0@lo:38:kworker.0
00000100:00080000:1.0:1767319168.494329:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319168.494332:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319168.494334:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940450688:0@lo:38:kworker.0
00000100:00080000:1.0:1767319168.494342:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319168.494344:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319168.494347:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940450944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319168.494448:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940450432:0@lo:400:kworker.0
00000100:00100000:3.0:1767319168.494478:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319168.494516:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319168.494522:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940450560:0@lo:400:kworker.0
00000100:00100000:3.0:1767319168.494543:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319168.494618:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450560
00000100:00100000:0.0:1767319168.494623:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450560
00000100:00100000:0.0:1767319168.494666:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4329
00000100:00100000:0.0:1767319168.494672:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940450560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319168.494707:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940450560:12345-0@lo:400:kworker.0 Request processed in 35us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319168.494713:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4329
00000100:00080000:3.0:1767319168.494768:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319168.494804:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940450560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319168.495008:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450304
00000100:00100000:2.0:1767319168.495013:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450304
00000100:00100000:2.0:1767319168.495056:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940450432
00000100:00100000:2.0:1767319168.495059:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940450432
00000100:00100000:2.0:1767319168.495081:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820
00000100:00100000:2.0:1767319168.495088:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940450304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319168.495125:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940450304:12345-0@lo:400:kworker.0 Request processed in 38us (1817us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319168.495141:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820
00000100:00100000:2.0:1767319168.495154:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821
00000100:00100000:2.0:1767319168.495160:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940450432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319168.495192:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940450432:12345-0@lo:400:kworker.0 Request processed in 32us (712us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319168.495197:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821
00000100:00100000:2.0:1767319168.495241:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940450432:0@lo:400:kworker.0
00000100:00080000:0.0:1767319168.495372:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319168.495375:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319168.495441:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940450304:0@lo:400:kworker.0
00000100:00100000:3.0:1767319169.005073:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319169.006428:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940451072:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319169.006626:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319169.009170:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451072
00000100:00100000:1.0:1767319169.009185:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451072
00000100:00100000:1.0:1767319169.009255:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362
00000100:00100000:1.0:1767319169.009266:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940451072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319169.009301:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319169.009382:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940451072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (2754us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319169.009389:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362
00000100:00100000:3.0:1767319169.009898:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940451072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319169.134171:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319169.453072:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319170.035690:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940451200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319170.035810:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319170.035926:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451200
00000100:00100000:0.0:1767319170.035936:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451200
00000100:00100000:0.0:1767319170.036002:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363
00000100:00100000:0.0:1767319170.036012:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940451200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319170.036040:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319170.036450:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940451200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 439us (638us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319170.036459:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363
00000100:00080000:0.0:1767319170.036482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319170.036548:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940451200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319170.156891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319170.477162:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319171.184294:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319171.501115:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319172.166376:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319172.166431:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319172.166511:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303616
00000100:00100000:2.0:1767319172.166520:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303616
00000100:00100000:2.0:1767319172.166592:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303488
00000100:00100000:2.0:1767319172.166595:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303488
00000100:00100000:2.0:1767319172.166622:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4330
00000100:00100000:3.0:1767319172.166632:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16851
00000100:00100000:2.0:1767319172.166634:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894303616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319172.166644:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894303488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319172.166665:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319172.166738:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319172.190615:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894303488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 23959us (24169us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319172.190632:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16851
00000100:00100000:2.0:1767319172.192665:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894303616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 26021us (26287us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319172.192681:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4330
00000100:00100000:2.0:1767319172.206679:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319172.525096:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319173.232812:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319173.549190:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319173.613970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.613980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319173.613983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.613987:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.613990:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.613998:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4418
00000100:00080000:2.0:1767319173.614003:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.614009:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319173.614048:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09c00 x1853163940451328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319173.614076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.614079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.614081:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.614084:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4418
00000100:00080000:2.0:1767319173.614087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.614090:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319173.614103:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b100 x1853163940451456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319173.614390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940451328:0@lo:38:kworker.0
00000100:00100000:1.0:1767319173.614452:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.614502:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940451456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319173.614521:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.614557:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451456
00000100:00100000:1.0:1767319173.614563:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451456
00000100:00100000:1.0:1767319173.614589:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47
00000100:00100000:1.0:1767319173.614595:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940451456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319173.614614:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319173.614647:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940451456:12345-0@lo:38:kworker.0 Request processed in 51us (124us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319173.614653:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47
00000100:00080000:1.0:1767319173.614686:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319173.614690:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319173.614693:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940451456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319173.614725:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451328
00000100:00100000:1.0:1767319173.614727:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451328
00000100:00100000:1.0:1767319173.614744:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16852
00000100:00100000:1.0:1767319173.614748:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940451328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319173.614758:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319173.614799:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940451328:12345-0@lo:38:kworker.0 Request processed in 49us (347us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319173.614804:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16852
00000100:00080000:1.0:1767319173.614908:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319173.614912:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319173.614915:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940451328:0@lo:38:kworker.0
00000100:00100000:3.0:1767319173.614986:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940451584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319173.615018:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319173.615109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.615113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.615115:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.615119:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4418
00000100:00080000:2.0:1767319173.615123:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.615127:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319173.615139:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9a300 x1853163940451968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319173.615236:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940451840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319173.615263:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319173.615281:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319173.615285:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940451712:0@lo:400:kworker.0
00000100:00100000:0.0:1767319173.615300:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319173.615327:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451584
00000100:00100000:0.0:1767319173.615330:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451584
00000100:00100000:0.0:1767319173.615366:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451712
00000100:00100000:0.0:1767319173.615368:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451712
00000100:00100000:0.0:1767319173.615384:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822
00000100:00100000:0.0:1767319173.615390:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940451584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616341:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823
00000100:00100000:1.0:1767319173.616354:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940451712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616404:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940451712:12345-0@lo:400:kworker.0 Request processed in 55us (1102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319173.616410:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823
00000100:00100000:1.0:1767319173.616437:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940451968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319173.616459:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.616487:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451840
00000100:00100000:1.0:1767319173.616490:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451840
00000100:00100000:1.0:1767319173.616517:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940451968
00000100:00100000:1.0:1767319173.616520:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940451968
00000100:00100000:1.0:1767319173.616532:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4331
00000100:00100000:1.0:1767319173.616537:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940451840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616561:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940451840:12345-0@lo:400:kworker.0 Request processed in 24us (1297us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319173.616567:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4331
00000100:00100000:1.0:1767319173.616577:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16853
00000100:00100000:1.0:1767319173.616581:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940451968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319173.616598:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319173.616620:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940451968:12345-0@lo:38:kworker.0 Request processed in 38us (160us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319173.616625:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16853
00000100:00080000:1.0:1767319173.616656:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319173.616660:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319173.616663:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940451968:0@lo:38:kworker.0
00000100:00080000:1.0:1767319173.616697:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319173.616702:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319173.616704:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319173.616716:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940452096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616736:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.616758:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452096
00000100:00100000:1.0:1767319173.616760:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452096
00000100:00100000:1.0:1767319173.616804:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4332
00000100:00100000:1.0:1767319173.616809:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940452096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616835:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940452096:12345-0@lo:400:kworker.0 Request processed in 27us (98us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319173.616854:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4332
00000100:00080000:1.0:1767319173.616869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319173.616886:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940452096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616921:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940451712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.616929:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940451840:0@lo:400:kworker.0
00000100:00080000:2.0:1767319173.626424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.626436:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.626441:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.626449:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4418
00000100:00080000:2.0:1767319173.626454:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.626461:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319173.626503:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99f80 x1853163940452224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319173.626641:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940451584:12345-0@lo:400:kworker.0 Request processed in 11248us (11619us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319173.626650:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822
00000100:00100000:1.0:1767319173.627009:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940452224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319173.627073:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319173.627202:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452224
00000100:00100000:0.0:1767319173.627209:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452224
00000100:00100000:0.0:1767319173.627252:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16854
00000100:00100000:0.0:1767319173.627258:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940452224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319173.627278:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319173.627327:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940452224:12345-0@lo:38:kworker.0 Request processed in 68us (254us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319173.627333:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16854
00000100:00080000:2.0:1767319173.627534:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319173.627539:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319173.627543:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940452224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319173.629027:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940451584:0@lo:400:kworker.0
00000100:00100000:2.0:1767319174.126981:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319174.127008:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940452352:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319174.127080:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319174.127229:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452352
00000100:00100000:0.0:1767319174.127238:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452352
00000100:00100000:0.0:1767319174.127289:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364
00000100:00100000:0.0:1767319174.127298:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940452352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319174.127376:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319174.127432:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940452352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319174.127447:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364
00000100:00100000:2.0:1767319174.127938:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940452352:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319174.253682:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319174.573981:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319175.150064:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319175.150098:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940452480:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319175.150163:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319175.150225:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452480
00000100:00100000:3.0:1767319175.150233:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452480
00000100:00100000:3.0:1767319175.150299:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365
00000100:00100000:3.0:1767319175.150309:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940452480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319175.150339:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319175.150395:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940452480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (230us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319175.150402:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365
00000100:00080000:1.0:1767319175.150484:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319175.150523:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940452480:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319175.276912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319175.597260:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319176.265259:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894303744 offset 0 length 520: 4
00000100:00100000:3.0:1767319176.265300:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319176.265387:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319176.272566:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894303872
00000100:00100000:1.0:1767319176.272583:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894303872
00000100:00100000:1.0:1767319176.272731:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304000
00000100:00100000:1.0:1767319176.272735:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304000
00000100:00100000:2.0:1767319176.272856:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16855
00000100:00100000:2.0:1767319176.272866:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894303872:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319176.272892:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319176.272928:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4333
00000100:00100000:1.0:1767319176.272935:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894304000:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319176.272970:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894303872:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 104us (7669us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319176.272977:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894304000:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 44us (7591us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319176.272977:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16855
00000100:00100000:1.0:1767319176.272996:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4333
00000100:00080000:3.0:1767319176.274297:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319176.300899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319176.621119:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319177.325087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319177.645531:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319178.349446:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319178.669111:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319178.733978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319178.733989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319178.733992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319178.733996:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319178.734001:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319178.734009:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4423
00000100:00080000:3.0:1767319178.734013:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319178.734020:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319178.734057:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940452608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319178.734111:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940452608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.734177:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.734308:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452608
00000100:00100000:0.0:1767319178.734316:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452608
00000100:00100000:0.0:1767319178.734383:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16856
00000100:00100000:0.0:1767319178.734391:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940452608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319178.734413:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319178.734738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319178.734743:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319178.734745:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319178.734749:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4423
00000100:00080000:3.0:1767319178.734752:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319178.734756:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319178.734819:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940452736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319178.735026:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940452736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.735062:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319178.735118:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452736
00000100:00100000:2.0:1767319178.735123:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452736
00000100:00100000:2.0:1767319178.735151:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48
00000100:00100000:2.0:1767319178.735157:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940452736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319178.735170:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319178.735203:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940452736:12345-0@lo:38:kworker.0 Request processed in 45us (140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319178.735210:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48
00000100:00100000:0.0:1767319178.738589:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940452608:12345-0@lo:38:kworker.0 Request processed in 4190us (4404us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319178.738603:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16856
00000100:00080000:1.0:1767319178.743241:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319178.743255:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319178.743260:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940452608:0@lo:38:kworker.0
00000100:00080000:1.0:1767319178.743298:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319178.743301:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319178.743305:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940452736:0@lo:38:kworker.0
00000100:00100000:2.0:1767319178.745628:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940452864:0@lo:400:kworker.0
00000100:00100000:2.0:1767319178.745700:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.746451:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452864
00000100:00100000:0.0:1767319178.746460:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452864
00000100:00100000:0.0:1767319178.746521:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824
00000100:00100000:0.0:1767319178.746530:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940452864:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319178.746640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319178.746644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319178.746647:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319178.746652:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4423
00000100:00080000:3.0:1767319178.746655:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319178.746661:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319178.746677:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e300 x1853163940453248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319178.749662:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940453248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.749739:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319178.749956:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453248
00000100:00100000:1.0:1767319178.749963:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453248
00000100:00100000:1.0:1767319178.750007:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16857
00000100:00100000:1.0:1767319178.750013:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940453248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319178.750035:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319178.750081:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940453248:12345-0@lo:38:kworker.0 Request processed in 66us (341us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319178.750088:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16857
00000100:00080000:1.0:1767319178.750130:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319178.750135:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319178.750139:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940453248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.750179:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940453120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750206:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319178.750228:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319178.750234:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940452992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750259:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319178.750296:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940453376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750319:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319178.750369:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940452992
00000100:00100000:1.0:1767319178.750373:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940452992
00000100:00100000:1.0:1767319178.750408:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825
00000100:00100000:1.0:1767319178.750415:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940452992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750457:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940452992:12345-0@lo:400:kworker.0 Request processed in 42us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319178.750463:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825
00000100:00100000:1.0:1767319178.750493:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940452992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750509:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453120
00000100:00100000:1.0:1767319178.750513:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453120
00000100:00100000:1.0:1767319178.750535:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453376
00000100:00100000:1.0:1767319178.750538:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453376
00000100:00100000:1.0:1767319178.750555:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4334
00000100:00100000:1.0:1767319178.750561:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940453120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750593:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940453120:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319178.750598:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4334
00000100:00100000:1.0:1767319178.750609:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4335
00000100:00100000:1.0:1767319178.750613:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940453376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750642:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940453376:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319178.750647:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4335
00000100:00100000:1.0:1767319178.750673:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940453376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.750694:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940453120:0@lo:400:kworker.0
00000100:00080000:1.0:1767319178.750728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319178.750733:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319178.750735:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319178.751098:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940452864:12345-0@lo:400:kworker.0 Request processed in 4568us (5395us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319178.751106:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824
00000100:00100000:2.0:1767319178.758577:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940452864:0@lo:400:kworker.0
00000100:00080000:3.0:1767319178.761045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319178.761057:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319178.761063:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319178.761072:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4423
00000100:00080000:3.0:1767319178.761077:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319178.761083:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319178.761126:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940453504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319178.761208:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940453504:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.761282:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319178.761372:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453504
00000100:00100000:2.0:1767319178.761380:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453504
00000100:00100000:2.0:1767319178.761433:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16858
00000100:00100000:2.0:1767319178.761440:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940453504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319178.761463:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319178.762671:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940453504:12345-0@lo:38:kworker.0 Request processed in 1225us (1382us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319178.762682:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16858
00000100:00080000:1.0:1767319178.762751:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319178.762757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319178.762761:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940453504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319179.245180:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940453632:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319179.245256:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319179.245594:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453632
00000100:00100000:0.0:1767319179.245602:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453632
00000100:00100000:0.0:1767319179.245650:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366
00000100:00100000:0.0:1767319179.245658:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940453632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319179.245686:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319179.245735:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940453632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (478us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319179.245742:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366
00000100:00100000:2.0:1767319179.245886:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940453632:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319179.372934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319179.693201:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319180.269214:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319180.270446:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940453760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319180.270509:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319180.271149:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453760
00000100:00100000:1.0:1767319180.271156:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453760
00000100:00080000:2.0:1767319180.271215:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319180.272654:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367
00000100:00100000:1.0:1767319180.272670:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940453760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319180.272698:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319180.272769:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940453760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (2258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319180.272804:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367
00000100:00100000:3.0:1767319180.272888:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940453760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319180.396887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319180.718288:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319181.386429:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319181.386465:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319181.386601:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304128
00000100:00100000:0.0:1767319181.386609:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304128
00000100:00100000:0.0:1767319181.386645:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304256
00000100:00100000:0.0:1767319181.386647:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304256
00000100:00100000:0.0:1767319181.386696:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4336
00000100:00100000:0.0:1767319181.386704:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894304256:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319181.386762:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894304256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 59us (295us total) trans 0 rc 0/0
00000100:00080000:3.0:1767319181.386808:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319181.386809:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4336
00000100:00100000:0.0:1767319181.386828:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16859
00000100:00100000:0.0:1767319181.386833:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894304128:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319181.386853:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319181.386881:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894304128:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (459us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319181.386887:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16859
00000100:00100000:2.0:1767319181.420908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319181.742187:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319182.444929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319182.769308:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319183.471528:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319183.791078:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319183.852975:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.852983:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319183.852986:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.852989:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.852993:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.852999:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4428
00000100:00080000:0.0:1767319183.853004:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.853009:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319183.853045:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412680 x1853163940453888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319183.853062:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.853065:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.853066:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.853068:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4428
00000100:00080000:0.0:1767319183.853070:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.853071:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319183.853079:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073410000 x1853163940454016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319183.853110:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.853112:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.853113:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.853115:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4428
00000100:00080000:0.0:1767319183.853116:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.853118:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319183.853123:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411f80 x1853163940454528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319183.853135:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.853138:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.853139:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.853142:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4428
00000100:00080000:0.0:1767319183.853145:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.853149:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319183.853157:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411500 x1853163940454784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319183.853192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940453888:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.853262:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853322:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940454016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.853345:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853357:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940454528:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.853367:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853387:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940454784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.853399:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853425:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940454656:0@lo:400:kworker.0
00000100:00100000:0.0:1767319183.853438:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853449:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319183.853452:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940454144:0@lo:400:kworker.0
00000100:00100000:0.0:1767319183.853464:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.853487:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940453888
00000100:00100000:0.0:1767319183.853493:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940453888
00000100:00100000:0.0:1767319183.853524:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454528
00000100:00100000:0.0:1767319183.853526:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454528
00000100:00100000:0.0:1767319183.853535:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454784
00000100:00100000:0.0:1767319183.853536:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454784
00000100:00100000:0.0:1767319183.853541:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454656
00000100:00100000:0.0:1767319183.853542:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454656
00000100:00100000:0.0:1767319183.853568:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4337
00000100:00100000:0.0:1767319183.853574:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940454656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319183.853612:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940454656:12345-0@lo:400:kworker.0 Request processed in 39us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319183.853617:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4337
00000100:00100000:0.0:1767319183.853630:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16860
00000100:00100000:0.0:1767319183.853633:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940453888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319183.853651:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319183.853678:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940453888:12345-0@lo:38:kworker.0 Request processed in 43us (416us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319183.853684:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16860
00000100:00100000:0.0:1767319183.853698:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16861
00000100:00100000:0.0:1767319183.853701:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940454528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319183.853710:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319183.853731:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940454528:12345-0@lo:38:kworker.0 Request processed in 28us (361us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319183.853736:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16861
00000100:00100000:0.0:1767319183.853794:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16862
00000100:00100000:0.0:1767319183.853798:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940454784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319183.853807:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319183.853829:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940454784:12345-0@lo:38:kworker.0 Request processed in 29us (428us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319183.853833:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16862
00000100:00100000:0.0:1767319183.853849:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454016
00000100:00100000:0.0:1767319183.853853:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454016
00000100:00100000:3.0:1767319183.853922:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940454272:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.853950:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319183.853972:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319183.853977:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940454400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.853995:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319183.854014:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454400
00000100:00100000:3.0:1767319183.854018:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454400
00000100:00100000:3.0:1767319183.854042:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4338
00000100:00100000:3.0:1767319183.854047:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940454400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854079:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940454400:12345-0@lo:400:kworker.0 Request processed in 31us (82us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.854085:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4338
00000100:00080000:3.0:1767319183.854104:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319183.854117:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454144
00000100:00100000:3.0:1767319183.854120:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454144
00000100:00100000:3.0:1767319183.854157:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454272
00000100:00100000:3.0:1767319183.854161:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454272
00000100:00100000:3.0:1767319183.854181:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826
00000100:00100000:3.0:1767319183.854187:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940454144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854215:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940454144:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.854221:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826
00000100:00100000:3.0:1767319183.854235:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827
00000100:00100000:3.0:1767319183.854241:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940454272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854267:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940454272:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.854273:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827
00000100:00080000:3.0:1767319183.854287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319183.854290:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319183.854313:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940454400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854323:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940454272:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854399:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940454144:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.854408:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940454656:0@lo:400:kworker.0
00000100:00080000:3.0:1767319183.854440:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319183.854445:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319183.854448:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940453888:0@lo:38:kworker.0
00000100:00080000:3.0:1767319183.854456:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319183.854459:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319183.854461:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940454528:0@lo:38:kworker.0
00000100:00080000:3.0:1767319183.854470:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319183.854472:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319183.854475:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940454784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.862308:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49
00000100:00100000:0.0:1767319183.862324:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940454016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319183.862354:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319183.862478:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940454016:12345-0@lo:38:kworker.0 Request processed in 155us (9130us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319183.862486:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49
00000100:00080000:3.0:1767319183.862756:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319183.862763:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319183.862767:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940454016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319184.365886:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319184.365910:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940454912:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319184.365978:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319184.366322:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940454912
00000100:00100000:1.0:1767319184.366331:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940454912
00000100:00100000:1.0:1767319184.366391:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368
00000100:00100000:1.0:1767319184.366401:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940454912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319184.366432:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319184.366488:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940454912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (509us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319184.366495:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368
00000100:00100000:3.0:1767319184.366661:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940454912:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319184.492894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319184.813960:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319184.877014:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319158/real 1767319158]  req@ffff93cf45b91180 x1853163940447360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319184.877049:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45b91180 x1853163940447360/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319184.877067:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319184.877240:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319184.877245:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940447360:0@lo:250:kworker.0
00000100:00080000:2.0:1767319184.878594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319184.878602:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319184.878606:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319184.878611:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4408
00000100:00080000:2.0:1767319184.878615:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319184.878621:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319184.878653:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9a300 x1853163940455040/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319184.878682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319184.878686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319184.878687:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319184.878690:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4433
00000100:00080000:2.0:1767319184.878693:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319184.878695:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319184.878712:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940455168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319184.878720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319184.878723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319184.878724:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319184.878727:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4433
00000100:00080000:2.0:1767319184.878729:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319184.878732:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319184.878787:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1f80 x1853163940455296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319184.878842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319184.878846:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319184.878848:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319184.878852:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4433
00000100:00080000:2.0:1767319184.878854:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319184.878858:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319184.878868:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012300 x1853163940455680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319184.878889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319184.878892:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319184.878894:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319184.878897:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4433
00000100:00080000:2.0:1767319184.878899:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319184.878903:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319184.878912:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940455936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319184.878998:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940455552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319184.879056:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319184.879117:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319184.879124:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940455424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319184.879159:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319184.879195:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455424
00000100:00100000:1.0:1767319184.879203:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455424
00000100:00100000:1.0:1767319184.879242:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828
00000100:00100000:1.0:1767319184.879250:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940455424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319184.879293:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940455424:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319184.879300:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828
00000100:00100000:1.0:1767319184.879340:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940455424:0@lo:400:kworker.0
00000100:00100000:2.0:1767319184.879547:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455552
00000100:00100000:2.0:1767319184.879552:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455552
00000100:00100000:2.0:1767319184.879591:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4339
00000100:00100000:2.0:1767319184.879599:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940455552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319184.879644:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940455552:12345-0@lo:400:kworker.0 Request processed in 47us (588us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319184.879651:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4339
00000100:00100000:0.0:1767319184.879717:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940455552:0@lo:400:kworker.0
00000100:00100000:3.0:1767319184.879929:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319184.879940:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940455808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319184.879971:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319184.880008:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940455040:0@lo:250:kworker.0
00000400:00000100:3.0:1767319184.880028:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940455040 offset 0 length 520: 4
00000100:00100000:3.0:1767319184.880044:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940455168:0@lo:38:kworker.0
00000100:00100000:3.0:1767319184.880061:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319184.880083:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940455296:0@lo:38:kworker.0
00000100:00100000:3.0:1767319184.880107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319184.880353:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455296
00000100:00100000:0.0:1767319184.880357:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455296
00000100:00100000:0.0:1767319184.880390:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50
00000100:00100000:0.0:1767319184.880395:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940455296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319184.880412:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319184.880443:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940455296:12345-0@lo:38:kworker.0 Request processed in 47us (335us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319184.880450:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50
00000100:00100000:3.0:1767319184.880561:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940455680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319184.880588:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319184.880614:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940455936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319184.880636:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319184.880664:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319184.880669:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319184.880671:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940455296:0@lo:38:kworker.0
00000100:00100000:3.0:1767319184.880693:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455808
00000100:00100000:3.0:1767319184.880697:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455808
00000100:00100000:3.0:1767319184.880722:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455168
00000100:00100000:3.0:1767319184.880725:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455168
00000100:00100000:3.0:1767319184.880748:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455680
00000100:00100000:3.0:1767319184.880751:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455680
00000100:00100000:3.0:1767319184.880759:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940455936
00000100:00100000:3.0:1767319184.880761:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940455936
00000100:00100000:3.0:1767319184.880768:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1767319184.880800:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940455808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319184.880834:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940455808:12345-0@lo:400:kworker.0 Request processed in 60us (862us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319184.880839:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1767319184.880852:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16863
00000100:00100000:3.0:1767319184.880857:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455168:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319184.880866:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319184.880891:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455168:12345-0@lo:38:kworker.0 Request processed in 34us (829us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319184.880901:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16863
00000100:00100000:3.0:1767319184.880912:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16864
00000100:00100000:3.0:1767319184.880916:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319184.880924:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319184.880946:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455680:12345-0@lo:38:kworker.0 Request processed in 29us (357us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319184.880951:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16864
00000100:00100000:3.0:1767319184.880962:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16865
00000100:00100000:3.0:1767319184.880965:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319184.880973:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319184.880992:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940455936:12345-0@lo:38:kworker.0 Request processed in 25us (355us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319184.880997:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16865
00000100:00100000:3.0:1767319184.881025:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940455808:0@lo:400:kworker.0
00000100:00080000:3.0:1767319184.881051:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319184.881054:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319184.881057:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940455168:0@lo:38:kworker.0
00000100:00080000:3.0:1767319184.881064:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319184.881067:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319184.881069:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940455680:0@lo:38:kworker.0
00000100:00080000:3.0:1767319184.881075:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319184.881078:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319184.881080:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940455936:0@lo:38:kworker.0
00000100:00100000:0.0:1767319185.389078:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319185.389101:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940456064:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319185.389173:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319185.389279:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456064
00000100:00100000:2.0:1767319185.389288:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456064
00000100:00100000:2.0:1767319185.389357:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369
00000100:00100000:2.0:1767319185.389367:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940456064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319185.389395:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319185.389442:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940456064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319185.389449:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369
00000100:00080000:0.0:1767319185.389545:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319185.389580:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940456064:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319185.517024:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319185.837487:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319186.509264:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319186.509358:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304384
00000100:00100000:1.0:1767319186.509368:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304384
00000100:00100000:1.0:1767319186.509416:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16866
00000100:00100000:1.0:1767319186.509424:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894304384:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319186.509449:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319186.509518:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894304384:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 93us (264us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319186.509526:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16866
00000100:00100000:3.0:1767319186.514428:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319186.514549:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304512
00000100:00100000:1.0:1767319186.514558:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304512
00000100:00100000:1.0:1767319186.514628:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4341
00000100:00100000:1.0:1767319186.514638:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894304512:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319186.514715:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894304512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (297us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319186.514729:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4341
00000100:00080000:0.0:1767319186.514829:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319186.540893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319186.861136:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319187.566061:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319187.885337:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319188.589022:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319188.909013:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319189.485246:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940456192:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319189.485317:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319189.485637:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456192
00000100:00100000:1.0:1767319189.485644:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456192
00000100:00100000:1.0:1767319189.485733:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370
00000100:00100000:1.0:1767319189.485743:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940456192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319189.485865:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319189.485907:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940456192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (590us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319189.485913:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370
00000100:00100000:1.0:1767319189.485951:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940456192:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319189.486207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319189.613270:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319189.938264:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319189.997191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319189.997204:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319189.997206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319189.997211:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319189.997215:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319189.997223:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319189.997228:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319189.997235:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319189.997282:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940456320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319189.997341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940456320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319189.997406:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319189.997511:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456320
00000100:00100000:1.0:1767319189.997519:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456320
00000100:00100000:1.0:1767319189.997556:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16867
00000100:00100000:1.0:1767319189.997563:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940456320:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319189.997584:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319189.998241:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319189.998247:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319189.998250:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319189.998255:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319189.998258:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319189.998263:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319189.998286:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940456448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319189.999469:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940456448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319189.999534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319189.999631:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456448
00000100:00100000:0.0:1767319189.999639:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456448
00000100:00100000:0.0:1767319189.999676:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51
00000100:00100000:0.0:1767319189.999684:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940456448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319189.999714:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319189.999754:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940456448:12345-0@lo:38:kworker.0 Request processed in 69us (219us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319189.999761:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51
00000100:00100000:1.0:1767319190.001600:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940456320:12345-0@lo:38:kworker.0 Request processed in 4026us (4183us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319190.001617:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16867
00000100:00080000:2.0:1767319190.002343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319190.002349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319190.002352:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319190.002357:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319190.002361:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319190.002367:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319190.002388:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2d80 x1853163940456960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319190.002405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319190.002408:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319190.002410:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319190.002413:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319190.002415:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319190.002419:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319190.002429:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940457216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319190.002494:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940456832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319190.002552:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319190.002588:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319190.002594:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940456704:0@lo:400:kworker.0
00000100:00100000:2.0:1767319190.002619:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319190.002807:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456704
00000100:00100000:1.0:1767319190.002814:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456704
00000100:00100000:1.0:1767319190.002870:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1767319190.002879:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940456704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.002932:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940456704:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319190.002939:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1767319190.002983:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940456704:0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003017:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940457088:0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003043:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319190.003061:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319190.003066:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940456576:0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003086:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319190.003107:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456576
00000100:00100000:1.0:1767319190.003111:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456576
00000100:00100000:1.0:1767319190.003512:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830
00000100:00100000:1.0:1767319190.003522:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940456576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003561:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940456576:12345-0@lo:400:kworker.0 Request processed in 42us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319190.003568:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830
00000100:00100000:1.0:1767319190.003587:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456832
00000100:00100000:1.0:1767319190.003591:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456832
00000100:00100000:1.0:1767319190.003615:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457088
00000100:00100000:1.0:1767319190.003618:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457088
00000100:00100000:1.0:1767319190.003641:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4342
00000100:00100000:1.0:1767319190.003647:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940456832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003684:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940456832:12345-0@lo:400:kworker.0 Request processed in 37us (1131us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319190.003701:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4342
00000100:00100000:1.0:1767319190.003713:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4343
00000100:00100000:1.0:1767319190.003719:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940457088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003745:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940457088:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319190.003750:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4343
00000100:00100000:1.0:1767319190.003808:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940456832:0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003834:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940456576:0@lo:400:kworker.0
00000100:00100000:1.0:1767319190.003843:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940457088:0@lo:400:kworker.0
00000100:00080000:2.0:1767319190.008908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319190.008920:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319190.010913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319190.010926:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319190.010931:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940456320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319190.010973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940456960:0@lo:38:kworker.0
00000100:00100000:3.0:1767319190.011051:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319190.011090:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940457216:0@lo:38:kworker.0
00000100:00100000:3.0:1767319190.011116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319190.011151:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319190.011156:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319190.011159:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940456448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319190.011327:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940456960
00000100:00100000:1.0:1767319190.011336:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940456960
00000100:00100000:1.0:1767319190.011378:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457216
00000100:00100000:1.0:1767319190.011382:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457216
00000100:00100000:1.0:1767319190.011413:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16868
00000100:00100000:1.0:1767319190.011420:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940456960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319190.011454:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319190.011501:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940456960:12345-0@lo:38:kworker.0 Request processed in 80us (449us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319190.011508:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16868
00000100:00100000:1.0:1767319190.011527:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16869
00000100:00100000:1.0:1767319190.011531:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940457216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319190.011540:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319190.011565:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940457216:12345-0@lo:38:kworker.0 Request processed in 32us (448us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319190.011570:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16869
00000100:00080000:3.0:1767319190.012132:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319190.012138:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319190.012141:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940456960:0@lo:38:kworker.0
00000100:00080000:3.0:1767319190.012152:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319190.012155:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319190.012158:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940457216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319190.509170:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319190.509202:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940457344:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319190.509261:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319190.509510:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457344
00000100:00100000:1.0:1767319190.509518:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457344
00000100:00100000:1.0:1767319190.509563:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371
00000100:00100000:1.0:1767319190.509569:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940457344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319190.509597:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319190.509645:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940457344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319190.509653:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371
00000100:00100000:2.0:1767319190.509745:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940457344:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319190.636914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319190.956991:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319191.622405:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319191.622759:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304768
00000100:00100000:3.0:1767319191.622815:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304768
00000100:00080000:2.0:1767319191.622965:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319191.623107:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319191.623946:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304640
00000100:00100000:3.0:1767319191.623955:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304640
00000100:00100000:3.0:1767319191.624000:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4344
00000100:00100000:3.0:1767319191.624013:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894304768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319191.624104:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894304768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (1712us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319191.624114:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4344
00000100:00100000:3.0:1767319191.624136:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16870
00000100:00100000:3.0:1767319191.624141:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894304640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319191.624163:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319191.624191:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894304640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (1085us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319191.624197:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16870
00000100:00100000:0.0:1767319191.661002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319191.981274:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319192.685017:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319193.005901:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319193.709852:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319194.029081:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319194.605078:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940457472:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319194.605168:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319194.605470:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457472
00000100:00100000:3.0:1767319194.605480:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457472
00000100:00100000:3.0:1767319194.605555:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372
00000100:00100000:3.0:1767319194.605567:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940457472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319194.605597:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767319194.605707:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319194.608280:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940457472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2707us (3102us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319194.608359:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372
00000100:00100000:0.0:1767319194.608471:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940457472:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319194.732974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319195.053009:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319195.118584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319195.118596:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319195.118600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319195.118604:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319195.118608:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319195.118616:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4440
00000100:00080000:2.0:1767319195.118629:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319195.118637:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319195.118690:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adea00 x1853163940457600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319195.118718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319195.118722:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319195.118724:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319195.118727:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4440
00000100:00080000:2.0:1767319195.118729:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319195.118733:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319195.118748:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf800 x1853163940457728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319195.118837:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319195.118840:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319195.118842:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319195.118846:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4440
00000100:00080000:2.0:1767319195.118848:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319195.118852:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319195.118862:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940458240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319195.118878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319195.118881:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319195.118882:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319195.118885:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4440
00000100:00080000:2.0:1767319195.118887:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319195.118891:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319195.118927:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9c00 x1853163940458496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319195.118957:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940457984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119017:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319195.119069:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940458368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119076:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319195.119081:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940458112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319195.119101:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319195.119127:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319195.119130:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458368
00000100:00100000:0.0:1767319195.119132:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940457856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119137:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458368
00000100:00100000:0.0:1767319195.119153:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319195.119176:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457984
00000100:00100000:2.0:1767319195.119190:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4345
00000100:00100000:2.0:1767319195.119200:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940458368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119250:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940458368:12345-0@lo:400:kworker.0 Request processed in 52us (147us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319195.119257:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4345
00000100:00080000:2.0:1767319195.119279:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319195.119302:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319195.119323:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458112
00000100:00100000:2.0:1767319195.119327:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458112
00000100:00100000:0.0:1767319195.119333:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457984
00000100:00100000:2.0:1767319195.119354:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4346
00000100:00100000:0.0:1767319195.119359:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457856
00000100:00100000:2.0:1767319195.119359:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940458112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319195.119362:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457856
00000100:00100000:0.0:1767319195.119378:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831
00000100:00100000:0.0:1767319195.119384:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940457984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119389:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940458112:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319195.119396:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4346
00000100:00080000:2.0:1767319195.119409:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319195.119412:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319195.119413:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940457984:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319195.119419:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831
00000100:00100000:0.0:1767319195.119431:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832
00000100:00100000:0.0:1767319195.119437:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940457856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119439:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940458112:0@lo:400:kworker.0
00000100:00100000:2.0:1767319195.119449:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940457984:0@lo:400:kworker.0
00000100:00100000:0.0:1767319195.119459:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940457856:12345-0@lo:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319195.119465:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832
00000100:00100000:0.0:1767319195.119487:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940457856:0@lo:400:kworker.0
00000100:00100000:0.0:1767319195.119496:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940458368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319195.120823:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940457600:0@lo:38:kworker.0
00000100:00100000:3.0:1767319195.120882:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319195.120925:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940457728:0@lo:38:kworker.0
00000100:00100000:3.0:1767319195.120952:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319195.120978:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940458240:0@lo:38:kworker.0
00000100:00100000:3.0:1767319195.121000:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319195.121027:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940458496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319195.121047:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319195.121075:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457600
00000100:00100000:3.0:1767319195.121080:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457600
00000100:00100000:3.0:1767319195.121112:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458240
00000100:00100000:3.0:1767319195.121116:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458240
00000100:00100000:3.0:1767319195.121128:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458496
00000100:00100000:3.0:1767319195.121130:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458496
00000100:00100000:3.0:1767319195.121144:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16871
00000100:00100000:3.0:1767319195.121151:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940457600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319195.121171:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319195.121195:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940457728
00000100:00100000:0.0:1767319195.121202:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940457728
00000100:00100000:3.0:1767319195.121208:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940457600:12345-0@lo:38:kworker.0 Request processed in 56us (324us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319195.121216:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16871
00000100:00100000:0.0:1767319195.121232:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52
00000100:00100000:3.0:1767319195.121240:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16872
00000100:00100000:0.0:1767319195.121242:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940457728:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319195.121250:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940458240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319195.121260:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767319195.121264:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319195.121309:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940457728:12345-0@lo:38:kworker.0 Request processed in 67us (354us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319195.121311:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940458240:12345-0@lo:38:kworker.0 Request processed in 61us (309us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319195.121326:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52
00000100:00100000:3.0:1767319195.121327:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16872
00000100:00100000:3.0:1767319195.121348:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16873
00000100:00100000:3.0:1767319195.121354:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940458496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319195.121363:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319195.121388:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940458496:12345-0@lo:38:kworker.0 Request processed in 33us (339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319195.121395:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16873
00000100:00080000:3.0:1767319195.121429:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319195.121434:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319195.121438:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940458496:0@lo:38:kworker.0
00000100:00080000:3.0:1767319195.121458:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319195.121462:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319195.121464:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940457600:0@lo:38:kworker.0
00000100:00080000:3.0:1767319195.121471:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319195.121473:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319195.121475:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940457728:0@lo:38:kworker.0
00000100:00080000:3.0:1767319195.121481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319195.121484:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319195.121486:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940458240:0@lo:38:kworker.0
00000100:00100000:0.0:1767319195.629599:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319195.629626:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940458624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319195.629730:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319195.630007:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458624
00000100:00100000:1.0:1767319195.630016:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458624
00000100:00100000:1.0:1767319195.630070:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373
00000100:00100000:1.0:1767319195.630080:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940458624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319195.630109:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319195.630163:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940458624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (432us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319195.630170:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373
00000100:00100000:0.0:1767319195.630254:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940458624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319195.757230:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319196.078270:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319196.744659:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319196.744727:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319196.744840:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894304896
00000100:00100000:2.0:1767319196.744854:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894304896
00000100:00100000:2.0:1767319196.744909:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305024
00000100:00100000:2.0:1767319196.744913:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305024
00000100:00100000:2.0:1767319196.744983:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4347
00000100:00100000:2.0:1767319196.744995:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319196.745077:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319196.745084:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4347
00000100:00100000:2.0:1767319196.745103:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16874
00000100:00100000:2.0:1767319196.745108:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894304896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319196.745128:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319196.745157:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894304896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (514us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319196.745164:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16874
00000100:00080000:0.0:1767319196.745547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319196.780921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319197.101439:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319197.804950:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319198.125444:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319198.828902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319199.148988:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319199.727150:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940458752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319199.727222:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319199.727725:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458752
00000100:00100000:1.0:1767319199.727734:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458752
00000100:00100000:1.0:1767319199.727915:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374
00000100:00100000:1.0:1767319199.727926:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940458752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319199.727955:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319199.728011:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940458752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (788us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319199.728018:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374
00000100:00080000:0.0:1767319199.728052:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319199.728129:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940458752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319199.853068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319200.173066:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319200.237159:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319200.237170:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319200.237172:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319200.237176:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319200.237181:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319200.237189:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4445
00000100:00080000:3.0:1767319200.237194:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319200.237200:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319200.237238:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf800 x1853163940458880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319200.237261:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319200.237264:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319200.237266:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319200.237269:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4445
00000100:00080000:3.0:1767319200.237272:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319200.237275:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319200.237287:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adea00 x1853163940459008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319200.237367:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319200.237371:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319200.237373:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319200.237376:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4445
00000100:00080000:3.0:1767319200.237378:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319200.237382:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319200.237392:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879c380 x1853163940459520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319200.237406:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319200.237409:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319200.237411:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319200.237414:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4445
00000100:00080000:3.0:1767319200.237416:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319200.237419:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319200.237428:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f480 x1853163940459776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319200.237454:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940459264:0@lo:400:kworker.0
00000100:00100000:3.0:1767319200.237509:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319200.237675:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940458880:0@lo:38:kworker.0
00000100:00100000:0.0:1767319200.237707:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319200.237724:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940459008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319200.237741:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319200.237755:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940459520:0@lo:38:kworker.0
00000100:00100000:0.0:1767319200.237793:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319200.237807:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940459776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319200.237825:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319200.237853:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459008
00000100:00100000:0.0:1767319200.237859:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459008
00000100:00100000:0.0:1767319200.237887:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53
00000100:00100000:0.0:1767319200.237893:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940459008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319200.237912:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319200.237944:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940459008:12345-0@lo:38:kworker.0 Request processed in 50us (201us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319200.237951:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53
00000100:00080000:0.0:1767319200.237982:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319200.237986:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319200.238004:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940459008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319200.238042:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459264
00000100:00100000:0.0:1767319200.238045:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459264
00000100:00100000:0.0:1767319200.238077:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833
00000100:00100000:0.0:1767319200.238082:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940459264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319200.238113:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940459264:12345-0@lo:400:kworker.0 Request processed in 31us (604us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319200.238118:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833
00000100:00100000:0.0:1767319200.238133:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940459392:0@lo:400:kworker.0
00000100:00100000:0.0:1767319200.238154:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319200.238179:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319200.238200:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940458880
00000100:00100000:0.0:1767319200.238204:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940458880
00000100:00100000:0.0:1767319200.238221:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459520
00000100:00100000:0.0:1767319200.238224:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459520
00000100:00100000:0.0:1767319200.238234:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459776
00000100:00100000:0.0:1767319200.238236:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459776
00000100:00100000:0.0:1767319200.238243:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459392
00000100:00100000:0.0:1767319200.238245:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459392
00000100:00100000:0.0:1767319200.238263:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4348
00000100:00100000:0.0:1767319200.238269:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940459392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319200.238301:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940459392:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319200.238307:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4348
00000100:00100000:0.0:1767319200.238319:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16875
00000100:00100000:0.0:1767319200.238323:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940458880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319200.238332:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319200.238359:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940458880:12345-0@lo:38:kworker.0 Request processed in 35us (652us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319200.238365:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16875
00000100:00100000:0.0:1767319200.238376:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16876
00000100:00100000:0.0:1767319200.238380:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940459520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319200.238388:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319200.238409:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940459520:12345-0@lo:38:kworker.0 Request processed in 28us (616us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319200.238415:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16876
00000100:00100000:0.0:1767319200.238425:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16877
00000100:00100000:0.0:1767319200.238429:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940459776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319200.238437:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319200.238460:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940459776:12345-0@lo:38:kworker.0 Request processed in 29us (634us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319200.238465:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16877
00000100:00080000:0.0:1767319200.238487:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319200.238504:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940459392:0@lo:400:kworker.0
00000100:00080000:0.0:1767319200.238523:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319200.238527:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319200.238529:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940458880:0@lo:38:kworker.0
00000100:00080000:0.0:1767319200.238536:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319200.238539:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319200.238541:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940459520:0@lo:38:kworker.0
00000100:00080000:0.0:1767319200.238547:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319200.238549:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319200.238552:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940459776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319200.238681:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940459264:0@lo:400:kworker.0
00000100:00100000:1.0:1767319200.238849:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940459648:0@lo:400:kworker.0
00000100:00100000:1.0:1767319200.238881:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319200.238910:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319200.238916:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940459136:0@lo:400:kworker.0
00000100:00100000:1.0:1767319200.238940:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319200.238962:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459136
00000100:00100000:1.0:1767319200.238965:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459136
00000100:00100000:1.0:1767319200.238992:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834
00000100:00100000:1.0:1767319200.238998:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940459136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319200.239031:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940459136:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319200.239037:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834
00000100:00100000:1.0:1767319200.239064:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940459136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319200.239360:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459648
00000100:00100000:2.0:1767319200.239365:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459648
00000100:00100000:2.0:1767319200.239407:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4349
00000100:00100000:2.0:1767319200.239413:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940459648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319200.239449:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940459648:12345-0@lo:400:kworker.0 Request processed in 37us (568us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319200.239455:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4349
00000100:00100000:2.0:1767319200.239478:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940459648:0@lo:400:kworker.0
00000100:00080000:0.0:1767319200.241406:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319200.749281:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940459904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319200.749356:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319200.749499:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940459904
00000100:00100000:1.0:1767319200.749509:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940459904
00000100:00100000:1.0:1767319200.749563:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375
00000100:00100000:1.0:1767319200.749572:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940459904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319200.749619:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319200.749678:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940459904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319200.749685:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375
00000100:00100000:2.0:1767319200.749771:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940459904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319200.877134:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319201.197180:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319201.863952:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319201.864095:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894305152 offset 0 length 520: 4
00000100:00100000:3.0:1767319201.864164:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319201.864963:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305408
00000100:00100000:1.0:1767319201.864975:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305408
00000100:00100000:1.0:1767319201.865289:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305280
00000100:00100000:1.0:1767319201.865294:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305280
00000100:00100000:1.0:1767319201.865320:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4350
00000100:00100000:1.0:1767319201.865330:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305408:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319201.865408:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305408:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (1465us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319201.865417:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4350
00000100:00100000:1.0:1767319201.865437:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16878
00000100:00100000:1.0:1767319201.865441:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894305280:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319201.865464:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319201.865489:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894305280:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (1326us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319201.865496:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16878
00000100:00080000:2.0:1767319201.865714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319201.901492:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319202.221174:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319202.924882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319203.245245:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319203.949882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319204.275262:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319204.845600:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319204.845625:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940460032:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319204.845708:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319204.846023:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460032
00000100:00100000:1.0:1767319204.846033:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460032
00000100:00100000:1.0:1767319204.846117:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376
00000100:00100000:1.0:1767319204.846127:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940460032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319204.846160:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319204.846208:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940460032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319204.846215:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376
00000100:00100000:0.0:1767319204.846385:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940460032:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319204.846499:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319204.972902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319205.293615:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319205.357300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319205.357312:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319205.357315:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319205.357319:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319205.357332:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319205.357340:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4450
00000100:00080000:2.0:1767319205.357345:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319205.357351:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319205.357404:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eaa00 x1853163940460160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319205.357431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319205.357435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319205.357436:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319205.357440:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4450
00000100:00080000:2.0:1767319205.357442:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319205.357446:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319205.357458:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8700 x1853163940460288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319205.357525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319205.357528:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319205.357530:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319205.357533:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4450
00000100:00080000:2.0:1767319205.357535:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319205.357540:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319205.357563:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940460800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319205.357581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319205.357585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319205.357587:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319205.357591:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4450
00000100:00080000:2.0:1767319205.357593:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319205.357598:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319205.357600:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940460416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319205.357610:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9f80 x1853163940461056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319205.357638:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940460672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319205.357675:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319205.357681:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319205.357750:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940460544:0@lo:400:kworker.0
00000100:00100000:1.0:1767319205.357754:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319205.357763:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940460928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319205.357803:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319205.357873:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460672
00000100:00100000:0.0:1767319205.357881:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460672
00000100:00100000:0.0:1767319205.357936:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351
00000100:00100000:0.0:1767319205.357946:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940460672:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319205.358589:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319205.358623:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460416
00000100:00100000:2.0:1767319205.358628:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460416
00000100:00100000:2.0:1767319205.358661:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460544
00000100:00100000:2.0:1767319205.358664:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460544
00000100:00100000:2.0:1767319205.358693:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835
00000100:00100000:2.0:1767319205.358700:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940460416:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319205.359084:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319205.359107:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836
00000100:00100000:3.0:1767319205.359118:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940460544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319205.359205:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940460672:12345-0@lo:400:kworker.0 Request processed in 1262us (1526us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319205.359212:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351
00000100:00100000:0.0:1767319205.359264:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940460672:0@lo:400:kworker.0
00000100:00100000:0.0:1767319205.359287:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940460160:0@lo:38:kworker.0
00000100:00100000:0.0:1767319205.359308:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319205.359319:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940460288:0@lo:38:kworker.0
00000100:00100000:0.0:1767319205.359332:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319205.359341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940460800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319205.359351:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319205.359358:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940461056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319205.359368:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319205.359387:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460288
00000100:00100000:0.0:1767319205.359389:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460288
00000100:00100000:0.0:1767319205.359402:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54
00000100:00100000:0.0:1767319205.359405:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940460288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319205.359422:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319205.359453:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940460288:12345-0@lo:38:kworker.0 Request processed in 46us (118us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319205.359459:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54
00000100:00080000:0.0:1767319205.359481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319205.359485:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319205.359487:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940460288:0@lo:38:kworker.0
00000100:00100000:0.0:1767319205.359497:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460160
00000100:00100000:0.0:1767319205.359499:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460160
00000100:00100000:0.0:1767319205.359514:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460800
00000100:00100000:0.0:1767319205.359517:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460800
00000100:00100000:0.0:1767319205.359527:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461056
00000100:00100000:0.0:1767319205.359529:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461056
00000100:00100000:0.0:1767319205.359540:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16879
00000100:00100000:0.0:1767319205.359544:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940460160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319205.359568:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319205.359595:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940460160:12345-0@lo:38:kworker.0 Request processed in 48us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319205.359600:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16879
00000100:00100000:0.0:1767319205.359610:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16880
00000100:00100000:0.0:1767319205.359612:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940460800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319205.359619:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319205.359641:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940460800:12345-0@lo:38:kworker.0 Request processed in 26us (288us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319205.359646:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16880
00000100:00100000:0.0:1767319205.359657:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16881
00000100:00100000:0.0:1767319205.359661:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940461056:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319205.359669:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319205.359689:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940461056:12345-0@lo:38:kworker.0 Request processed in 28us (320us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319205.360075:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16881
00000100:00080000:0.0:1767319205.360110:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319205.360114:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319205.360117:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940460160:0@lo:38:kworker.0
00000100:00080000:0.0:1767319205.360124:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319205.360128:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319205.360130:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940460800:0@lo:38:kworker.0
00000100:00080000:0.0:1767319205.360137:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319205.360140:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319205.360143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940461056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319205.363239:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319205.363319:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940460928
00000100:00100000:1.0:1767319205.363329:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940460928
00000100:00100000:1.0:1767319205.363413:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352
00000100:00100000:2.0:1767319205.363415:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940460416:12345-0@lo:400:kworker.0 Request processed in 4711us (5737us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319205.363429:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835
00000100:00080000:0.0:1767319205.363511:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319205.363567:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940460416:0@lo:400:kworker.0
00000100:00100000:3.0:1767319205.363688:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940460544:12345-0@lo:400:kworker.0 Request processed in 4573us (5883us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319205.363696:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836
00000100:00100000:2.0:1767319205.363753:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940460544:0@lo:400:kworker.0
00000100:00100000:1.0:1767319205.363989:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940460928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319205.364054:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940460928:12345-0@lo:400:kworker.0 Request processed in 631us (823us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319205.364062:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352
00000100:00100000:0.0:1767319205.364256:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940460928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319205.869794:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940461184:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319205.869875:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319205.869922:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461184
00000100:00100000:3.0:1767319205.869931:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461184
00000100:00100000:3.0:1767319205.870061:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377
00000100:00100000:3.0:1767319205.870071:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940461184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319205.870105:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319205.870302:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940461184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 232us (426us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319205.870310:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377
00000100:00100000:0.0:1767319205.871975:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940461184:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319205.996905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319206.318295:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319206.984178:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319206.984301:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319206.984465:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305664
00000100:00100000:1.0:1767319206.984476:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305664
00000100:00100000:1.0:1767319206.984614:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305536
00000100:00100000:1.0:1767319206.984618:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305536
00000100:00100000:1.0:1767319206.984643:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4353
00000100:00100000:1.0:1767319206.984653:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305664:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319206.984748:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305664:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (582us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319206.984756:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4353
00000100:00100000:1.0:1767319206.984811:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16882
00000100:00100000:1.0:1767319206.984817:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894305536:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319206.984852:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319206.984889:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894305536:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 69us (587us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319206.984895:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16882
00000100:00080000:3.0:1767319206.985018:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319207.020958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319207.341557:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319208.044896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319208.365345:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319209.068901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319209.388979:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319209.453365:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319184/real 1767319184]  req@ffff93d046b9a300 x1853163940455040/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319209.453398:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d046b9a300 x1853163940455040/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319209.453417:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319209.453443:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319209.453447:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940455040:0@lo:250:kworker.0
00000100:00080000:2.0:1767319209.453563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319209.453569:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319209.453572:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319209.453577:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319209.453582:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319209.453590:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319209.453636:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eb800 x1853163940461312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319209.453665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319209.453669:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319209.453670:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319209.453674:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4455
00000100:00080000:2.0:1767319209.453677:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319209.453689:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319209.453704:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eb100 x1853163940461440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319209.453715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319209.453718:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319209.453720:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319209.453724:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4455
00000100:00080000:2.0:1767319209.453726:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319209.453729:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319209.453740:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea300 x1853163940461568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319209.453831:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940461696:0@lo:400:kworker.0
00000100:00100000:3.0:1767319209.453939:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319209.454000:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461696
00000100:00100000:1.0:1767319209.454013:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461696
00000100:00100000:0.0:1767319209.454079:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940461312:0@lo:250:kworker.0
00000100:00100000:1.0:1767319209.454109:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837
00000400:00000100:0.0:1767319209.454121:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940461312 offset 0 length 520: 4
00000100:00100000:1.0:1767319209.454123:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940461696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.454146:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940461440:0@lo:38:kworker.0
00000100:00100000:0.0:1767319209.454255:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.454278:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940461568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319209.454323:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.454357:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940461824:0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.454380:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.454409:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461440
00000100:00100000:0.0:1767319209.454413:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461440
00000100:00100000:0.0:1767319209.454466:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16883
00000100:00100000:0.0:1767319209.454472:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940461440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319209.454492:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319209.454558:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940461440:12345-0@lo:38:kworker.0 Request processed in 84us (373us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319209.454565:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16883
00000100:00100000:0.0:1767319209.454604:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461568
00000100:00100000:0.0:1767319209.454608:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461568
00000100:00100000:0.0:1767319209.454627:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55
00000100:00100000:0.0:1767319209.454631:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940461568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319209.454642:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319209.454668:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940461568:12345-0@lo:38:kworker.0 Request processed in 35us (344us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319209.454675:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55
00000100:00100000:0.0:1767319209.454693:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461824
00000100:00100000:0.0:1767319209.454697:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461824
00000100:00100000:0.0:1767319209.454735:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838
00000100:00100000:0.0:1767319209.454743:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940461824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.454797:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940461824:12345-0@lo:400:kworker.0 Request processed in 55us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319209.454806:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838
00000100:00100000:0.0:1767319209.454859:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940461824:0@lo:400:kworker.0
00000100:00080000:0.0:1767319209.454886:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319209.454891:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319209.454894:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940461440:0@lo:38:kworker.0
00000100:00080000:0.0:1767319209.454901:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319209.454904:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319209.454907:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940461568:0@lo:38:kworker.0
00000100:00080000:0.0:1767319209.454967:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319209.454971:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319209.461220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319209.461227:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319209.461232:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319209.461241:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4455
00000100:00080000:2.0:1767319209.461246:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319209.461287:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319209.461320:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eb100 x1853163940462080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319209.461344:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319209.461347:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319209.461349:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319209.461353:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4455
00000100:00080000:2.0:1767319209.461356:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319209.461359:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319209.461369:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ebb80 x1853163940462336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319209.461575:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940461952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.461661:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.461725:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319209.461731:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940462208:0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.461768:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.461837:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940461952
00000100:00100000:0.0:1767319209.461847:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940461952
00000100:00100000:2.0:1767319209.461929:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462208
00000100:00100000:2.0:1767319209.461935:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462208
00000100:00100000:2.0:1767319209.461989:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4354
00000100:00100000:2.0:1767319209.461999:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940461952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319209.462055:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940461952:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319209.462063:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4354
00000100:00100000:2.0:1767319209.462081:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4355
00000100:00100000:2.0:1767319209.462087:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940462208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319209.462113:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940462208:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319209.462119:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4355
00000100:00100000:2.0:1767319209.462143:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940462080:0@lo:38:kworker.0
00000100:00100000:2.0:1767319209.462173:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319209.462178:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319209.462190:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462080
00000100:00100000:0.0:1767319209.462195:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462080
00000100:00100000:2.0:1767319209.462196:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940462336:0@lo:38:kworker.0
00000100:00100000:0.0:1767319209.462219:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16884
00000100:00100000:2.0:1767319209.462226:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319209.462228:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940462080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319209.462249:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319209.462275:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462336
00000100:00100000:2.0:1767319209.462282:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462336
00000100:00100000:0.0:1767319209.462289:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940462080:12345-0@lo:38:kworker.0 Request processed in 61us (115us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319209.462300:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16884
00000100:00100000:2.0:1767319209.462309:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16885
00000100:00100000:2.0:1767319209.462315:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940462336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319209.462328:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319209.462348:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940462208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319209.462360:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940462336:12345-0@lo:38:kworker.0 Request processed in 44us (136us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319209.462365:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940461952:0@lo:400:kworker.0
00000100:00100000:2.0:1767319209.462373:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16885
00000100:00080000:0.0:1767319209.462406:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319209.462412:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319209.462416:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940462080:0@lo:38:kworker.0
00000100:00080000:0.0:1767319209.462426:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319209.462431:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319209.462434:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940462336:0@lo:38:kworker.0
00000100:00100000:1.0:1767319209.463470:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940461696:12345-0@lo:400:kworker.0 Request processed in 9343us (9523us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319209.463490:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837
00000100:00100000:3.0:1767319209.463723:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940461696:0@lo:400:kworker.0
00000100:00100000:0.0:1767319209.964986:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319209.965083:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940462464:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319209.965196:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319209.967027:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462464
00000100:00100000:1.0:1767319209.967044:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462464
00000100:00100000:1.0:1767319209.967121:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378
00000100:00100000:1.0:1767319209.967131:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940462464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319209.967216:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319209.967294:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940462464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (2150us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319209.967302:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378
00000100:00100000:0.0:1767319209.967424:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940462464:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319210.094106:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319210.413047:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319210.992096:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940462592:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319210.992166:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319210.992322:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462592
00000100:00100000:1.0:1767319210.992331:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462592
00000100:00100000:1.0:1767319210.992382:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379
00000100:00100000:1.0:1767319210.992391:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940462592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319210.992428:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319210.992481:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940462592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (314us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319210.992488:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379
00000100:00100000:0.0:1767319210.992642:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940462592:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319211.117373:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319211.439220:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319212.104582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319212.104727:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319212.105632:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305920
00000100:00100000:2.0:1767319212.105770:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305920
00000100:00100000:2.0:1767319212.106032:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894305792
00000100:00100000:2.0:1767319212.106037:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894305792
00000100:00100000:3.0:1767319212.106169:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4356
00000100:00100000:3.0:1767319212.106229:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319212.106315:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894305920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 136us (1742us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319212.106323:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4356
00000100:00100000:3.0:1767319212.106344:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16886
00000100:00100000:3.0:1767319212.106348:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894305792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319212.106368:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319212.106395:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894305792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (1668us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319212.106402:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16886
00000100:00080000:0.0:1767319212.106430:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319212.140904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319212.461348:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319213.164910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319213.486312:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319214.192018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319214.516944:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319214.579415:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319214.579428:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319214.579443:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319214.579447:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319214.579451:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319214.579459:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4459
00000100:00080000:0.0:1767319214.579473:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319214.579524:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319214.579569:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dd500 x1853163940462720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319214.579605:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319214.579610:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319214.579611:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319214.579627:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4459
00000100:00080000:0.0:1767319214.579630:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319214.579633:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319214.579647:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df800 x1853163940462848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319214.579749:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319214.579753:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319214.579754:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319214.579758:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4459
00000100:00080000:0.0:1767319214.579760:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319214.579764:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319214.579835:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940463360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319214.579853:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319214.579856:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319214.579858:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319214.579861:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4459
00000100:00080000:0.0:1767319214.579864:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319214.579867:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319214.579877:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019500 x1853163940463616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319214.579909:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940463488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319214.579978:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319214.580059:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319214.580066:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940463232:0@lo:400:kworker.0
00000100:00100000:0.0:1767319214.580088:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319214.580191:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940463104:0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580226:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319214.580265:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319214.580270:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940462976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580291:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319214.580324:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463488
00000100:00100000:3.0:1767319214.580332:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463488
00000100:00100000:3.0:1767319214.580385:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463232
00000100:00100000:3.0:1767319214.580388:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463232
00000100:00100000:3.0:1767319214.580416:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4357
00000100:00100000:3.0:1767319214.580425:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940463488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580489:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940463488:12345-0@lo:400:kworker.0 Request processed in 64us (511us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319214.580497:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4357
00000100:00100000:3.0:1767319214.580515:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358
00000100:00100000:3.0:1767319214.580521:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940463232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580544:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940463232:12345-0@lo:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319214.580549:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358
00000100:00100000:3.0:1767319214.580567:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463104
00000100:00100000:3.0:1767319214.580570:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463104
00000100:00100000:3.0:1767319214.580613:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462976
00000100:00100000:3.0:1767319214.580616:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462976
00000100:00100000:3.0:1767319214.580635:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839
00000100:00100000:3.0:1767319214.580642:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940463104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580675:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940463104:12345-0@lo:400:kworker.0 Request processed in 33us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319214.580680:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839
00000100:00100000:3.0:1767319214.580692:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840
00000100:00100000:3.0:1767319214.580698:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940462976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580725:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940462976:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319214.580730:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840
00000100:00080000:3.0:1767319214.580747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319214.580751:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319214.580754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319214.580808:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940462976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580820:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940463104:0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580848:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940463232:0@lo:400:kworker.0
00000100:00100000:3.0:1767319214.580857:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940463488:0@lo:400:kworker.0
00000100:00100000:2.0:1767319214.580955:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940462720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319214.580986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319214.581012:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940462848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319214.581035:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319214.581054:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940463360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319214.581073:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319214.581088:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940463616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319214.581107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319214.581138:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462848
00000100:00100000:2.0:1767319214.581142:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462848
00000100:00100000:2.0:1767319214.581165:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56
00000100:00100000:2.0:1767319214.581169:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940462848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319214.581187:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319214.581221:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940462848:12345-0@lo:38:kworker.0 Request processed in 50us (185us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319214.581227:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56
00000100:00100000:2.0:1767319214.581248:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940462720
00000100:00100000:2.0:1767319214.581252:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940462720
00000100:00100000:2.0:1767319214.581267:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463360
00000100:00100000:2.0:1767319214.581270:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463360
00000100:00100000:2.0:1767319214.581281:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463616
00000100:00100000:2.0:1767319214.581284:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463616
00000100:00100000:2.0:1767319214.581293:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16887
00000100:00100000:2.0:1767319214.581297:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940462720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319214.581306:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319214.581330:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940462720:12345-0@lo:38:kworker.0 Request processed in 31us (343us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319214.581336:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16887
00000100:00100000:2.0:1767319214.581346:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16888
00000100:00100000:2.0:1767319214.581350:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940463360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319214.581358:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319214.581378:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940463360:12345-0@lo:38:kworker.0 Request processed in 27us (304us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319214.581383:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16888
00000100:00100000:2.0:1767319214.581392:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16889
00000100:00100000:2.0:1767319214.581396:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940463616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319214.581406:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319214.581424:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940463616:12345-0@lo:38:kworker.0 Request processed in 27us (316us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319214.581429:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16889
00000100:00080000:2.0:1767319214.581452:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319214.581457:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319214.581460:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940462720:0@lo:38:kworker.0
00000100:00080000:2.0:1767319214.581502:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319214.581506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319214.581509:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940462848:0@lo:38:kworker.0
00000100:00080000:2.0:1767319214.581516:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319214.581520:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319214.581522:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940463360:0@lo:38:kworker.0
00000100:00080000:2.0:1767319214.581529:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319214.581531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319214.581534:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940463616:0@lo:38:kworker.0
00000100:00100000:0.0:1767319215.086515:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940463744:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319215.086607:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319215.087973:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463744
00000100:00100000:2.0:1767319215.087985:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463744
00000100:00100000:2.0:1767319215.088050:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380
00000100:00100000:2.0:1767319215.088059:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940463744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319215.088092:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319215.088243:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940463744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (1634us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319215.088251:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380
00000100:00100000:0.0:1767319215.097293:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940463744:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319215.212912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319215.533229:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319216.112285:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319216.112310:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940463872:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319216.112384:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319216.112588:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940463872
00000100:00100000:1.0:1767319216.112597:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940463872
00000100:00100000:1.0:1767319216.112667:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381
00000100:00100000:1.0:1767319216.112676:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940463872:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319216.112710:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319216.112759:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940463872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319216.112766:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381
00000100:00080000:0.0:1767319216.112854:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319216.112897:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940463872:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319216.236911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319216.557899:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319217.228113:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319217.228218:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319217.232990:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306176
00000100:00100000:3.0:1767319217.233007:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306176
00000100:00100000:3.0:1767319217.233087:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306048
00000100:00100000:3.0:1767319217.233090:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306048
00000100:00100000:3.0:1767319217.233111:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4359
00000100:00100000:3.0:1767319217.233123:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319217.233257:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 136us (5152us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319217.233264:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4359
00000100:00100000:3.0:1767319217.233287:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16890
00000100:00100000:3.0:1767319217.233291:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319217.233313:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319217.233338:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (5121us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319217.233344:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16890
00000100:00080000:0.0:1767319217.234102:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319217.261711:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319217.582916:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319218.284941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319218.605029:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319219.310075:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319219.629430:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319219.693212:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319219.693231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319219.693234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319219.693238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319219.693243:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319219.693251:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4464
00000100:00080000:3.0:1767319219.693256:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319219.693264:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319219.693317:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879d880 x1853163940464000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319219.693354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319219.693358:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319219.693360:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319219.693363:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4464
00000100:00080000:3.0:1767319219.693366:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319219.693369:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319219.693384:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f100 x1853163940464128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319219.693450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319219.693453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319219.693455:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319219.693458:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4464
00000100:00080000:3.0:1767319219.693461:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319219.693464:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319219.693476:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879e680 x1853163940464640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319219.693492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319219.693495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319219.693496:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319219.693500:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4464
00000100:00100000:1.0:1767319219.693561:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940464384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.693615:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940464256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319219.693646:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319219.693683:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940464512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.693733:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319219.693767:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464384
00000100:00100000:1.0:1767319219.693798:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464384
00000100:00100000:0.0:1767319219.693807:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319219.693816:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940464768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.693839:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319219.693882:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464512
00000100:00100000:0.0:1767319219.693886:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464512
00000100:00100000:0.0:1767319219.693936:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464768
00000100:00100000:2.0:1767319219.693946:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940464000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319219.693954:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464768
00000100:00100000:1.0:1767319219.693958:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841
00000100:00100000:1.0:1767319219.693970:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940464384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.693995:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4360
00000100:00100000:0.0:1767319219.694009:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940464512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319219.694009:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319219.694044:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940464128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319219.694062:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940464512:12345-0@lo:400:kworker.0 Request processed in 58us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319219.694070:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4360
00000100:00100000:0.0:1767319219.694087:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464000
00000100:00100000:2.0:1767319219.694089:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319219.694092:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464000
00000100:00100000:2.0:1767319219.694112:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940464640:0@lo:38:kworker.0
00000100:00100000:0.0:1767319219.694116:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4361
00000100:00100000:0.0:1767319219.694126:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940464768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319219.694140:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319219.694164:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940464768:12345-0@lo:400:kworker.0 Request processed in 40us (325us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319219.694172:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4361
00000100:00100000:2.0:1767319219.694174:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464640
00000100:00100000:2.0:1767319219.694179:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464640
00000100:00100000:0.0:1767319219.694192:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16891
00000100:00100000:0.0:1767319219.694198:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940464000:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319219.694203:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16892
00000100:00100000:2.0:1767319219.694210:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940464640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319219.694234:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319219.694239:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940464384:12345-0@lo:400:kworker.0 Request processed in 64us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319219.694249:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841
00000100:00100000:0.0:1767319219.694271:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940464000:12345-0@lo:38:kworker.0 Request processed in 71us (265us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319219.694278:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16891
00000100:00080000:1.0:1767319219.694278:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319219.694287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319219.694305:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319219.694329:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940464384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.694355:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940464768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319219.694358:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464256
00000100:00100000:1.0:1767319219.694364:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464256
00000100:00100000:0.0:1767319219.694369:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940464512:0@lo:400:kworker.0
00000100:00100000:1.0:1767319219.694400:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842
00000100:00080000:0.0:1767319219.694401:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319219.694410:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940464256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319219.694444:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464128
00000100:00100000:0.0:1767319219.694449:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464128
00000100:00100000:1.0:1767319219.694469:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940464256:12345-0@lo:400:kworker.0 Request processed in 62us (164us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319219.694474:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57
00000100:00100000:1.0:1767319219.694487:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842
00000100:00100000:0.0:1767319219.694488:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940464128:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319219.694526:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940464256:0@lo:400:kworker.0
00000100:00080000:3.0:1767319219.694611:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319219.694616:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319219.694633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879c380 x1853163940464896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319219.694665:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940464896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319219.694707:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319219.694736:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319219.694741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319219.694744:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940464000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319219.694765:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940464896
00000100:00100000:3.0:1767319219.694768:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940464896
00000100:00100000:3.0:1767319219.694801:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16893
00000100:00100000:3.0:1767319219.694806:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940464896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319219.696710:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319219.696828:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940464640:12345-0@lo:38:kworker.0 Request processed in 2615us (2686us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319219.696841:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16892
00000100:00080000:1.0:1767319219.697132:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319219.697138:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319219.697142:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940464640:0@lo:38:kworker.0
00010000:00020000:0.0:1767319219.698649:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319219.698805:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940464128:12345-0@lo:38:kworker.0 Request processed in 4318us (4714us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319219.698818:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57
00010000:00020000:3.0:1767319219.698912:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319219.698965:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940464896:12345-0@lo:38:kworker.0 Request processed in 4157us (4256us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319219.698973:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16893
00000100:00080000:1.0:1767319219.710857:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319219.710871:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319219.710878:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940464128:0@lo:38:kworker.0
00000100:00080000:1.0:1767319219.710912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319219.710917:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319219.710920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940464896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319220.206385:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940465024:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319220.206498:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319220.208049:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465024
00000100:00100000:2.0:1767319220.208068:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465024
00000100:00100000:2.0:1767319220.208225:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382
00000100:00100000:2.0:1767319220.208238:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940465024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319220.208295:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319220.228570:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940465024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20325us (22060us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319220.228581:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940465024:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319220.228587:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382
00000100:00100000:0.0:1767319220.334545:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319220.654956:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319221.230051:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319221.233579:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940465152:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319221.233674:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319221.237990:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465152
00000100:00100000:2.0:1767319221.238007:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465152
00000100:00100000:2.0:1767319221.238182:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383
00000100:00100000:2.0:1767319221.238203:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940465152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319221.238285:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319221.239783:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940465152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1572us (6087us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319221.239807:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383
00000100:00100000:3.0:1767319221.240179:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940465152:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319221.240644:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319221.359890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319221.684599:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319222.345386:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319222.345479:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306432
00000100:00100000:3.0:1767319222.345490:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306432
00000100:00100000:1.0:1767319222.345543:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:0.0:1767319222.345603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319222.352079:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306304
00000100:00100000:3.0:1767319222.352095:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306304
00000100:00100000:3.0:1767319222.352158:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4362
00000100:00100000:3.0:1767319222.352175:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319222.352328:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 161us (6954us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319222.352485:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4362
00000100:00100000:0.0:1767319222.352922:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16894
00000100:00100000:0.0:1767319222.352930:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319222.352951:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319222.352985:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (7443us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319222.352992:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16894
00000100:00100000:0.0:1767319222.384692:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319222.705944:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319223.404998:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319223.725124:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319224.429025:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319224.749617:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319224.813581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319224.813590:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319224.813593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319224.813597:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319224.813601:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319224.813608:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4469
00000100:00080000:1.0:1767319224.813612:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319224.813619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319224.813657:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335500 x1853163940465280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319224.813800:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940465280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319224.813869:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319224.814100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319224.814104:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319224.814106:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319224.814110:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4469
00000100:00080000:1.0:1767319224.814112:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319224.814116:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319224.814132:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337800 x1853163940465408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319224.814927:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465280
00000100:00100000:0.0:1767319224.814936:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465280
00000100:00100000:0.0:1767319224.815028:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16895
00000100:00100000:0.0:1767319224.815035:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940465280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319224.815057:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319224.820538:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940465408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319224.820625:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319224.820757:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465408
00000100:00100000:2.0:1767319224.820766:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465408
00000100:00100000:2.0:1767319224.820830:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58
00000100:00100000:2.0:1767319224.820837:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940465408:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319224.820859:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319224.820942:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940465408:12345-0@lo:38:kworker.0 Request processed in 103us (316us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319224.820949:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58
00000100:00100000:0.0:1767319224.821620:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940465280:12345-0@lo:38:kworker.0 Request processed in 6581us (7747us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319224.821631:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16895
00000100:00080000:1.0:1767319224.822110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319224.822116:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319224.822119:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319224.822125:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4469
00000100:00080000:1.0:1767319224.822130:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319224.822135:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319224.822154:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335f80 x1853163940465920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319224.822171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319224.822173:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319224.822175:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319224.822178:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4469
00000100:00080000:1.0:1767319224.822180:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319224.822183:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319224.822193:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337100 x1853163940466176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319224.822222:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940466048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319224.822266:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319224.822486:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940465664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319224.822514:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319224.822544:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465664
00000100:00100000:2.0:1767319224.822549:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465664
00000100:00100000:2.0:1767319224.822592:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843
00000100:00100000:2.0:1767319224.822598:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940465664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319224.822638:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940465664:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319224.822645:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843
00000100:00080000:2.0:1767319224.822660:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319224.822689:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940465792:0@lo:400:kworker.0
00000100:00100000:2.0:1767319224.822711:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319224.822733:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466048
00000100:00100000:2.0:1767319224.822735:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466048
00000100:00100000:2.0:1767319224.822760:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465792
00000100:00100000:2.0:1767319224.822763:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465792
00000100:00100000:2.0:1767319224.822798:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4363
00000100:00100000:2.0:1767319224.822804:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940466048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319224.822832:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940466048:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319224.822838:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4363
00000100:00100000:2.0:1767319224.822849:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364
00000100:00100000:2.0:1767319224.822854:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940465792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319224.822880:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940465792:12345-0@lo:400:kworker.0 Request processed in 26us (168us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319224.822885:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364
00000100:00100000:0.0:1767319224.822914:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940465536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319224.822945:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319224.822971:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465536
00000100:00100000:0.0:1767319224.822975:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465536
00000100:00100000:0.0:1767319224.823006:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844
00000100:00100000:0.0:1767319224.823013:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940465536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319224.823048:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940465536:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319224.823055:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844
00000100:00080000:3.0:1767319224.827070:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319224.827084:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319224.827089:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940465280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319224.827895:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940465920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319224.827963:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319224.829147:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940466048:0@lo:400:kworker.0
00000100:00080000:2.0:1767319224.836820:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319224.836830:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319224.836931:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940465664:0@lo:400:kworker.0
00000100:00100000:3.0:1767319224.837127:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940465792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319224.841003:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940465536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319224.841023:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940466176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319224.841093:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319224.841138:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319224.841144:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319224.841147:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940465408:0@lo:38:kworker.0
00000100:00100000:2.0:1767319224.841226:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940465920
00000100:00100000:2.0:1767319224.841233:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940465920
00000100:00100000:2.0:1767319224.841276:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466176
00000100:00100000:2.0:1767319224.841279:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466176
00000100:00100000:1.0:1767319224.841403:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16896
00000100:00100000:1.0:1767319224.841411:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940465920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319224.841433:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319224.841488:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940465920:12345-0@lo:38:kworker.0 Request processed in 76us (13525us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319224.841495:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16896
00000100:00080000:3.0:1767319224.841566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319224.841570:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319224.841574:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940465920:0@lo:38:kworker.0
00000100:00100000:1.0:1767319224.842004:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16897
00000100:00100000:1.0:1767319224.842009:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940466176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319224.842021:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319224.842067:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940466176:12345-0@lo:38:kworker.0 Request processed in 56us (974us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319224.842073:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16897
00000100:00080000:3.0:1767319224.842138:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319224.842143:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319224.842147:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940466176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319225.325667:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940466304:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319225.325746:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319225.325857:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466304
00000100:00100000:3.0:1767319225.325874:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466304
00000100:00100000:3.0:1767319225.325928:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384
00000100:00100000:3.0:1767319225.325938:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940466304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319225.325967:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319225.331769:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940466304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5822us (6012us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319225.331797:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384
00000100:00100000:2.0:1767319225.333994:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940466304:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319225.453050:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319225.775035:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319226.349460:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319226.349483:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940466432:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319226.349559:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319226.349745:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466432
00000100:00100000:3.0:1767319226.349754:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466432
00000100:00100000:3.0:1767319226.349874:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385
00000100:00100000:3.0:1767319226.349884:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940466432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319226.349908:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319226.349959:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940466432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (394us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319226.349967:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385
00000100:00100000:1.0:1767319226.350036:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940466432:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319226.350165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319226.438072:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319226.438215:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306816
00000100:00100000:0.0:1767319226.438226:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306816
00000100:00080000:2.0:1767319226.438465:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319226.438537:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4365
00000100:00100000:0.0:1767319226.438548:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306816:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319226.438633:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894306816:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (571us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319226.438641:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4365
00000400:00000100:0.0:1767319226.444392:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894306560 offset 0 length 520: 4
00000100:00100000:0.0:1767319226.444451:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319226.444592:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306688
00000100:00100000:2.0:1767319226.444601:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306688
00000100:00100000:2.0:1767319226.444650:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16898
00000100:00100000:2.0:1767319226.444658:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306688:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319226.444682:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319226.444758:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894306688:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 98us (306us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319226.444767:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16898
00000100:00100000:0.0:1767319226.476903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319226.797396:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319227.501122:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319227.824008:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319228.526692:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319228.846190:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319229.548903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319229.869104:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319229.932997:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319229.933008:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319229.933011:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319229.933014:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319229.933018:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319229.933026:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319229.933031:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319229.933039:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319229.933081:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335880 x1853163940466560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319229.933111:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319229.933115:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319229.933117:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319229.933120:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319229.933122:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319229.933125:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319229.933157:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334a80 x1853163940466688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319229.933181:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940466560:0@lo:38:kworker.0
00000100:00080000:1.0:1767319229.933228:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319229.933233:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319229.933235:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319229.933239:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319229.933242:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319229.933246:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319229.933255:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319229.933259:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334380 x1853163940467200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319229.933277:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319229.933280:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319229.933282:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319229.933286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319229.933288:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319229.933291:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319229.933307:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337480 x1853163940467456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319229.933319:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940466688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319229.933360:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940466944:0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.933361:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319229.933394:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940467200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319229.933404:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319229.933467:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466560
00000100:00100000:2.0:1767319229.933471:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940466816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319229.933476:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466560
00000100:00100000:0.0:1767319229.933576:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16899
00000100:00100000:0.0:1767319229.933584:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940466560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319229.933606:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319229.933708:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319229.933729:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940467456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319229.933749:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319229.933793:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466688
00000100:00100000:3.0:1767319229.933797:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466688
00000100:00100000:3.0:1767319229.933814:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59
00000100:00100000:3.0:1767319229.933818:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940466688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319229.933826:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319229.933848:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940466688:12345-0@lo:38:kworker.0 Request processed in 29us (490us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319229.933853:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59
00000100:00080000:3.0:1767319229.933885:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319229.933889:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319229.933891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940466688:0@lo:38:kworker.0
00000100:00100000:3.0:1767319229.933933:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467200
00000100:00100000:3.0:1767319229.933937:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467200
00000100:00100000:3.0:1767319229.933954:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467456
00000100:00100000:3.0:1767319229.933957:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467456
00000100:00100000:3.0:1767319229.933971:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16900
00000100:00100000:3.0:1767319229.933975:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940467200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319229.933983:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319229.934013:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940467200:12345-0@lo:38:kworker.0 Request processed in 35us (303us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319229.934019:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16900
00000100:00100000:3.0:1767319229.934030:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16901
00000100:00100000:3.0:1767319229.934034:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940467456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319229.934041:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319229.934064:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940467456:12345-0@lo:38:kworker.0 Request processed in 28us (312us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319229.934069:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16901
00000100:00080000:3.0:1767319229.934090:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319229.934093:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319229.934096:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940467200:0@lo:38:kworker.0
00000100:00080000:3.0:1767319229.934103:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319229.934106:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319229.934108:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940467456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319229.934154:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940467328:0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.934178:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319229.934906:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319229.934916:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940467072:0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.934948:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319229.934979:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467328
00000100:00100000:3.0:1767319229.934984:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467328
00000100:00100000:3.0:1767319229.935026:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467072
00000100:00100000:3.0:1767319229.935028:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467072
00000100:00100000:3.0:1767319229.935044:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4366
00000100:00100000:3.0:1767319229.935049:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940467328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.935080:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940467328:12345-0@lo:400:kworker.0 Request processed in 31us (902us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319229.935084:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4366
00000100:00100000:3.0:1767319229.935093:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4367
00000100:00100000:3.0:1767319229.935096:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940467072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.935113:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940467072:12345-0@lo:400:kworker.0 Request processed in 17us (165us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319229.935116:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4367
00000100:00100000:3.0:1767319229.935147:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940467072:0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.935156:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940467328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319229.935386:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466944
00000100:00100000:1.0:1767319229.935392:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466944
00000100:00100000:1.0:1767319229.935426:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845
00000100:00100000:1.0:1767319229.935433:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940466944:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319229.935450:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319229.935456:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319229.935477:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940466944:12345-0@lo:400:kworker.0 Request processed in 44us (2073us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319229.935485:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845
00000100:00100000:1.0:1767319229.935517:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940466944:0@lo:400:kworker.0
00000100:00100000:2.0:1767319229.942605:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319229.942819:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940466560:12345-0@lo:38:kworker.0 Request processed in 9230us (9560us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319229.942832:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16899
00000100:00080000:1.0:1767319229.942950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319229.942956:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319229.942960:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940466560:0@lo:38:kworker.0
00000100:00100000:3.0:1767319229.943043:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940466816
00000100:00100000:3.0:1767319229.943050:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940466816
00000100:00100000:3.0:1767319229.943131:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846
00000100:00100000:3.0:1767319229.943142:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940466816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319229.943216:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940466816:12345-0@lo:400:kworker.0 Request processed in 78us (617us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319229.943221:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846
00000100:00100000:1.0:1767319229.943320:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940466816:0@lo:400:kworker.0
00000100:00080000:2.0:1767319229.943433:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319230.445147:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319230.445171:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940467584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319230.445246:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319230.445515:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467584
00000100:00100000:2.0:1767319230.445523:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467584
00000100:00100000:2.0:1767319230.446644:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386
00000100:00100000:2.0:1767319230.446657:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940467584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319230.446690:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319230.446768:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940467584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319230.446792:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386
00000100:00100000:1.0:1767319230.446877:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940467584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319230.573345:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319230.893002:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319231.469065:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940467712:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319231.469153:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319231.469966:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467712
00000100:00100000:2.0:1767319231.469977:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467712
00000100:00100000:2.0:1767319231.470110:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387
00000100:00100000:2.0:1767319231.470130:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940467712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319231.470163:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319231.470616:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940467712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 495us (1460us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319231.470625:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387
00000100:00100000:0.0:1767319231.470953:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940467712:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319231.471032:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319231.559425:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319231.559609:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307072
00000100:00100000:0.0:1767319231.559621:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307072
00000100:00100000:0.0:1767319231.559709:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4368
00000100:00100000:0.0:1767319231.559720:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307072:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319231.559834:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307072:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 116us (420us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319231.559843:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4368
00000100:00080000:3.0:1767319231.560861:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319231.561336:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319231.562847:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894306944
00000100:00100000:2.0:1767319231.562867:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894306944
00000100:00100000:2.0:1767319231.563360:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16902
00000100:00100000:2.0:1767319231.563369:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894306944:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319231.563395:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319231.563539:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894306944:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 168us (2206us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319231.563547:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16902
00000100:00100000:0.0:1767319231.597010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319231.917022:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319232.620910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319232.945068:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319233.644899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319233.966127:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319234.028915:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319209/real 1767319209]  req@ffff93d06d3eb800 x1853163940461312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319234.028956:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d3eb800 x1853163940461312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319234.028977:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319234.028998:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319234.029002:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940461312:0@lo:250:kworker.0
00000100:00080000:0.0:1767319234.029137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319234.029144:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319234.029147:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319234.029152:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4459
00000100:00080000:0.0:1767319234.029156:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319234.029162:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319234.029209:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940467840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319234.029235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319234.029238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319234.029240:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319234.029243:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319234.029244:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319234.029247:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319234.029262:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940467968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319234.029268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319234.029270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319234.029271:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319234.029274:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319234.029275:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319234.029277:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319234.029319:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08380 x1853163940468096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319234.029368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319234.029371:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319234.029373:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319234.029376:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319234.029378:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319234.029382:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319234.029400:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08700 x1853163940468608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319234.029415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319234.029418:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319234.029420:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319234.029424:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319234.029426:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319234.029429:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319234.029439:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0b800 x1853163940468864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319234.029465:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.029529:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319234.029557:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940467840:0@lo:250:kworker.0
00000400:00000100:1.0:1767319234.029590:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940467840 offset 0 length 520: 4
00000100:00100000:0.0:1767319234.029594:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319234.029603:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319234.029629:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940467968:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.029634:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319234.029669:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319234.029673:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940468480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319234.029699:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940468096:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.029706:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319234.029732:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319234.029739:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940468736:0@lo:400:kworker.0
00000100:00100000:1.0:1767319234.029742:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319234.029769:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940468608:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.029794:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319234.029830:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468224
00000100:00100000:0.0:1767319234.029838:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468224
00000100:00100000:0.0:1767319234.029895:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468352
00000100:00100000:0.0:1767319234.029899:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468352
00000100:00100000:0.0:1767319234.029923:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847
00000100:00100000:0.0:1767319234.029931:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.029981:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468224:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319234.029989:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847
00000100:00100000:0.0:1767319234.030008:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848
00000100:00100000:0.0:1767319234.030016:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319234.030032:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319234.030054:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940468864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.030060:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468352:12345-0@lo:400:kworker.0 Request processed in 42us (425us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319234.030068:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848
00000100:00100000:1.0:1767319234.030081:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319234.030095:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940467968
00000100:00100000:0.0:1767319234.030100:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940467968
00000100:00100000:1.0:1767319234.030117:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468096
00000100:00100000:1.0:1767319234.030123:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468096
00000100:00100000:0.0:1767319234.030125:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468480
00000100:00100000:0.0:1767319234.030130:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468480
00000100:00100000:1.0:1767319234.030153:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60
00000100:00100000:0.0:1767319234.030154:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468736
00000100:00100000:0.0:1767319234.030158:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468736
00000100:00100000:1.0:1767319234.030161:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940468096:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.030174:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468608
00000100:00100000:0.0:1767319234.030178:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468608
00010000:00020000:1.0:1767319234.030184:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319234.030187:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468864
00000100:00100000:0.0:1767319234.030191:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468864
00000100:00100000:0.0:1767319234.030206:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4369
00000100:00100000:0.0:1767319234.030214:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940468480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319234.030224:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940468096:12345-0@lo:38:kworker.0 Request processed in 63us (484us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319234.030233:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60
00000100:00100000:0.0:1767319234.030259:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940468480:12345-0@lo:400:kworker.0 Request processed in 46us (555us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319234.030267:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4369
00000100:00080000:1.0:1767319234.030271:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319234.030278:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319234.030283:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940468096:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.030298:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4370
00000100:00100000:0.0:1767319234.030305:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940468736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.030334:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940468736:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319234.030340:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4370
00000100:00100000:0.0:1767319234.030353:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16903
00000100:00100000:0.0:1767319234.030357:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940467968:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319234.030368:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319234.030392:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940467968:12345-0@lo:38:kworker.0 Request processed in 33us (724us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319234.030399:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16903
00000100:00100000:0.0:1767319234.030409:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16904
00000100:00100000:0.0:1767319234.030413:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940468608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319234.030422:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319234.030443:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940468608:12345-0@lo:38:kworker.0 Request processed in 29us (413us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319234.030448:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16904
00000100:00100000:0.0:1767319234.030459:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16905
00000100:00100000:0.0:1767319234.030462:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940468864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319234.030471:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319234.030498:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940468864:12345-0@lo:38:kworker.0 Request processed in 28us (413us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319234.030504:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16905
00000100:00080000:0.0:1767319234.030520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319234.030524:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319234.030526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319234.030554:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940468736:0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.030565:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940468480:0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.030590:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319234.030600:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468224:0@lo:400:kworker.0
00000100:00080000:1.0:1767319234.031914:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319234.031921:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319234.031924:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940468608:0@lo:38:kworker.0
00000100:00080000:1.0:1767319234.031935:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319234.031938:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319234.031941:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940468864:0@lo:38:kworker.0
00000100:00080000:1.0:1767319234.031966:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319234.031970:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319234.031973:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940467968:0@lo:38:kworker.0
00000100:00100000:0.0:1767319234.669368:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319234.989083:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319235.565484:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468992:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319235.565558:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319235.565714:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940468992
00000100:00100000:3.0:1767319235.565724:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940468992
00000100:00100000:3.0:1767319235.565804:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388
00000100:00100000:3.0:1767319235.565814:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319235.565847:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319235.567082:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940468992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1264us (1518us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319235.567091:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388
00000100:00100000:0.0:1767319235.570358:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940468992:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319235.693766:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319236.013011:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319236.589055:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940469120:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319236.589119:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319236.589254:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469120
00000100:00100000:3.0:1767319236.589273:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469120
00000100:00100000:3.0:1767319236.589336:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389
00000100:00100000:3.0:1767319236.589356:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940469120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319236.589385:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319236.589424:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940469120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319236.589431:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389
00000100:00080000:0.0:1767319236.589558:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319236.589592:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940469120:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319236.678366:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319236.678557:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307328
00000100:00100000:3.0:1767319236.678568:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307328
00000100:00100000:3.0:1767319236.678659:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4371
00000100:00100000:3.0:1767319236.678681:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319236.678764:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319236.678802:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4371
00000100:00100000:3.0:1767319236.678908:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319236.679061:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307200
00000100:00100000:2.0:1767319236.679066:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307200
00000100:00100000:2.0:1767319236.679093:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16906
00000100:00100000:2.0:1767319236.679099:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894307200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319236.679122:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319236.679153:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894307200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319236.679160:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16906
00000100:00080000:1.0:1767319236.680739:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319236.716918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319237.038422:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319237.741087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319238.061128:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319238.764902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319239.085485:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319239.149923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319239.149936:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319239.149939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319239.149943:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319239.149948:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319239.149957:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4484
00000100:00080000:0.0:1767319239.149962:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319239.149969:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319239.150016:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09500 x1853163940469248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319239.150045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319239.150049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319239.150051:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319239.150054:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4484
00000100:00080000:0.0:1767319239.150056:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319239.150061:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319239.150079:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09880 x1853163940469376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319239.150151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319239.150151:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940469504:0@lo:400:kworker.0
00000100:00080000:0.0:1767319239.150160:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319239.150163:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319239.150167:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4484
00000100:00080000:0.0:1767319239.150170:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319239.150175:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319239.150189:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0ad80 x1853163940469888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319239.150208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319239.150211:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319239.150213:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319239.150216:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4484
00000100:00080000:0.0:1767319239.150219:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319239.150224:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319239.150228:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319239.150251:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08e00 x1853163940470144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319239.150279:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940469632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319239.150316:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319239.150334:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940469760:0@lo:400:kworker.0
00000100:00100000:0.0:1767319239.150362:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940470016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319239.150369:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319239.150399:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319239.150439:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469504
00000100:00100000:0.0:1767319239.150446:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469504
00000100:00100000:0.0:1767319239.150497:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469632
00000100:00100000:0.0:1767319239.150502:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469632
00000100:00100000:1.0:1767319239.150574:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940469248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319239.150606:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319239.150635:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849
00000100:00100000:0.0:1767319239.150645:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940469504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319239.150702:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940469504:12345-0@lo:400:kworker.0 Request processed in 58us (476us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319239.150710:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849
00000100:00100000:0.0:1767319239.150728:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850
00000100:00100000:0.0:1767319239.150734:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940469632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319239.150881:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940469632:12345-0@lo:400:kworker.0 Request processed in 146us (563us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319239.150888:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850
00000100:00080000:0.0:1767319239.150912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319239.150916:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319239.150957:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940469632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319239.150998:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940469504:0@lo:400:kworker.0
00000100:00100000:1.0:1767319239.156397:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940469376:0@lo:38:kworker.0
00000100:00100000:1.0:1767319239.156482:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319239.156517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940469888:0@lo:38:kworker.0
00000100:00100000:1.0:1767319239.156541:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319239.159978:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469760
00000100:00100000:2.0:1767319239.159997:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469760
00000100:00100000:2.0:1767319239.160079:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470016
00000100:00100000:2.0:1767319239.160083:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470016
00000100:00100000:2.0:1767319239.160108:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469248
00000100:00100000:2.0:1767319239.160111:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469248
00000100:00100000:2.0:1767319239.160129:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4372
00000100:00100000:2.0:1767319239.160138:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940469760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319239.160229:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940469760:12345-0@lo:400:kworker.0 Request processed in 93us (9860us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319239.160237:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4372
00000100:00100000:2.0:1767319239.160287:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4373
00000100:00100000:2.0:1767319239.160295:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940470016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319239.160330:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940470016:12345-0@lo:400:kworker.0 Request processed in 36us (9932us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319239.160336:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4373
00000100:00100000:2.0:1767319239.160349:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16907
00000100:00100000:2.0:1767319239.160353:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940469248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319239.160374:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319239.160402:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940469248:12345-0@lo:38:kworker.0 Request processed in 47us (9795us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319239.160409:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16907
00000100:00080000:2.0:1767319239.160436:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319239.160475:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940470016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319239.160514:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940469760:0@lo:400:kworker.0
00000100:00100000:2.0:1767319239.160645:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469376
00000100:00100000:2.0:1767319239.160650:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469376
00000100:00100000:2.0:1767319239.160674:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61
00000100:00100000:2.0:1767319239.160679:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940469376:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319239.160690:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319239.160721:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940469376:12345-0@lo:38:kworker.0 Request processed in 41us (4239us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319239.160727:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61
00000100:00100000:3.0:1767319239.161799:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940469888
00000100:00100000:3.0:1767319239.161810:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940469888
00000100:00100000:1.0:1767319239.161813:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940470144:0@lo:38:kworker.0
00000100:00100000:3.0:1767319239.161840:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16908
00000100:00100000:3.0:1767319239.161849:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940469888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319239.161867:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319239.161876:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319239.161911:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940469888:12345-0@lo:38:kworker.0 Request processed in 62us (5368us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319239.161919:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16908
00000100:00080000:1.0:1767319239.161933:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319239.161937:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470144
00000100:00100000:3.0:1767319239.161942:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470144
00000100:00100000:3.0:1767319239.161962:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16909
00000100:00100000:3.0:1767319239.161967:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b831c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940470144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319239.161976:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319239.162000:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b831c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940470144:12345-0@lo:38:kworker.0 Request processed in 32us (125us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319239.162006:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16909
00000100:00080000:1.0:1767319239.162659:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319239.162666:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940469248:0@lo:38:kworker.0
00000100:00080000:1.0:1767319239.162688:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319239.162692:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319239.162696:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940469376:0@lo:38:kworker.0
00000100:00080000:1.0:1767319239.162707:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319239.162710:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319239.162713:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940469888:0@lo:38:kworker.0
00000100:00080000:1.0:1767319239.162721:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319239.162725:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319239.162727:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940470144:0@lo:38:kworker.0
00000100:00100000:0.0:1767319239.790434:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319240.109055:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319240.685217:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319240.685252:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940470272:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319240.685323:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319240.685556:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470272
00000100:00100000:2.0:1767319240.685565:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470272
00000100:00100000:2.0:1767319240.685619:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390
00000100:00100000:2.0:1767319240.685629:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940470272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319240.685658:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319240.685707:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940470272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319240.685714:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390
00000100:00100000:1.0:1767319240.685825:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940470272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319240.813109:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319241.133000:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319241.709303:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319241.709329:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940470400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319241.709415:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319241.709626:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470400
00000100:00100000:1.0:1767319241.709634:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470400
00000100:00100000:1.0:1767319241.709695:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391
00000100:00100000:1.0:1767319241.709712:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940470400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319241.709739:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319241.709815:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940470400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319241.709821:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391
00000100:00100000:1.0:1767319241.709872:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940470400:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319241.711050:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319241.798741:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319241.798819:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319241.798970:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307456
00000100:00100000:3.0:1767319241.798981:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307456
00000100:00100000:3.0:1767319241.799032:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307584
00000100:00100000:3.0:1767319241.799036:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307584
00000100:00100000:3.0:1767319241.799085:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4374
00000100:00100000:3.0:1767319241.799096:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894307584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319241.799264:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894307584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 169us (443us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319241.799272:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4374
00000100:00100000:3.0:1767319241.799294:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16910
00000100:00100000:3.0:1767319241.799387:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894307456:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319241.799473:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319241.799502:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894307456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 201us (772us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319241.799509:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16910
00000100:00080000:3.0:1767319241.799531:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319241.839502:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319242.157096:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319242.861000:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319243.181009:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319243.884907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319244.204977:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319244.271525:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319244.271537:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319244.271540:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319244.271544:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319244.271547:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319244.271555:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4489
00000100:00080000:1.0:1767319244.271560:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319244.271567:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319244.271976:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337100 x1853163940470528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319244.272074:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940470528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319244.272144:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319244.272188:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319244.272201:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319244.272203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319244.272207:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4489
00000100:00080000:1.0:1767319244.272209:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319244.272213:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319244.272230:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335f80 x1853163940470656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319244.272307:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940470784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272341:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319244.272412:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470784
00000100:00100000:0.0:1767319244.272420:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470784
00000100:00100000:0.0:1767319244.272476:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851
00000100:00100000:0.0:1767319244.272485:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940470784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272534:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940470784:12345-0@lo:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319244.272541:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851
00000100:00080000:1.0:1767319244.272541:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319244.272544:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319244.272546:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319244.272549:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4489
00000100:00080000:1.0:1767319244.272551:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319244.272555:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00080000:0.0:1767319244.272562:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319244.272566:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335500 x1853163940471168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319244.272596:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940470784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272610:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319244.272616:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940470912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272637:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319244.272664:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470912
00000100:00100000:0.0:1767319244.272668:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470912
00000100:00100000:0.0:1767319244.272694:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852
00000100:00100000:0.0:1767319244.272700:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940470912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272732:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940470912:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319244.272738:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852
00000100:00080000:0.0:1767319244.272750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319244.272767:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940470912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319244.272818:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940471040:0@lo:400:kworker.0
00000100:00080000:1.0:1767319244.272836:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319244.272840:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319244.272842:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319244.272846:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4489
00000100:00080000:1.0:1767319244.272849:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319244.272851:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940471296:0@lo:400:kworker.0
00000100:00080000:1.0:1767319244.272853:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319244.272865:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334700 x1853163940471424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319244.272954:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940470656:0@lo:38:kworker.0
00000100:00100000:1.0:1767319244.272966:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319244.273026:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319244.273076:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940471168:0@lo:38:kworker.0
00000100:00100000:0.0:1767319244.273738:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470656
00000100:00100000:0.0:1767319244.273744:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470656
00000100:00100000:0.0:1767319244.273770:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62
00000100:00100000:0.0:1767319244.273791:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940470656:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319244.273792:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767319244.273861:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319244.273908:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940470656:12345-0@lo:38:kworker.0 Request processed in 116us (881us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319244.273915:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62
00000100:00100000:3.0:1767319244.274082:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940470528
00000100:00100000:3.0:1767319244.274087:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940470528
00000100:00100000:2.0:1767319244.276417:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471040
00000100:00100000:2.0:1767319244.276429:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471040
00000100:00100000:2.0:1767319244.276498:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471296
00000100:00100000:2.0:1767319244.276506:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471296
00000100:00100000:2.0:1767319244.276536:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4375
00000100:00100000:2.0:1767319244.276546:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940471040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319244.276638:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940471040:12345-0@lo:400:kworker.0 Request processed in 93us (3670us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319244.276644:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4375
00000100:00100000:2.0:1767319244.276661:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4376
00000100:00100000:2.0:1767319244.276667:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940471296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319244.276701:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940471296:12345-0@lo:400:kworker.0 Request processed in 34us (2907us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319244.276706:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4376
00000100:00100000:2.0:1767319244.276718:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16911
00000100:00100000:2.0:1767319244.276723:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940470528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319244.276742:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319244.276788:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940470528:12345-0@lo:38:kworker.0 Request processed in 48us (4629us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319244.276798:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16911
00000100:00080000:2.0:1767319244.276825:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319244.280102:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319244.280108:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940471296:0@lo:400:kworker.0
00000100:00100000:1.0:1767319244.280148:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940471040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319244.280285:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940471424:0@lo:38:kworker.0
00000100:00100000:3.0:1767319244.280334:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319244.280479:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319244.280484:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319244.280488:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940470528:0@lo:38:kworker.0
00000100:00080000:3.0:1767319244.280510:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319244.280514:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319244.280517:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940470656:0@lo:38:kworker.0
00000100:00100000:0.0:1767319244.280630:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471168
00000100:00100000:0.0:1767319244.280639:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471168
00000100:00100000:0.0:1767319244.280679:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471424
00000100:00100000:0.0:1767319244.280682:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471424
00000100:00100000:0.0:1767319244.280703:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16912
00000100:00100000:0.0:1767319244.280709:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940471168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319244.280729:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319244.280793:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940471168:12345-0@lo:38:kworker.0 Request processed in 64us (679us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319244.280800:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16912
00000100:00100000:0.0:1767319244.280816:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16913
00000100:00100000:0.0:1767319244.280820:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940471424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319244.280829:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319244.280852:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940471424:12345-0@lo:38:kworker.0 Request processed in 31us (517us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319244.280858:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16913
00000100:00080000:3.0:1767319244.281024:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319244.281029:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319244.281033:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940471168:0@lo:38:kworker.0
00000100:00080000:3.0:1767319244.281042:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319244.281044:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319244.281047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940471424:0@lo:38:kworker.0
00000100:00100000:0.0:1767319244.909135:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319245.229854:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319245.805099:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940471552:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319245.805171:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319245.805317:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471552
00000100:00100000:3.0:1767319245.805325:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471552
00000100:00100000:3.0:1767319245.805373:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392
00000100:00100000:3.0:1767319245.805382:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940471552:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319245.805423:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319245.805470:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940471552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (299us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319245.805477:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392
00000100:00100000:0.0:1767319245.805636:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940471552:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319245.933026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319246.256501:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319246.831687:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319246.831711:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940471680:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319246.831805:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319246.832247:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471680
00000100:00100000:2.0:1767319246.832265:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471680
00000100:00100000:2.0:1767319246.832334:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393
00000100:00100000:2.0:1767319246.832345:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940471680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319246.832383:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319246.832448:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940471680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (643us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319246.832457:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393
00000100:00100000:3.0:1767319246.832724:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940471680:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319246.832868:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319246.918618:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319246.918734:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307840
00000100:00100000:1.0:1767319246.918744:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307840
00000100:00100000:1.0:1767319246.918861:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4377
00000100:00100000:1.0:1767319246.918872:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319246.918962:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894307840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (356us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319246.918970:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4377
00000100:00080000:0.0:1767319246.919047:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319246.922809:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319246.925497:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894307712
00000100:00100000:2.0:1767319246.925515:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894307712
00000100:00100000:2.0:1767319246.927310:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16914
00000100:00100000:2.0:1767319246.927322:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894307712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319246.927348:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319246.927425:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894307712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (4626us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319246.927432:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16914
00000100:00100000:0.0:1767319246.958668:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319247.276943:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319247.980943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319248.305849:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319249.005437:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319249.325009:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319249.389222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319249.389239:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319249.389242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319249.389246:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319249.389250:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319249.389257:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4494
00000100:00080000:0.0:1767319249.389262:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767319249.389269:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319249.389306:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08e00 x1853163940471808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319249.389330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319249.389334:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319249.389336:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319249.389338:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4494
00000100:00080000:0.0:1767319249.389341:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767319249.389343:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319249.389353:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0ad80 x1853163940471936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319249.389403:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319249.389406:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319249.389408:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319249.389410:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4494
00000100:00080000:0.0:1767319249.389413:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:0.0:1767319249.389416:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319249.389426:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09c00 x1853163940472448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319249.389440:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319249.389443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319249.389444:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319249.389447:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4494
00000100:00080000:0.0:1767319249.389449:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319249.389452:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319249.389459:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073410a80 x1853163940472704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319249.389513:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472192:0@lo:400:kworker.0
00000100:00100000:2.0:1767319249.389575:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319249.389630:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319249.389635:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319249.389695:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319249.389723:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472192
00000100:00100000:2.0:1767319249.389728:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472192
00000100:00100000:2.0:1767319249.389789:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472064
00000100:00100000:2.0:1767319249.389792:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472064
00000100:00100000:2.0:1767319249.389811:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853
00000100:00100000:2.0:1767319249.389819:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319249.389861:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472192:12345-0@lo:400:kworker.0 Request processed in 42us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319249.389867:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853
00000100:00100000:2.0:1767319249.389880:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854
00000100:00100000:2.0:1767319249.389885:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319249.389904:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472064:12345-0@lo:400:kworker.0 Request processed in 19us (209us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319249.389921:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854
00000100:00080000:2.0:1767319249.390105:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319249.390109:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319249.390133:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319249.390141:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.390293:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940472320:0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.390330:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390364:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319249.390369:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940472576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.390388:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390415:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472320
00000100:00100000:3.0:1767319249.390419:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472320
00000100:00100000:3.0:1767319249.390448:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472576
00000100:00100000:3.0:1767319249.390451:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472576
00000100:00100000:3.0:1767319249.390470:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4378
00000100:00100000:3.0:1767319249.390475:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940472320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.390508:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940472320:12345-0@lo:400:kworker.0 Request processed in 33us (177us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319249.390514:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4378
00000100:00100000:3.0:1767319249.390527:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4379
00000100:00100000:3.0:1767319249.390533:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940472576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.390558:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940472576:12345-0@lo:400:kworker.0 Request processed in 25us (168us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319249.390563:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4379
00000100:00080000:3.0:1767319249.390583:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319249.390593:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940471808:0@lo:38:kworker.0
00000100:00100000:3.0:1767319249.390619:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390635:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940471936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319249.390656:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390674:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940472448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319249.390693:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390706:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940472704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319249.390724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.390748:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471936
00000100:00100000:3.0:1767319249.390752:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471936
00000100:00100000:3.0:1767319249.390770:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63
00000100:00100000:3.0:1767319249.390799:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940471936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319249.390815:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319249.390845:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940471936:12345-0@lo:38:kworker.0 Request processed in 46us (188us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319249.390851:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63
00000100:00100000:3.0:1767319249.390869:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940471808
00000100:00100000:3.0:1767319249.390872:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940471808
00000100:00100000:3.0:1767319249.390887:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472448
00000100:00100000:3.0:1767319249.390889:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472448
00000100:00100000:3.0:1767319249.390902:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472704
00000100:00100000:3.0:1767319249.390905:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472704
00000100:00100000:3.0:1767319249.390998:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16915
00000100:00100000:3.0:1767319249.391002:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940471808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319249.391012:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319249.391035:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940471808:12345-0@lo:38:kworker.0 Request processed in 32us (416us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319249.391043:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16915
00000100:00100000:3.0:1767319249.391054:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16916
00000100:00100000:3.0:1767319249.391058:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940472448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319249.391066:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319249.391086:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940472448:12345-0@lo:38:kworker.0 Request processed in 27us (392us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319249.391090:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16916
00000100:00100000:3.0:1767319249.391100:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16917
00000100:00100000:3.0:1767319249.391103:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940472704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319249.391110:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319249.391129:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940472704:12345-0@lo:38:kworker.0 Request processed in 25us (404us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319249.391135:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16917
00000100:00100000:3.0:1767319249.391180:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940472576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319249.391190:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940472320:0@lo:400:kworker.0
00000100:00080000:3.0:1767319249.391217:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319249.391221:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319249.391225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940471808:0@lo:38:kworker.0
00000100:00080000:3.0:1767319249.391233:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319249.391236:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319249.391238:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940471936:0@lo:38:kworker.0
00000100:00080000:3.0:1767319249.391245:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319249.391249:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319249.391252:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940472448:0@lo:38:kworker.0
00000100:00080000:3.0:1767319249.391258:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319249.391262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319249.391264:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940472704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319250.028958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319250.349285:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319250.925090:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319250.925115:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472832:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319250.925193:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319250.925334:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472832
00000100:00100000:2.0:1767319250.925343:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472832
00000100:00100000:2.0:1767319250.925397:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394
00000100:00100000:2.0:1767319250.925405:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319250.925437:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319250.925560:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (366us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319250.925568:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394
00000100:00100000:0.0:1767319250.929303:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472832:0@lo:13:osp-pre-1-1.0
00000400:00000100:0.0:1767319251.016583:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894307968 offset 0 length 520: 4
00000100:00100000:0.0:1767319251.018996:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319251.019096:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319251.019279:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308096
00000100:00100000:2.0:1767319251.019288:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308096
00000100:00100000:2.0:1767319251.019352:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308224
00000100:00100000:2.0:1767319251.019354:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308224
00000100:00100000:1.0:1767319251.019405:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4380
00000100:00100000:1.0:1767319251.019414:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894308224:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319251.019472:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894308224:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 61us (377us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319251.019477:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4380
00000100:00100000:1.0:1767319251.019489:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16918
00000100:00100000:1.0:1767319251.019492:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894308096:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319251.019509:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319251.019525:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894308096:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 32us (540us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319251.019529:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16918
00000100:00080000:0.0:1767319251.019562:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319251.053310:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319251.376154:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319251.949153:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472960:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319251.949222:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319251.949415:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940472960
00000100:00100000:2.0:1767319251.949425:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940472960
00000100:00100000:2.0:1767319251.949490:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395
00000100:00100000:2.0:1767319251.949499:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319251.949532:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319251.949579:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940472960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (356us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319251.949586:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395
00000100:00080000:0.0:1767319251.949738:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319251.949789:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940472960:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319252.076916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319252.397475:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319253.100896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319253.421561:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319254.124924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319254.444959:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319254.509569:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319254.509580:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319254.509583:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319254.509587:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319254.509592:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319254.509602:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4499
00000100:00080000:3.0:1767319254.509609:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767319254.509615:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319254.509659:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a46d80 x1853163940473088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319254.509730:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940473088:0@lo:38:kworker.0
00000100:00100000:0.0:1767319254.509820:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319254.509949:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473088
00000100:00100000:1.0:1767319254.509957:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473088
00000100:00100000:1.0:1767319254.510000:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16919
00000100:00100000:1.0:1767319254.510007:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940473088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319254.510027:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319254.510089:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319254.510094:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319254.510096:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319254.510111:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4499
00000100:00080000:3.0:1767319254.510114:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767319254.510119:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319254.510136:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a45c00 x1853163940473216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319254.510223:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940473216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319254.510252:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319254.510329:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473216
00000100:00100000:2.0:1767319254.510333:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473216
00000100:00100000:2.0:1767319254.510355:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64
00000100:00100000:2.0:1767319254.510360:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940473216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319254.510371:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319254.510414:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940473216:12345-0@lo:38:kworker.0 Request processed in 51us (159us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319254.510421:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64
00000100:00100000:1.0:1767319254.510488:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940473088:12345-0@lo:38:kworker.0 Request processed in 480us (667us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319254.510495:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16919
00000100:00080000:0.0:1767319254.510552:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319254.510556:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319254.510560:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940473088:0@lo:38:kworker.0
00000100:00080000:0.0:1767319254.510578:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319254.510581:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319254.510584:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940473216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319254.510991:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940473344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319254.511023:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319254.511124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319254.511129:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319254.511131:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319254.511135:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4499
00000100:00080000:3.0:1767319254.511139:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767319254.511143:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319254.511157:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a47480 x1853163940473728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319254.511176:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319254.511179:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319254.511180:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319254.511184:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4499
00000100:00080000:3.0:1767319254.511186:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319254.511189:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319254.511199:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a45c00 x1853163940473984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319254.511220:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940473856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511249:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319254.511272:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319254.511277:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940473600:0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511298:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319254.511334:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473856
00000100:00100000:3.0:1767319254.511338:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473856
00000100:00100000:3.0:1767319254.511379:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473600
00000100:00100000:3.0:1767319254.511382:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473600
00000100:00100000:3.0:1767319254.511414:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4381
00000100:00100000:3.0:1767319254.511421:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940473856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511461:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940473856:12345-0@lo:400:kworker.0 Request processed in 41us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319254.511468:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4381
00000100:00100000:3.0:1767319254.511483:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382
00000100:00100000:3.0:1767319254.511489:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940473600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511515:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940473600:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319254.511520:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382
00000100:00080000:3.0:1767319254.511536:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319254.511561:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940473600:0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511572:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940473856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319254.511607:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940473728:0@lo:38:kworker.0
00000100:00100000:3.0:1767319254.511630:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319254.511653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940473984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319254.511671:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319254.511695:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473728
00000100:00100000:3.0:1767319254.511699:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473728
00000100:00100000:3.0:1767319254.511715:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473984
00000100:00100000:3.0:1767319254.511718:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473984
00000100:00100000:3.0:1767319254.511732:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16920
00000100:00100000:3.0:1767319254.511736:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940473728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319254.511750:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319254.511803:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940473728:12345-0@lo:38:kworker.0 Request processed in 64us (172us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319254.511809:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16920
00000100:00100000:3.0:1767319254.511821:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16921
00000100:00100000:3.0:1767319254.511825:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940473984:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319254.511993:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319254.512000:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940473472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319254.512023:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767319254.512128:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319254.512156:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940473984:12345-0@lo:38:kworker.0 Request processed in 329us (484us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319254.512162:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16921
00000100:00080000:3.0:1767319254.512196:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319254.512200:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319254.512204:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940473728:0@lo:38:kworker.0
00000100:00080000:3.0:1767319254.512211:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319254.512215:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319254.512217:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940473984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319254.512599:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473344
00000100:00100000:1.0:1767319254.512605:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473344
00000100:00100000:1.0:1767319254.512651:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940473472
00000100:00100000:1.0:1767319254.512654:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940473472
00000100:00100000:1.0:1767319254.512677:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855
00000100:00100000:1.0:1767319254.512683:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940473344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319254.512724:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940473344:12345-0@lo:400:kworker.0 Request processed in 41us (1700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319254.512730:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855
00000100:00100000:1.0:1767319254.512741:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856
00000100:00100000:1.0:1767319254.512747:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940473472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319254.512770:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940473472:12345-0@lo:400:kworker.0 Request processed in 24us (747us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319254.512792:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856
00000100:00100000:0.0:1767319254.512877:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940473472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319254.512887:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940473344:0@lo:400:kworker.0
00000100:00080000:3.0:1767319254.512946:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319254.512950:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319255.149478:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319255.469223:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319256.045984:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319256.046014:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940474112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319256.046104:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319256.046453:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474112
00000100:00100000:3.0:1767319256.046461:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474112
00000100:00100000:3.0:1767319256.046523:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396
00000100:00100000:3.0:1767319256.046542:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940474112:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319256.046903:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767319256.048496:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319256.049129:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940474112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2593us (3019us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319256.049141:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396
00000100:00100000:1.0:1767319256.056547:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940474112:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319256.133896:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319256.133942:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319256.133997:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308352
00000100:00100000:3.0:1767319256.134008:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308352
00000100:00100000:3.0:1767319256.134067:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308480
00000100:00100000:3.0:1767319256.134071:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308480
00000100:00100000:2.0:1767319256.134114:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16922
00000100:00100000:2.0:1767319256.134123:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894308352:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:3.0:1767319256.134134:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4383
00000100:00100000:3.0:1767319256.134142:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894308480:12345-192.168.202.21@tcp:400:kworker.0
00010000:00020000:2.0:1767319256.134147:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319256.134192:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319256.134220:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894308352:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (331us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319256.134230:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16922
00000100:00100000:3.0:1767319256.135375:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894308480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1227us (1424us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319256.135386:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4383
00000100:00100000:0.0:1767319256.173334:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319256.493036:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319257.069133:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940474240:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319257.069211:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319257.069285:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474240
00000100:00100000:3.0:1767319257.069294:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474240
00000100:00100000:3.0:1767319257.069366:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397
00000100:00100000:3.0:1767319257.069377:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940474240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319257.069406:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319257.069470:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319257.076027:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940474240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6643us (6806us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319257.076038:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940474240:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319257.076043:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397
00000100:00100000:0.0:1767319257.197139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319257.517531:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319258.220921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319258.541015:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319259.244942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319259.565018:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319259.629069:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.629080:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319259.629083:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.629087:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319259.629091:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319259.629099:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4504
00000100:00080000:1.0:1767319259.629105:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319259.629112:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319259.629149:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044336d80 x1853163940474368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319259.629174:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.629178:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319259.629180:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319259.629183:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4504
00000100:00080000:1.0:1767319259.629186:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319259.629190:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319259.629204:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044336680 x1853163940474496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319259.629279:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.629283:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319259.629285:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319259.629289:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4504
00000100:00080000:1.0:1767319259.629292:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319259.629297:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319259.629306:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940474752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319259.629322:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044336a00 x1853163940475008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319259.629341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.629344:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319259.629346:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319259.629350:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4504
00000100:00080000:1.0:1767319259.629353:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319259.629356:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319259.629368:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335500 x1853163940475264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319259.629378:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319259.629396:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940474880:0@lo:400:kworker.0
00000100:00100000:1.0:1767319259.629433:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319259.629446:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319259.629455:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940474624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319259.629457:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319259.629467:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940475136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319259.629483:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319259.629501:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319259.629517:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474752
00000100:00100000:2.0:1767319259.629525:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474752
00000100:00100000:1.0:1767319259.629539:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474880
00000100:00100000:1.0:1767319259.629544:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474880
00000100:00100000:2.0:1767319259.629577:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474624
00000100:00100000:2.0:1767319259.629581:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474624
00000100:00100000:2.0:1767319259.629603:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857
00000100:00100000:2.0:1767319259.629611:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940474752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319259.629661:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940474752:12345-0@lo:400:kworker.0 Request processed in 50us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319259.629669:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857
00000100:00100000:2.0:1767319259.629684:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858
00000100:00100000:2.0:1767319259.629692:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940474624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319259.629695:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475136
00000100:00100000:3.0:1767319259.629701:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475136
00000100:00100000:2.0:1767319259.629722:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940474624:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319259.629728:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858
00000100:00100000:1.0:1767319259.629762:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4384
00000100:00100000:1.0:1767319259.629771:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940474880:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319259.629798:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940474624:0@lo:400:kworker.0
00000100:00100000:2.0:1767319259.629816:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940474752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319259.629842:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940474880:12345-0@lo:400:kworker.0 Request processed in 72us (407us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319259.629849:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4384
00000100:00100000:1.0:1767319259.629889:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940474880:0@lo:400:kworker.0
00000100:00100000:0.0:1767319259.630104:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319234/real 1767319234]  req@ffff93d04401aa00 x1853163940467840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319259 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319259.630122:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d04401aa00 x1853163940467840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319259 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319259.630135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940474368:0@lo:38:kworker.0
00000100:00100000:0.0:1767319259.630162:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319259.630189:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940474496:0@lo:38:kworker.0
00000100:00100000:0.0:1767319259.630209:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319259.630233:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940475008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319259.630251:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319259.630263:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940475264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319259.630279:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319259.630293:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319259.630302:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319259.630305:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940467840:0@lo:250:kworker.0
00000100:00080000:0.0:1767319259.630332:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319259.630336:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319259.630338:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319259.630349:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474368
00000100:00100000:0.0:1767319259.630352:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474368
00000100:00100000:0.0:1767319259.630373:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475008
00000100:00100000:0.0:1767319259.630376:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475008
00000100:00100000:0.0:1767319259.630387:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475264
00000100:00100000:0.0:1767319259.630390:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475264
00000100:00100000:0.0:1767319259.630400:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16923
00000100:00100000:0.0:1767319259.630405:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940474368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319259.630423:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319259.630455:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940474368:12345-0@lo:38:kworker.0 Request processed in 49us (292us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319259.630461:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16923
00000100:00100000:0.0:1767319259.630473:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16924
00000100:00100000:0.0:1767319259.630477:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940475008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319259.630487:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319259.630509:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940475008:12345-0@lo:38:kworker.0 Request processed in 30us (256us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319259.630514:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16924
00000100:00100000:0.0:1767319259.630526:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16925
00000100:00100000:0.0:1767319259.630529:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940475264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319259.630538:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319259.630559:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940475264:12345-0@lo:38:kworker.0 Request processed in 28us (279us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319259.630565:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16925
00000100:00080000:0.0:1767319259.630600:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319259.630604:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319259.630607:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940474368:0@lo:38:kworker.0
00000100:00080000:0.0:1767319259.630615:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319259.630618:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319259.630620:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940475008:0@lo:38:kworker.0
00000100:00080000:0.0:1767319259.630626:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319259.630629:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319259.630632:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940475264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319259.631198:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940474496
00000100:00100000:2.0:1767319259.631204:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940474496
00000100:00100000:2.0:1767319259.631231:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65
00000100:00100000:2.0:1767319259.631238:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940474496:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319259.631250:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319259.631290:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940474496:12345-0@lo:38:kworker.0 Request processed in 51us (1079us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319259.631295:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65
00000100:00080000:2.0:1767319259.631326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319259.631331:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319259.631334:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940474496:0@lo:38:kworker.0
00000100:00080000:1.0:1767319259.631498:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319259.631505:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319259.631508:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319259.631513:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4484
00000100:00080000:1.0:1767319259.631517:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319259.631522:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319259.631547:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334e00 x1853163940475392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319259.631658:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940475392:0@lo:250:kworker.0
00000400:00000100:2.0:1767319259.631685:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940475392 offset 0 length 520: 4
00000100:00100000:3.0:1767319259.636800:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4385
00000100:00100000:3.0:1767319259.636828:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940475136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319259.636942:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940475136:12345-0@lo:400:kworker.0 Request processed in 130us (7441us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319259.636959:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4385
00000100:00100000:0.0:1767319259.637291:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940475136:0@lo:400:kworker.0
00000100:00100000:0.0:1767319260.268890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319260.589137:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319261.169247:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319261.169273:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940475520:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319261.179003:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319261.179164:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475520
00000100:00100000:2.0:1767319261.179174:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475520
00000100:00100000:2.0:1767319261.179243:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398
00000100:00100000:2.0:1767319261.179253:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940475520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319261.179303:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319261.179359:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940475520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (363us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319261.179367:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398
00000100:00100000:2.0:1767319261.179415:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940475520:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319261.180108:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319261.256546:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319261.256589:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319261.256641:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308736
00000100:00100000:3.0:1767319261.256651:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308736
00000100:00100000:3.0:1767319261.256723:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308608
00000100:00100000:3.0:1767319261.256726:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308608
00000100:00100000:3.0:1767319261.256745:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4386
00000100:00100000:3.0:1767319261.256752:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894308736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767319261.256921:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319261.256973:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16926
00000100:00100000:2.0:1767319261.256980:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894308608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319261.257002:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319261.257176:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894308608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 193us (584us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319261.257185:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16926
00000100:00100000:2.0:1767319261.257405:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894308736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 653us (877us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319261.257411:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4386
00000100:00100000:0.0:1767319261.292908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319261.613534:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319262.193078:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319262.193106:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940475648:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319262.193195:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319262.194250:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475648
00000100:00100000:1.0:1767319262.194262:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475648
00000100:00100000:1.0:1767319262.194447:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399
00000100:00100000:1.0:1767319262.194457:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940475648:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319262.194490:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319262.194562:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940475648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319262.194569:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399
00000100:00100000:3.0:1767319262.198916:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940475648:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319262.210337:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319262.316949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319262.637386:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319263.343724:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319263.661968:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319264.364911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319264.685290:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319264.751045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319264.751057:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319264.751061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319264.751065:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319264.751069:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319264.751077:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4509
00000100:00080000:3.0:1767319264.751082:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319264.751089:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319264.751130:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a47480 x1853163940475776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319264.751156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319264.751159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319264.751161:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319264.751165:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4509
00000100:00080000:3.0:1767319264.751168:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319264.751171:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319264.751192:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a45c00 x1853163940475904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319264.751410:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319264.751473:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940476160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.751488:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319264.751530:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476032
00000100:00100000:1.0:1767319264.751537:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476032
00000100:00100000:1.0:1767319264.751597:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859
00000100:00100000:2.0:1767319264.751603:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940475776:0@lo:38:kworker.0
00000100:00100000:1.0:1767319264.751605:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476032:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319264.751669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319264.751672:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319264.751675:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319264.751679:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4509
00000100:00080000:3.0:1767319264.751681:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319264.751685:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319264.751695:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc3b800 x1853163940476416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319264.751709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319264.751712:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319264.751713:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319264.751716:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4509
00000100:00080000:3.0:1767319264.751718:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319264.751721:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319264.751730:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38700 x1853163940476672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319264.751750:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940476544:0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.753910:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319264.753966:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476160
00000100:00100000:0.0:1767319264.753973:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476160
00000100:00100000:0.0:1767319264.754025:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860
00000100:00100000:0.0:1767319264.754033:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940476160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.754095:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940476160:12345-0@lo:400:kworker.0 Request processed in 63us (190us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319264.754101:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860
00000100:00080000:0.0:1767319264.754123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319264.754127:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319264.754154:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940476160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.754199:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940476288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.754231:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319264.754268:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476288
00000100:00100000:0.0:1767319264.754271:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476288
00000100:00100000:0.0:1767319264.754303:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4387
00000100:00100000:0.0:1767319264.754309:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940476288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319264.754341:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940476288:12345-0@lo:400:kworker.0 Request processed in 32us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319264.754346:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4387
00000100:00080000:0.0:1767319264.754360:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319264.754376:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940476288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319264.756170:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319264.756223:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940475904:0@lo:38:kworker.0
00000100:00100000:2.0:1767319264.756253:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319264.756285:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940476416:0@lo:38:kworker.0
00000100:00100000:2.0:1767319264.756308:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319264.756325:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940476672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319264.756343:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319264.756383:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475904
00000100:00100000:2.0:1767319264.756390:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475904
00000100:00100000:2.0:1767319264.756419:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66
00000100:00100000:2.0:1767319264.756425:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940475904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319264.756443:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319264.756495:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940475904:12345-0@lo:38:kworker.0 Request processed in 68us (239us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319264.756502:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66
00000100:00100000:2.0:1767319264.756526:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940475776
00000100:00100000:2.0:1767319264.756530:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940475776
00000100:00100000:2.0:1767319264.756549:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476416
00000100:00100000:2.0:1767319264.756552:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476416
00000100:00100000:2.0:1767319264.756579:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476672
00000100:00100000:2.0:1767319264.756582:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476672
00000100:00100000:2.0:1767319264.756598:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16927
00000100:00100000:2.0:1767319264.756603:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940475776:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319264.759317:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476032:12345-0@lo:400:kworker.0 Request processed in 7699us (7815us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319264.759333:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859
00000100:00100000:1.0:1767319264.759416:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319264.759477:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16928
00000100:00100000:1.0:1767319264.759483:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940476416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319264.759889:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319264.759930:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940476416:12345-0@lo:38:kworker.0 Request processed in 446us (3621us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319264.759937:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16928
00000100:00100000:1.0:1767319264.759951:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16929
00000100:00100000:1.0:1767319264.759955:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940476672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319264.759965:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319264.759983:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940476672:12345-0@lo:38:kworker.0 Request processed in 27us (3639us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319264.759989:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16929
00000100:00080000:1.0:1767319264.760099:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319264.760104:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319264.760108:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940476416:0@lo:38:kworker.0
00000100:00080000:1.0:1767319264.760117:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319264.760120:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319264.760123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940476672:0@lo:38:kworker.0
00000100:00080000:1.0:1767319264.760133:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319264.760136:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319264.760139:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940475904:0@lo:38:kworker.0
00000100:00100000:3.0:1767319264.760652:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319264.760732:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476544
00000100:00100000:1.0:1767319264.760739:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476544
00000100:00100000:1.0:1767319264.760806:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388
00000100:00100000:1.0:1767319264.760813:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940476544:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319264.760886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319264.760990:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940476544:12345-0@lo:400:kworker.0 Request processed in 176us (338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319264.761110:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940476544:0@lo:400:kworker.0
00000100:00100000:1.0:1767319264.761147:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388
00010000:00020000:2.0:1767319264.761886:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319264.761960:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940475776:12345-0@lo:38:kworker.0 Request processed in 5354us (5795us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319264.761968:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16927
00000100:00080000:1.0:1767319264.764662:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319264.764673:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319264.764678:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940475776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319265.388899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319265.709043:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319266.286385:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476800:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319266.286460:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319266.286583:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476800
00000100:00100000:3.0:1767319266.286592:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476800
00000100:00100000:3.0:1767319266.286656:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400
00000100:00100000:3.0:1767319266.286668:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319266.286698:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767319266.286811:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319266.287165:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 501us (704us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319266.287176:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400
00000100:00100000:1.0:1767319266.287400:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476800:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319266.374710:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319266.375200:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319266.380945:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308992
00000100:00100000:2.0:1767319266.380962:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308992
00000100:00100000:2.0:1767319266.381088:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894308864
00000100:00100000:2.0:1767319266.381092:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894308864
00000100:00100000:2.0:1767319266.381131:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4389
00000100:00100000:2.0:1767319266.381141:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894308992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319266.381236:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894308992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (6537us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319266.381245:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4389
00000100:00100000:2.0:1767319266.381265:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16930
00000100:00100000:2.0:1767319266.381270:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894308864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319266.381297:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319266.381324:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894308864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (6125us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319266.381333:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16930
00000100:00080000:0.0:1767319266.381675:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319266.417934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319266.733055:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319267.309048:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319267.309070:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476928:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319267.309142:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319267.309453:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940476928
00000100:00100000:3.0:1767319267.309460:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940476928
00000100:00100000:3.0:1767319267.309519:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401
00000100:00100000:3.0:1767319267.309527:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319267.309553:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319267.309590:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940476928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (459us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319267.309596:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401
00000100:00080000:1.0:1767319267.309680:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319267.309712:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940476928:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319267.438450:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319267.757035:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319268.460952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319268.781023:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319269.488116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319269.805307:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319269.868923:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319269.868935:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319269.868938:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319269.868942:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319269.868948:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319269.868957:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1767319269.868991:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319269.868999:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319269.869048:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044336680 x1853163940477056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319269.869069:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319269.869073:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319269.869076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319269.869080:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1767319269.869083:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319269.869088:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319269.869106:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335500 x1853163940477184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319269.869113:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940477056:0@lo:38:kworker.0
00000100:00080000:1.0:1767319269.869177:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319269.869182:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319269.869184:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319269.869188:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1767319269.869191:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319269.869196:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319269.869202:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319269.869213:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337480 x1853163940477696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319269.869232:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319269.869235:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319269.869237:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319269.869241:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1767319269.869243:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319269.869247:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319269.869258:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018a80 x1853163940477952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319269.869282:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940477184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.869300:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940477824:0@lo:400:kworker.0
00000100:00100000:0.0:1767319269.869316:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319269.869340:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319269.869362:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477184
00000100:00100000:1.0:1767319269.869367:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319269.869372:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477184
00000100:00100000:1.0:1767319269.869376:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940477568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319269.869402:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319269.869414:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67
00000100:00100000:0.0:1767319269.869424:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940477184:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.869437:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477056
00000100:00100000:1.0:1767319269.869442:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477056
00010000:00020000:0.0:1767319269.869448:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319269.869479:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477824
00000100:00100000:1.0:1767319269.869484:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477824
00000100:00100000:0.0:1767319269.869497:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940477184:12345-0@lo:38:kworker.0 Request processed in 73us (180us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319269.869505:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67
00000100:00100000:1.0:1767319269.869538:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477568
00000100:00100000:1.0:1767319269.869543:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477568
00000100:00080000:0.0:1767319269.869548:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319269.869554:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319269.869559:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940477184:0@lo:38:kworker.0
00000100:00100000:0.0:1767319269.869567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940477696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.869572:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4390
00000100:00100000:1.0:1767319269.869581:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940477824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319269.869596:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319269.869610:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940477952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.869635:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940477824:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319269.869645:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4390
00000100:00100000:0.0:1767319269.869656:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319269.869658:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477696
00000100:00100000:1.0:1767319269.869662:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477696
00000100:00100000:1.0:1767319269.869674:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477952
00000100:00100000:1.0:1767319269.869677:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477952
00000100:00100000:1.0:1767319269.869692:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4391
00000100:00100000:1.0:1767319269.869699:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940477568:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319269.869711:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319269.869733:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940477568:12345-0@lo:400:kworker.0 Request processed in 33us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319269.869734:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16931
00000100:00100000:0.0:1767319269.869744:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940477056:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.869746:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4391
00010000:00020000:0.0:1767319269.869759:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319269.869766:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16932
00000100:00100000:1.0:1767319269.869771:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940477696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319269.869803:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319269.869833:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940477696:12345-0@lo:38:kworker.0 Request processed in 61us (237us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319269.869840:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16932
00000100:00100000:1.0:1767319269.869851:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16933
00000100:00100000:1.0:1767319269.869855:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940477952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319269.869864:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319269.869886:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940477952:12345-0@lo:38:kworker.0 Request processed in 30us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319269.869892:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16933
00000100:00100000:1.0:1767319269.869937:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940477568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319269.869944:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940477312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319269.869948:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940477824:0@lo:400:kworker.0
00000100:00080000:1.0:1767319269.869994:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319269.869997:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319269.870001:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319269.870005:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940477696:0@lo:38:kworker.0
00000100:00100000:3.0:1767319269.870070:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940477440:0@lo:400:kworker.0
00000100:00080000:1.0:1767319269.870182:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319269.870187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319269.870189:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940477952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319269.870213:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477312
00000100:00100000:1.0:1767319269.870216:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477312
00000100:00100000:1.0:1767319269.870249:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861
00000100:00100000:1.0:1767319269.870255:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940477312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319269.876293:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940477056:12345-0@lo:38:kworker.0 Request processed in 6534us (7080us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319269.876308:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16931
00000100:00080000:0.0:1767319269.876362:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319269.876402:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319269.876407:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319269.876415:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940477056:0@lo:38:kworker.0
00000100:00100000:3.0:1767319269.881721:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319269.881818:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940477440
00000100:00100000:0.0:1767319269.881830:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940477440
00000100:00100000:0.0:1767319269.881931:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862
00000100:00100000:0.0:1767319269.881941:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940477440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319269.882021:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940477440:12345-0@lo:400:kworker.0 Request processed in 82us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319269.882030:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862
00000100:00080000:2.0:1767319269.883185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319269.885711:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940477440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319269.886737:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940477312:12345-0@lo:400:kworker.0 Request processed in 16476us (16736us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319269.886753:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861
00000100:00100000:2.0:1767319269.886841:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940477312:0@lo:400:kworker.0
00000100:00100000:2.0:1767319270.509159:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319270.829640:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319271.405091:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319271.405118:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940478080:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319271.405189:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319271.405380:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478080
00000100:00100000:2.0:1767319271.405388:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478080
00000100:00100000:2.0:1767319271.405463:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402
00000100:00100000:2.0:1767319271.405473:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940478080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319271.405503:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319271.405602:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940478080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319271.405611:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402
00000100:00080000:0.0:1767319271.405704:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319271.405762:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940478080:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319271.494181:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319271.497361:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309248
00000100:00100000:1.0:1767319271.497380:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309248
00000100:00100000:1.0:1767319271.497567:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4392
00000100:00100000:1.0:1767319271.497580:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894309248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319271.497677:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894309248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (3506us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319271.497685:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4392
00000100:00080000:0.0:1767319271.500125:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319271.502352:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319271.502467:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309120
00000100:00100000:2.0:1767319271.502478:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309120
00000100:00100000:2.0:1767319271.502533:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16934
00000100:00100000:2.0:1767319271.502544:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894309120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319271.502572:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319271.502649:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894309120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 105us (308us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319271.502657:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16934
00000100:00100000:2.0:1767319271.532927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319271.853051:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319272.431753:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940478208:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319272.431854:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319272.432175:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478208
00000100:00100000:3.0:1767319272.432184:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478208
00000100:00100000:3.0:1767319272.432260:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403
00000100:00100000:3.0:1767319272.432272:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940478208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319272.432304:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319272.432356:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940478208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (502us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319272.432365:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403
00000100:00100000:3.0:1767319272.432428:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940478208:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319272.432496:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319272.557235:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319272.877298:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319273.580918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319273.901115:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319274.605019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319274.925226:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319274.990238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319274.990248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319274.990252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319274.990256:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319274.990260:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319274.990268:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4519
00000100:00080000:1.0:1767319274.990273:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319274.990280:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319274.990324:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940478336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319274.990340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319274.990343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319274.990345:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319274.990348:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4519
00000100:00080000:1.0:1767319274.990350:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319274.990353:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319274.990362:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018000 x1853163940478464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319274.990423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319274.990426:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319274.990427:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319274.990430:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4519
00000100:00080000:1.0:1767319274.990433:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319274.990436:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319274.990447:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a300 x1853163940478976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319274.990462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319274.990465:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319274.990467:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319274.990470:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4519
00000100:00080000:1.0:1767319274.990472:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319274.990475:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319274.990486:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019500 x1853163940479232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319274.990567:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940478592:0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.990632:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319274.990697:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319274.990702:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940478720:0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.990721:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319274.990747:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940478848:0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.990767:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319274.990808:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319274.990813:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940479104:0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.990838:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319274.990871:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478848
00000100:00100000:2.0:1767319274.990877:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478848
00000100:00100000:2.0:1767319274.990937:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479104
00000100:00100000:2.0:1767319274.990940:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479104
00000100:00100000:2.0:1767319274.990965:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4393
00000100:00100000:2.0:1767319274.990972:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940478848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.991035:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940478848:12345-0@lo:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319274.991042:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4393
00000100:00100000:2.0:1767319274.991060:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4394
00000100:00100000:2.0:1767319274.991066:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940479104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.991092:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940479104:12345-0@lo:400:kworker.0 Request processed in 27us (254us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319274.991099:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4394
00000100:00080000:2.0:1767319274.991117:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319274.991157:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940479104:0@lo:400:kworker.0
00000100:00100000:2.0:1767319274.991167:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940478848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319274.991396:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478592
00000100:00100000:3.0:1767319274.991401:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478592
00000100:00100000:3.0:1767319274.991438:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478720
00000100:00100000:3.0:1767319274.991441:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478720
00000100:00100000:3.0:1767319274.991465:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863
00000100:00100000:3.0:1767319274.991472:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940478592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319274.991513:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940478592:12345-0@lo:400:kworker.0 Request processed in 43us (881us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319274.991519:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863
00000100:00100000:3.0:1767319274.991533:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864
00000100:00100000:3.0:1767319274.991539:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940478720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319274.991568:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940478720:12345-0@lo:400:kworker.0 Request processed in 29us (845us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319274.991573:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864
00000100:00100000:3.0:1767319274.991604:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940478720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319274.991613:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940478592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319274.992406:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940478336:0@lo:38:kworker.0
00000100:00100000:0.0:1767319274.992452:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319274.992487:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940478464:0@lo:38:kworker.0
00000100:00100000:0.0:1767319274.992513:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319274.992542:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940478976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319274.992564:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319274.992583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940479232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319274.992605:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319274.992641:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478336
00000100:00100000:0.0:1767319274.992647:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478336
00000100:00100000:0.0:1767319274.992669:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478976
00000100:00100000:0.0:1767319274.992672:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478976
00000100:00100000:0.0:1767319274.992683:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479232
00000100:00100000:0.0:1767319274.992686:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479232
00000100:00100000:0.0:1767319274.992699:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16935
00000100:00100000:0.0:1767319274.992704:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940478336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319274.992725:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319274.992764:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940478336:12345-0@lo:38:kworker.0 Request processed in 58us (310us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319274.992771:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16935
00000100:00080000:2.0:1767319274.993123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319274.993128:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319274.994129:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16936
00000100:00100000:2.0:1767319274.994138:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940478976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319274.994157:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319274.994217:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940478976:12345-0@lo:38:kworker.0 Request processed in 78us (1651us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319274.994236:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16936
00000100:00100000:2.0:1767319274.994257:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16937
00000100:00100000:2.0:1767319274.994261:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940479232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319274.994272:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319274.995600:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940478464
00000100:00100000:3.0:1767319274.995614:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940478464
00000100:00100000:3.0:1767319274.995666:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68
00000100:00100000:3.0:1767319274.995673:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940478464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319274.995691:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319274.996618:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319274.996628:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319274.996633:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940478336:0@lo:38:kworker.0
00000100:00080000:0.0:1767319274.996648:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319274.996652:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319274.996655:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940478976:0@lo:38:kworker.0
00000100:00100000:3.0:1767319275.007093:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940478464:12345-0@lo:38:kworker.0 Request processed in 11409us (14568us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319275.007108:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68
00000100:00080000:0.0:1767319275.008625:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319275.008636:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319275.008641:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940478464:0@lo:38:kworker.0
00000100:00100000:2.0:1767319275.010842:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940479232:12345-0@lo:38:kworker.0 Request processed in 16558us (18215us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319275.010858:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16937
00000100:00080000:0.0:1767319275.015084:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319275.015099:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319275.015104:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940479232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319275.629011:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319275.948991:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319276.525169:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940479360:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319276.525263:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319276.525387:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479360
00000100:00100000:1.0:1767319276.525398:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479360
00000100:00080000:2.0:1767319276.525458:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319276.525488:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404
00000100:00100000:1.0:1767319276.525573:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940479360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319276.525606:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319276.529875:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940479360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4366us (4599us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319276.531328:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940479360:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319276.531612:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404
00000100:00100000:0.0:1767319276.629291:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319276.629481:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309504
00000100:00100000:2.0:1767319276.629492:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309504
00000100:00100000:2.0:1767319276.629612:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4395
00000100:00100000:2.0:1767319276.629623:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894309504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319276.629814:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894309504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 151us (499us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319276.629821:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4395
00000100:00080000:0.0:1767319276.632095:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319276.634867:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319276.634920:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894309632 offset 0 length 520: 4
00000100:00100000:1.0:1767319276.634958:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309376
00000100:00100000:1.0:1767319276.634970:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309376
00000100:00100000:1.0:1767319276.635033:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16938
00000100:00100000:1.0:1767319276.635044:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894309376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319276.635068:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319276.635140:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894309376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 96us (284us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319276.635151:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16938
00000100:00100000:2.0:1767319276.653116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319276.973022:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319277.549053:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319277.549083:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940479488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319277.549158:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.551044:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479488
00000100:00100000:1.0:1767319277.551059:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479488
00000100:00100000:1.0:1767319277.551159:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405
00000100:00100000:1.0:1767319277.551171:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940479488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319277.551211:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319277.551293:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940479488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2133us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319277.551301:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405
00000100:00080000:2.0:1767319277.551438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319277.551494:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940479488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319277.677729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319277.997187:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319278.700932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319279.023522:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319279.725004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319280.045292:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319280.108938:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319280.108962:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319280.108965:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319280.108969:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319280.108973:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319280.109251:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1767319280.109259:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319280.109268:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319280.109315:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940479616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319280.109351:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319280.109355:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319280.109357:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319280.109361:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1767319280.109365:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319280.109368:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319280.109383:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019500 x1853163940479744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319280.109455:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940479872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319280.109519:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319280.109651:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479872
00000100:00100000:0.0:1767319280.109659:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479872
00000100:00100000:0.0:1767319280.109730:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865
00000100:00100000:0.0:1767319280.109740:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940479872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.110093:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940479616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.110122:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319280.110138:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940479744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.110153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319280.110176:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479616
00000100:00100000:2.0:1767319280.110179:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479616
00000100:00100000:2.0:1767319280.110198:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16939
00000100:00100000:2.0:1767319280.110201:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940479616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319280.110218:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319280.110242:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940479616:12345-0@lo:38:kworker.0 Request processed in 40us (119us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319280.110249:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16939
00000100:00080000:2.0:1767319280.110280:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319280.110283:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319280.110286:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940479616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.110306:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940479744
00000100:00100000:2.0:1767319280.110308:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940479744
00000100:00100000:2.0:1767319280.110321:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69
00000100:00100000:2.0:1767319280.110324:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940479744:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319280.110330:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319280.110348:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940479744:12345-0@lo:38:kworker.0 Request processed in 23us (194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319280.110352:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69
00000100:00080000:2.0:1767319280.110366:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319280.110368:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319280.110370:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940479744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.110389:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.110405:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319280.110429:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480000
00000100:00100000:2.0:1767319280.110432:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480000
00000100:00100000:2.0:1767319280.110456:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866
00000100:00100000:2.0:1767319280.110462:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.110492:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480000:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319280.110498:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866
00000100:00100000:2.0:1767319280.110539:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480000:0@lo:400:kworker.0
00000100:00080000:2.0:1767319280.110567:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319280.110570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319280.121980:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940479872:12345-0@lo:400:kworker.0 Request processed in 12228us (12446us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319280.122135:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865
00000100:00100000:3.0:1767319280.122321:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940479872:0@lo:400:kworker.0
00000100:00080000:1.0:1767319280.123532:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319280.123537:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319280.123541:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319280.123548:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1767319280.123552:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319280.123559:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319280.123584:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019f80 x1853163940480256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319280.123586:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940480128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.123656:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319280.123736:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940480384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.124082:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480128
00000100:00100000:2.0:1767319280.124091:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480128
00000100:00100000:2.0:1767319280.124150:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4396
00000100:00100000:2.0:1767319280.124161:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940480128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319280.124210:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940480256:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.124218:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940480128:12345-0@lo:400:kworker.0 Request processed in 60us (561us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319280.124224:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4396
00000100:00080000:2.0:1767319280.124245:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319280.124247:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319280.124259:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480256
00000100:00100000:2.0:1767319280.124263:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480256
00000100:00100000:0.0:1767319280.124282:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16940
00000100:00100000:0.0:1767319280.124287:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940480256:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.124302:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767319280.124312:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319280.124326:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480384
00000100:00100000:2.0:1767319280.124329:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480384
00000100:00100000:0.0:1767319280.124343:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940480256:12345-0@lo:38:kworker.0 Request processed in 55us (95us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319280.124349:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16940
00000100:00100000:2.0:1767319280.124352:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4397
00000100:00100000:2.0:1767319280.124358:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940480384:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319280.124378:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319280.124383:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319280.124386:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940480256:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.124388:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940480384:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319280.124393:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4397
00000100:00080000:2.0:1767319280.124405:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319280.124421:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940480384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319280.124453:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940480128:0@lo:400:kworker.0
00000100:00080000:1.0:1767319280.124737:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319280.124743:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319280.124745:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319280.124750:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1767319280.124753:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319280.124758:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319280.125499:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940480512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319280.125646:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940480512:0@lo:38:kworker.0
00000100:00100000:0.0:1767319280.125694:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319280.125964:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480512
00000100:00100000:1.0:1767319280.125970:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480512
00000100:00100000:1.0:1767319280.126130:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16941
00000100:00100000:1.0:1767319280.126138:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940480512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319280.126156:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319280.126209:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940480512:12345-0@lo:38:kworker.0 Request processed in 70us (513us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319280.126215:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16941
00000100:00080000:2.0:1767319280.126326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319280.126331:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319280.126336:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940480512:0@lo:38:kworker.0
00000100:00100000:2.0:1767319280.748927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319281.069241:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319281.645081:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319281.645109:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480640:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319281.645185:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319281.645363:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480640
00000100:00100000:3.0:1767319281.645371:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480640
00000100:00100000:3.0:1767319281.650446:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406
00000100:00100000:3.0:1767319281.650474:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319281.650513:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319281.650615:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (5429us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319281.650622:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406
00000100:00100000:0.0:1767319281.650807:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480640:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319281.736313:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319281.736421:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319281.747553:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309760
00000100:00100000:0.0:1767319281.747569:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309760
00000100:00100000:0.0:1767319281.747628:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894309888
00000100:00100000:0.0:1767319281.747630:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894309888
00000100:00100000:0.0:1767319281.747710:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4398
00000100:00100000:0.0:1767319281.747722:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894309888:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319281.747846:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894309888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (11423us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319281.747882:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4398
00000100:00100000:0.0:1767319281.747903:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16942
00000100:00100000:0.0:1767319281.747921:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894309760:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319281.747951:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319281.747975:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894309760:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (11672us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319281.747979:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16942
00000100:00080000:3.0:1767319281.748493:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319281.772970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319282.093540:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319282.669901:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319282.669981:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.670114:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940480768
00000100:00100000:0.0:1767319282.670123:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940480768
00000100:00100000:0.0:1767319282.670178:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407
00000100:00100000:0.0:1767319282.670194:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319282.670222:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319282.670276:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940480768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319282.670283:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407
00000100:00080000:3.0:1767319282.670351:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319282.670361:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940480768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319282.797240:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319283.117480:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319283.820950:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319284.143311:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319284.205171:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319259/real 1767319259]  req@ffff93d044334e00 x1853163940475392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319284 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319284.205203:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d044334e00 x1853163940475392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319284 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319284.205221:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319284.205248:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319284.205252:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940475392:0@lo:250:kworker.0
00000100:00080000:1.0:1767319284.205328:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319284.205333:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319284.205336:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319284.205342:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4509
00000100:00080000:1.0:1767319284.205346:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319284.205352:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319284.205381:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018380 x1853163940480896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319284.205406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319284.205410:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319284.205411:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319284.205414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4530
00000100:00080000:1.0:1767319284.205417:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319284.205420:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319284.205434:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940481024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319284.205442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319284.205446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319284.205448:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319284.205451:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4530
00000100:00080000:1.0:1767319284.205453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319284.205456:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319284.205467:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940481152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319284.205533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319284.205537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319284.205539:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319284.205542:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4530
00000100:00080000:1.0:1767319284.205545:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319284.205548:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319284.205558:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a300 x1853163940481664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319284.205573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319284.205575:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319284.205577:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319284.205580:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4530
00000100:00080000:1.0:1767319284.205582:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319284.205585:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319284.205594:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940481920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319284.205619:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940481536:0@lo:400:kworker.0
00000100:00100000:1.0:1767319284.205681:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319284.205732:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319284.205738:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940481792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319284.205760:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319284.205814:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481536
00000100:00100000:1.0:1767319284.205822:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481536
00000100:00100000:1.0:1767319284.205878:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481792
00000100:00100000:1.0:1767319284.205882:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481792
00000100:00100000:1.0:1767319284.205905:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4399
00000100:00100000:1.0:1767319284.205912:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940481536:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319284.205960:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940481536:12345-0@lo:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319284.205967:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4399
00000100:00100000:1.0:1767319284.205984:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400
00000100:00100000:1.0:1767319284.205990:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940481792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319284.206014:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940481792:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319284.206019:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400
00000100:00100000:1.0:1767319284.206053:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940481792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319284.206061:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940481536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319284.206204:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940481408:0@lo:400:kworker.0
00000100:00100000:3.0:1767319284.206238:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319284.206272:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319284.206278:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940481280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319284.206296:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319284.206314:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319284.206376:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481408
00000100:00100000:2.0:1767319284.206380:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481408
00000100:00100000:2.0:1767319284.206414:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481280
00000100:00100000:2.0:1767319284.206417:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481280
00000100:00100000:2.0:1767319284.206432:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867
00000100:00100000:2.0:1767319284.206437:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940481408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319284.206467:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940481408:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319284.206473:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867
00000100:00100000:2.0:1767319284.206482:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868
00000100:00100000:2.0:1767319284.206487:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940481280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319284.206517:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940481280:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319284.206522:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868
00000100:00080000:3.0:1767319284.206632:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319284.206635:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319284.206652:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940481280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319284.206660:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940481408:0@lo:400:kworker.0
00000100:00100000:0.0:1767319284.206727:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940480896:0@lo:250:kworker.0
00000400:00000100:0.0:1767319284.206748:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940480896 offset 0 length 520: 4
00000100:00100000:0.0:1767319284.206765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940481024:0@lo:38:kworker.0
00000100:00100000:0.0:1767319284.206800:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319284.206823:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940481152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319284.206858:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319284.206884:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940481664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319284.206905:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319284.206921:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940481920:0@lo:38:kworker.0
00000100:00100000:0.0:1767319284.206941:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319284.206969:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481024
00000100:00100000:0.0:1767319284.206973:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481024
00000100:00100000:0.0:1767319284.206993:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481664
00000100:00100000:0.0:1767319284.206997:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481664
00000100:00100000:0.0:1767319284.207008:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481920
00000100:00100000:0.0:1767319284.207011:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481920
00000100:00100000:0.0:1767319284.207023:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16943
00000100:00100000:0.0:1767319284.207027:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319284.207045:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319284.207079:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481024:12345-0@lo:38:kworker.0 Request processed in 50us (278us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319284.207085:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16943
00000100:00100000:0.0:1767319284.207098:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16944
00000100:00100000:0.0:1767319284.207102:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319284.207111:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319284.207133:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481664:12345-0@lo:38:kworker.0 Request processed in 29us (226us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319284.207138:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16944
00000100:00100000:0.0:1767319284.207149:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16945
00000100:00100000:0.0:1767319284.207153:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319284.207161:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319284.207184:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940481920:12345-0@lo:38:kworker.0 Request processed in 29us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319284.207189:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16945
00000100:00080000:0.0:1767319284.207223:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319284.207228:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319284.207231:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940481024:0@lo:38:kworker.0
00000100:00080000:0.0:1767319284.207239:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319284.207243:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319284.207246:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940481664:0@lo:38:kworker.0
00000100:00080000:0.0:1767319284.207252:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319284.207255:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319284.207258:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940481920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319284.207334:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940481152
00000100:00100000:3.0:1767319284.207338:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940481152
00000100:00100000:3.0:1767319284.207368:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70
00000100:00100000:3.0:1767319284.207372:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940481152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319284.207383:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319284.207416:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940481152:12345-0@lo:38:kworker.0 Request processed in 42us (557us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319284.207422:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70
00000100:00080000:3.0:1767319284.207444:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319284.207448:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319284.207451:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940481152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319284.844910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319285.165020:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319285.868921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319286.190219:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319286.766481:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319286.769389:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940482048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319286.769478:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319286.770000:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482048
00000100:00100000:2.0:1767319286.770011:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482048
00000100:00100000:2.0:1767319286.770080:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408
00000100:00100000:2.0:1767319286.770089:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940482048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319286.770122:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319286.770184:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940482048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (705us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319286.770192:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408
00000100:00100000:1.0:1767319286.770286:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940482048:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319286.770349:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319286.855647:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319286.855859:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310144
00000100:00100000:2.0:1767319286.855878:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310144
00000100:00100000:2.0:1767319286.855996:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4401
00000100:00100000:2.0:1767319286.856007:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894310144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319286.856112:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894310144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 106us (481us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319286.856119:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4401
00000100:00080000:3.0:1767319286.856362:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319286.860132:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319286.860252:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310016
00000100:00100000:0.0:1767319286.860269:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310016
00000100:00100000:0.0:1767319286.860345:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16946
00000100:00100000:0.0:1767319286.860354:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894310016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319286.860382:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319286.860467:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894310016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 113us (350us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319286.860475:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16946
00000100:00100000:2.0:1767319286.892969:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319287.215422:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319287.790433:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940482176:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319287.790533:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319287.790620:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482176
00000100:00100000:0.0:1767319287.790637:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482176
00000100:00080000:3.0:1767319287.790742:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319287.790809:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409
00000100:00100000:0.0:1767319287.790820:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940482176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319287.790855:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319287.790946:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940482176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (411us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319287.790952:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409
00000100:00100000:1.0:1767319287.791054:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940482176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319287.916964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319288.237184:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319288.942800:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319289.262345:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319289.325314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319289.325329:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319289.325333:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319289.325338:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319289.325343:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319289.325354:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4534
00000100:00080000:0.0:1767319289.325360:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319289.325369:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319289.325426:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2680 x1853163940482304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319289.325474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319289.325478:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319289.325480:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319289.325484:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4534
00000100:00080000:0.0:1767319289.325486:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319289.325490:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319289.325506:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0000 x1853163940482432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319289.325574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319289.325578:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319289.325580:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319289.325584:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4534
00000100:00080000:0.0:1767319289.325586:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319289.325591:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319289.325602:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b0a80 x1853163940482944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319289.325618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319289.325622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319289.325623:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319289.325626:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4534
00000100:00080000:0.0:1767319289.325628:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319289.325631:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319289.325641:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1880 x1853163940483200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319289.325671:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940482816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319289.325805:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319289.325949:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940482560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.325990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319289.326027:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482560
00000100:00100000:1.0:1767319289.326036:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482560
00000100:00100000:1.0:1767319289.326105:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869
00000100:00100000:1.0:1767319289.326115:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940482560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326176:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940482560:12345-0@lo:400:kworker.0 Request processed in 62us (184us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319289.326183:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869
00000100:00100000:1.0:1767319289.326214:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940482688:0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326239:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319289.326260:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482688
00000100:00100000:1.0:1767319289.326264:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482688
00000100:00100000:1.0:1767319289.326290:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870
00000100:00100000:1.0:1767319289.326296:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940482688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326329:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940482688:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319289.326334:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870
00000100:00100000:1.0:1767319289.326357:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940483072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326382:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319289.326427:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482816
00000100:00100000:1.0:1767319289.326430:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482816
00000100:00100000:1.0:1767319289.326462:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483072
00000100:00100000:1.0:1767319289.326466:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483072
00000100:00100000:1.0:1767319289.326489:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4402
00000100:00100000:1.0:1767319289.326495:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940482816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326527:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940482816:12345-0@lo:400:kworker.0 Request processed in 31us (752us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319289.326533:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4402
00000100:00100000:1.0:1767319289.326544:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4403
00000100:00100000:1.0:1767319289.326550:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940483072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319289.326579:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940483072:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319289.326585:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4403
00000100:00080000:3.0:1767319289.326668:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319289.326675:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319289.326677:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319289.326691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940482304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.326724:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319289.327176:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940482816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319289.327306:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482304
00000100:00100000:2.0:1767319289.327312:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482304
00000100:00100000:2.0:1767319289.327343:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16947
00000100:00100000:2.0:1767319289.327349:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940482304:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319289.327375:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319289.327419:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940482304:12345-0@lo:38:kworker.0 Request processed in 69us (694us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319289.327424:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16947
00000100:00100000:3.0:1767319289.327663:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940482560:0@lo:400:kworker.0
00000100:00080000:3.0:1767319289.327693:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319289.327713:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319289.327716:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940482304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.327724:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940482432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.327758:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319289.327812:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940482944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.327835:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319289.327863:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940483200:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.327885:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319289.328150:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940482688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319289.328214:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482432
00000100:00100000:2.0:1767319289.328220:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482432
00000100:00100000:2.0:1767319289.328252:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71
00000100:00100000:2.0:1767319289.328258:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940482432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319289.328271:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319289.328303:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940482432:12345-0@lo:38:kworker.0 Request processed in 44us (545us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319289.328309:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71
00000100:00100000:2.0:1767319289.328328:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940482944
00000100:00100000:2.0:1767319289.328331:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940482944
00000100:00100000:2.0:1767319289.328350:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483200
00000100:00100000:2.0:1767319289.328352:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483200
00000100:00100000:2.0:1767319289.328369:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16948
00000100:00100000:2.0:1767319289.328374:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940482944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319289.328384:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319289.328409:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940482944:12345-0@lo:38:kworker.0 Request processed in 34us (573us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319289.328415:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16948
00000100:00100000:2.0:1767319289.328425:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16949
00000100:00100000:2.0:1767319289.328429:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940483200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319289.328437:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319289.328470:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940483200:12345-0@lo:38:kworker.0 Request processed in 39us (584us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319289.328475:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16949
00000100:00080000:3.0:1767319289.329488:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319289.329498:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319289.329503:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940482432:0@lo:38:kworker.0
00000100:00080000:3.0:1767319289.329515:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319289.329519:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319289.329522:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940482944:0@lo:38:kworker.0
00000100:00080000:3.0:1767319289.329532:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319289.329536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319289.329540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940483200:0@lo:38:kworker.0
00000100:00100000:3.0:1767319289.329596:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940483072:0@lo:400:kworker.0
00000100:00100000:3.0:1767319289.965218:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319290.285239:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319290.993471:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319291.309271:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319291.885249:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940483328:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319291.885349:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319291.885492:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483328
00000100:00100000:2.0:1767319291.885514:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483328
00000100:00100000:2.0:1767319291.885626:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410
00000100:00100000:2.0:1767319291.885638:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940483328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319291.885687:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319291.885868:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940483328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 233us (519us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319291.885879:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410
00000100:00100000:0.0:1767319291.885951:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940483328:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319291.886088:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319291.980108:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319291.980205:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319291.981541:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310400
00000100:00100000:3.0:1767319291.981554:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310400
00000100:00080000:0.0:1767319291.981654:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319291.981660:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310272
00000100:00100000:3.0:1767319291.981677:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310272
00000100:00100000:3.0:1767319291.981710:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4404
00000100:00100000:3.0:1767319291.981728:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894310400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319291.981742:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16950
00000100:00100000:0.0:1767319291.981755:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894310272:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:3.0:1767319291.981846:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894310400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (1747us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319291.981854:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4404
00010000:00020000:0.0:1767319291.982693:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319291.982877:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894310272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1120us (2668us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319291.982887:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16950
00000100:00100000:3.0:1767319292.014206:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319292.333236:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319292.909110:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319292.909138:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940483456:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319292.909209:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319292.909362:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483456
00000100:00100000:2.0:1767319292.909371:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483456
00000100:00080000:0.0:1767319292.909443:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319292.909444:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411
00000100:00100000:2.0:1767319292.909463:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940483456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319292.909499:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319292.909555:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940483456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319292.909563:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411
00000100:00100000:1.0:1767319292.909691:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940483456:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319293.036941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319293.357326:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319294.061537:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319294.382679:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319294.446419:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319294.446429:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319294.446432:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319294.446435:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319294.446440:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319294.446448:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4539
00000100:00080000:1.0:1767319294.446452:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319294.446460:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319294.446500:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940483584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319294.446531:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319294.446536:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319294.446537:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319294.446541:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4539
00000100:00080000:1.0:1767319294.446543:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319294.446547:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319294.446560:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220a80 x1853163940483712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319294.446633:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319294.446636:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319294.446638:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319294.446642:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4539
00000100:00080000:1.0:1767319294.446644:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319294.446648:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319294.446660:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401aa00 x1853163940484224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319294.446675:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319294.446678:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319294.446679:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319294.446682:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4539
00000100:00080000:1.0:1767319294.446684:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319294.446687:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319294.446697:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401a300 x1853163940484480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319294.446725:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940484352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.446833:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319294.446895:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319294.446902:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940484096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.446925:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319294.447011:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940483968:0@lo:400:kworker.0
00000100:00100000:3.0:1767319294.447047:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319294.447083:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319294.447089:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940483840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319294.447111:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319294.447188:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940483584:0@lo:38:kworker.0
00000100:00100000:0.0:1767319294.447231:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319294.447257:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940483712:0@lo:38:kworker.0
00000100:00100000:0.0:1767319294.447282:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319294.447298:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940484224:0@lo:38:kworker.0
00000100:00100000:0.0:1767319294.447317:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319294.447333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940484480:0@lo:38:kworker.0
00000100:00100000:0.0:1767319294.447349:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319294.447376:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484352
00000100:00100000:0.0:1767319294.447383:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484352
00000100:00100000:0.0:1767319294.447427:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484096
00000100:00100000:0.0:1767319294.447429:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484096
00000100:00100000:0.0:1767319294.447442:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483584
00000100:00100000:0.0:1767319294.447445:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483584
00000100:00100000:0.0:1767319294.447452:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484224
00000100:00100000:0.0:1767319294.447454:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484224
00000100:00100000:0.0:1767319294.447460:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484480
00000100:00100000:0.0:1767319294.447462:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484480
00000100:00100000:0.0:1767319294.447473:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4405
00000100:00100000:0.0:1767319294.447481:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940484352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319294.447526:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940484352:12345-0@lo:400:kworker.0 Request processed in 45us (692us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319294.447533:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4405
00000100:00100000:0.0:1767319294.447549:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406
00000100:00100000:0.0:1767319294.447555:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940484096:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319294.447579:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940484096:12345-0@lo:400:kworker.0 Request processed in 25us (654us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319294.447584:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406
00000100:00100000:0.0:1767319294.447595:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16951
00000100:00100000:0.0:1767319294.447599:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940483584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319294.447615:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319294.447645:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940483584:12345-0@lo:38:kworker.0 Request processed in 43us (413us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319294.447651:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16951
00000100:00100000:0.0:1767319294.447661:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16952
00000100:00100000:0.0:1767319294.447665:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940484224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319294.447673:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319294.447693:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940484224:12345-0@lo:38:kworker.0 Request processed in 27us (375us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319294.447698:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16952
00000100:00100000:0.0:1767319294.447708:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16953
00000100:00100000:0.0:1767319294.447712:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940484480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319294.447720:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319294.447751:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940484480:12345-0@lo:38:kworker.0 Request processed in 38us (401us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319294.447756:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16953
00000100:00100000:0.0:1767319294.447794:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483712
00000100:00100000:0.0:1767319294.447797:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483712
00000100:00100000:0.0:1767319294.447813:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72
00000100:00100000:0.0:1767319294.447817:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940483712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319294.447826:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319294.447847:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940483712:12345-0@lo:38:kworker.0 Request processed in 29us (565us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319294.447852:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72
00000100:00080000:0.0:1767319294.447869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319294.447897:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319294.447901:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319294.447904:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940483584:0@lo:38:kworker.0
00000100:00080000:0.0:1767319294.447912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319294.447915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319294.447918:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940483712:0@lo:38:kworker.0
00000100:00080000:0.0:1767319294.447925:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319294.447927:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319294.447930:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940484224:0@lo:38:kworker.0
00000100:00080000:0.0:1767319294.447936:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319294.447939:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319294.447941:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940484480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319294.448233:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483968
00000100:00100000:1.0:1767319294.448238:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483968
00000100:00100000:1.0:1767319294.448288:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940483840
00000100:00100000:1.0:1767319294.448291:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940483840
00000100:00100000:1.0:1767319294.448323:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871
00000100:00100000:1.0:1767319294.448330:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940483968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.448373:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940483968:12345-0@lo:400:kworker.0 Request processed in 43us (1324us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319294.448379:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871
00000100:00100000:1.0:1767319294.448391:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872
00000100:00100000:1.0:1767319294.448397:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940483840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.448422:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940483840:12345-0@lo:400:kworker.0 Request processed in 26us (1310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319294.448427:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872
00000100:00100000:1.0:1767319294.448461:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940483840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.448471:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940483968:0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.448497:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940484096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319294.448506:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940484352:0@lo:400:kworker.0
00000100:00080000:0.0:1767319294.448680:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319294.448684:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319295.084934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319295.408424:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319296.108902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319296.429230:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319297.005149:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940484608:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319297.005237:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319297.005537:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484608
00000100:00100000:0.0:1767319297.005545:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484608
00000100:00100000:0.0:1767319297.005609:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412
00000100:00100000:0.0:1767319297.005618:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940484608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319297.005659:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319297.005704:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940484608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (467us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319297.005720:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412
00000100:00080000:2.0:1767319297.006126:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319297.006180:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940484608:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319297.096251:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319297.096413:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310528
00000100:00100000:2.0:1767319297.096423:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310528
00000100:00100000:2.0:1767319297.096478:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16954
00000100:00100000:2.0:1767319297.096486:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894310528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319297.096511:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319297.096581:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894310528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 93us (340us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319297.096589:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16954
00000100:00100000:3.0:1767319297.099003:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319297.099361:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310656
00000100:00100000:0.0:1767319297.099372:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310656
00000100:00100000:0.0:1767319297.099519:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4407
00000100:00100000:0.0:1767319297.099530:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894310656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319297.099612:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894310656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (617us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319297.099619:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4407
00000100:00080000:2.0:1767319297.104823:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319297.132910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319297.453683:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319298.029249:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319298.029274:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940484736:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319298.029361:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319298.030024:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484736
00000100:00100000:3.0:1767319298.030033:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484736
00000100:00100000:3.0:1767319298.030103:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413
00000100:00100000:3.0:1767319298.030115:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940484736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319298.030145:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319298.030195:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940484736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (834us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319298.030202:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413
00000100:00080000:2.0:1767319298.030489:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319298.030531:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940484736:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319298.158963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319298.478069:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319299.183480:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319299.501396:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319299.565101:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319299.565111:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319299.565114:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319299.565118:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319299.565123:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319299.565130:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4544
00000100:00080000:3.0:1767319299.565135:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319299.565142:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319299.565184:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3fb80 x1853163940484864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319299.565207:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319299.565210:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319299.565212:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319299.565215:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4544
00000100:00080000:3.0:1767319299.565217:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319299.565220:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319299.565231:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3ed80 x1853163940484992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319299.565283:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319299.565287:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319299.565288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319299.565291:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4544
00000100:00080000:3.0:1767319299.565294:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319299.565299:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319299.565307:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f8700 x1853163940485504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319299.565321:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319299.565324:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319299.565325:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319299.565329:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4544
00000100:00080000:3.0:1767319299.565331:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319299.565334:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319299.565345:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb480 x1853163940485760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319299.565491:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940485376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319299.565558:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319299.565634:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319299.565641:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940485632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319299.565665:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319299.565718:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485376
00000100:00100000:2.0:1767319299.565727:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485376
00000100:00100000:2.0:1767319299.566086:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485632
00000100:00100000:2.0:1767319299.566091:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485632
00000100:00100000:2.0:1767319299.566117:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4408
00000100:00100000:2.0:1767319299.566123:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940485376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319299.566172:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940485376:12345-0@lo:400:kworker.0 Request processed in 49us (613us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319299.566179:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4408
00000100:00100000:2.0:1767319299.566192:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4409
00000100:00100000:2.0:1767319299.566197:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940485632:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319299.566217:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940485632:12345-0@lo:400:kworker.0 Request processed in 20us (552us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319299.566222:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4409
00000100:00080000:2.0:1767319299.566239:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319299.566266:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940485632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319299.566274:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940485376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.566368:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940485120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.566402:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319299.566438:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319299.566444:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940485248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.566460:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319299.566492:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485120
00000100:00100000:1.0:1767319299.566495:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485120
00000100:00100000:1.0:1767319299.566520:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485248
00000100:00100000:1.0:1767319299.566522:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485248
00000100:00100000:1.0:1767319299.566535:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873
00000100:00100000:1.0:1767319299.566540:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940485120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.566568:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940485120:12345-0@lo:400:kworker.0 Request processed in 27us (164us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319299.566910:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873
00000100:00100000:1.0:1767319299.566926:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874
00000100:00100000:1.0:1767319299.566933:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940485248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.566965:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940485248:12345-0@lo:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319299.566971:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874
00000100:00100000:1.0:1767319299.567006:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940485248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319299.567017:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940485120:0@lo:400:kworker.0
00000100:00080000:2.0:1767319299.567091:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319299.567748:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940484864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319299.569077:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319299.569131:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940484992:0@lo:38:kworker.0
00000100:00100000:0.0:1767319299.569166:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319299.569187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940485504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319299.569202:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319299.569219:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940485760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319299.569234:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319299.569278:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484864
00000100:00100000:0.0:1767319299.569285:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484864
00000100:00100000:0.0:1767319299.569319:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485504
00000100:00100000:0.0:1767319299.569322:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485504
00000100:00100000:0.0:1767319299.569335:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485760
00000100:00100000:0.0:1767319299.569338:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485760
00000100:00100000:0.0:1767319299.569364:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16955
00000100:00100000:0.0:1767319299.569371:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940484864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319299.569391:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319299.569434:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940484864:12345-0@lo:38:kworker.0 Request processed in 61us (361us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319299.569440:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16955
00000100:00100000:0.0:1767319299.569456:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16956
00000100:00100000:0.0:1767319299.569459:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940485504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319299.569469:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319299.569492:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940485504:12345-0@lo:38:kworker.0 Request processed in 31us (288us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319299.569498:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16956
00000100:00100000:0.0:1767319299.569509:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16957
00000100:00100000:0.0:1767319299.569512:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940485760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319299.569519:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319299.569541:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940485760:12345-0@lo:38:kworker.0 Request processed in 27us (305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319299.569546:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16957
00000100:00080000:0.0:1767319299.569657:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319299.569662:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319299.569665:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940484864:0@lo:38:kworker.0
00000100:00080000:0.0:1767319299.569672:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319299.569675:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319299.569677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940485504:0@lo:38:kworker.0
00000100:00080000:0.0:1767319299.569684:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319299.569696:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319299.569699:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940485760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319299.571074:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940484992
00000100:00100000:2.0:1767319299.571087:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940484992
00000100:00100000:2.0:1767319299.571138:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73
00000100:00100000:2.0:1767319299.571146:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940484992:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319299.571169:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319299.571251:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940484992:12345-0@lo:38:kworker.0 Request processed in 105us (2084us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319299.571257:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73
00000100:00080000:3.0:1767319299.571339:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319299.571344:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319299.571348:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940484992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319300.204906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319300.527139:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319301.196987:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319301.197027:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894310784 offset 0 length 520: 4
00000100:00100000:3.0:1767319301.197050:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319301.199907:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311040
00000100:00100000:2.0:1767319301.199925:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311040
00000100:00100000:2.0:1767319301.200116:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894310912
00000100:00100000:2.0:1767319301.200121:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894310912
00000100:00100000:2.0:1767319301.200151:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4410
00000100:00100000:2.0:1767319301.200165:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894311040:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319301.200269:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894311040:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (3293us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319301.200281:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4410
00000100:00100000:2.0:1767319301.200301:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16958
00000100:00100000:2.0:1767319301.200305:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894310912:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319301.200328:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319301.201097:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894310912:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 784us (4040us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319301.201108:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16958
00000100:00080000:3.0:1767319301.208954:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319301.228999:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319301.549190:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319302.126487:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319302.126518:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940485888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319302.126610:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319302.126953:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940485888
00000100:00100000:0.0:1767319302.126961:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940485888
00000100:00100000:0.0:1767319302.127037:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1767319302.127047:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940485888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319302.127077:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319302.127126:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940485888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (515us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319302.127144:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1767319302.127434:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940485888:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319302.127850:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319302.253013:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319302.575367:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319303.149594:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940486016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319303.149684:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319303.149853:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486016
00000100:00100000:2.0:1767319303.149862:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486016
00000100:00100000:2.0:1767319303.149933:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415
00000100:00100000:2.0:1767319303.149942:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940486016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319303.149971:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319303.150037:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319303.157109:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940486016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7157us (7414us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319303.157133:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415
00000100:00100000:0.0:1767319303.157768:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940486016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319303.277225:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319303.597033:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319304.300917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319304.621691:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319304.685148:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319304.685160:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319304.685164:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319304.685168:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319304.685173:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319304.685182:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319304.685196:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319304.685203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319304.685242:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9880 x1853163940486144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319304.685265:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319304.685268:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319304.685270:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319304.685274:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319304.685276:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319304.685279:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319304.685291:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb480 x1853163940486272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319304.685338:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319304.685342:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319304.685344:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319304.685348:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319304.685350:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319304.685355:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319304.685366:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940486784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319304.685387:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319304.685390:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319304.685392:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319304.685395:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319304.685397:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319304.685401:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319304.685409:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940487040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319304.685451:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940486528:0@lo:400:kworker.0
00000100:00100000:3.0:1767319304.685523:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319304.685600:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940486656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319304.685623:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319304.685639:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319304.685659:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940486912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319304.685678:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319304.685929:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940486400:0@lo:400:kworker.0
00000100:00100000:1.0:1767319304.685962:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319304.686277:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486528
00000100:00100000:3.0:1767319304.686287:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486528
00000100:00100000:3.0:1767319304.686473:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486400
00000100:00100000:3.0:1767319304.686479:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486400
00000100:00100000:0.0:1767319304.686541:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940486144:0@lo:38:kworker.0
00000100:00100000:0.0:1767319304.686575:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319304.686596:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940486272:0@lo:38:kworker.0
00000100:00100000:0.0:1767319304.686620:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319304.686635:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940486784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319304.686666:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319304.686683:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940487040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319304.686703:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319304.686738:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486656
00000100:00100000:0.0:1767319304.686743:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486656
00000100:00100000:0.0:1767319304.686787:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486912
00000100:00100000:0.0:1767319304.686790:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486912
00000100:00100000:0.0:1767319304.686804:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486144
00000100:00100000:0.0:1767319304.686807:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486144
00000100:00100000:0.0:1767319304.686815:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486784
00000100:00100000:0.0:1767319304.686818:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486784
00000100:00100000:0.0:1767319304.686824:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487040
00000100:00100000:0.0:1767319304.686826:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487040
00000100:00100000:0.0:1767319304.686839:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4411
00000100:00100000:0.0:1767319304.686848:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940486656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319304.686855:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875
00000100:00100000:1.0:1767319304.686867:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940486528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319304.686912:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940486656:12345-0@lo:400:kworker.0 Request processed in 65us (1286us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319304.686919:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4411
00000100:00100000:0.0:1767319304.686935:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4412
00000100:00100000:0.0:1767319304.686941:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940486912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319304.686970:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940486912:12345-0@lo:400:kworker.0 Request processed in 29us (1291us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319304.686979:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412
00000100:00100000:0.0:1767319304.686991:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16959
00000100:00100000:0.0:1767319304.686994:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940486144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319304.687012:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319304.687040:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940486144:12345-0@lo:38:kworker.0 Request processed in 44us (464us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319304.687046:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16959
00000100:00100000:0.0:1767319304.687057:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960
00000100:00100000:0.0:1767319304.687060:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940486784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319304.687068:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319304.687088:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940486784:12345-0@lo:38:kworker.0 Request processed in 26us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319304.687093:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960
00000100:00100000:0.0:1767319304.687104:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961
00000100:00100000:0.0:1767319304.687107:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940487040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319304.687115:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319304.687134:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940487040:12345-0@lo:38:kworker.0 Request processed in 26us (430us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319304.687139:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961
00000100:00100000:0.0:1767319304.687157:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940486272
00000100:00100000:0.0:1767319304.687160:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940486272
00000100:00100000:0.0:1767319304.687175:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74
00000100:00100000:0.0:1767319304.687179:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940486272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319304.687187:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319304.687220:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940486528:12345-0@lo:400:kworker.0 Request processed in 355us (1693us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319304.687221:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940486272:12345-0@lo:38:kworker.0 Request processed in 37us (597us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319304.687235:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875
00000100:00100000:0.0:1767319304.687236:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74
00000100:00100000:1.0:1767319304.687261:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876
00000100:00100000:1.0:1767319304.687269:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940486400:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319304.687305:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940486400:12345-0@lo:400:kworker.0 Request processed in 36us (1342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319304.687312:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876
00000100:00080000:0.0:1767319304.687326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319304.687331:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319304.687334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:1.0:1767319304.687337:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319304.687340:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940486144:0@lo:38:kworker.0
00000100:00080000:0.0:1767319304.687354:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319304.687357:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319304.687361:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940486272:0@lo:38:kworker.0
00000100:00080000:0.0:1767319304.687371:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319304.687374:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319304.687377:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940486784:0@lo:38:kworker.0
00000100:00080000:0.0:1767319304.687383:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319304.687386:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319304.687389:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940487040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319304.687432:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940486400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319304.687490:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940486912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319304.687500:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940486656:0@lo:400:kworker.0
00000100:00100000:1.0:1767319304.687689:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940486528:0@lo:400:kworker.0
00000100:00100000:3.0:1767319305.324944:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319305.645353:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319306.313898:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319306.313949:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319306.314152:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311168
00000100:00100000:2.0:1767319306.314163:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311168
00000100:00100000:2.0:1767319306.314208:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311296
00000100:00100000:2.0:1767319306.314212:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311296
00000100:00100000:2.0:1767319306.314261:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4413
00000100:00100000:2.0:1767319306.314270:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894311296:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319306.314359:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894311296:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319306.314368:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4413
00000100:00100000:2.0:1767319306.314386:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16962
00000100:00100000:2.0:1767319306.314391:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894311168:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319306.314410:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319306.314434:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894311168:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 41us (546us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319306.314440:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16962
00000100:00080000:1.0:1767319306.314573:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319306.352920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319306.670241:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319307.245497:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319307.245525:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940487168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319307.245598:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319307.245694:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487168
00000100:00100000:2.0:1767319307.245705:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487168
00000100:00080000:0.0:1767319307.245802:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319307.245808:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416
00000100:00100000:2.0:1767319307.245820:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940487168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319307.245853:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319307.245911:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940487168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319307.245919:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416
00000100:00100000:3.0:1767319307.246167:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940487168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319307.372992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319307.696362:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319308.269439:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319308.269464:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940487296:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319308.269532:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319308.269736:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487296
00000100:00100000:2.0:1767319308.269745:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487296
00000100:00100000:2.0:1767319308.269830:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417
00000100:00100000:2.0:1767319308.269840:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940487296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319308.269870:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319308.269917:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940487296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (384us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319308.269925:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417
00000100:00080000:0.0:1767319308.269994:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319308.270035:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940487296:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319308.396914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319308.717186:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319309.420890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319309.741803:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319309.805047:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319284/real 1767319284]  req@ffff93d044018380 x1853163940480896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319309.805084:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d044018380 x1853163940480896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319309.805108:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319309.805119:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319309.805123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940480896:0@lo:250:kworker.0
00000100:00080000:3.0:1767319309.806882:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319309.806893:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319309.806897:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319309.806904:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4534
00000100:00080000:3.0:1767319309.806908:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319309.806916:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319309.806955:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96d80 x1853163940487424/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319309.806991:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319309.807002:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319309.807004:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319309.807008:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319309.807011:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319309.807016:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940487424:0@lo:250:kworker.0
00000100:00080000:3.0:1767319309.807016:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319309.807049:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb97b80 x1853163940487552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319309.807059:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319309.807062:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319309.807064:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000400:00000100:0.0:1767319309.807069:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940487424 offset 0 length 520: 4
00000100:00080000:3.0:1767319309.807072:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319309.807077:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319309.807081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319309.807097:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940487680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319309.807135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940487552:0@lo:38:kworker.0
00000100:00080000:3.0:1767319309.807154:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319309.807159:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319309.807161:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319309.807166:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4554
00000100:00100000:0.0:1767319309.807171:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319309.807172:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319309.807179:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319309.807192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940487680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319309.807195:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319309.807213:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319309.807220:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319309.807224:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319309.807227:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767319309.807229:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940488192:0@lo:38:kworker.0
00000100:00080000:3.0:1767319309.807234:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319309.807238:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319309.807242:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319309.807247:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319309.807258:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8a680 x1853163940488448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319309.807268:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940487808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319309.807288:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319309.807300:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940488064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319309.807303:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319309.807309:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940487936:0@lo:400:kworker.0
00000100:00100000:0.0:1767319309.807349:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319309.807349:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319309.807422:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940488320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319309.807431:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487808
00000100:00100000:2.0:1767319309.807438:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487808
00000100:00100000:2.0:1767319309.807481:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1767319309.807488:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940487808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319309.808157:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487552
00000100:00100000:0.0:1767319309.808164:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487552
00000100:00100000:0.0:1767319309.808191:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488192
00000100:00100000:0.0:1767319309.808194:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488192
00000100:00100000:0.0:1767319309.808206:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488064
00000100:00100000:0.0:1767319309.808209:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488064
00000100:00100000:0.0:1767319309.808235:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4414
00000100:00100000:0.0:1767319309.808243:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940488064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319309.808703:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940488064:12345-0@lo:400:kworker.0 Request processed in 458us (1358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319309.808712:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4414
00000100:00100000:0.0:1767319309.808733:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16963
00000100:00100000:0.0:1767319309.808737:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940487552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319309.808756:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319309.808859:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940487552:12345-0@lo:38:kworker.0 Request processed in 119us (1689us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319309.808865:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16963
00000100:00100000:0.0:1767319309.808877:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964
00000100:00100000:0.0:1767319309.808881:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940488192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319309.808891:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319309.813242:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940488064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319309.813309:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319309.813343:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487936
00000100:00100000:3.0:1767319309.813354:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487936
00000100:00100000:3.0:1767319309.813419:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878
00000100:00100000:3.0:1767319309.813430:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940487936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319309.813469:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488320
00000100:00100000:1.0:1767319309.813477:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488320
00000100:00100000:3.0:1767319309.813498:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940487936:12345-0@lo:400:kworker.0 Request processed in 68us (6154us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319309.813507:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878
00000100:00100000:1.0:1767319309.813518:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4415
00000100:00100000:1.0:1767319309.813527:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940488320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319309.813565:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940488320:12345-0@lo:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319309.813570:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4415
00000100:00100000:1.0:1767319309.813609:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940487680
00000100:00100000:1.0:1767319309.813614:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940487680
00000100:00100000:1.0:1767319309.813636:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75
00000100:00100000:1.0:1767319309.813641:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940487680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319309.813660:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319309.813693:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940487680:12345-0@lo:38:kworker.0 Request processed in 51us (6479us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319309.813698:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75
00000100:00100000:1.0:1767319309.813722:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940488448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319309.813761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319309.813822:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319309.813827:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319309.813830:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940487552:0@lo:38:kworker.0
00000100:00080000:1.0:1767319309.813839:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319309.813842:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319309.813845:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940487680:0@lo:38:kworker.0
00000100:00100000:1.0:1767319309.813878:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488448
00000100:00100000:1.0:1767319309.813881:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488448
00000100:00100000:1.0:1767319309.813903:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965
00000100:00100000:1.0:1767319309.813918:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940488448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319309.813929:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319309.813962:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940488448:12345-0@lo:38:kworker.0 Request processed in 42us (200us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319309.813969:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965
00000100:00080000:1.0:1767319309.814006:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319309.814010:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319309.814013:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940488448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319309.814038:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940488320:0@lo:400:kworker.0
00000100:00100000:1.0:1767319309.814109:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940487936:0@lo:400:kworker.0
00000100:00080000:1.0:1767319309.814150:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319309.814156:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319309.817339:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940488192:12345-0@lo:38:kworker.0 Request processed in 8443us (10079us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319309.817356:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964
00000100:00080000:1.0:1767319309.817370:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319309.817378:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319309.817382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940488192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319309.817858:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940487808:12345-0@lo:400:kworker.0 Request processed in 10367us (10565us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319309.817869:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877
00000100:00100000:1.0:1767319309.818112:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940487808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319310.445067:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319310.765629:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319311.430926:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319311.430986:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319311.431151:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311424
00000100:00100000:2.0:1767319311.431162:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311424
00000100:00100000:2.0:1767319311.431202:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311552
00000100:00100000:2.0:1767319311.431205:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311552
00000100:00100000:2.0:1767319311.431255:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4416
00000100:00100000:2.0:1767319311.431265:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894311552:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319311.431348:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894311552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319311.431355:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4416
00000100:00100000:2.0:1767319311.431373:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16966
00000100:00100000:2.0:1767319311.431377:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894311424:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319311.431398:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319311.431423:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894311424:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (511us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319311.431430:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16966
00000100:00080000:3.0:1767319311.432150:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319311.468925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319311.789621:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319312.365387:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319312.365413:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940488576:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319312.365487:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319312.365691:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488576
00000100:00100000:3.0:1767319312.365699:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488576
00000100:00100000:3.0:1767319312.365758:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418
00000100:00100000:3.0:1767319312.365788:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940488576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319312.365822:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319312.365881:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940488576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319312.365889:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418
00000100:00100000:2.0:1767319312.365925:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940488576:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319312.365993:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319312.495168:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319312.819962:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319313.389555:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940488704:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319313.389646:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319313.389836:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488704
00000100:00100000:3.0:1767319313.389844:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488704
00000100:00100000:3.0:1767319313.389917:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419
00000100:00100000:3.0:1767319313.389930:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940488704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319313.389963:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319313.390012:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940488704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319313.390019:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419
00000100:00100000:2.0:1767319313.390271:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940488704:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319313.390416:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319313.516983:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319313.846886:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319314.541807:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319314.861607:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319314.926349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319314.926362:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319314.926366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319314.926370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319314.926375:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319314.926385:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319314.926391:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319314.926399:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319314.926450:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412a00 x1853163940488832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319314.926497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319314.926502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319314.926503:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319314.926507:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319314.926510:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319314.926513:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319314.926527:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334000 x1853163940488960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319314.926578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940488832:0@lo:38:kworker.0
00000100:00080000:0.0:1767319314.926618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319314.926622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319314.926625:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319314.926629:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319314.926632:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319314.926636:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319314.926652:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334700 x1853163940489472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319314.926653:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940489216:0@lo:400:kworker.0
00000100:00100000:1.0:1767319314.926672:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319314.926737:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940489088:0@lo:400:kworker.0
00000100:00080000:0.0:1767319314.926796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319314.926800:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319314.926802:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319314.926807:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319314.926809:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319314.926813:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319314.926829:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38700 x1853163940489728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319314.926855:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940489600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319314.931821:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319314.931929:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940489344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319314.931977:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319314.932013:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488832
00000100:00100000:2.0:1767319314.932021:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488832
00000100:00100000:2.0:1767319314.932059:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489344
00000100:00100000:2.0:1767319314.932062:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489344
00000100:00100000:2.0:1767319314.932104:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4417
00000100:00100000:2.0:1767319314.932113:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940489344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319314.932168:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940489344:12345-0@lo:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319314.932176:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4417
00000100:00100000:2.0:1767319314.932194:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967
00000100:00100000:2.0:1767319314.932198:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940488832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319314.932219:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319314.932262:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940488832:12345-0@lo:38:kworker.0 Request processed in 62us (5595us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319314.932269:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967
00000100:00080000:2.0:1767319314.932285:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319314.932320:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940489344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319314.932345:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489216
00000100:00100000:2.0:1767319314.932349:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489216
00000100:00100000:2.0:1767319314.932391:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1767319314.932398:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940489216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319314.932434:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940489216:12345-0@lo:400:kworker.0 Request processed in 37us (621us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319314.932440:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1767319314.932477:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940489216:0@lo:400:kworker.0
00000100:00080000:1.0:1767319314.936571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319314.936585:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319314.936590:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940488832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319314.936603:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940488960:0@lo:38:kworker.0
00000100:00100000:1.0:1767319314.937534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319314.937676:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940489472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319314.937712:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319314.937736:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940489728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319314.937761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319314.937826:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489472
00000100:00100000:1.0:1767319314.937833:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489472
00000100:00100000:1.0:1767319314.937868:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489728
00000100:00100000:1.0:1767319314.937871:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489728
00000100:00100000:1.0:1767319314.937891:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968
00000100:00100000:1.0:1767319314.937898:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940489472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319314.937928:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319314.937973:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940489472:12345-0@lo:38:kworker.0 Request processed in 74us (259us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319314.937981:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968
00000100:00100000:1.0:1767319314.937998:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969
00000100:00100000:1.0:1767319314.938002:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940489728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319314.938011:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319314.938037:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940489728:12345-0@lo:38:kworker.0 Request processed in 33us (275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319314.938043:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969
00000100:00080000:1.0:1767319314.938081:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319314.938087:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319314.938091:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940489472:0@lo:38:kworker.0
00000100:00080000:1.0:1767319314.938100:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319314.938104:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319314.938107:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940489728:0@lo:38:kworker.0
00000100:00100000:3.0:1767319314.940611:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319314.941282:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319314.941481:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489600
00000100:00100000:3.0:1767319314.941493:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489600
00000100:00100000:3.0:1767319314.941578:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418
00000100:00100000:3.0:1767319314.941588:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940489600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319314.941656:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940489600:12345-0@lo:400:kworker.0 Request processed in 69us (374us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319314.941664:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418
00000100:00100000:1.0:1767319314.941756:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489088
00000100:00080000:0.0:1767319314.941762:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319314.941763:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489088
00000100:00100000:0.0:1767319314.941817:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940489600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319314.941847:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880
00000100:00100000:1.0:1767319314.941857:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940489088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319314.941911:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940489088:12345-0@lo:400:kworker.0 Request processed in 56us (1307us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319314.941918:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880
00000100:00100000:0.0:1767319314.942417:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940489088:0@lo:400:kworker.0
00000100:00080000:3.0:1767319314.942480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319314.944032:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940488960
00000100:00100000:2.0:1767319314.944049:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940488960
00000100:00100000:2.0:1767319314.944107:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76
00000100:00100000:2.0:1767319314.944117:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940488960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319314.944232:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319314.944430:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940488960:12345-0@lo:38:kworker.0 Request processed in 311us (6897us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319314.944442:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76
00000100:00080000:3.0:1767319314.944620:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319314.944626:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319314.944630:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940488960:0@lo:38:kworker.0
00000100:00100000:2.0:1767319315.564902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319315.885804:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319316.563043:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319316.563113:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319316.564757:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311808
00000100:00100000:2.0:1767319316.564808:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311808
00000100:00100000:2.0:1767319316.564908:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311680
00000100:00100000:2.0:1767319316.564912:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311680
00000100:00100000:2.0:1767319316.564939:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4419
00000100:00100000:2.0:1767319316.564951:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894311808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319316.565044:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894311808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (2015us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319316.565053:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4419
00000100:00100000:2.0:1767319316.565074:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16970
00000100:00100000:2.0:1767319316.565079:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894311680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319316.565115:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319316.568806:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319316.617384:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00000100:00100000:2.0:1767319316.644047:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894311680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 78950us (80928us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319316.644066:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16970
00010000:00010000:2.0:1767319316.909692:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319317.485083:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319317.485110:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940489856:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319317.485182:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319317.486420:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489856
00000100:00100000:1.0:1767319317.486433:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489856
00000100:00100000:1.0:1767319317.486551:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420
00000100:00100000:1.0:1767319317.486562:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940489856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319317.486606:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319317.486681:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940489856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (1498us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319317.486689:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420
00000100:00100000:0.0:1767319317.486847:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940489856:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319317.487212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319317.676881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319317.933704:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319318.510106:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319318.510131:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940489984:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319318.510203:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319318.512721:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940489984
00000100:00100000:3.0:1767319318.512743:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940489984
00000100:00100000:3.0:1767319318.512884:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421
00000100:00100000:3.0:1767319318.512897:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940489984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319318.512937:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319318.513025:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940489984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (2821us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319318.513033:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421
00000100:00080000:1.0:1767319318.513279:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319318.513341:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940489984:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319318.701010:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319318.958276:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319319.725302:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319319.981525:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319320.046793:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319320.046803:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319320.046807:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319320.046810:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319320.046814:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319320.046821:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319320.046826:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319320.046833:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319320.046872:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940490112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319320.047161:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319320.047165:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319320.047167:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319320.047171:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319320.047173:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319320.047177:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319320.047191:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88a80 x1853163940490240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319320.047268:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940490112:0@lo:38:kworker.0
00000100:00100000:1.0:1767319320.047341:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319320.047403:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940490240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319320.047429:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319320.047475:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490240
00000100:00100000:1.0:1767319320.047483:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490240
00000100:00100000:1.0:1767319320.047525:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77
00000100:00100000:1.0:1767319320.047532:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940490240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319320.047556:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319320.047612:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940490240:12345-0@lo:38:kworker.0 Request processed in 78us (180us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319320.047619:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77
00000100:00080000:1.0:1767319320.047660:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319320.047664:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319320.047668:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940490240:0@lo:38:kworker.0
00000100:00100000:0.0:1767319320.047763:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319320.047813:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319320.047827:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940490496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319320.047845:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940490368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319320.047871:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319320.048033:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490112
00000100:00100000:1.0:1767319320.048038:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490496
00000100:00100000:2.0:1767319320.048039:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490112
00000100:00100000:1.0:1767319320.048043:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490496
00000100:00100000:2.0:1767319320.048067:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971
00000100:00100000:2.0:1767319320.048073:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940490112:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319320.048085:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319320.048120:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940490112:12345-0@lo:38:kworker.0 Request processed in 45us (778us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319320.048127:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971
00000100:00080000:2.0:1767319320.048150:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319320.048154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319320.048157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940490112:0@lo:38:kworker.0
00000100:00100000:0.0:1767319320.048232:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319320.048237:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881
00000100:00100000:1.0:1767319320.048244:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940490496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319320.048329:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940490496:12345-0@lo:400:kworker.0 Request processed in 87us (460us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319320.048334:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881
00000100:00100000:1.0:1767319320.048343:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490368
00000100:00100000:1.0:1767319320.048346:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490368
00000100:00100000:1.0:1767319320.048365:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882
00000100:00100000:1.0:1767319320.048371:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940490368:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319320.048380:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319320.048384:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319320.048386:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319320.048390:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319320.048393:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319320.048394:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940490368:12345-0@lo:400:kworker.0 Request processed in 25us (164us total) trans 0 rc 0/0
00000100:00080000:3.0:1767319320.048406:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00080000:2.0:1767319320.048568:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319320.048573:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319320.048719:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882
00000100:00100000:3.0:1767319320.048722:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88700 x1853163940490752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319320.048753:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319320.048755:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319320.048757:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319320.048759:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319320.048761:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319320.048764:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319320.048794:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940490880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319320.048795:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abfb80 x1853163940491008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319320.048822:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940490624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319320.048845:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319320.048867:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940490752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319320.049804:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940490368:0@lo:400:kworker.0
00000100:00100000:0.0:1767319320.049838:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490880
00000100:00100000:0.0:1767319320.049842:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490880
00000100:00100000:0.0:1767319320.050132:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4420
00000100:00100000:0.0:1767319320.050142:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940490880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319320.050362:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319320.050383:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319320.050390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940491008:0@lo:38:kworker.0
00000100:00100000:1.0:1767319320.050405:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490752
00000100:00100000:1.0:1767319320.050411:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490752
00000100:00100000:3.0:1767319320.050420:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319320.050449:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491008
00000100:00100000:3.0:1767319320.050452:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491008
00000100:00100000:1.0:1767319320.050462:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972
00000100:00100000:1.0:1767319320.050469:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940490752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319320.050490:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319320.050545:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940490752:12345-0@lo:38:kworker.0 Request processed in 74us (182us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319320.050576:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940490880:12345-0@lo:400:kworker.0 Request processed in 435us (1731us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319320.050620:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973
00000100:00100000:3.0:1767319320.050625:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940491008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319320.050636:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319320.050664:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940491008:12345-0@lo:38:kworker.0 Request processed in 38us (242us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319320.050673:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973
00000100:00100000:1.0:1767319320.050681:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972
00000100:00100000:3.0:1767319320.050708:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319320.050757:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940490880:0@lo:400:kworker.0
00000100:00080000:3.0:1767319320.050766:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319320.050796:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319320.050801:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940490752:0@lo:38:kworker.0
00000100:00100000:1.0:1767319320.050807:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940490624
00000100:00080000:3.0:1767319320.050813:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319320.050814:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940490624
00000100:00080000:3.0:1767319320.050821:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319320.050825:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940491008:0@lo:38:kworker.0
00000100:00080000:1.0:1767319320.050837:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319320.050867:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4421
00000100:00100000:1.0:1767319320.050875:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940490624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319320.050989:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940490624:12345-0@lo:400:kworker.0 Request processed in 114us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319320.050997:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4421
00000100:00100000:3.0:1767319320.051346:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940490624:0@lo:400:kworker.0
00000100:00100000:0.0:1767319320.052933:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4420
00000100:00100000:2.0:1767319320.053488:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940490496:0@lo:400:kworker.0
00000100:00100000:3.0:1767319320.748898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319321.005756:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319321.677464:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319321.677529:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319321.677588:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312064
00000100:00100000:0.0:1767319321.677600:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312064
00000100:00100000:0.0:1767319321.677719:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894311936
00000100:00100000:0.0:1767319321.677723:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894311936
00000100:00100000:0.0:1767319321.677750:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4422
00000100:00100000:0.0:1767319321.677762:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894312064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319321.677884:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894312064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 124us (433us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319321.677894:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4422
00000100:00100000:0.0:1767319321.677914:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16974
00000100:00100000:0.0:1767319321.677920:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894311936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319321.677941:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319321.677964:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894311936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (436us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319321.677971:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16974
00000100:00080000:2.0:1767319321.678185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319321.774243:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319322.029824:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319322.605053:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319322.605083:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940491136:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319322.605162:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319322.605876:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491136
00000100:00100000:3.0:1767319322.605886:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491136
00000100:00100000:3.0:1767319322.606024:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422
00000100:00100000:3.0:1767319322.606037:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940491136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319322.606078:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319322.606160:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940491136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (997us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319322.606167:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422
00000100:00100000:0.0:1767319322.606277:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940491136:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319322.606616:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319322.797261:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319323.055093:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319323.629169:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940491264:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319323.629244:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319323.629383:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491264
00000100:00100000:1.0:1767319323.629392:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491264
00000100:00080000:3.0:1767319323.633315:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319323.633537:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423
00000100:00100000:1.0:1767319323.633572:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940491264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319323.633617:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319323.633721:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940491264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (4476us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319323.633728:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423
00000100:00100000:0.0:1767319323.633849:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940491264:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319323.821751:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319324.077244:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319324.844933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319325.102970:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319325.165135:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319325.165145:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319325.165149:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319325.165153:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319325.165157:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319325.165165:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4570
00000100:00080000:2.0:1767319325.165170:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319325.165177:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319325.165228:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08000 x1853163940491392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319325.165247:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319325.165251:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319325.165253:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319325.165256:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4570
00000100:00080000:2.0:1767319325.165259:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319325.165262:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319325.165274:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09180 x1853163940491520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319325.165338:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319325.165342:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319325.165344:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319325.165347:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4570
00000100:00080000:2.0:1767319325.165350:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319325.165354:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319325.165366:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337800 x1853163940492032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319325.165374:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940491776:0@lo:400:kworker.0
00000100:00080000:2.0:1767319325.165385:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319325.165388:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319325.165390:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319325.165395:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4570
00000100:00080000:2.0:1767319325.165397:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319325.165401:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319325.165416:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219c700 x1853163940492288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319325.165440:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940491904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319325.165449:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319325.165516:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940491648:0@lo:400:kworker.0
00000100:00100000:0.0:1767319325.166975:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940492160:0@lo:400:kworker.0
00000100:00100000:2.0:1767319325.169547:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319325.169702:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940491392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319325.169752:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319325.169804:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940491520:0@lo:38:kworker.0
00000100:00100000:2.0:1767319325.169833:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319325.170432:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940492032:0@lo:38:kworker.0
00000100:00100000:2.0:1767319325.170472:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319325.170498:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940492288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319325.170530:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319325.170582:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491520
00000100:00100000:2.0:1767319325.170590:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491520
00000100:00100000:2.0:1767319325.170633:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78
00000100:00100000:2.0:1767319325.170641:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940491520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319325.170664:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319325.170715:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940491520:12345-0@lo:38:kworker.0 Request processed in 74us (881us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319325.170723:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78
00000100:00100000:2.0:1767319325.170747:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491904
00000100:00100000:2.0:1767319325.170750:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491904
00000100:00100000:2.0:1767319325.170829:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491392
00000100:00100000:2.0:1767319325.170833:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491392
00000100:00100000:2.0:1767319325.171322:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492032
00000100:00100000:2.0:1767319325.171327:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492032
00000100:00100000:2.0:1767319325.171337:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492288
00000100:00100000:2.0:1767319325.171339:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492288
00000100:00100000:2.0:1767319325.171348:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4423
00000100:00100000:2.0:1767319325.171356:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940491904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319325.171407:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940491904:12345-0@lo:400:kworker.0 Request processed in 52us (1868us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319325.171414:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4423
00000100:00100000:2.0:1767319325.171428:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16975
00000100:00100000:2.0:1767319325.171432:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940491392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319325.171445:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319325.171484:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940491392:12345-0@lo:38:kworker.0 Request processed in 51us (1731us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319325.171490:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16975
00000100:00100000:2.0:1767319325.171502:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976
00000100:00100000:2.0:1767319325.171506:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940492032:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319325.172006:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16977
00000100:00100000:1.0:1767319325.172013:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940492288:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319325.172203:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319325.172248:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491776
00000100:00100000:3.0:1767319325.172254:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491776
00000100:00100000:3.0:1767319325.172300:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940491648
00000100:00100000:3.0:1767319325.172304:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940491648
00000100:00100000:3.0:1767319325.172331:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883
00000100:00100000:3.0:1767319325.172337:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940491776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319325.172374:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940491776:12345-0@lo:400:kworker.0 Request processed in 37us (6926us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319325.172380:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883
00000100:00100000:3.0:1767319325.172408:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884
00000100:00100000:3.0:1767319325.172414:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940491648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319325.172440:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940491648:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319325.172445:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884
00000100:00100000:3.0:1767319325.172509:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940491648:0@lo:400:kworker.0
00000100:00080000:3.0:1767319325.172564:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319325.172568:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319325.172571:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319325.172599:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319325.172604:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319325.172607:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940491392:0@lo:38:kworker.0
00000100:00080000:3.0:1767319325.172617:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319325.172620:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319325.172623:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940491520:0@lo:38:kworker.0
00000100:00100000:3.0:1767319325.172675:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940491904:0@lo:400:kworker.0
00010000:00020000:2.0:1767319325.174588:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319325.174676:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940492032:12345-0@lo:38:kworker.0 Request processed in 3166us (4201us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319325.174687:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976
00000100:00100000:0.0:1767319325.175400:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319325.175545:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940491776:0@lo:400:kworker.0
00000100:00080000:3.0:1767319325.175962:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319325.175968:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319325.175972:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940492032:0@lo:38:kworker.0
00000100:00100000:2.0:1767319325.177190:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492160
00000100:00100000:2.0:1767319325.177200:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492160
00000100:00100000:2.0:1767319325.177292:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4424
00000100:00100000:2.0:1767319325.177301:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940492160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319325.177381:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940492160:12345-0@lo:400:kworker.0 Request processed in 81us (1982us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319325.177388:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4424
00000100:00100000:2.0:1767319325.177430:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940492160:0@lo:400:kworker.0
00000100:00080000:3.0:1767319325.177738:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767319325.180903:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319325.181238:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940492288:12345-0@lo:38:kworker.0 Request processed in 9217us (10700us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319325.181251:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16977
00000100:00080000:3.0:1767319325.181344:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319325.181352:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319325.181356:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940492288:0@lo:38:kworker.0
00000100:00100000:3.0:1767319325.868925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319326.126295:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319326.789988:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319326.790052:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319326.791301:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312320
00000100:00100000:2.0:1767319326.791329:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312320
00000100:00100000:2.0:1767319326.791438:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312192
00000100:00100000:2.0:1767319326.791450:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312192
00000100:00100000:2.0:1767319326.791476:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4425
00000100:00100000:2.0:1767319326.791488:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894312320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767319326.791513:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319326.791540:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16978
00000100:00100000:3.0:1767319326.791548:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894312192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319326.791574:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319326.791578:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894312320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (1603us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319326.791588:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4425
00000100:00100000:3.0:1767319326.791634:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894312192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 68us (1563us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319326.791649:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16978
00000400:00000100:2.0:1767319326.791659:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894312448 offset 0 length 520: 4
00000100:00100000:3.0:1767319326.896800:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319327.149395:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319327.728555:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940492416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319327.728646:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319327.730299:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492416
00000100:00100000:2.0:1767319327.730314:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492416
00000100:00100000:2.0:1767319327.730399:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424
00000100:00100000:2.0:1767319327.730408:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940492416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319327.730452:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319327.730534:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940492416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (1887us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319327.730541:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424
00000100:00100000:1.0:1767319327.730647:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940492416:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319327.730841:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319327.916956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319328.179326:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319328.749313:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940492544:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319328.749569:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319328.749745:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492544
00000100:00100000:0.0:1767319328.749755:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492544
00000100:00080000:3.0:1767319328.749851:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319328.751771:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425
00000100:00100000:0.0:1767319328.751815:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940492544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319328.751854:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319328.751954:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940492544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (2384us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319328.751965:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425
00000100:00100000:1.0:1767319328.752063:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940492544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319328.942301:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319329.197095:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319329.964919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319330.221092:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319330.285433:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319330.285443:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319330.285446:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319330.285452:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319330.285457:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319330.285465:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4575
00000100:00080000:3.0:1767319330.285471:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319330.285478:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319330.285520:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08000 x1853163940492672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319330.285537:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319330.285540:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319330.285542:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319330.285545:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4575
00000100:00080000:3.0:1767319330.285548:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319330.285550:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319330.285562:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337b80 x1853163940492800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319330.285651:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940492928:0@lo:400:kworker.0
00000100:00100000:2.0:1767319330.285689:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940492672:0@lo:38:kworker.0
00000100:00100000:0.0:1767319330.285727:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319330.285733:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319330.285806:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319330.285814:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319330.285822:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940493056:0@lo:400:kworker.0
00000100:00080000:3.0:1767319330.285838:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319330.285843:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319330.285845:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767319330.285851:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319330.285855:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4575
00000100:00080000:3.0:1767319330.285859:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319330.285863:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319330.285878:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334000 x1853163940493312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319330.285922:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492672
00000100:00100000:0.0:1767319330.285930:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492672
00000100:00100000:0.0:1767319330.285967:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16979
00000100:00100000:0.0:1767319330.285976:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940492672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319330.285999:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319330.286034:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940492672:12345-0@lo:38:kworker.0 Request processed in 58us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319330.286054:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16979
00000100:00100000:0.0:1767319330.286078:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319330.286087:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940493440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286113:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319330.286137:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493440
00000100:00100000:0.0:1767319330.286141:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493440
00000100:00100000:0.0:1767319330.286196:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4426
00000100:00100000:0.0:1767319330.286203:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940493440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286247:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940493440:12345-0@lo:400:kworker.0 Request processed in 45us (132us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319330.286252:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4426
00000100:00100000:0.0:1767319330.286290:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940493440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286345:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492928
00000100:00100000:0.0:1767319330.286349:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492928
00000100:00100000:0.0:1767319330.286376:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493056
00000100:00100000:0.0:1767319330.286380:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493056
00000100:00100000:0.0:1767319330.286732:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885
00000100:00100000:0.0:1767319330.286742:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940492928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286810:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940492928:12345-0@lo:400:kworker.0 Request processed in 71us (1085us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319330.286817:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885
00000100:00100000:0.0:1767319330.286832:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886
00000100:00100000:0.0:1767319330.286838:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940493056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286867:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940493056:12345-0@lo:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319330.286873:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886
00000100:00100000:0.0:1767319330.286907:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940493056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319330.286917:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940492928:0@lo:400:kworker.0
00000100:00080000:0.0:1767319330.286955:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319330.286960:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319330.286963:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319330.292113:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319330.292129:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319330.292134:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940492672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319330.292148:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940492800:0@lo:38:kworker.0
00000100:00100000:2.0:1767319330.292230:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319330.292295:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940493312:0@lo:38:kworker.0
00000100:00100000:2.0:1767319330.292321:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319330.292381:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493312
00000100:00100000:2.0:1767319330.292388:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493312
00000100:00100000:2.0:1767319330.292440:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16980
00000100:00100000:2.0:1767319330.292447:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940493312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319330.292470:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319330.292513:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940493312:12345-0@lo:38:kworker.0 Request processed in 65us (190us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319330.292521:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16980
00000100:00080000:2.0:1767319330.292551:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319330.292555:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319330.292557:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940493312:0@lo:38:kworker.0
00000100:00100000:1.0:1767319330.292711:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940493184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319330.292738:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319330.292838:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493184
00000100:00100000:1.0:1767319330.292842:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493184
00000100:00100000:1.0:1767319330.292876:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4427
00000100:00100000:1.0:1767319330.292880:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940493184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319330.292921:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940493184:12345-0@lo:400:kworker.0 Request processed in 39us (181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319330.292928:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4427
00000100:00080000:1.0:1767319330.292944:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319330.292964:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940493184:0@lo:400:kworker.0
00000100:00080000:3.0:1767319330.294295:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319330.294303:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319330.294307:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319330.294314:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4575
00000100:00080000:3.0:1767319330.294320:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319330.294326:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319330.294363:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ded80 x1853163940493568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319330.294423:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940493568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319330.294472:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319330.294595:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493568
00000100:00100000:2.0:1767319330.294602:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493568
00000100:00100000:0.0:1767319330.294910:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940492800
00000100:00100000:0.0:1767319330.294916:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940492800
00000100:00100000:1.0:1767319330.294947:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16981
00000100:00100000:1.0:1767319330.294956:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940493568:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319330.294962:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79
00000100:00100000:0.0:1767319330.294970:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940492800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319330.294978:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767319330.294986:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319330.295047:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940492800:12345-0@lo:38:kworker.0 Request processed in 66us (2807us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319330.295058:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79
00000100:00100000:1.0:1767319330.295098:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940493568:12345-0@lo:38:kworker.0 Request processed in 141us (624us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319330.295105:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16981
00000100:00080000:3.0:1767319330.297523:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319330.297536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319330.297541:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940493568:0@lo:38:kworker.0
00000100:00080000:3.0:1767319330.297558:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319330.297561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319330.297564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940492800:0@lo:38:kworker.0
00000100:00100000:3.0:1767319330.988959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319331.245432:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319331.911522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319331.912380:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319331.912512:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312704
00000100:00100000:1.0:1767319331.912525:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312704
00000100:00100000:2.0:1767319331.912749:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312576
00000100:00100000:2.0:1767319331.912754:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312576
00000100:00100000:2.0:1767319331.912827:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16982
00000100:00100000:2.0:1767319331.912837:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894312576:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319331.912863:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319331.912929:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894312576:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 92us (552us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319331.912938:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16982
00000100:00100000:1.0:1767319331.913611:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4428
00000100:00100000:1.0:1767319331.913623:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894312704:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319331.913685:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894312704:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 65us (2176us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319331.913692:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4428
00000100:00080000:0.0:1767319331.917059:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319332.013047:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319332.269660:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319332.845326:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940493696:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319332.845407:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319332.847731:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493696
00000100:00100000:1.0:1767319332.847744:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493696
00000100:00100000:1.0:1767319332.847850:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426
00000100:00100000:1.0:1767319332.847860:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940493696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319332.847896:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319332.847982:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940493696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (2574us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319332.847989:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426
00000100:00080000:0.0:1767319332.849479:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319332.849540:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940493696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319333.039209:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319333.293025:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319333.869104:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940493824:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319333.869192:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319333.869315:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940493824
00000100:00100000:2.0:1767319333.869325:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940493824
00000100:00100000:2.0:1767319333.869401:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427
00000100:00100000:2.0:1767319333.869412:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940493824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319333.869448:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319333.869541:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319333.876281:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940493824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6861us (7078us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319333.876297:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427
00000100:00100000:1.0:1767319333.876871:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940493824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319334.063281:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319334.317045:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319334.380959:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319309/real 1767319309]  req@ffff93d07bb96d80 x1853163940487424/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319334 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319334.380997:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d07bb96d80 x1853163940487424/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319334 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319334.381022:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319334.381050:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319334.381063:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940487424:0@lo:250:kworker.0
00000100:00080000:3.0:1767319334.381798:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319334.381805:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319334.381808:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319334.381813:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4559
00000100:00080000:3.0:1767319334.381818:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319334.381824:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319334.381857:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dc380 x1853163940493952/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319334.381885:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319334.381889:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319334.381890:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319334.381894:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4580
00000100:00080000:3.0:1767319334.381896:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319334.381900:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319334.381915:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dd500 x1853163940494080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319334.381923:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319334.381926:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319334.381928:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319334.381931:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4580
00000100:00080000:3.0:1767319334.381933:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319334.381936:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319334.381957:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dfb80 x1853163940494208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319334.382031:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319334.382114:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940493952:0@lo:250:kworker.0
00000400:00000100:0.0:1767319334.382179:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940493952 offset 0 length 520: 4
00000100:00100000:0.0:1767319334.382227:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940494080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319334.382266:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319334.382303:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940494208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319334.382328:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319334.382540:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494080
00000100:00100000:1.0:1767319334.382549:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494080
00000100:00100000:1.0:1767319334.382614:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16983
00000100:00100000:1.0:1767319334.382623:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940494080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319334.382646:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319334.382695:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940494080:12345-0@lo:38:kworker.0 Request processed in 72us (428us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319334.382702:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16983
00000100:00100000:1.0:1767319334.382728:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494208
00000100:00100000:1.0:1767319334.382732:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494208
00000100:00100000:1.0:1767319334.382751:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80
00000100:00100000:1.0:1767319334.382756:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940494208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319334.382765:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319334.382816:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940494208:12345-0@lo:38:kworker.0 Request processed in 58us (487us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319334.382822:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80
00000100:00080000:0.0:1767319334.382928:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319334.382934:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319334.382937:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940494080:0@lo:38:kworker.0
00000100:00080000:0.0:1767319334.382963:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319334.382966:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319334.382969:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940494208:0@lo:38:kworker.0
00000100:00100000:2.0:1767319334.385889:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940494464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319334.386226:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319334.386355:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940494336:0@lo:400:kworker.0
00000100:00100000:2.0:1767319334.386390:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319334.386517:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319334.386522:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319334.386527:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319334.386533:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4580
00000100:00080000:3.0:1767319334.386537:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319334.386546:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319334.386569:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940494720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319334.386608:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319334.386612:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319334.386614:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319334.386618:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4580
00000100:00080000:3.0:1767319334.386622:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767319334.386626:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319334.386637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddc00 x1853163940494976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319334.386675:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940494592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.386708:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319334.386731:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319334.386737:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940494848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.386770:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319334.386817:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494592
00000100:00100000:3.0:1767319334.386826:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494592
00000100:00100000:3.0:1767319334.386883:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494848
00000100:00100000:3.0:1767319334.386886:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494848
00000100:00100000:3.0:1767319334.386915:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4429
00000100:00100000:3.0:1767319334.386924:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940494592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.386991:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940494592:12345-0@lo:400:kworker.0 Request processed in 67us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319334.386998:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4429
00000100:00100000:3.0:1767319334.387016:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430
00000100:00100000:3.0:1767319334.387023:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940494848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.387049:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940494848:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319334.387054:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430
00000100:00080000:3.0:1767319334.387076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319334.387105:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940494848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.387116:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940494592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319334.387253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940494720:0@lo:38:kworker.0
00000100:00100000:1.0:1767319334.387282:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319334.387309:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940494976:0@lo:38:kworker.0
00000100:00100000:1.0:1767319334.387328:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319334.387358:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494720
00000100:00100000:1.0:1767319334.387362:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494720
00000100:00100000:1.0:1767319334.387390:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494976
00000100:00100000:1.0:1767319334.387393:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494976
00000100:00100000:1.0:1767319334.387410:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16984
00000100:00100000:1.0:1767319334.387414:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940494720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319334.387434:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319334.387469:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940494720:12345-0@lo:38:kworker.0 Request processed in 53us (185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319334.387475:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16984
00000100:00100000:1.0:1767319334.387487:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16985
00000100:00100000:1.0:1767319334.387490:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940494976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319334.387499:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319334.387521:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940494976:12345-0@lo:38:kworker.0 Request processed in 29us (192us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319334.387526:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16985
00000100:00080000:1.0:1767319334.387553:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319334.387558:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319334.387562:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940494720:0@lo:38:kworker.0
00000100:00080000:1.0:1767319334.387569:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319334.387572:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319334.387575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940494976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319334.388287:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494464
00000100:00100000:0.0:1767319334.388294:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494464
00000100:00100000:0.0:1767319334.388379:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940494336
00000100:00100000:0.0:1767319334.388383:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940494336
00000100:00080000:2.0:1767319334.388439:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319334.388476:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887
00000100:00100000:3.0:1767319334.388487:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940494464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.388547:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940494464:12345-0@lo:400:kworker.0 Request processed in 64us (2322us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319334.388553:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887
00000100:00100000:3.0:1767319334.388568:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888
00000100:00100000:3.0:1767319334.388575:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940494336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319334.388612:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940494336:12345-0@lo:400:kworker.0 Request processed in 39us (2222us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319334.388619:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888
00000100:00100000:2.0:1767319334.388680:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940494464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319334.388691:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940494336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319335.084939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319335.341231:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319336.108879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319336.367220:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319337.034341:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319337.034765:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319337.035245:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312832
00000100:00100000:1.0:1767319337.035259:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312832
00000100:00100000:1.0:1767319337.035324:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894312960
00000100:00100000:1.0:1767319337.035328:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894312960
00000100:00100000:1.0:1767319337.035399:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4431
00000100:00080000:0.0:1767319337.035412:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319337.035890:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16986
00000100:00100000:1.0:1767319337.035892:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894312960:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319337.035901:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894312832:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319337.035927:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319337.036014:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894312832:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 115us (2109us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319337.036022:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16986
00000100:00100000:1.0:1767319337.037604:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894312960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1705us (2924us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319337.037623:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4431
00000100:00100000:3.0:1767319337.133621:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319337.390280:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319337.968409:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940495104:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319337.968499:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319337.968747:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495104
00000100:00100000:1.0:1767319337.968757:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495104
00000100:00100000:1.0:1767319337.968882:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428
00000100:00100000:1.0:1767319337.968893:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940495104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319337.968930:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319337.968986:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940495104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (486us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319337.968993:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428
00000100:00100000:2.0:1767319337.969043:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940495104:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319337.969072:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319338.157552:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319338.413200:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319338.990538:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319338.990565:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940495232:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319338.990652:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319338.991320:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495232
00000100:00100000:3.0:1767319338.991338:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495232
00000100:00100000:3.0:1767319338.991406:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429
00000100:00100000:3.0:1767319338.991417:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940495232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319338.991446:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319338.991503:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940495232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (851us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319338.991510:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429
00000100:00100000:2.0:1767319338.991603:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940495232:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319338.992034:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319339.180924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319339.437444:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319339.501382:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319339.501395:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319339.501397:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319339.501401:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319339.501413:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319339.501421:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4584
00000100:00080000:2.0:1767319339.501426:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319339.501433:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319339.501486:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940495360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319339.501511:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319339.501514:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319339.501515:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319339.501518:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4584
00000100:00080000:2.0:1767319339.501521:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319339.501524:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319339.501537:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433f800 x1853163940495488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319339.501599:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319339.501603:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319339.501605:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319339.501609:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4584
00000100:00080000:2.0:1767319339.501611:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319339.501616:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319339.501859:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940495744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319339.501932:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319339.501977:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495744
00000100:00100000:0.0:1767319339.501984:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495744
00000100:00100000:0.0:1767319339.502057:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4432
00000100:00100000:0.0:1767319339.502067:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940495744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319339.502117:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940495744:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319339.502125:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4432
00000100:00080000:0.0:1767319339.502146:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319339.502196:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940495744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319339.502216:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319339.502221:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940495616:0@lo:400:kworker.0
00000100:00100000:0.0:1767319339.502246:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319339.502634:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433e680 x1853163940495872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319339.502674:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319339.502678:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319339.502680:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319339.502684:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4584
00000100:00080000:2.0:1767319339.502687:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767319339.502692:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319339.502942:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319339.502954:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940496000:0@lo:400:kworker.0
00000100:00100000:3.0:1767319339.502993:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319339.503039:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496000
00000100:00100000:3.0:1767319339.503044:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496000
00000100:00100000:3.0:1767319339.503081:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4433
00000100:00100000:3.0:1767319339.503088:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940496000:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319339.503123:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940496000:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319339.503129:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4433
00000100:00080000:3.0:1767319339.503152:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319339.503170:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940496000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319339.503388:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940496128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319339.503596:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940495360:0@lo:38:kworker.0
00000100:00100000:1.0:1767319339.503639:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319339.503663:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940495488:0@lo:38:kworker.0
00000100:00100000:1.0:1767319339.503686:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319339.503703:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940495872:0@lo:38:kworker.0
00000100:00100000:1.0:1767319339.503734:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319339.503748:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940496128:0@lo:38:kworker.0
00000100:00100000:1.0:1767319339.503766:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319339.503810:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495360
00000100:00100000:1.0:1767319339.503814:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495360
00000100:00100000:1.0:1767319339.503834:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495872
00000100:00100000:1.0:1767319339.503837:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495872
00000100:00100000:1.0:1767319339.503847:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496128
00000100:00100000:1.0:1767319339.503849:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496128
00000100:00100000:1.0:1767319339.503858:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16987
00000100:00100000:1.0:1767319339.503863:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940495360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319339.503881:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319339.503915:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940495360:12345-0@lo:38:kworker.0 Request processed in 52us (276us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319339.503921:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16987
00000100:00100000:1.0:1767319339.503932:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16988
00000100:00100000:1.0:1767319339.503935:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940495872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319339.503944:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319339.503965:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940495872:12345-0@lo:38:kworker.0 Request processed in 28us (230us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319339.503970:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16988
00000100:00100000:1.0:1767319339.503980:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16989
00000100:00100000:1.0:1767319339.503984:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940496128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319339.503992:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319339.504176:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940496128:12345-0@lo:38:kworker.0 Request processed in 190us (407us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319339.504182:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16989
00000100:00100000:1.0:1767319339.504203:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495616
00000100:00100000:1.0:1767319339.504207:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495616
00000100:00100000:1.0:1767319339.504239:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889
00000100:00100000:1.0:1767319339.504245:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940495616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319339.504280:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940495616:12345-0@lo:400:kworker.0 Request processed in 35us (2033us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319339.504286:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889
00000100:00100000:1.0:1767319339.504303:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940495488
00000100:00100000:1.0:1767319339.504307:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940495488
00000100:00100000:1.0:1767319339.504357:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81
00000100:00100000:1.0:1767319339.504361:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940495488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319339.504371:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319339.504396:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940495488:12345-0@lo:38:kworker.0 Request processed in 33us (708us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319339.504401:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81
00000100:00080000:3.0:1767319339.505052:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319339.505114:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319339.505121:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319339.505125:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940495360:0@lo:38:kworker.0
00000100:00080000:3.0:1767319339.505135:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319339.505137:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319339.505140:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940495488:0@lo:38:kworker.0
00000100:00080000:3.0:1767319339.505149:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319339.505151:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319339.505154:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940495872:0@lo:38:kworker.0
00000100:00080000:3.0:1767319339.505161:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319339.505164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319339.505166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940496128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319339.505450:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940495616:0@lo:400:kworker.0
00000100:00100000:3.0:1767319340.205207:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319340.461426:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319341.228982:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319341.485800:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319342.152891:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319342.153574:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313088
00000100:00100000:3.0:1767319342.153586:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313088
00000100:00100000:3.0:1767319342.153648:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16990
00000100:00100000:3.0:1767319342.153657:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894313088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319342.153682:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319342.153752:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894313088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 94us (870us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319342.153758:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16990
00000100:00100000:3.0:1767319342.155709:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319342.155846:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313216
00000100:00100000:0.0:1767319342.155857:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313216
00000100:00100000:0.0:1767319342.155936:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4434
00000100:00100000:0.0:1767319342.155948:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767319342.155973:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319342.156029:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319342.156037:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4434
00000100:00100000:3.0:1767319342.252965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319342.509130:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319343.085370:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940496256:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319343.085451:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319343.085638:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496256
00000100:00100000:1.0:1767319343.085647:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496256
00000100:00100000:1.0:1767319343.085725:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430
00000100:00100000:1.0:1767319343.085735:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940496256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319343.085767:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319343.085852:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940496256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319343.085860:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430
00000100:00100000:2.0:1767319343.085965:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940496256:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319343.086114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319343.278622:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319343.533058:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319344.111176:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940496384:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319344.111258:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319344.111419:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496384
00000100:00100000:1.0:1767319344.111429:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496384
00000100:00100000:1.0:1767319344.111495:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431
00000100:00100000:1.0:1767319344.111505:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940496384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319344.111535:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319344.111614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319344.118096:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940496384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6582us (6826us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319344.118114:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431
00000100:00100000:0.0:1767319344.119063:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940496384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319344.301517:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319344.557473:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319344.621055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319344.621067:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319344.621071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319344.621079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319344.621084:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319344.621091:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4589
00000100:00080000:2.0:1767319344.621103:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319344.621110:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319344.621153:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940496512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319344.621315:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319344.621320:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319344.621322:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319344.621326:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4589
00000100:00080000:2.0:1767319344.621328:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319344.621334:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319344.621350:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433e680 x1853163940496640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319344.621401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319344.621405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319344.621407:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319344.621410:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4589
00000100:00080000:2.0:1767319344.621413:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319344.621416:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319344.621427:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c380 x1853163940497024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319344.621443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319344.621446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319344.621447:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319344.621451:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4589
00000100:00080000:2.0:1767319344.621453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319344.621456:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319344.621467:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940497280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319344.621503:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319344.621519:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940496768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319344.622008:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319344.622078:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940496896:0@lo:400:kworker.0
00000100:00100000:2.0:1767319344.622120:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319344.622139:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319344.622146:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940497152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319344.622166:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319344.622416:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496768
00000100:00100000:3.0:1767319344.622426:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496768
00000100:00100000:0.0:1767319344.622454:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496896
00000100:00100000:0.0:1767319344.622462:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496896
00000100:00100000:3.0:1767319344.622483:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890
00000100:00100000:3.0:1767319344.622494:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940496768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319344.622508:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497152
00000100:00100000:0.0:1767319344.622513:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497152
00000100:00100000:0.0:1767319344.622546:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4435
00000100:00100000:0.0:1767319344.622553:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940496896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319344.622638:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4436
00000100:00100000:1.0:1767319344.622648:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940497152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319344.623008:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940496768:12345-0@lo:400:kworker.0 Request processed in 515us (998us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319344.623017:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890
00000100:00100000:3.0:1767319344.623078:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940496768:0@lo:400:kworker.0
00000100:00080000:3.0:1767319344.623136:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319344.623158:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940496512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319344.623189:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319344.623208:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940496640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319344.623462:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319344.623484:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940497024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319344.623505:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319344.623519:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940497280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319344.623536:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319344.623563:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496512
00000100:00100000:3.0:1767319344.623568:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496512
00000100:00100000:3.0:1767319344.623587:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497024
00000100:00100000:3.0:1767319344.623590:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497024
00000100:00100000:3.0:1767319344.623597:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497280
00000100:00100000:3.0:1767319344.623599:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497280
00000100:00100000:3.0:1767319344.623609:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16991
00000100:00100000:3.0:1767319344.623614:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940496512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319344.623634:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319344.623668:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940496512:12345-0@lo:38:kworker.0 Request processed in 52us (478us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319344.623678:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16991
00000100:00100000:3.0:1767319344.623690:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16992
00000100:00100000:3.0:1767319344.623694:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940497024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319344.623703:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319344.623724:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940497024:12345-0@lo:38:kworker.0 Request processed in 28us (217us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319344.623729:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16992
00000100:00100000:3.0:1767319344.623739:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16993
00000100:00100000:3.0:1767319344.623743:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940497280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319344.623751:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319344.623770:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940497280:12345-0@lo:38:kworker.0 Request processed in 26us (232us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319344.623798:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16993
00000100:00080000:3.0:1767319344.623912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319344.623917:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319344.623920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940496512:0@lo:38:kworker.0
00000100:00080000:3.0:1767319344.623928:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319344.623931:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319344.623934:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940497024:0@lo:38:kworker.0
00000100:00080000:3.0:1767319344.623940:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319344.623944:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319344.623946:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940497280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319344.623983:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940496640
00000100:00100000:3.0:1767319344.623988:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940496640
00000100:00100000:3.0:1767319344.624008:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82
00000100:00100000:3.0:1767319344.624012:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940496640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319344.624022:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319344.624065:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940496640:12345-0@lo:38:kworker.0 Request processed in 50us (602us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319344.624070:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82
00000100:00080000:3.0:1767319344.624101:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319344.624105:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319344.624108:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940496640:0@lo:38:kworker.0
00000100:00100000:0.0:1767319344.624133:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940496896:12345-0@lo:400:kworker.0 Request processed in 1578us (2009us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319344.624143:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4435
00000100:00100000:2.0:1767319344.624522:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940496896:0@lo:400:kworker.0
00000100:00100000:1.0:1767319344.624647:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940497152:12345-0@lo:400:kworker.0 Request processed in 2000us (2477us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319344.624655:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4436
00000100:00100000:2.0:1767319344.624710:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940497152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319345.325719:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319345.581003:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319346.348916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319346.605054:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319347.274246:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319347.274303:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319347.277091:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313472
00000100:00100000:1.0:1767319347.277110:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313472
00000100:00100000:1.0:1767319347.277988:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313344
00000100:00100000:1.0:1767319347.277995:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313344
00000100:00100000:1.0:1767319347.278024:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4437
00000100:00100000:1.0:1767319347.278034:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319347.278120:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (3884us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319347.278138:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4437
00000100:00100000:1.0:1767319347.278168:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16994
00000100:00100000:1.0:1767319347.278173:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894313344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319347.278195:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319347.278220:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894313344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (3917us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319347.278226:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16994
00000100:00080000:3.0:1767319347.283612:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319347.372974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319347.631048:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319348.207235:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940497408:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319348.207316:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319348.207464:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497408
00000100:00100000:1.0:1767319348.207473:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497408
00000100:00100000:1.0:1767319348.207542:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432
00000100:00100000:1.0:1767319348.207550:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940497408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319348.207581:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319348.207625:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940497408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (308us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319348.207632:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432
00000100:00080000:3.0:1767319348.208928:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319348.208987:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940497408:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319348.396929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319348.652978:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319349.230420:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940497536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319349.230505:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319349.230811:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497536
00000100:00100000:0.0:1767319349.230821:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497536
00000100:00100000:0.0:1767319349.230941:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433
00000100:00100000:0.0:1767319349.230972:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940497536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319349.231008:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319349.232566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319349.234760:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940497536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3789us (4245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319349.234785:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433
00000100:00100000:2.0:1767319349.236214:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940497536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319349.422132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319349.677273:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319349.740933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319349.740948:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319349.740951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319349.740957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319349.740963:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319349.740974:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319349.740980:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319349.740989:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319349.741044:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335180 x1853163940497664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319349.741069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319349.741073:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319349.741111:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319349.741115:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319349.741117:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319349.741120:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319349.741135:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a46300 x1853163940497792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319349.741183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319349.741186:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319349.741188:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319349.741192:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319349.741194:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319349.741197:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319349.741274:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940497920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319349.741447:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3df80 x1853163940498176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319349.741480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319349.741485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319349.741486:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319349.741490:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319349.741493:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319349.741497:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319349.741507:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3ed80 x1853163940498432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319349.741548:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319349.741564:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940498304:0@lo:400:kworker.0
00000100:00100000:0.0:1767319349.741634:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319349.741731:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940498048:0@lo:400:kworker.0
00000100:00100000:3.0:1767319349.741842:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940497664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319349.747694:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319349.747844:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319349.747897:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498304
00000100:00100000:1.0:1767319349.747906:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498304
00000100:00100000:2.0:1767319349.747951:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497920
00000100:00100000:2.0:1767319349.747957:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497920
00000100:00100000:1.0:1767319349.747965:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498048
00000100:00100000:1.0:1767319349.747970:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498048
00000100:00100000:1.0:1767319349.748006:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4438
00000100:00100000:2.0:1767319349.748013:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891
00000100:00100000:1.0:1767319349.748018:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940498304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319349.748084:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940498304:12345-0@lo:400:kworker.0 Request processed in 70us (6448us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319349.748091:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4438
00000100:00100000:1.0:1767319349.748108:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4439
00000100:00100000:1.0:1767319349.748114:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940498048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319349.748149:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940498048:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319349.748155:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4439
00000100:00100000:1.0:1767319349.748225:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940498048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319349.748253:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940497920:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319349.748256:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319349.748356:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940497920:0@lo:400:kworker.0
00000100:00100000:2.0:1767319349.748399:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940497920:12345-0@lo:400:kworker.0 Request processed in 376us (710us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319349.748406:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891
00000100:00100000:0.0:1767319349.749382:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940498304:0@lo:400:kworker.0
00000100:00100000:3.0:1767319349.754023:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319349.754098:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940497792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319349.754141:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319349.754178:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940498176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319349.754197:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319349.754238:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940498432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319349.754258:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319349.754330:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497664
00000100:00100000:1.0:1767319349.754444:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497664
00000100:00100000:1.0:1767319349.754496:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498176
00000100:00100000:1.0:1767319349.754500:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498176
00000100:00100000:1.0:1767319349.754517:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498432
00000100:00100000:1.0:1767319349.754519:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498432
00000100:00100000:1.0:1767319349.754551:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16995
00000100:00100000:1.0:1767319349.754562:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940497664:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319349.754590:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319349.754643:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940497664:12345-0@lo:38:kworker.0 Request processed in 82us (628us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319349.754654:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16995
00000100:00100000:1.0:1767319349.754670:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16996
00000100:00100000:1.0:1767319349.754674:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940498176:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319349.754713:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940497792
00000100:00100000:2.0:1767319349.754719:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940497792
00000100:00100000:2.0:1767319349.754741:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83
00000100:00100000:2.0:1767319349.754747:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940497792:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319349.754808:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16997
00000100:00100000:0.0:1767319349.754815:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940498432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319349.754860:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319349.754887:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940498176:12345-0@lo:38:kworker.0 Request processed in 212us (689us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319349.754893:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16996
00000100:00080000:3.0:1767319349.755011:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319349.755018:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319349.755021:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940497664:0@lo:38:kworker.0
00000100:00080000:3.0:1767319349.755031:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319349.755034:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319349.755036:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940498176:0@lo:38:kworker.0
00010000:00020000:2.0:1767319349.758516:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319349.758648:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940497792:12345-0@lo:38:kworker.0 Request processed in 3896us (4502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319349.758663:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83
00000100:00080000:3.0:1767319349.758860:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319349.758868:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319349.758872:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940497792:0@lo:38:kworker.0
00010000:00020000:0.0:1767319349.761832:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319349.761959:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940498432:12345-0@lo:38:kworker.0 Request processed in 7139us (7697us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319349.761972:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16997
00000100:00080000:3.0:1767319349.762113:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319349.762119:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319349.762123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940498432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319350.448494:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319350.701070:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319351.373823:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319351.373869:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894313600 offset 0 length 520: 4
00000100:00100000:3.0:1767319351.373894:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319351.374029:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313856
00000100:00100000:0.0:1767319351.374042:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313856
00000100:00100000:0.0:1767319351.374239:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313728
00000100:00100000:0.0:1767319351.374244:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313728
00000100:00080000:2.0:1767319351.374270:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319351.374772:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4440
00000100:00100000:3.0:1767319351.374814:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313856:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319351.374915:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894313856:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (1147us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319351.374924:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4440
00000100:00100000:3.0:1767319351.374948:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16998
00000100:00100000:3.0:1767319351.374953:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894313728:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319351.375746:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319351.375870:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894313728:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 911us (1970us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319351.375879:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16998
00000100:00100000:3.0:1767319351.468886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319351.727316:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319352.492967:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319352.749048:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319353.325816:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940498560:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319353.325907:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319353.326218:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498560
00000100:00100000:1.0:1767319353.326227:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498560
00000100:00080000:2.0:1767319353.326395:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319353.326871:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434
00000100:00100000:1.0:1767319353.326885:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940498560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319353.326918:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319353.327215:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940498560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 333us (1306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319353.327223:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434
00000100:00100000:0.0:1767319353.328492:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940498560:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319353.520471:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319353.773030:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319354.349421:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319354.349450:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940498688:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319354.349530:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319354.350060:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498688
00000100:00100000:3.0:1767319354.350073:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498688
00000100:00100000:3.0:1767319354.350149:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435
00000100:00100000:3.0:1767319354.350160:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940498688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319354.350204:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319354.350271:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940498688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (740us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319354.350279:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435
00000100:00080000:1.0:1767319354.350364:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319354.350492:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940498688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319354.541564:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319354.798533:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319354.861307:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319354.861321:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319354.861324:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319354.861329:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319354.861333:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319354.861342:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4599
00000100:00080000:3.0:1767319354.861348:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319354.861356:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319354.861418:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335180 x1853163940498816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319354.861436:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319354.861439:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319354.861441:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319354.861444:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4599
00000100:00080000:3.0:1767319354.861446:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319354.861450:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319354.861468:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ea00 x1853163940498944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319354.861526:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319354.861530:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319354.861532:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319354.861535:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4599
00000100:00080000:3.0:1767319354.861538:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319354.861541:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319354.861552:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879fb80 x1853163940499328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319354.861567:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319354.861570:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319354.861572:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319354.861576:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4599
00000100:00080000:3.0:1767319354.861578:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319354.861581:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319354.861592:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879dc00 x1853163940499584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319354.861672:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319354.861769:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319354.861962:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940498816:0@lo:38:kworker.0
00000100:00100000:0.0:1767319354.861999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319354.862044:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940498944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319354.862067:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319354.862095:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940499328:0@lo:38:kworker.0
00000100:00100000:0.0:1767319354.862116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319354.862134:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940499584:0@lo:38:kworker.0
00000100:00100000:2.0:1767319354.862145:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498944
00000100:00100000:0.0:1767319354.862153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319354.862154:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498944
00000100:00100000:0.0:1767319354.862177:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940499456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319354.862196:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84
00000100:00100000:2.0:1767319354.862203:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940498944:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319354.862208:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767319354.862225:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319354.862227:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319354.862232:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940499200:0@lo:400:kworker.0
00000100:00100000:0.0:1767319354.862250:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319354.862276:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940498816
00000100:00100000:2.0:1767319354.862276:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940498944:12345-0@lo:38:kworker.0 Request processed in 62us (196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319354.862279:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940498816
00000100:00100000:2.0:1767319354.862283:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84
00000100:00100000:0.0:1767319354.862297:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499328
00000100:00100000:0.0:1767319354.862299:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499328
00000100:00100000:0.0:1767319354.862307:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499584
00000100:00100000:0.0:1767319354.862308:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499584
00000100:00100000:0.0:1767319354.862316:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499456
00000100:00100000:0.0:1767319354.862318:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499456
00000100:00080000:2.0:1767319354.862334:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319354.862339:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319354.862342:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940498944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319354.862346:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499200
00000100:00100000:0.0:1767319354.862349:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499200
00000100:00100000:0.0:1767319354.862364:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4441
00000100:00100000:0.0:1767319354.862371:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940499456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319354.862381:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4442
00000100:00100000:2.0:1767319354.862387:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940499200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319354.862419:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940499200:12345-0@lo:400:kworker.0 Request processed in 32us (167us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319354.862421:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940499456:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319354.862425:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4442
00000100:00100000:0.0:1767319354.862428:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4441
00000100:00100000:0.0:1767319354.862441:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16999
00000100:00100000:0.0:1767319354.862444:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940498816:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319354.862536:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499072
00000100:00100000:3.0:1767319354.862540:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499072
00000100:00100000:2.0:1767319354.862556:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17000
00000100:00100000:2.0:1767319354.862561:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940499328:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319354.862573:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319354.862578:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892
00000100:00100000:3.0:1767319354.862584:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319354.862603:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940499328:12345-0@lo:38:kworker.0 Request processed in 40us (486us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319354.862610:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17000
00000100:00100000:2.0:1767319354.862623:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17001
00000100:00100000:3.0:1767319354.862625:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499072:12345-0@lo:400:kworker.0 Request processed in 41us (857us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319354.862627:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940499584:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319354.862631:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892
00010000:00020000:2.0:1767319354.862636:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319354.862661:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940499584:12345-0@lo:38:kworker.0 Request processed in 33us (507us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319354.862667:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17001
00000100:00100000:3.0:1767319354.862681:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499072:0@lo:400:kworker.0
00000100:00080000:2.0:1767319354.862684:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319354.862688:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319354.862691:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940499328:0@lo:38:kworker.0
00000100:00080000:2.0:1767319354.862698:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319354.862702:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319354.862706:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940499584:0@lo:38:kworker.0
00000100:00080000:2.0:1767319354.862733:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319354.862849:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940499200:0@lo:400:kworker.0
00000100:00100000:3.0:1767319354.862858:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940499456:0@lo:400:kworker.0
00010000:00020000:0.0:1767319354.866457:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319354.866584:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940498816:12345-0@lo:38:kworker.0 Request processed in 4134us (4581us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319354.866599:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16999
00000100:00080000:2.0:1767319354.868337:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319354.868349:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319354.868353:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940498816:0@lo:38:kworker.0
00000100:00100000:3.0:1767319355.565567:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319355.821007:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319356.486932:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319356.488234:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314112
00000100:00100000:0.0:1767319356.488253:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314112
00000100:00100000:0.0:1767319356.488442:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4443
00000100:00100000:0.0:1767319356.488455:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314112:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319356.488590:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314112:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 137us (1669us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319356.488599:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4443
00000100:00100000:3.0:1767319356.490943:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319356.491667:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894313984
00000100:00100000:0.0:1767319356.491682:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894313984
00000100:00100000:0.0:1767319356.491743:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17002
00000100:00100000:0.0:1767319356.491752:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894313984:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319356.491808:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319356.491874:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894313984:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 122us (941us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319356.491881:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17002
00000100:00080000:2.0:1767319356.492660:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319356.588916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319356.845835:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319357.616232:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319357.869212:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319358.445206:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319358.448679:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499712:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319358.449276:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319358.454114:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499712
00000100:00100000:0.0:1767319358.454130:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499712
00000100:00100000:0.0:1767319358.454300:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436
00000100:00100000:0.0:1767319358.454311:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499712:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319358.454349:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319358.454441:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (5165us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319358.454449:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436
00000100:00100000:1.0:1767319358.454908:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499712:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319358.458093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319358.636919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319358.893073:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319359.469177:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499840:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319359.469257:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319359.469471:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499840
00000100:00100000:2.0:1767319359.469485:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499840
00000100:00100000:2.0:1767319359.469562:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437
00000100:00100000:2.0:1767319359.469572:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319359.469617:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319359.469687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319359.471269:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940499840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1682us (1996us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319359.471284:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437
00000100:00100000:1.0:1767319359.472137:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940499840:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319359.661327:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319359.917223:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319359.980909:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319359.980919:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319359.980922:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319359.980926:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319359.980930:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319359.980940:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4604
00000100:00080000:3.0:1767319359.980945:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319359.980953:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319359.980997:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f800 x1853163940499968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319359.981025:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319359.981040:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319359.981042:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319359.981046:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4604
00000100:00080000:3.0:1767319359.981048:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319359.981053:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319359.981066:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879c000 x1853163940500096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319359.981145:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319359.981149:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319359.981151:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319359.981155:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4604
00000100:00080000:3.0:1767319359.981157:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319359.981162:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319359.981173:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879e680 x1853163940500608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319359.981200:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319359.981203:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319359.981205:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319359.981209:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4604
00000100:00080000:3.0:1767319359.981211:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319359.981215:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319359.981226:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ca80 x1853163940500864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319359.981478:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319334/real 1767319334]  req@ffff93d0712dc380 x1853163940493952/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319359.981486:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940500352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319359.981506:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0712dc380 x1853163940493952/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319359.981523:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940499968:0@lo:38:kworker.0
00000100:00100000:0.0:1767319359.981667:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940500480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319359.986166:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319359.986525:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319359.987393:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940500224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319359.987496:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319359.988914:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319359.988973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940500096:0@lo:38:kworker.0
00000100:00100000:2.0:1767319359.989023:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319359.989058:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940500608:0@lo:38:kworker.0
00000100:00100000:2.0:1767319359.989081:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319359.989098:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940500864:0@lo:38:kworker.0
00000100:00100000:2.0:1767319359.989432:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319359.989451:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500096
00000100:00080000:2.0:1767319359.989452:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319359.989467:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319359.989470:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500096
00000100:00100000:2.0:1767319359.989471:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940493952:0@lo:250:kworker.0
00000100:00100000:2.0:1767319359.989505:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940499968
00000100:00100000:2.0:1767319359.989509:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940499968
00000100:00100000:2.0:1767319359.989527:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500608
00000100:00100000:2.0:1767319359.989530:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500608
00000100:00100000:1.0:1767319359.989541:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85
00000100:00100000:2.0:1767319359.989543:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500864
00000100:00100000:2.0:1767319359.989545:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500864
00000100:00100000:2.0:1767319359.989559:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17003
00000100:00100000:1.0:1767319359.989560:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940500096:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319359.989564:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940499968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319359.989582:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767319359.989588:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319359.989621:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940499968:12345-0@lo:38:kworker.0 Request processed in 55us (714us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319359.989625:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940500096:12345-0@lo:38:kworker.0 Request processed in 77us (602us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319359.989628:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17003
00000100:00100000:1.0:1767319359.989630:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85
00000100:00100000:2.0:1767319359.989644:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17004
00000100:00100000:2.0:1767319359.989648:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940500608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319359.989656:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319359.989659:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17005
00000100:00100000:1.0:1767319359.989663:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940500864:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319359.989679:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940500608:12345-0@lo:38:kworker.0 Request processed in 30us (598us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319359.989684:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17004
00010000:00020000:1.0:1767319359.989686:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319359.989721:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319359.989722:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940500864:12345-0@lo:38:kworker.0 Request processed in 56us (290us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319359.989727:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319359.989730:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319359.989735:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4584
00000100:00080000:2.0:1767319359.989739:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319359.989742:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17005
00000100:00080000:2.0:1767319359.989744:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319359.989770:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf800 x1853163940500992/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319359.989810:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940500736:0@lo:400:kworker.0
00000100:00100000:2.0:1767319359.989823:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940500992:0@lo:250:kworker.0
00000400:00000100:2.0:1767319359.989852:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940500992 offset 0 length 520: 4
00000100:00100000:1.0:1767319359.989865:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319359.989892:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319359.989897:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319359.989900:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940499968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319359.990126:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500736
00000100:00100000:1.0:1767319359.990131:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500736
00000100:00100000:1.0:1767319359.990180:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4444
00000100:00100000:1.0:1767319359.990186:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940500736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319359.990228:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940500736:12345-0@lo:400:kworker.0 Request processed in 43us (362us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319359.990234:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4444
00000100:00100000:1.0:1767319359.990263:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940500736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319359.992409:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500352
00000100:00100000:3.0:1767319359.992423:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500352
00000100:00100000:3.0:1767319359.992504:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500224
00000100:00100000:3.0:1767319359.992508:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500224
00000100:00100000:3.0:1767319359.992537:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893
00000100:00100000:3.0:1767319359.992548:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940500352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319359.992648:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940500352:12345-0@lo:400:kworker.0 Request processed in 102us (6492us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319359.992656:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893
00000100:00100000:3.0:1767319359.992672:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894
00000100:00100000:3.0:1767319359.992678:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940500224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319359.992702:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940500224:12345-0@lo:400:kworker.0 Request processed in 25us (5207us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319359.992707:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894
00000100:00080000:3.0:1767319359.992732:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319359.992895:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319359.992902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319359.992907:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940500096:0@lo:38:kworker.0
00000100:00080000:2.0:1767319359.992920:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319359.992924:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319359.992927:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940500608:0@lo:38:kworker.0
00000100:00080000:2.0:1767319359.992937:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319359.992941:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319359.992944:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940500864:0@lo:38:kworker.0
00000100:00100000:1.0:1767319359.997333:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940500224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319359.997356:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940500352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319359.999453:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319360.001009:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940500480
00000100:00100000:3.0:1767319360.001023:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940500480
00000100:00100000:3.0:1767319360.001120:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4445
00000100:00100000:3.0:1767319360.001133:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940500480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319360.001234:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940500480:12345-0@lo:400:kworker.0 Request processed in 106us (1789us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319360.001242:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4445
00000100:00100000:1.0:1767319360.001461:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940500480:0@lo:400:kworker.0
00000100:00080000:2.0:1767319360.001809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319360.686050:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319360.941566:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319361.606749:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319361.606879:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319361.612577:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314368
00000100:00100000:1.0:1767319361.612595:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314368
00000100:00100000:1.0:1767319361.613468:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314240
00000100:00100000:1.0:1767319361.613475:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314240
00000100:00100000:1.0:1767319361.613506:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4446
00000100:00100000:1.0:1767319361.613518:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314368:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319361.613605:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (6866us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319361.613612:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4446
00000100:00100000:1.0:1767319361.613633:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17006
00000100:00100000:1.0:1767319361.613637:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894314240:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319361.613660:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319361.613686:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894314240:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (6808us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319361.613693:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17006
00000100:00080000:3.0:1767319361.624336:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319361.709466:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319361.965016:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319362.733004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319362.991148:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319363.566198:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319363.571072:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940501120:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319363.571157:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319363.572563:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501120
00000100:00100000:3.0:1767319363.572576:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501120
00000100:00100000:3.0:1767319363.572659:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438
00000100:00100000:3.0:1767319363.572673:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940501120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319363.572707:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319363.572972:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940501120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319363.573370:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940501120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 694us (2203us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319363.573379:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438
00000100:00080000:2.0:1767319363.573754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319363.757055:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319364.016446:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319364.589128:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940501248:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319364.589207:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319364.589504:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501248
00000100:00100000:0.0:1767319364.589513:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501248
00000100:00100000:0.0:1767319364.589594:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439
00000100:00100000:0.0:1767319364.589603:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940501248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319364.589646:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319364.589702:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940501248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (494us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319364.589709:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439
00000100:00080000:3.0:1767319364.589850:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319364.590004:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940501248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319364.781866:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319365.037049:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319365.101486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319365.101501:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319365.101504:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319365.101508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319365.101513:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319365.101521:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319365.101527:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319365.101536:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319365.101589:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ce00 x1853163940501376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319365.101622:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319365.101627:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319365.101628:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319365.101632:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319365.101635:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319365.101639:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319365.101654:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ca80 x1853163940501504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319365.101725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319365.101728:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319365.101730:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319365.101734:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319365.101736:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319365.101740:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319365.101750:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879e300 x1853163940502016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319365.101769:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319365.101792:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319365.101794:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319365.101798:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319365.101801:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319365.101804:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319365.101815:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879dc00 x1853163940502272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319365.101847:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940501888:0@lo:400:kworker.0
00000100:00100000:3.0:1767319365.101925:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319365.101997:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319365.102004:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940502144:0@lo:400:kworker.0
00000100:00100000:3.0:1767319365.102030:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319365.102063:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501888
00000100:00100000:3.0:1767319365.102072:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501888
00000100:00100000:3.0:1767319365.102151:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4447
00000100:00100000:3.0:1767319365.102161:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940501888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319365.102228:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940501888:12345-0@lo:400:kworker.0 Request processed in 68us (301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319365.102235:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4447
00000100:00100000:3.0:1767319365.102256:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502144
00000100:00100000:3.0:1767319365.102260:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502144
00000100:00100000:3.0:1767319365.102282:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4448
00000100:00100000:3.0:1767319365.102288:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940502144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319365.102314:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940502144:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319365.102319:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4448
00000100:00080000:3.0:1767319365.102340:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319365.102376:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940502144:0@lo:400:kworker.0
00000100:00100000:3.0:1767319365.102387:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940501888:0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102502:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940501632:0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102542:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319365.102579:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319365.102585:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940501760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102605:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319365.102629:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501632
00000100:00100000:1.0:1767319365.102632:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501632
00000100:00100000:1.0:1767319365.102666:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501760
00000100:00100000:1.0:1767319365.102668:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501760
00000100:00100000:1.0:1767319365.102687:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1767319365.102693:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940501632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102721:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940501632:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319365.102727:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1767319365.102738:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896
00000100:00100000:1.0:1767319365.102759:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940501760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102813:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940501760:12345-0@lo:400:kworker.0 Request processed in 70us (206us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319365.102819:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896
00000100:00080000:1.0:1767319365.102837:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319365.102859:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940501760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319365.102868:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940501632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319365.103043:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940501376:0@lo:38:kworker.0
00000100:00100000:2.0:1767319365.103076:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319365.103111:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940501504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319365.103136:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319365.103160:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940502016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319365.103180:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319365.103200:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940502272:0@lo:38:kworker.0
00000100:00100000:2.0:1767319365.103218:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319365.103250:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501376
00000100:00100000:2.0:1767319365.103253:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501376
00000100:00100000:2.0:1767319365.103272:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502016
00000100:00100000:2.0:1767319365.103275:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502016
00000100:00100000:2.0:1767319365.103287:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502272
00000100:00100000:2.0:1767319365.103288:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502272
00000100:00100000:2.0:1767319365.103302:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17007
00000100:00100000:2.0:1767319365.103307:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940501376:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319365.103330:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319365.103363:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940501376:12345-0@lo:38:kworker.0 Request processed in 55us (286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319365.103369:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17007
00000100:00100000:2.0:1767319365.103380:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17008
00000100:00100000:2.0:1767319365.103384:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940502016:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319365.103404:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319365.103426:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940502016:12345-0@lo:38:kworker.0 Request processed in 41us (245us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319365.103432:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17008
00000100:00100000:2.0:1767319365.103442:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17009
00000100:00100000:2.0:1767319365.103445:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940502272:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319365.103453:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319365.103471:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940502272:12345-0@lo:38:kworker.0 Request processed in 25us (252us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319365.103476:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17009
00000100:00080000:2.0:1767319365.103508:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319365.103514:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319365.103518:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940501376:0@lo:38:kworker.0
00000100:00080000:2.0:1767319365.103526:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319365.103530:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319365.103532:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940502016:0@lo:38:kworker.0
00000100:00080000:2.0:1767319365.103540:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319365.103542:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319365.103545:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940502272:0@lo:38:kworker.0
00000100:00100000:3.0:1767319365.104340:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940501504
00000100:00100000:3.0:1767319365.104348:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940501504
00000100:00100000:3.0:1767319365.104387:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86
00000100:00100000:3.0:1767319365.104394:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940501504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319365.104408:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319365.104466:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940501504:12345-0@lo:38:kworker.0 Request processed in 71us (1328us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319365.104472:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86
00000100:00080000:2.0:1767319365.105180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319365.105187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319365.105191:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940501504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319365.805026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319366.061823:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319366.728056:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319366.728118:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319366.728240:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314496
00000100:00100000:2.0:1767319366.728252:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314496
00000100:00100000:0.0:1767319366.728272:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314624
00000100:00100000:0.0:1767319366.728277:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314624
00000100:00100000:2.0:1767319366.728310:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17010
00000100:00100000:2.0:1767319366.728319:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894314496:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:0.0:1767319366.728342:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4449
00010000:00020000:2.0:1767319366.728347:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319366.728350:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314624:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319366.728699:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894314496:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 379us (653us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319366.728711:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17010
00000100:00080000:1.0:1767319366.728913:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319366.731967:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894314624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 2965us (3196us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319366.731985:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4449
00000100:00100000:2.0:1767319366.829235:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319367.087021:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319367.853210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319368.108984:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319368.685176:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940502400:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319368.685708:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319368.685861:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502400
00000100:00100000:3.0:1767319368.685873:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502400
00000100:00100000:3.0:1767319368.685958:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440
00000100:00100000:3.0:1767319368.685971:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940502400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319368.686012:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767319368.686439:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319368.690006:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940502400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4022us (4281us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319368.690029:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440
00000100:00100000:0.0:1767319368.691074:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940502400:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319368.878822:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319369.133191:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319369.709111:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940502528:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319369.709184:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319369.709373:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502528
00000100:00100000:1.0:1767319369.709381:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502528
00000100:00100000:1.0:1767319369.709448:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441
00000100:00100000:1.0:1767319369.709457:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940502528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319369.709490:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319369.709569:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319369.709893:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940502528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 436us (707us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319369.709901:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441
00000100:00100000:0.0:1767319369.710212:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940502528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319369.902207:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319370.157101:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319370.220948:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319370.220961:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319370.220964:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319370.220968:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319370.220973:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319370.220981:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319370.220986:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319370.220994:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319370.221037:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ead80 x1853163940502656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319370.221119:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940502656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319370.221219:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319370.221392:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319370.221397:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319370.221400:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319370.221404:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319370.221407:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319370.221412:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319370.221432:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8e00 x1853163940502784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319370.221502:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319370.221506:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319370.221508:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319370.221514:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319370.221516:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319370.221520:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319370.221524:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940503040:0@lo:400:kworker.0
00000100:00100000:2.0:1767319370.221533:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9500 x1853163940503296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319370.221555:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319370.221559:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319370.221561:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319370.221565:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319370.221568:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319370.221573:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319370.221575:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319370.221588:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940503552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319370.221618:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940503424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.221645:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319370.221653:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940502912:0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.221685:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319370.221697:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940503168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.221724:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503040
00000100:00100000:1.0:1767319370.221734:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503040
00000100:00100000:2.0:1767319370.221745:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502912
00000100:00100000:2.0:1767319370.221751:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502912
00000100:00100000:1.0:1767319370.221824:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897
00000100:00100000:2.0:1767319370.221832:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898
00000100:00100000:1.0:1767319370.221837:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940503040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319370.221845:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940502912:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.221902:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940503040:12345-0@lo:400:kworker.0 Request processed in 68us (330us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319370.221904:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940502912:12345-0@lo:400:kworker.0 Request processed in 61us (218us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319370.221916:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897
00000100:00100000:1.0:1767319370.221976:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940502912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319370.222123:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502656
00000100:00100000:0.0:1767319370.222128:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502656
00000100:00100000:0.0:1767319370.222158:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17011
00000100:00100000:0.0:1767319370.222163:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940502656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319370.222188:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319370.222248:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940502784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319370.222402:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898
00000100:00080000:2.0:1767319370.222423:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319370.222444:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319370.222479:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319370.222501:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940503040:0@lo:400:kworker.0
00000100:00100000:2.0:1767319370.222518:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503168
00000100:00100000:2.0:1767319370.222526:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503168
00000100:00100000:2.0:1767319370.222560:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503424
00000100:00100000:2.0:1767319370.222563:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503424
00000100:00100000:2.0:1767319370.222583:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4450
00000100:00100000:2.0:1767319370.222591:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940503168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.222620:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4451
00000100:00100000:1.0:1767319370.222634:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940503424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319370.222634:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940503168:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319370.222647:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4450
00000100:00080000:2.0:1767319370.222674:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319370.222688:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940503424:12345-0@lo:400:kworker.0 Request processed in 58us (207us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319370.222696:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4451
00000100:00100000:2.0:1767319370.222699:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940503168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319370.222732:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940503424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319370.222816:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319370.222836:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940503296:0@lo:38:kworker.0
00000100:00100000:3.0:1767319370.222856:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319370.222878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940503552:0@lo:38:kworker.0
00000100:00100000:3.0:1767319370.222899:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319370.222928:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503296
00000100:00100000:3.0:1767319370.222932:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503296
00000100:00100000:3.0:1767319370.222950:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503552
00000100:00100000:3.0:1767319370.222953:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503552
00000100:00100000:3.0:1767319370.222966:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17012
00000100:00100000:3.0:1767319370.222970:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940503296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319370.222983:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319370.223012:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940503296:12345-0@lo:38:kworker.0 Request processed in 40us (154us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319370.223031:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17012
00000100:00100000:3.0:1767319370.223056:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17013
00000100:00100000:3.0:1767319370.223061:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940503552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319370.223070:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319370.223093:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940503552:12345-0@lo:38:kworker.0 Request processed in 31us (193us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319370.223099:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17013
00000100:00080000:3.0:1767319370.223126:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319370.223132:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319370.223135:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940503296:0@lo:38:kworker.0
00000100:00080000:3.0:1767319370.223143:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319370.223147:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319370.223149:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940503552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319370.223682:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940502784
00000100:00100000:1.0:1767319370.223689:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940502784
00000100:00100000:1.0:1767319370.223730:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87
00000100:00100000:1.0:1767319370.223736:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940502784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319370.223748:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319370.223835:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940502784:12345-0@lo:38:kworker.0 Request processed in 97us (1018us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319370.223842:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87
00000100:00080000:2.0:1767319370.223916:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319370.223921:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319370.223924:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940502784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319370.224126:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940502656:12345-0@lo:38:kworker.0 Request processed in 1960us (2905us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319370.224134:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17011
00000100:00080000:2.0:1767319370.224191:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319370.224195:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319370.224199:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940502656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319370.925063:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319371.183096:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319371.846508:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319371.846559:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319371.846700:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314880
00000100:00100000:0.0:1767319371.846712:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314880
00000100:00100000:0.0:1767319371.846891:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894314752
00000100:00100000:0.0:1767319371.846896:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894314752
00000100:00080000:1.0:1767319371.846936:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319371.850667:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4452
00000100:00100000:3.0:1767319371.850694:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894314880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319371.850798:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894314880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 118us (4299us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319371.850805:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4452
00000100:00100000:3.0:1767319371.850830:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17014
00000100:00100000:3.0:1767319371.850835:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894314752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319371.851097:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319371.851127:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894314752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 290us (4567us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319371.851134:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17014
00000100:00100000:2.0:1767319371.948957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319372.205074:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319372.975398:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319373.229131:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319373.805527:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940503680:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319373.805602:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319373.806401:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503680
00000100:00100000:3.0:1767319373.806413:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503680
00000100:00100000:3.0:1767319373.806499:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442
00000100:00100000:3.0:1767319373.806511:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940503680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319373.806542:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767319373.806639:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319373.822483:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940503680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15961us (16865us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319373.822502:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442
00000100:00100000:2.0:1767319373.822555:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940503680:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319373.996895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319374.253047:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319374.829223:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319374.829247:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940503808:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319374.829311:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319374.829517:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503808
00000100:00100000:3.0:1767319374.829525:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503808
00000100:00100000:3.0:1767319374.829582:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443
00000100:00100000:3.0:1767319374.829593:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940503808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319374.829623:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319374.829669:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940503808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (358us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319374.829675:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443
00000100:00080000:1.0:1767319374.829726:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319374.829809:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940503808:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319375.020921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319375.277169:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319375.341066:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319375.341079:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319375.341082:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319375.341087:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319375.341091:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319375.341100:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4620
00000100:00080000:2.0:1767319375.341105:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319375.341112:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319375.341237:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9880 x1853163940503936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319375.341256:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319375.341259:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319375.341261:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319375.341266:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4620
00000100:00080000:2.0:1767319375.341268:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319375.341272:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319375.341286:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9c00 x1853163940504064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319375.341356:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940504192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319375.341424:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319375.341534:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940503936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319375.341566:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319375.341586:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940504064:0@lo:38:kworker.0
00000100:00100000:3.0:1767319375.341611:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319375.341646:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504064
00000100:00100000:3.0:1767319375.341654:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504064
00000100:00100000:3.0:1767319375.341688:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88
00000100:00100000:3.0:1767319375.341695:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940504064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319375.341716:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319375.341756:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940504064:12345-0@lo:38:kworker.0 Request processed in 59us (143us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319375.341763:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88
00000100:00100000:3.0:1767319375.341812:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940503936
00000100:00100000:3.0:1767319375.341816:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940503936
00000100:00100000:3.0:1767319375.341836:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17015
00000100:00100000:3.0:1767319375.341840:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940503936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319375.341850:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319375.341876:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940503936:12345-0@lo:38:kworker.0 Request processed in 35us (310us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319375.341882:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17015
00000100:00080000:3.0:1767319375.341928:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319375.341932:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319375.341936:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940503936:0@lo:38:kworker.0
00000100:00080000:3.0:1767319375.341944:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319375.341947:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319375.341949:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940504064:0@lo:38:kworker.0
00000100:00100000:3.0:1767319375.341983:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504192
00000100:00100000:3.0:1767319375.341987:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504192
00000100:00100000:3.0:1767319375.342041:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899
00000100:00100000:3.0:1767319375.342048:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940504192:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319375.342144:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319375.342350:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940504320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319375.342382:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319375.342418:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504320
00000100:00100000:0.0:1767319375.342422:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504320
00000100:00100000:0.0:1767319375.342447:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900
00000100:00100000:0.0:1767319375.342453:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940504320:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319375.342485:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940504320:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319375.342490:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900
00000100:00100000:0.0:1767319375.342520:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940504320:0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.344453:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940504192:12345-0@lo:400:kworker.0 Request processed in 2396us (3020us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319375.344469:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899
00000100:00100000:1.0:1767319375.344566:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940504192:0@lo:400:kworker.0
00000100:00080000:2.0:1767319375.347096:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319375.347103:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319375.347107:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319375.347115:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4620
00000100:00080000:2.0:1767319375.347119:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319375.347126:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319375.347150:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ebb80 x1853163940504576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319375.347188:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319375.347191:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319375.347193:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319375.347196:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4620
00000100:00080000:2.0:1767319375.347199:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319375.347203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319375.347214:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9c00 x1853163940504832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319375.347327:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940504448:0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.347390:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319375.347436:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319375.347441:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940504704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.347463:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319375.347495:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504448
00000100:00100000:3.0:1767319375.347501:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504448
00000100:00100000:3.0:1767319375.347548:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504704
00000100:00100000:3.0:1767319375.347551:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504704
00000100:00100000:3.0:1767319375.347577:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4453
00000100:00100000:3.0:1767319375.347586:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940504448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.347633:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940504448:12345-0@lo:400:kworker.0 Request processed in 48us (242us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319375.347639:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4453
00000100:00100000:3.0:1767319375.347656:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4454
00000100:00100000:3.0:1767319375.347662:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940504704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.347689:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940504704:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319375.347695:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4454
00000100:00100000:3.0:1767319375.347733:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940504704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319375.347743:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940504448:0@lo:400:kworker.0
00000100:00080000:0.0:1767319375.347845:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319375.347918:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940504576:0@lo:38:kworker.0
00000100:00100000:1.0:1767319375.347951:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319375.347976:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940504832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319375.347995:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319375.348076:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504576
00000100:00100000:0.0:1767319375.348080:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504576
00000100:00100000:0.0:1767319375.348108:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504832
00000100:00100000:0.0:1767319375.348111:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504832
00000100:00100000:0.0:1767319375.348129:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17016
00000100:00100000:0.0:1767319375.348134:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940504576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319375.348152:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319375.348187:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940504576:12345-0@lo:38:kworker.0 Request processed in 52us (235us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319375.348192:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17016
00000100:00100000:0.0:1767319375.348204:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17017
00000100:00100000:0.0:1767319375.348207:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940504832:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319375.348215:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319375.348236:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940504832:12345-0@lo:38:kworker.0 Request processed in 28us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319375.348241:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17017
00000100:00080000:1.0:1767319375.348488:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319375.348493:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319375.348496:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940504576:0@lo:38:kworker.0
00000100:00080000:1.0:1767319375.348503:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319375.348506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319375.348508:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940504832:0@lo:38:kworker.0
00000100:00100000:2.0:1767319375.944133:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319375.944375:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315264
00000100:00100000:1.0:1767319375.944412:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315264
00000100:00100000:1.0:1767319375.944506:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4455
00000100:00100000:1.0:1767319375.944517:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894315264:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319375.944597:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894315264:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319375.944605:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4455
00000100:00080000:0.0:1767319375.947594:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767319375.953049:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894315008 offset 0 length 520: 4
00000100:00100000:3.0:1767319375.953111:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319375.953349:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315136
00000100:00100000:2.0:1767319375.953360:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315136
00000100:00100000:2.0:1767319375.953415:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17018
00000100:00100000:2.0:1767319375.953425:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894315136:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319375.953450:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319375.953520:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894315136:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (408us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319375.953527:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17018
00000100:00100000:2.0:1767319376.045036:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319376.305075:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319377.070151:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319377.325236:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319378.092930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319378.349024:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319378.925052:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940504960:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319378.925128:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319378.925311:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940504960
00000100:00100000:1.0:1767319378.925319:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940504960
00000100:00100000:1.0:1767319378.925392:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444
00000100:00100000:1.0:1767319378.925403:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940504960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319378.925437:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319378.925494:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940504960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319378.925501:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444
00000100:00100000:2.0:1767319378.925593:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940504960:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319378.925651:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319379.116920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319379.373415:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319379.953144:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319379.953172:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940505088:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319379.953239:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319379.953386:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505088
00000100:00100000:1.0:1767319379.953395:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505088
00000100:00100000:1.0:1767319379.953473:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445
00000100:00100000:1.0:1767319379.953483:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940505088:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319379.953512:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319379.953550:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319379.953566:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940505088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319379.953574:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445
00000100:00100000:2.0:1767319379.953607:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940505088:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319380.141181:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319380.397250:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319380.461418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319380.461429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319380.461432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319380.461436:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319380.461440:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319380.461448:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319380.461453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319380.461459:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319380.461517:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940505216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319380.461544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319380.461548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319380.461550:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319380.461554:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319380.461556:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319380.461560:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319380.461573:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540bb80 x1853163940505344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319380.461663:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940505472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319380.461736:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319380.461811:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505472
00000100:00100000:2.0:1767319380.461821:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505472
00000100:00100000:1.0:1767319380.461878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940505216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319380.461891:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901
00000100:00100000:2.0:1767319380.461915:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940505472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319380.461929:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319380.461966:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940505344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319380.462613:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319380.462695:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940505600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319380.462753:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319380.462826:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505344
00000100:00100000:1.0:1767319380.462832:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505344
00000100:00100000:1.0:1767319380.462859:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89
00000100:00100000:1.0:1767319380.462866:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940505344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319380.462887:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319380.462940:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940505344:12345-0@lo:38:kworker.0 Request processed in 73us (186us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319380.462947:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89
00000100:00100000:1.0:1767319380.462983:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505216
00000100:00100000:1.0:1767319380.462987:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505216
00000100:00100000:1.0:1767319380.463023:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17019
00000100:00100000:1.0:1767319380.463029:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940505216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319380.463040:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319380.463082:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940505216:12345-0@lo:38:kworker.0 Request processed in 52us (1153us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319380.463088:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17019
00000100:00080000:1.0:1767319380.463123:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319380.463129:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319380.463132:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940505216:0@lo:38:kworker.0
00000100:00080000:1.0:1767319380.463142:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319380.463145:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319380.463148:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940505344:0@lo:38:kworker.0
00000100:00080000:1.0:1767319380.463197:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319380.463680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319380.463686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319380.463689:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319380.463694:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319380.463698:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319380.463703:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319380.463723:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45409500 x1853163940505856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319380.463746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319380.463749:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319380.463751:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319380.463754:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319380.463757:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319380.463760:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319380.463770:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940506112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319380.463815:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940505856:0@lo:38:kworker.0
00000100:00100000:3.0:1767319380.463853:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319380.463876:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940506112:0@lo:38:kworker.0
00000100:00100000:3.0:1767319380.463898:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319380.463945:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505856
00000100:00100000:3.0:1767319380.463961:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505856
00000100:00100000:3.0:1767319380.463983:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506112
00000100:00100000:3.0:1767319380.463986:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506112
00000100:00100000:3.0:1767319380.464009:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17020
00000100:00100000:3.0:1767319380.464014:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940505856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319380.464026:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319380.464366:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940505856:12345-0@lo:38:kworker.0 Request processed in 350us (511us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319380.464374:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17020
00000100:00100000:3.0:1767319380.464406:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17021
00000100:00100000:3.0:1767319380.464411:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940506112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319380.464424:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319380.464450:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940506112:12345-0@lo:38:kworker.0 Request processed in 38us (551us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319380.464456:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17021
00000100:00080000:3.0:1767319380.464717:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319380.464722:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319380.464726:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940505856:0@lo:38:kworker.0
00000100:00080000:3.0:1767319380.464738:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319380.464741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319380.464743:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940506112:0@lo:38:kworker.0
00000100:00100000:3.0:1767319380.464809:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940505984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.464840:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319380.464862:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319380.464868:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940505728:0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.464888:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319380.464922:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505984
00000100:00100000:3.0:1767319380.464926:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505984
00000100:00100000:3.0:1767319380.464974:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505728
00000100:00100000:3.0:1767319380.464977:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505728
00000100:00100000:3.0:1767319380.465198:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4456
00000100:00100000:3.0:1767319380.465209:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940505984:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.465254:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940505984:12345-0@lo:400:kworker.0 Request processed in 49us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319380.465260:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4456
00000100:00100000:3.0:1767319380.465275:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4457
00000100:00100000:3.0:1767319380.465282:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940505728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.465308:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940505728:12345-0@lo:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319380.465312:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4457
00000100:00100000:3.0:1767319380.465343:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940505728:0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.465352:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940505984:0@lo:400:kworker.0
00000100:00080000:1.0:1767319380.465619:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319380.472149:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940505472:12345-0@lo:400:kworker.0 Request processed in 10221us (10396us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319380.472170:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901
00000100:00100000:0.0:1767319380.473825:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319380.474220:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940505472:0@lo:400:kworker.0
00000100:00100000:2.0:1767319380.478752:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940505600
00000100:00100000:2.0:1767319380.478766:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940505600
00000100:00100000:3.0:1767319380.482751:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902
00000100:00100000:3.0:1767319380.483600:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940505600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319380.483808:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940505600:12345-0@lo:400:kworker.0 Request processed in 227us (9989us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319380.483818:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902
00000100:00100000:0.0:1767319380.483861:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940505600:0@lo:400:kworker.0
00000100:00100000:0.0:1767319381.065355:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319381.065534:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315520
00000100:00100000:1.0:1767319381.065545:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315520
00000100:00080000:2.0:1767319381.065750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319381.066220:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4458
00000100:00100000:1.0:1767319381.066232:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894315520:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319381.066306:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894315520:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (961us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319381.066314:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4458
00000100:00100000:0.0:1767319381.066375:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319381.066520:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315392
00000100:00100000:3.0:1767319381.066526:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315392
00000100:00100000:3.0:1767319381.066554:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17022
00000100:00100000:3.0:1767319381.066559:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894315392:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319381.066579:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319381.066606:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894315392:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (231us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319381.066613:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17022
00000100:00100000:2.0:1767319381.164924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319381.420996:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319382.188888:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319382.445472:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319383.213386:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319383.469372:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319384.048344:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940506240:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319384.048433:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319384.049018:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506240
00000100:00100000:1.0:1767319384.049028:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506240
00000100:00080000:3.0:1767319384.049093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319384.049285:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446
00000100:00100000:1.0:1767319384.049298:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940506240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319384.049331:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319384.049395:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940506240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (961us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319384.049402:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1767319384.049520:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940506240:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319384.236941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319384.493117:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319384.556937:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319359/real 1767319359]  req@ffff93cf50adf800 x1853163940500992/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319384.556970:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf50adf800 x1853163940500992/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319384.556987:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319384.557018:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319384.557021:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940500992:0@lo:250:kworker.0
00000100:00080000:3.0:1767319384.557139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319384.557145:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319384.557148:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319384.557152:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319384.557157:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319384.557163:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319384.557193:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964a80 x1853163940506368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319384.557219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319384.557223:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319384.557225:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319384.557228:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4630
00000100:00080000:3.0:1767319384.557231:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319384.557234:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319384.557253:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940506496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319384.557262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319384.557265:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319384.557266:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319384.557270:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4630
00000100:00080000:3.0:1767319384.557271:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319384.557274:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319384.557283:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966680 x1853163940506624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319384.557334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319384.557337:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319384.557339:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319384.557342:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4630
00000100:00080000:3.0:1767319384.557345:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319384.557349:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319384.557359:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940507008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319384.557373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319384.557375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319384.557376:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319384.557378:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4630
00000100:00080000:3.0:1767319384.557380:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319384.557382:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319384.557388:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940507264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319384.557409:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940507136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319384.557472:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319384.557524:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319384.557530:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940506880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319384.557550:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319384.557581:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507136
00000100:00100000:3.0:1767319384.557587:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507136
00000100:00100000:3.0:1767319384.557635:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506880
00000100:00100000:3.0:1767319384.557638:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506880
00000100:00100000:3.0:1767319384.557663:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4459
00000100:00100000:3.0:1767319384.557670:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940507136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319384.557895:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940507136:12345-0@lo:400:kworker.0 Request processed in 225us (422us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319384.557901:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4459
00000100:00100000:3.0:1767319384.557928:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4460
00000100:00100000:3.0:1767319384.557935:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940506880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319384.557967:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940506880:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319384.557973:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4460
00000100:00080000:3.0:1767319384.557989:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319384.558014:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319384.558024:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940506752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319384.558056:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319384.558076:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940506368:0@lo:250:kworker.0
00000400:00000100:0.0:1767319384.558098:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940506368 offset 0 length 520: 4
00000100:00100000:0.0:1767319384.558115:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940506496:0@lo:38:kworker.0
00000100:00100000:0.0:1767319384.558139:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319384.558147:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940506880:0@lo:400:kworker.0
00000100:00100000:0.0:1767319384.558154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940506624:0@lo:38:kworker.0
00000100:00100000:2.0:1767319384.558157:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940507136:0@lo:400:kworker.0
00000100:00100000:0.0:1767319384.558174:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319384.558185:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506752
00000100:00100000:0.0:1767319384.558188:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940507008:0@lo:38:kworker.0
00000100:00100000:2.0:1767319384.558188:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506752
00000100:00100000:0.0:1767319384.558211:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319384.558226:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940507264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319384.558244:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319384.558271:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506496
00000100:00100000:0.0:1767319384.558275:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506496
00000100:00100000:0.0:1767319384.558299:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507008
00000100:00100000:0.0:1767319384.558302:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507008
00000100:00100000:0.0:1767319384.558315:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507264
00000100:00100000:0.0:1767319384.558317:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507264
00000100:00100000:0.0:1767319384.558327:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17023
00000100:00100000:0.0:1767319384.558331:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940506496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319384.558348:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319384.558379:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940506496:12345-0@lo:38:kworker.0 Request processed in 47us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319384.558385:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17023
00000100:00100000:0.0:1767319384.558397:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17024
00000100:00100000:0.0:1767319384.558401:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940507008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319384.558410:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319384.558430:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940507008:12345-0@lo:38:kworker.0 Request processed in 27us (223us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319384.558435:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17024
00000100:00100000:0.0:1767319384.558444:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17025
00000100:00100000:0.0:1767319384.558447:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940507264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319384.558455:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319384.558473:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940507264:12345-0@lo:38:kworker.0 Request processed in 24us (228us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319384.558479:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17025
00000100:00080000:0.0:1767319384.558502:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319384.558506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319384.558510:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940506496:0@lo:38:kworker.0
00000100:00080000:0.0:1767319384.558517:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319384.558520:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319384.558523:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940507008:0@lo:38:kworker.0
00000100:00080000:0.0:1767319384.558529:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319384.558531:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319384.558535:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940507264:0@lo:38:kworker.0
00000100:00100000:1.0:1767319384.558841:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940506624
00000100:00100000:1.0:1767319384.558846:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940506624
00000100:00100000:1.0:1767319384.558870:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90
00000100:00100000:1.0:1767319384.558875:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940506624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319384.558886:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319384.558934:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940506624:12345-0@lo:38:kworker.0 Request processed in 58us (759us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319384.558941:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90
00000100:00080000:1.0:1767319384.558968:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319384.558971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319384.558974:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940506624:0@lo:38:kworker.0
00000100:00100000:2.0:1767319384.565112:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903
00000100:00100000:2.0:1767319384.565129:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940506752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319384.565235:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940506752:12345-0@lo:400:kworker.0 Request processed in 111us (7177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319384.565242:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903
00000100:00080000:3.0:1767319384.566095:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319384.567286:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940506752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319385.080347:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940507392:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319385.080419:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319385.080621:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507392
00000100:00100000:2.0:1767319385.080630:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507392
00000100:00100000:2.0:1767319385.080701:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447
00000100:00100000:2.0:1767319385.080712:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940507392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319385.080749:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319385.080837:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940507392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (417us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319385.080845:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447
00000100:00100000:0.0:1767319385.081102:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940507392:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319385.260974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319385.517250:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319386.184941:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319386.184978:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319386.185023:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319386.185120:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315648
00000100:00100000:2.0:1767319386.185131:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315648
00000100:00100000:1.0:1767319386.185162:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315904
00000100:00100000:1.0:1767319386.185167:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315904
00000100:00100000:3.0:1767319386.185221:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894315776
00000100:00100000:3.0:1767319386.185225:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894315776
00000100:00100000:2.0:1767319386.194275:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4461
00000100:00100000:2.0:1767319386.194301:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+6:2503:x1853163894315904:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319386.194398:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+6:2503:x1853163894315904:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (9417us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319386.194406:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4461
00000100:00100000:2.0:1767319386.194432:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17026
00000100:00100000:2.0:1767319386.194439:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894315648:12345-192.168.202.21@tcp:17:kworker.0
00000100:00100000:2.0:1767319386.194533:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894315648:12345-192.168.202.21@tcp:17:kworker.0 Request processed in 95us (9602us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319386.194540:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17026
00000100:00080000:2.0:1767319386.195331:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319386.196352:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17027
00000100:00100000:3.0:1767319386.196361:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894315776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319386.196383:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319386.196446:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894315776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 84us (11422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319386.196454:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17027
00000100:00100000:2.0:1767319386.285067:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319386.542288:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319387.308975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319387.568132:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319388.333120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319388.589127:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319389.167130:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319389.167162:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940507520:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319389.167297:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319389.168744:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507520
00000100:00100000:1.0:1767319389.168758:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507520
00000100:00100000:1.0:1767319389.168973:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448
00000100:00100000:1.0:1767319389.168986:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940507520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319389.169021:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319389.169112:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940507520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (1816us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319389.169121:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448
00000100:00100000:3.0:1767319389.169263:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940507520:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319389.169332:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319389.357958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319389.613452:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319389.676941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319389.676958:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319389.676961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319389.676965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319389.676969:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319389.676977:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4634
00000100:00080000:3.0:1767319389.676981:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319389.676989:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319389.677045:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940507648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319389.677075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319389.677079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319389.677081:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319389.677084:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4634
00000100:00080000:3.0:1767319389.677087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319389.677090:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319389.677106:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940507776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319389.677151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319389.677154:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319389.677156:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319389.677160:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4634
00000100:00080000:3.0:1767319389.677162:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319389.677166:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319389.677176:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940508160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319389.677200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319389.677203:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319389.677205:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319389.677208:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4634
00000100:00080000:3.0:1767319389.677210:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319389.677213:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319389.677223:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940508416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319389.677248:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940508288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319389.677319:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319389.677811:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940507648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319389.677844:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319389.677888:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940507776:0@lo:38:kworker.0
00000100:00100000:1.0:1767319389.677920:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319389.677933:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508288
00000100:00100000:1.0:1767319389.677942:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940508160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319389.677942:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508288
00000100:00100000:1.0:1767319389.677968:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319389.677994:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940508416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319389.678013:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319389.678045:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507776
00000100:00100000:1.0:1767319389.678050:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507776
00000100:00100000:1.0:1767319389.678082:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91
00000100:00100000:1.0:1767319389.678089:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940507776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319389.678109:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319389.678117:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507648
00000100:00100000:3.0:1767319389.678122:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507648
00000100:00100000:3.0:1767319389.678141:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508160
00000100:00100000:3.0:1767319389.678144:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508160
00000100:00100000:3.0:1767319389.678155:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508416
00000100:00100000:3.0:1767319389.678159:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508416
00000100:00100000:1.0:1767319389.678161:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940507776:12345-0@lo:38:kworker.0 Request processed in 68us (238us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319389.678171:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91
00000100:00100000:3.0:1767319389.678176:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4462
00000100:00100000:3.0:1767319389.678187:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940508288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319389.678241:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940508288:12345-0@lo:400:kworker.0 Request processed in 56us (920us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319389.678248:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4462
00000100:00100000:3.0:1767319389.678271:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17028
00000100:00100000:3.0:1767319389.678276:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940507648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319389.678287:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319389.678317:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940507648:12345-0@lo:38:kworker.0 Request processed in 39us (471us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319389.678324:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17028
00000100:00100000:3.0:1767319389.678340:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17029
00000100:00100000:3.0:1767319389.678344:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940508160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319389.678353:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319389.678382:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940508160:12345-0@lo:38:kworker.0 Request processed in 37us (413us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319389.678388:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17029
00000100:00080000:1.0:1767319389.678390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319389.678397:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319389.678401:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940507648:0@lo:38:kworker.0
00000100:00080000:1.0:1767319389.678412:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319389.678420:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319389.678422:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940507776:0@lo:38:kworker.0
00000100:00080000:1.0:1767319389.678431:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319389.678434:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319389.678436:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940508160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319389.678515:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030
00000100:00100000:3.0:1767319389.678520:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940508416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319389.678530:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319389.678707:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940508416:12345-0@lo:38:kworker.0 Request processed in 185us (692us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319389.678712:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030
00000100:00100000:3.0:1767319389.678741:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940508288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319389.679597:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940507904:0@lo:400:kworker.0
00000100:00100000:0.0:1767319389.679635:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319389.679670:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319389.679676:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940508032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319389.679700:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319389.679725:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508032
00000100:00100000:0.0:1767319389.679729:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508032
00000100:00100000:3.0:1767319389.679737:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940507904
00000100:00100000:3.0:1767319389.679741:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940507904
00000100:00100000:0.0:1767319389.679757:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4463
00000100:00100000:0.0:1767319389.679763:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940508032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319389.679764:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904
00000100:00100000:3.0:1767319389.679769:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940507904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319389.679815:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940508032:12345-0@lo:400:kworker.0 Request processed in 52us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319389.679822:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4463
00000100:00100000:0.0:1767319389.679886:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940508032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319389.679897:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940507904:0@lo:400:kworker.0
00000100:00080000:0.0:1767319389.679931:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319389.679935:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319389.679951:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940508416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319389.679961:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940507904:12345-0@lo:400:kworker.0 Request processed in 50us (184us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319389.679970:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904
00000100:00080000:2.0:1767319389.685234:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319389.685246:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319390.192946:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319390.192972:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940508544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319390.193046:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319390.193960:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508544
00000100:00100000:0.0:1767319390.193970:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508544
00000100:00100000:0.0:1767319390.194030:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449
00000100:00100000:0.0:1767319390.194042:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940508544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319390.194078:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319390.194142:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940508544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1095us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319390.194149:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449
00000100:00100000:0.0:1767319390.194203:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940508544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319390.382207:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319390.638343:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319391.302441:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319391.302495:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319391.302592:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316160
00000100:00100000:1.0:1767319391.302603:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316160
00000100:00100000:2.0:1767319391.302633:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316032
00000100:00100000:2.0:1767319391.302638:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316032
00000100:00100000:2.0:1767319391.302680:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4464
00000100:00080000:3.0:1767319391.302687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319391.302691:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894316160:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319391.302848:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894316160:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 157us (415us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319391.302876:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4464
00000100:00100000:2.0:1767319391.302895:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17031
00000100:00100000:2.0:1767319391.302900:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894316032:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319391.302932:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319391.302959:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894316032:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 58us (464us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319391.302965:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17031
00000100:00100000:2.0:1767319391.405140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319391.669453:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319392.432201:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319392.685291:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319393.452951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319393.709077:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319394.285514:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940508672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319394.285597:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319394.286815:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508672
00000100:00100000:3.0:1767319394.286834:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508672
00000100:00100000:3.0:1767319394.286926:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450
00000100:00100000:3.0:1767319394.286941:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940508672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319394.286976:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767319394.287069:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319394.290586:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940508672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3637us (4975us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319394.290606:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450
00000100:00100000:0.0:1767319394.293731:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940508672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319394.476932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319394.733100:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319394.797229:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319394.797241:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319394.797244:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319394.797248:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319394.797253:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319394.797260:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4639
00000100:00080000:3.0:1767319394.797265:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319394.797272:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319394.797314:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940508800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319394.797341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319394.797345:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319394.797346:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319394.797350:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4639
00000100:00080000:3.0:1767319394.797352:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319394.797355:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319394.797367:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940508928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319394.797427:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319394.797431:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319394.797433:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319394.797436:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4639
00000100:00080000:3.0:1767319394.797439:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319394.797443:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319394.797454:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966a00 x1853163940509312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319394.797469:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319394.797472:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319394.797474:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319394.797477:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4639
00000100:00080000:3.0:1767319394.797480:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319394.797483:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319394.797493:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940509568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319394.797520:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940509184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.797583:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319394.797642:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319394.797648:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940509440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.797670:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319394.797704:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509184
00000100:00100000:3.0:1767319394.797711:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509184
00000100:00100000:3.0:1767319394.797758:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509440
00000100:00100000:3.0:1767319394.797761:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509440
00000100:00100000:3.0:1767319394.797831:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4465
00000100:00100000:3.0:1767319394.797840:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940509184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.797890:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940509184:12345-0@lo:400:kworker.0 Request processed in 52us (307us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319394.797896:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4465
00000100:00100000:3.0:1767319394.797913:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4466
00000100:00100000:3.0:1767319394.797919:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940509440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.797944:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940509440:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319394.797949:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4466
00000100:00100000:3.0:1767319394.797987:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940509440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.797996:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940509184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319394.798070:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319394.798080:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940509056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319394.798116:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319394.798226:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319394.799133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940508800:0@lo:38:kworker.0
00000100:00100000:1.0:1767319394.799179:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319394.799211:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940508928:0@lo:38:kworker.0
00000100:00100000:1.0:1767319394.799246:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319394.799273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940509312:0@lo:38:kworker.0
00000100:00100000:1.0:1767319394.799293:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319394.799323:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940509568:0@lo:38:kworker.0
00000100:00100000:1.0:1767319394.799345:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319394.799379:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508800
00000100:00100000:1.0:1767319394.799384:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508800
00000100:00100000:1.0:1767319394.799412:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509312
00000100:00100000:1.0:1767319394.799415:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509312
00000100:00100000:1.0:1767319394.799427:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509568
00000100:00100000:1.0:1767319394.799429:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509568
00000100:00100000:1.0:1767319394.799445:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032
00000100:00100000:1.0:1767319394.799451:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940508800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319394.799470:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319394.799506:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940508800:12345-0@lo:38:kworker.0 Request processed in 53us (325us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319394.799512:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032
00000100:00100000:1.0:1767319394.799527:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033
00000100:00100000:1.0:1767319394.799530:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940509312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319394.799539:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319394.799560:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940509312:12345-0@lo:38:kworker.0 Request processed in 29us (267us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319394.799566:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033
00000100:00100000:1.0:1767319394.799576:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034
00000100:00100000:1.0:1767319394.799579:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940509568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319394.799587:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319394.799610:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940509568:12345-0@lo:38:kworker.0 Request processed in 29us (265us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319394.799615:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034
00000100:00080000:1.0:1767319394.799648:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319394.799653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319394.799656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940508800:0@lo:38:kworker.0
00000100:00080000:1.0:1767319394.799664:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319394.799667:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319394.799670:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940509312:0@lo:38:kworker.0
00000100:00080000:1.0:1767319394.799676:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319394.799679:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319394.799681:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940509568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319394.799794:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940508928
00000100:00100000:0.0:1767319394.799799:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940508928
00000100:00100000:0.0:1767319394.799831:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92
00000100:00100000:0.0:1767319394.799836:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940508928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319394.799845:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319394.799891:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940508928:12345-0@lo:38:kworker.0 Request processed in 43us (634us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319394.799898:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92
00000100:00080000:0.0:1767319394.799932:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319394.799936:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319394.799938:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940508928:0@lo:38:kworker.0
00000100:00100000:3.0:1767319394.800329:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509056
00000100:00100000:3.0:1767319394.800335:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509056
00000100:00100000:3.0:1767319394.800436:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905
00000100:00100000:3.0:1767319394.800445:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940509056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319394.800502:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940509056:12345-0@lo:400:kworker.0 Request processed in 60us (2386us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319394.800509:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905
00000100:00100000:3.0:1767319394.800545:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940509056:0@lo:400:kworker.0
00000100:00080000:2.0:1767319394.810093:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319395.312373:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319395.312401:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940509696:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319395.312476:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319395.313280:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509696
00000100:00100000:3.0:1767319395.313291:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509696
00000100:00100000:3.0:1767319395.313351:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451
00000100:00100000:3.0:1767319395.313361:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940509696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319395.313393:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319395.313459:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940509696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (983us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319395.313466:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451
00000100:00100000:0.0:1767319395.313613:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940509696:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319395.500969:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319395.757676:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319396.432744:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319396.433364:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316288
00000100:00100000:0.0:1767319396.433380:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316288
00000100:00100000:0.0:1767319396.433502:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17035
00000100:00100000:0.0:1767319396.433514:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894316288:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319396.433548:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319396.433639:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894316288:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 125us (907us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319396.433647:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17035
00000100:00100000:3.0:1767319396.447986:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319396.448126:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316416
00000100:00100000:0.0:1767319396.448137:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316416
00000100:00100000:0.0:1767319396.448231:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4467
00000100:00100000:0.0:1767319396.448240:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894316416:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319396.448332:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894316416:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319396.448340:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4467
00000100:00080000:2.0:1767319396.448516:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319396.524934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319396.781048:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319397.549193:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319397.805114:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319398.572937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319398.831939:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319399.405044:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940509824:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319399.405125:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319399.405590:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509824
00000100:00100000:2.0:1767319399.405599:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509824
00000100:00080000:0.0:1767319399.405654:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319399.405812:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452
00000100:00100000:3.0:1767319399.405824:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940509824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319399.405856:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319399.405908:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940509824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (782us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319399.405917:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452
00000100:00100000:0.0:1767319399.405948:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940509824:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319399.596979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319399.853543:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319399.916904:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319399.916916:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319399.916920:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319399.916925:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319399.916931:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319399.916941:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4644
00000100:00080000:3.0:1767319399.916947:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319399.916956:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319399.917008:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b100 x1853163940509952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319399.917038:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319399.917041:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319399.917043:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319399.917046:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4644
00000100:00080000:3.0:1767319399.917048:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319399.917052:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319399.917063:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540b800 x1853163940510080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319399.917111:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319399.917116:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319399.917118:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319399.917121:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4644
00000100:00080000:3.0:1767319399.917124:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319399.917130:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319399.917131:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940510208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319399.917141:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967100 x1853163940510464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319399.917180:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319399.917182:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319399.917184:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319399.917187:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4644
00000100:00080000:3.0:1767319399.917190:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319399.917194:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319399.917204:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964380 x1853163940510720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319399.917224:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319399.917234:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940510592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319399.917318:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319399.917411:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319399.917412:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510592
00000100:00100000:3.0:1767319399.917422:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510592
00000100:00100000:1.0:1767319399.917452:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319399.917460:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940510336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319399.917490:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319399.917523:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510208
00000100:00100000:1.0:1767319399.917527:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510208
00000100:00100000:1.0:1767319399.917567:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906
00000100:00100000:1.0:1767319399.917576:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940510208:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319399.917636:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940510208:12345-0@lo:400:kworker.0 Request processed in 59us (225us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319399.917645:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906
00000100:00100000:3.0:1767319399.917689:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510336
00000100:00100000:3.0:1767319399.917695:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510336
00000100:00100000:1.0:1767319399.917699:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4468
00000100:00100000:1.0:1767319399.917709:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940510592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319399.917743:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4469
00000100:00100000:3.0:1767319399.917752:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940510336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319399.917758:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940510592:12345-0@lo:400:kworker.0 Request processed in 48us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319399.917768:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4468
00000100:00100000:3.0:1767319399.917822:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940510336:12345-0@lo:400:kworker.0 Request processed in 71us (331us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319399.917833:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4469
00000100:00080000:3.0:1767319399.917856:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319399.917857:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940510336:0@lo:400:kworker.0
00000100:00080000:3.0:1767319399.917861:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319399.917874:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940510208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319399.917889:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940510592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319399.918050:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940509952:0@lo:38:kworker.0
00000100:00100000:0.0:1767319399.918078:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319399.918100:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940510080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319399.918124:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319399.918124:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940509952
00000100:00100000:1.0:1767319399.918130:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940509952
00000100:00100000:0.0:1767319399.918150:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940510464:0@lo:38:kworker.0
00000100:00100000:1.0:1767319399.918157:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036
00000100:00100000:1.0:1767319399.918244:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940509952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319399.918268:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319399.918315:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940509952:12345-0@lo:38:kworker.0 Request processed in 150us (234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319399.918317:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319399.918328:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036
00000100:00100000:3.0:1767319399.918387:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510080
00000100:00100000:3.0:1767319399.918392:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510080
00000100:00100000:3.0:1767319399.918696:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93
00000100:00100000:3.0:1767319399.918701:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940510080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319399.918713:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319399.918749:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940510080:12345-0@lo:38:kworker.0 Request processed in 47us (625us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319399.918756:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93
00000100:00100000:0.0:1767319399.918907:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940510720:0@lo:38:kworker.0
00000100:00100000:0.0:1767319399.918930:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319399.919289:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510464
00000100:00100000:1.0:1767319399.919295:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510464
00000100:00100000:2.0:1767319399.919993:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037
00000100:00100000:2.0:1767319399.920001:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940510464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319399.920016:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319399.920061:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940510464:12345-0@lo:38:kworker.0 Request processed in 60us (1747us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319399.920067:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037
00000100:00080000:0.0:1767319399.923090:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319399.923104:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319399.923109:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940509952:0@lo:38:kworker.0
00000100:00080000:0.0:1767319399.923121:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319399.923124:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319399.923128:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940510080:0@lo:38:kworker.0
00000100:00080000:0.0:1767319399.923136:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319399.923139:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319399.923143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940510464:0@lo:38:kworker.0
00000100:00100000:1.0:1767319399.923324:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510720
00000100:00100000:1.0:1767319399.923334:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510720
00000100:00100000:3.0:1767319399.923469:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038
00000100:00100000:3.0:1767319399.923478:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940510720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319399.923500:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319399.923562:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940510720:12345-0@lo:38:kworker.0 Request processed in 84us (4631us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319399.923570:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038
00000100:00080000:2.0:1767319399.931993:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319399.932014:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319399.932021:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940510720:0@lo:38:kworker.0
00000100:00100000:1.0:1767319400.431457:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319400.431485:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940510848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319400.431576:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319400.432845:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510848
00000100:00100000:2.0:1767319400.432856:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510848
00000100:00100000:2.0:1767319400.432925:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453
00000100:00100000:2.0:1767319400.432936:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940510848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319400.432971:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319400.433049:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940510848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1473us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319400.433057:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453
00000100:00100000:1.0:1767319400.433198:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940510848:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319400.620941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319400.881277:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319401.545365:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319401.545453:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319401.545467:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316672
00000100:00100000:1.0:1767319401.545477:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316672
00000100:00100000:1.0:1767319401.545551:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316544
00000100:00100000:1.0:1767319401.545554:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316544
00000100:00100000:1.0:1767319401.545576:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4470
00000100:00100000:1.0:1767319401.545587:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894316672:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319401.545602:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17039
00000100:00100000:2.0:1767319401.545620:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894316544:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767319401.545672:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894316672:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319401.545680:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4470
00010000:00020000:2.0:1767319401.546045:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319401.546077:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894316544:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 458us (624us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319401.546085:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17039
00000100:00080000:3.0:1767319401.546563:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767319401.560114:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894316800 offset 0 length 520: 4
00000100:00100000:2.0:1767319401.645133:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319401.903935:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319402.668972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319402.926859:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319403.692896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319403.949495:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319404.527016:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319404.527073:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940510976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319404.527173:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319404.527385:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940510976
00000100:00100000:3.0:1767319404.527399:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940510976
00000100:00100000:3.0:1767319404.527500:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454
00000100:00100000:3.0:1767319404.527513:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940510976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319404.527564:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319404.527620:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940510976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319404.527638:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454
00000100:00080000:2.0:1767319404.527935:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319404.527978:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940510976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319404.716897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319404.973078:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319405.037675:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319405.037685:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319405.037688:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319405.037692:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319405.037696:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319405.037704:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4649
00000100:00080000:3.0:1767319405.037708:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319405.037716:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319405.037797:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940511104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319405.037822:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319405.037826:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319405.037828:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319405.037832:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4649
00000100:00080000:3.0:1767319405.037834:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319405.037838:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319405.037850:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940511232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319405.037920:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940511360:0@lo:400:kworker.0
00000100:00100000:0.0:1767319405.037981:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319405.038070:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940511104:0@lo:38:kworker.0
00000100:00100000:2.0:1767319405.038107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319405.038127:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940511232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319405.038148:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319405.038181:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511232
00000100:00100000:2.0:1767319405.038188:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511232
00000100:00100000:2.0:1767319405.038220:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94
00000100:00100000:2.0:1767319405.038226:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940511232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319405.038246:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319405.038284:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940511232:12345-0@lo:38:kworker.0 Request processed in 56us (133us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319405.038291:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94
00000100:00080000:2.0:1767319405.038324:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319405.038328:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319405.038332:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940511232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319405.038364:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511360
00000100:00100000:2.0:1767319405.038368:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511360
00000100:00100000:2.0:1767319405.038395:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907
00000100:00100000:2.0:1767319405.038400:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940511360:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319405.038476:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319405.038479:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319405.038482:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319405.038486:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4649
00000100:00080000:3.0:1767319405.038489:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319405.038492:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319405.038505:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838700 x1853163940511744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319405.038570:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940511488:0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.038599:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319405.038621:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319405.038627:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940511616:0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.038647:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319405.038671:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511104
00000100:00100000:1.0:1767319405.038674:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511104
00000100:00100000:1.0:1767319405.038692:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511616
00000100:00100000:1.0:1767319405.038694:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511616
00000100:00100000:1.0:1767319405.038721:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4471
00000100:00100000:1.0:1767319405.038741:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940511616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.038790:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940511616:12345-0@lo:400:kworker.0 Request processed in 47us (125us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319405.038796:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4471
00000100:00100000:1.0:1767319405.038809:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17040
00000100:00100000:1.0:1767319405.038813:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940511104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319405.038829:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319405.038855:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940511104:12345-0@lo:38:kworker.0 Request processed in 40us (747us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319405.038860:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17040
00000100:00100000:1.0:1767319405.038879:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511488
00000100:00100000:1.0:1767319405.038883:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511488
00000100:00100000:1.0:1767319405.038904:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908
00000100:00100000:1.0:1767319405.038910:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940511488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.038935:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940511488:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319405.038941:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908
00000100:00100000:1.0:1767319405.038968:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940511616:0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.038976:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940511488:0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.039021:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940511872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.039044:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319405.039065:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511872
00000100:00100000:1.0:1767319405.039069:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511872
00000100:00100000:1.0:1767319405.039091:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4472
00000100:00100000:1.0:1767319405.039096:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940511872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319405.039124:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940511872:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319405.039130:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4472
00000100:00100000:1.0:1767319405.039150:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940511872:0@lo:400:kworker.0
00000100:00080000:1.0:1767319405.039175:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319405.039178:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319405.039186:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940511744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319405.039208:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319405.039228:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319405.039232:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319405.039235:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940511104:0@lo:38:kworker.0
00000100:00100000:1.0:1767319405.039253:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940511744
00000100:00100000:1.0:1767319405.039256:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940511744
00000100:00100000:1.0:1767319405.039272:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17041
00000100:00100000:1.0:1767319405.039276:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940511744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319405.039286:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319405.039312:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940511744:12345-0@lo:38:kworker.0 Request processed in 34us (103us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319405.039317:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17041
00000100:00080000:1.0:1767319405.039336:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319405.039339:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319405.039343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940511744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319405.039900:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940511360:12345-0@lo:400:kworker.0 Request processed in 1496us (1914us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319405.039919:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907
00000100:00080000:3.0:1767319405.040055:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319405.040060:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319405.040063:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319405.040067:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4649
00000100:00080000:3.0:1767319405.040070:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319405.040074:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319405.040097:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183bb80 x1853163940512000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319405.040171:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940512000:0@lo:38:kworker.0
00000100:00100000:1.0:1767319405.040202:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319405.040283:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512000
00000100:00100000:2.0:1767319405.040288:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512000
00000100:00100000:2.0:1767319405.040345:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17042
00000100:00100000:2.0:1767319405.040351:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940512000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319405.040364:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319405.040405:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940512000:12345-0@lo:38:kworker.0 Request processed in 53us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319405.040411:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17042
00000100:00080000:3.0:1767319405.040549:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319405.040554:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319405.040557:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940512000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319405.040609:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940511360:0@lo:400:kworker.0
00000100:00100000:0.0:1767319405.549395:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940512128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319405.549468:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319405.549607:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512128
00000100:00100000:3.0:1767319405.549615:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512128
00000100:00100000:3.0:1767319405.549667:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455
00000100:00100000:3.0:1767319405.549677:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940512128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319405.549713:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319405.549805:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940512128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319405.549812:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455
00000100:00100000:0.0:1767319405.550225:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940512128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319405.741643:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319405.997464:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319406.665499:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319406.665549:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319406.665857:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894316928
00000100:00100000:2.0:1767319406.665868:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894316928
00000100:00100000:2.0:1767319406.665913:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317056
00000100:00100000:2.0:1767319406.665917:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317056
00000100:00100000:2.0:1767319406.665969:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4473
00000100:00080000:3.0:1767319406.665970:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319406.665980:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319406.666134:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17043
00000100:00100000:0.0:1767319406.666139:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894316928:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319406.666156:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319406.666267:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 288us (717us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319406.666273:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4473
00000100:00100000:0.0:1767319406.666525:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894316928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 382us (1035us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319406.666532:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17043
00000100:00100000:2.0:1767319406.764911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319407.023386:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319407.789005:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319408.046537:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319408.813060:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319409.069822:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319409.132928:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319384/real 1767319384]  req@ffff93cf47964a80 x1853163940506368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319409 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319409.132969:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47964a80 x1853163940506368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319409 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319409.132992:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319409.133017:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319409.133022:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940506368:0@lo:250:kworker.0
00000100:00080000:0.0:1767319409.135416:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319409.135429:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319409.135506:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319409.135517:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4634
00000100:00080000:0.0:1767319409.135522:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319409.135532:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319409.135579:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3100 x1853163940512256/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319409.135613:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319409.135617:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319409.135618:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319409.135622:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4655
00000100:00080000:0.0:1767319409.135624:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319409.135628:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319409.135645:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940512384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319409.135655:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319409.135658:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319409.135660:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319409.135663:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4655
00000100:00080000:0.0:1767319409.135665:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319409.135669:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319409.135680:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0380 x1853163940512512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319409.135760:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319409.135761:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940512640:0@lo:400:kworker.0
00000100:00080000:0.0:1767319409.135764:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319409.135769:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319409.135795:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4655
00000100:00080000:0.0:1767319409.135798:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319409.135802:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319409.135817:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940513024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319409.135835:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319409.135839:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319409.135841:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319409.135845:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4655
00000100:00080000:0.0:1767319409.135848:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319409.135852:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319409.135863:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940513280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319409.135885:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319409.135907:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940513152:0@lo:400:kworker.0
00000100:00100000:0.0:1767319409.135956:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319409.135981:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319409.135987:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319409.135992:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940512768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319409.135998:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940512896:0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136026:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319409.136040:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319409.136088:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512640
00000100:00100000:0.0:1767319409.136089:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513152
00000100:00100000:0.0:1767319409.136097:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513152
00000100:00100000:1.0:1767319409.136097:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512640
00000100:00100000:1.0:1767319409.136157:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512768
00000100:00100000:1.0:1767319409.136160:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512768
00000100:00100000:1.0:1767319409.136182:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909
00000100:00100000:1.0:1767319409.136190:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940512640:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136250:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940512640:12345-0@lo:400:kworker.0 Request processed in 58us (364us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319409.136258:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909
00000100:00100000:1.0:1767319409.136277:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910
00000100:00100000:1.0:1767319409.136283:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940512768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136309:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940512768:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319409.136314:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910
00000100:00100000:1.0:1767319409.136357:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940512768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136366:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940512640:0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136402:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512896
00000100:00100000:1.0:1767319409.136407:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512896
00000100:00100000:1.0:1767319409.136438:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4474
00000100:00100000:1.0:1767319409.136444:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940512896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319409.136479:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940512896:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319409.136485:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4474
00000100:00100000:1.0:1767319409.136522:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940512896:0@lo:400:kworker.0
00000100:00100000:0.0:1767319409.141122:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4475
00000100:00100000:0.0:1767319409.141145:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940513152:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319409.141974:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319409.141982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319409.141985:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319409.142004:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940512256:0@lo:250:kworker.0
00000400:00000100:3.0:1767319409.142052:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940512256 offset 0 length 520: 4
00000100:00100000:3.0:1767319409.142083:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940512384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319409.142109:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319409.142128:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940512512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319409.142147:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319409.142161:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940513024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319409.142177:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319409.142327:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940513280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319409.142349:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319409.142381:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512512
00000100:00100000:3.0:1767319409.142389:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512512
00000100:00100000:3.0:1767319409.142413:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95
00000100:00100000:3.0:1767319409.142419:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940512512:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319409.142953:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940512384
00000100:00100000:2.0:1767319409.142958:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940512384
00000100:00100000:2.0:1767319409.142980:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513024
00000100:00100000:2.0:1767319409.142982:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513024
00000100:00100000:2.0:1767319409.142989:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513280
00000100:00100000:2.0:1767319409.142991:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513280
00000100:00100000:2.0:1767319409.143000:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17044
00000100:00100000:2.0:1767319409.143005:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940512384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319409.143153:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319409.143218:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940512512:12345-0@lo:38:kworker.0 Request processed in 797us (1068us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319409.143225:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95
00000100:00100000:3.0:1767319409.143250:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17045
00000100:00100000:3.0:1767319409.143255:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940513024:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319409.143328:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940513152:12345-0@lo:400:kworker.0 Request processed in 2193us (7372us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319409.143336:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4475
00000100:00100000:0.0:1767319409.143353:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17046
00000100:00100000:0.0:1767319409.143357:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940513280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319409.143382:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319409.143408:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940512384:12345-0@lo:38:kworker.0 Request processed in 402us (1299us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319409.143414:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17044
00000100:00080000:2.0:1767319409.143678:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319409.143683:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319409.143687:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940512384:0@lo:38:kworker.0
00000100:00080000:2.0:1767319409.143711:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319409.143715:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319409.143717:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940512512:0@lo:38:kworker.0
00000100:00100000:1.0:1767319409.143863:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940513152:0@lo:400:kworker.0
00010000:00020000:3.0:1767319409.144131:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319409.144179:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940513024:12345-0@lo:38:kworker.0 Request processed in 922us (2000us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319409.144194:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17045
00000100:00080000:2.0:1767319409.144845:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319409.144852:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319409.144855:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940513024:0@lo:38:kworker.0
00010000:00020000:0.0:1767319409.145528:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319409.145641:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940513280:12345-0@lo:38:kworker.0 Request processed in 2280us (3288us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319409.145648:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17046
00000100:00080000:2.0:1767319409.145717:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319409.145722:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319409.145725:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940513280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319409.649406:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319409.649444:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940513408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319409.649531:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319409.649740:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513408
00000100:00100000:3.0:1767319409.649750:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513408
00000100:00100000:3.0:1767319409.649847:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456
00000100:00100000:3.0:1767319409.649858:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940513408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319409.649897:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319409.649952:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940513408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (421us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319409.649960:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456
00000100:00100000:0.0:1767319409.650073:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940513408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319409.839555:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319410.093133:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319410.670311:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940513536:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319410.670408:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319410.670926:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513536
00000100:00100000:2.0:1767319410.670938:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513536
00000100:00100000:2.0:1767319410.671020:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457
00000100:00100000:2.0:1767319410.671031:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940513536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319410.671065:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319410.671127:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940513536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (719us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319410.671136:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457
00000100:00100000:0.0:1767319410.671668:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940513536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319410.861448:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319411.117030:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319411.784467:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319411.784582:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319411.784663:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317312
00000100:00100000:1.0:1767319411.784688:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317312
00000100:00100000:1.0:1767319411.784824:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317184
00000100:00100000:1.0:1767319411.784829:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317184
00000100:00100000:1.0:1767319411.784939:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4476
00000100:00100000:1.0:1767319411.784950:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317312:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767319411.784988:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319411.785029:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (573us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319411.785038:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4476
00000100:00100000:1.0:1767319411.785063:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17047
00000100:00100000:1.0:1767319411.785075:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317184:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319411.785096:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319411.785123:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317184:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (541us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319411.785129:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17047
00000100:00100000:2.0:1767319411.885113:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319412.142582:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319412.908896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319413.165147:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319413.933433:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319414.189323:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319414.253836:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319414.253846:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319414.253850:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319414.253853:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319414.253859:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319414.253868:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4659
00000100:00080000:3.0:1767319414.253874:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319414.253882:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319414.254845:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940513664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319414.254885:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319414.254889:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319414.254892:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319414.254896:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4659
00000100:00080000:3.0:1767319414.254899:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319414.254904:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319414.254930:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838a80 x1853163940513792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319414.255019:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940513920:0@lo:400:kworker.0
00000100:00100000:1.0:1767319414.255099:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319414.255241:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940513664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319414.255281:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319414.255305:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940513792:0@lo:38:kworker.0
00000100:00100000:2.0:1767319414.255328:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319414.255370:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513792
00000100:00100000:2.0:1767319414.255383:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513792
00000100:00100000:2.0:1767319414.255418:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96
00000100:00100000:2.0:1767319414.255425:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940513792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319414.255447:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319414.255490:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940513792:12345-0@lo:38:kworker.0 Request processed in 64us (160us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319414.255497:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96
00000100:00080000:2.0:1767319414.255533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319414.255537:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319414.255553:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940513792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319414.257425:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513920
00000100:00100000:0.0:1767319414.257438:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513920
00000100:00100000:0.0:1767319414.257532:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911
00000100:00100000:0.0:1767319414.257552:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940513920:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319414.257679:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319414.257716:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940513664
00000100:00100000:2.0:1767319414.257721:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940513664
00000100:00100000:2.0:1767319414.257749:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17048
00000100:00100000:2.0:1767319414.257755:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940513664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319414.257801:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319414.257845:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940513664:12345-0@lo:38:kworker.0 Request processed in 89us (2563us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319414.257853:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17048
00000100:00080000:2.0:1767319414.257899:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319414.257905:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319414.257909:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940513664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319414.262133:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940514048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319414.262221:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319414.262301:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514048
00000100:00100000:2.0:1767319414.262309:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514048
00000100:00100000:2.0:1767319414.262377:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912
00000100:00100000:2.0:1767319414.262386:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940514048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319414.262439:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940514048:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319414.262447:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912
00000100:00080000:2.0:1767319414.262470:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319414.262503:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940514048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.264188:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940513920:12345-0@lo:400:kworker.0 Request processed in 6631us (9081us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319414.264202:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911
00000100:00080000:3.0:1767319414.264345:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319414.264350:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319414.264354:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319414.264359:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4659
00000100:00080000:3.0:1767319414.264363:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319414.264369:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319414.264390:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839880 x1853163940514304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319414.264420:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319414.264423:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319414.264426:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319414.264429:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4659
00000100:00080000:3.0:1767319414.264431:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319414.264435:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319414.264444:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940514560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319414.264490:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940514304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319414.264556:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319414.264585:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940514560:0@lo:38:kworker.0
00000100:00100000:3.0:1767319414.264607:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319414.264658:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514304
00000100:00100000:3.0:1767319414.264665:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514304
00000100:00100000:3.0:1767319414.264692:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514560
00000100:00100000:3.0:1767319414.264695:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514560
00000100:00100000:3.0:1767319414.264713:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17049
00000100:00100000:3.0:1767319414.264719:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940514304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319414.264740:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319414.264799:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940514304:12345-0@lo:38:kworker.0 Request processed in 78us (242us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319414.264805:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17049
00000100:00100000:3.0:1767319414.264819:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17050
00000100:00100000:3.0:1767319414.264822:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940514560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319414.264831:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319414.264853:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940514560:12345-0@lo:38:kworker.0 Request processed in 29us (246us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319414.264859:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17050
00000100:00080000:3.0:1767319414.264896:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319414.264901:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319414.264904:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940514304:0@lo:38:kworker.0
00000100:00080000:3.0:1767319414.264913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319414.264915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319414.264918:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940514560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319414.265254:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940514176:0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.265290:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319414.265322:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319414.265328:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940514432:0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.265351:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319414.265378:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514176
00000100:00100000:0.0:1767319414.265383:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514176
00000100:00100000:0.0:1767319414.265431:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514432
00000100:00100000:0.0:1767319414.265435:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514432
00000100:00100000:0.0:1767319414.265457:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4477
00000100:00100000:0.0:1767319414.265463:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940514176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.265506:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940514176:12345-0@lo:400:kworker.0 Request processed in 44us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319414.265511:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4477
00000100:00100000:0.0:1767319414.265526:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478
00000100:00100000:0.0:1767319414.265531:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940514432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.265574:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940514432:12345-0@lo:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319414.265580:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478
00000100:00080000:0.0:1767319414.265607:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319414.265651:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940514432:0@lo:400:kworker.0
00000100:00100000:0.0:1767319414.265661:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940514176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319414.267547:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940513920:0@lo:400:kworker.0
00000100:00100000:2.0:1767319414.765361:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319414.765393:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940514688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319414.765487:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319414.765716:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514688
00000100:00100000:3.0:1767319414.765727:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514688
00000100:00100000:3.0:1767319414.765816:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458
00000100:00100000:3.0:1767319414.765828:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940514688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319414.765871:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319414.765938:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940514688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (451us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319414.765945:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458
00000100:00100000:1.0:1767319414.766035:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940514688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319414.959949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319415.213043:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319415.789154:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319415.789189:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940514816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319415.789265:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319415.789706:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514816
00000100:00100000:3.0:1767319415.789716:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514816
00000100:00100000:3.0:1767319415.789807:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459
00000100:00100000:3.0:1767319415.789817:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940514816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319415.789850:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319415.789911:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940514816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319415.789919:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459
00000100:00100000:1.0:1767319415.790128:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940514816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319415.980902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319416.237691:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319416.903062:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319416.903450:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319416.912436:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317568
00000100:00100000:0.0:1767319416.912455:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317568
00000100:00100000:0.0:1767319416.912568:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317440
00000100:00100000:0.0:1767319416.912572:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317440
00000100:00100000:0.0:1767319416.912613:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4479
00000100:00100000:0.0:1767319416.912653:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317568:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319416.913430:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894317568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 774us (10372us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319416.913442:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4479
00000100:00100000:0.0:1767319416.913473:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17051
00000100:00100000:0.0:1767319416.913478:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317440:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319416.913513:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319416.913551:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317440:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 71us (10101us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319416.913557:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17051
00000100:00080000:1.0:1767319416.914118:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319417.005047:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319417.261988:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319418.028904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319418.285136:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319419.055360:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319419.311646:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319419.373273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319419.373284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319419.373287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319419.373292:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319419.373297:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319419.373306:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4664
00000100:00080000:1.0:1767319419.373311:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319419.373318:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319419.373362:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967100 x1853163940514944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319419.373427:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940514944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319419.373520:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319419.373656:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940514944
00000100:00100000:2.0:1767319419.373669:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940514944
00000100:00100000:2.0:1767319419.373725:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17052
00000100:00100000:2.0:1767319419.373737:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940514944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319419.373761:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319419.374099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319419.374103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319419.374109:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319419.374115:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4664
00000100:00080000:1.0:1767319419.374118:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319419.374122:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319419.374141:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940515072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319419.376559:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940515072:0@lo:38:kworker.0
00000100:00100000:0.0:1767319419.376665:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319419.376805:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940514944:12345-0@lo:38:kworker.0 Request processed in 3066us (3281us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319419.376819:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17052
00000100:00100000:3.0:1767319419.376992:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515072
00000100:00100000:3.0:1767319419.377004:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515072
00000100:00100000:3.0:1767319419.377054:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97
00000100:00100000:3.0:1767319419.377062:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940515072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319419.377106:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319419.377164:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940515072:12345-0@lo:38:kworker.0 Request processed in 102us (499us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319419.377170:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97
00000100:00080000:1.0:1767319419.380424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319419.380435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319419.380440:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319419.380450:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4664
00000100:00080000:1.0:1767319419.380468:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319419.380476:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319419.380509:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70000 x1853163940515584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319419.380531:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319419.380535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319419.380536:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319419.380540:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4664
00000100:00080000:1.0:1767319419.380542:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319419.380546:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319419.380558:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940515840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319419.380621:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940515456:0@lo:400:kworker.0
00000100:00100000:1.0:1767319419.380707:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319419.380765:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319419.380800:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940515712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319419.380828:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319419.381130:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381168:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319419.381204:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319419.381211:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381231:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319419.381268:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515200
00000100:00100000:2.0:1767319419.381277:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515200
00000100:00100000:2.0:1767319419.381340:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515328
00000100:00100000:2.0:1767319419.381344:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515328
00000100:00100000:2.0:1767319419.381368:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913
00000100:00100000:2.0:1767319419.381374:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381424:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515200:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319419.381431:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913
00000100:00100000:2.0:1767319419.381447:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914
00000100:00100000:2.0:1767319419.381465:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381503:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515328:12345-0@lo:400:kworker.0 Request processed in 50us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319419.381509:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914
00000100:00080000:2.0:1767319419.381526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319419.381531:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319419.381565:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381576:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381624:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515456
00000100:00100000:2.0:1767319419.381628:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515456
00000100:00100000:2.0:1767319419.381664:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515712
00000100:00100000:2.0:1767319419.381667:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515712
00000100:00100000:2.0:1767319419.381687:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4480
00000100:00100000:2.0:1767319419.381692:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940515456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381728:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940515456:12345-0@lo:400:kworker.0 Request processed in 35us (1020us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319419.381735:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4480
00000100:00100000:2.0:1767319419.381746:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4481
00000100:00100000:2.0:1767319419.381751:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940515712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381799:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940515712:12345-0@lo:400:kworker.0 Request processed in 47us (970us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319419.381804:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4481
00000100:00080000:2.0:1767319419.381822:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319419.381842:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940515712:0@lo:400:kworker.0
00000100:00100000:2.0:1767319419.381852:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940515456:0@lo:400:kworker.0
00000100:00080000:0.0:1767319419.386587:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319419.386611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319419.386621:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940514944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319419.386679:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940515584:0@lo:38:kworker.0
00000100:00100000:0.0:1767319419.386760:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319419.386824:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940515840:0@lo:38:kworker.0
00000100:00100000:0.0:1767319419.386849:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319419.386884:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319419.386888:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319419.386891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940515072:0@lo:38:kworker.0
00000100:00100000:3.0:1767319419.387109:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515584
00000100:00100000:3.0:1767319419.387119:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515584
00000100:00100000:3.0:1767319419.387170:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515840
00000100:00100000:3.0:1767319419.387173:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515840
00000100:00100000:3.0:1767319419.387203:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17053
00000100:00100000:3.0:1767319419.387210:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940515584:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319419.387237:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319419.387286:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940515584:12345-0@lo:38:kworker.0 Request processed in 75us (526us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319419.387294:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17053
00000100:00100000:3.0:1767319419.387311:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17054
00000100:00100000:3.0:1767319419.387315:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940515840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319419.387324:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319419.387350:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940515840:12345-0@lo:38:kworker.0 Request processed in 34us (500us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319419.387356:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17054
00000100:00080000:0.0:1767319419.387645:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319419.387653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319419.387656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940515584:0@lo:38:kworker.0
00000100:00080000:0.0:1767319419.387664:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319419.387667:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319419.387672:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940515840:0@lo:38:kworker.0
00000100:00100000:2.0:1767319419.885239:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319419.885349:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319419.885563:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940515968
00000100:00100000:3.0:1767319419.885576:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940515968
00000100:00100000:3.0:1767319419.885681:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460
00000100:00100000:3.0:1767319419.885692:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319419.885734:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319419.885823:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940515968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (474us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319419.885832:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460
00000100:00100000:0.0:1767319419.885999:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940515968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319420.077341:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319420.334207:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319420.912618:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940516096:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319420.912702:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319420.920908:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516096
00000100:00100000:2.0:1767319420.920935:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516096
00000100:00100000:2.0:1767319420.921019:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461
00000100:00100000:2.0:1767319420.921030:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940516096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319420.921068:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319420.925439:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940516096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4395us (12720us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319420.925459:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461
00000100:00100000:0.0:1767319420.925651:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940516096:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319421.101369:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319421.357042:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319422.022927:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319422.023040:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317824
00000100:00100000:0.0:1767319422.023052:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317824
00000100:00100000:0.0:1767319422.023138:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4482
00000100:00100000:0.0:1767319422.023149:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894317824:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319422.023249:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894317824:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319422.023258:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4482
00000100:00100000:3.0:1767319422.024015:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319422.024146:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894317696
00000100:00100000:0.0:1767319422.024151:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894317696
00000100:00100000:0.0:1767319422.024198:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17055
00000100:00100000:0.0:1767319422.024203:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317696:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319422.024223:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319422.024256:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894317696:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (245us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319422.024260:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17055
00000100:00080000:1.0:1767319422.025485:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319422.124935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319422.381555:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319423.151269:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319423.406085:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319424.172906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319424.433612:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319424.493803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319424.493813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319424.493817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319424.493822:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319424.493827:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319424.493836:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4669
00000100:00080000:1.0:1767319424.493841:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319424.493850:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319424.493898:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2d80 x1853163940516224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319424.498402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319424.498413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319424.498417:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319424.498425:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4669
00000100:00080000:1.0:1767319424.498430:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319424.498437:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319424.498475:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1500 x1853163940516352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319424.498674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319424.498677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319424.498679:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319424.498683:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4669
00000100:00080000:1.0:1767319424.498685:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319424.498689:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319424.498699:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2300 x1853163940516864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319424.498719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319424.498721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319424.498723:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319424.498726:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4669
00000100:00080000:1.0:1767319424.498727:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319424.498731:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319424.498740:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1f80 x1853163940517120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319424.498798:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940516608:0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.498855:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940516480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319424.498894:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940516992:0@lo:400:kworker.0
00000100:00100000:0.0:1767319424.505691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940516224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319424.506109:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319424.506239:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516480
00000100:00100000:3.0:1767319424.506249:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516480
00000100:00100000:3.0:1767319424.506341:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915
00000100:00100000:3.0:1767319424.506355:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940516480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.506436:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940516480:12345-0@lo:400:kworker.0 Request processed in 86us (328us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319424.506444:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915
00000100:00080000:3.0:1767319424.506468:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319424.506504:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940516480:0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.506576:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940516736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.506615:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319424.506647:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516736
00000100:00100000:3.0:1767319424.506651:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516736
00000100:00100000:3.0:1767319424.506689:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483
00000100:00100000:3.0:1767319424.506696:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940516736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.506731:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940516736:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319424.506738:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483
00000100:00080000:3.0:1767319424.506753:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319424.506768:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940516736:0@lo:400:kworker.0
00000100:00100000:2.0:1767319424.507494:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319424.509659:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516992
00000100:00100000:3.0:1767319424.509680:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516992
00000100:00100000:3.0:1767319424.509896:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4484
00000100:00100000:3.0:1767319424.509906:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940516992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319424.510078:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940516992:12345-0@lo:400:kworker.0 Request processed in 173us (2586us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319424.510086:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4484
00000100:00100000:3.0:1767319424.510160:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940516992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319424.512212:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319424.512288:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516608
00000100:00100000:1.0:1767319424.512298:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516608
00000100:00100000:0.0:1767319424.514655:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319424.515838:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940516352:0@lo:38:kworker.0
00000100:00100000:0.0:1767319424.515899:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319424.515929:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940516864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319424.515952:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319424.519290:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319424.519302:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319424.519334:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516352
00000100:00100000:2.0:1767319424.519345:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516352
00000100:00100000:2.0:1767319424.519405:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98
00000100:00100000:2.0:1767319424.519414:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940516352:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319424.519438:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319424.519537:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940516352:12345-0@lo:38:kworker.0 Request processed in 123us (3637us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319424.519546:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98
00000100:00100000:3.0:1767319424.522827:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516224
00000100:00100000:3.0:1767319424.522850:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516224
00000100:00100000:0.0:1767319424.523584:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940517120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319424.523678:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319424.524886:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940516864
00000100:00100000:0.0:1767319424.524902:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940516864
00000100:00100000:0.0:1767319424.524962:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517120
00000100:00100000:0.0:1767319424.524966:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517120
00000100:00100000:0.0:1767319424.525002:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17056
00000100:00100000:0.0:1767319424.525013:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940516224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319424.525042:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319424.525103:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940516224:12345-0@lo:38:kworker.0 Request processed in 91us (10457us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319424.525111:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17056
00000100:00100000:0.0:1767319424.525132:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17057
00000100:00100000:0.0:1767319424.525136:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940516864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319424.525145:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319424.525167:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940516864:12345-0@lo:38:kworker.0 Request processed in 30us (9213us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319424.525172:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17057
00000100:00100000:0.0:1767319424.525185:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17058
00000100:00100000:0.0:1767319424.525189:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940517120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319424.525198:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319424.525219:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940517120:12345-0@lo:38:kworker.0 Request processed in 29us (1542us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319424.525225:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17058
00000100:00080000:0.0:1767319424.525287:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319424.525293:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319424.525298:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940517120:0@lo:38:kworker.0
00000100:00080000:0.0:1767319424.526017:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319424.526022:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319424.526025:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940516224:0@lo:38:kworker.0
00000100:00080000:0.0:1767319424.526038:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319424.526042:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319424.526044:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940516352:0@lo:38:kworker.0
00000100:00080000:0.0:1767319424.526054:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319424.526058:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319424.526061:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940516864:0@lo:38:kworker.0
00000100:00100000:1.0:1767319424.534604:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916
00000100:00100000:1.0:1767319424.534627:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940516608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319424.534758:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940516608:12345-0@lo:400:kworker.0 Request processed in 141us (22554us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319424.534767:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916
00000100:00100000:0.0:1767319424.535545:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940516608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319425.005059:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940517248:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319425.005131:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319425.008099:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517248
00000100:00100000:2.0:1767319425.008118:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517248
00000100:00100000:3.0:1767319425.008292:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462
00000100:00100000:3.0:1767319425.008308:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940517248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319425.008355:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319425.008483:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940517248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (3352us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319425.008504:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462
00000100:00100000:0.0:1767319425.010435:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940517248:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319425.196912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319425.454471:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319426.034373:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319426.035152:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940517376:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319426.035238:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319426.035569:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517376
00000100:00100000:2.0:1767319426.035579:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517376
00000100:00100000:2.0:1767319426.035661:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463
00000100:00100000:2.0:1767319426.035669:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940517376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319426.035700:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319426.035743:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940517376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (506us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319426.035748:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463
00000100:00080000:0.0:1767319426.036092:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319426.036135:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940517376:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319426.123503:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319426.123673:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894317952 offset 0 length 520: 4
00000100:00100000:3.0:1767319426.123705:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319426.136260:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318208
00000100:00100000:0.0:1767319426.136279:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318208
00000100:00100000:0.0:1767319426.136397:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318080
00000100:00100000:0.0:1767319426.136401:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318080
00000100:00100000:0.0:1767319426.136440:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4485
00000100:00100000:0.0:1767319426.136452:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319426.137262:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17059
00000100:00100000:3.0:1767319426.137271:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894318080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319426.137296:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319426.137397:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894318080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 124us (13689us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319426.137405:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17059
00000100:00100000:0.0:1767319426.138524:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 2068us (15024us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319426.138546:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4485
00000100:00080000:1.0:1767319426.139549:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319426.220924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319426.481092:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319427.246129:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319427.501704:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319428.268924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319428.527906:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319429.292917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319429.549085:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319429.613453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319429.613467:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319429.613470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319429.613474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319429.613480:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319429.613490:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4674
00000100:00080000:2.0:1767319429.613495:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319429.613531:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319429.613583:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3a680 x1853163940517504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319429.613613:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319429.613617:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319429.613619:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319429.613623:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4674
00000100:00080000:2.0:1767319429.613625:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319429.613629:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319429.613645:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70000 x1853163940517632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319429.613719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319429.613723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319429.613727:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319429.613730:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4674
00000100:00080000:2.0:1767319429.613733:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319429.613738:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319429.613766:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1500 x1853163940518144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319429.613818:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319429.613821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319429.613823:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319429.613827:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4674
00000100:00080000:2.0:1767319429.613829:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319429.613833:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319429.613844:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b100 x1853163940518400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319429.613873:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940518016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.613949:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319429.614001:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940517888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.614017:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319429.614022:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940518272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319429.614037:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319429.614041:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319429.614064:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319429.614070:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940517760:0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.614078:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518016
00000100:00100000:2.0:1767319429.614085:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518016
00000100:00100000:1.0:1767319429.614091:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319429.614114:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517888
00000100:00100000:1.0:1767319429.614118:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517888
00000100:00100000:2.0:1767319429.614143:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518272
00000100:00100000:2.0:1767319429.614147:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518272
00000100:00100000:2.0:1767319429.614175:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486
00000100:00100000:2.0:1767319429.614183:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940518016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319429.614236:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517760
00000100:00100000:2.0:1767319429.614237:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940518016:12345-0@lo:400:kworker.0 Request processed in 54us (288us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319429.614239:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517760
00000100:00100000:2.0:1767319429.614245:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486
00000100:00100000:1.0:1767319429.614275:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917
00000100:00100000:1.0:1767319429.614282:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940517888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.614292:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940518016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.614316:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4487
00000100:00100000:1.0:1767319429.614318:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940517888:12345-0@lo:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319429.614322:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940518272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319429.614324:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917
00000100:00100000:1.0:1767319429.614336:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918
00000100:00100000:1.0:1767319429.614341:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940517760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319429.614350:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940518272:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319429.614356:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4487
00000100:00100000:1.0:1767319429.614364:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940517760:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319429.614370:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918
00000100:00100000:2.0:1767319429.614376:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940518272:0@lo:400:kworker.0
00000100:00080000:1.0:1767319429.614397:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319429.614402:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319429.614405:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319429.614423:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940517760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319429.614432:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940517888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319429.614474:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940517504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319429.614518:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319429.614543:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940517632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319429.614570:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319429.614598:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940518144:0@lo:38:kworker.0
00000100:00100000:0.0:1767319429.614621:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319429.614640:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940518400:0@lo:38:kworker.0
00000100:00100000:0.0:1767319429.614658:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319429.614690:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517504
00000100:00100000:0.0:1767319429.614694:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517504
00000100:00100000:0.0:1767319429.614708:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518144
00000100:00100000:0.0:1767319429.614711:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518144
00000100:00100000:0.0:1767319429.614718:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518400
00000100:00100000:0.0:1767319429.614720:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518400
00000100:00100000:0.0:1767319429.614729:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17060
00000100:00100000:0.0:1767319429.614734:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940517504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319429.614753:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319429.614810:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940517504:12345-0@lo:38:kworker.0 Request processed in 75us (291us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319429.614831:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17060
00000100:00100000:0.0:1767319429.614844:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17061
00000100:00100000:0.0:1767319429.614848:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940518144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319429.614857:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319429.614881:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940518144:12345-0@lo:38:kworker.0 Request processed in 31us (259us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319429.614886:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17061
00000100:00100000:0.0:1767319429.614897:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17062
00000100:00100000:0.0:1767319429.614901:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940518400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319429.614909:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319429.614930:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940518400:12345-0@lo:38:kworker.0 Request processed in 28us (270us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319429.614936:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17062
00000100:00080000:0.0:1767319429.614980:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319429.614985:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319429.614988:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940517504:0@lo:38:kworker.0
00000100:00080000:0.0:1767319429.614997:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319429.615000:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319429.615004:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940518144:0@lo:38:kworker.0
00000100:00080000:0.0:1767319429.615010:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319429.615013:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319429.615015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940518400:0@lo:38:kworker.0
00000100:00100000:1.0:1767319429.616626:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940517632
00000100:00100000:1.0:1767319429.616643:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940517632
00000100:00100000:1.0:1767319429.616701:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99
00000100:00100000:1.0:1767319429.616710:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940517632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319429.616730:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319429.616843:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940517632:12345-0@lo:38:kworker.0 Request processed in 133us (2272us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319429.616851:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99
00000100:00080000:0.0:1767319429.617315:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319429.617322:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319429.617326:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940517632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319430.125632:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940518528:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319430.125744:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319430.125959:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518528
00000100:00100000:3.0:1767319430.125971:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518528
00000100:00100000:3.0:1767319430.127292:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464
00000100:00100000:3.0:1767319430.127324:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940518528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319430.127361:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319430.127456:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940518528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (1712us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319430.127463:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464
00000100:00100000:0.0:1767319430.127849:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940518528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319430.316970:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319430.573243:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319431.151392:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319431.152532:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940518656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319431.152629:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319431.153805:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518656
00000100:00100000:3.0:1767319431.153818:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518656
00000100:00100000:3.0:1767319431.153952:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465
00000100:00100000:3.0:1767319431.153966:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940518656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319431.154006:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319431.154097:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940518656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (1466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319431.154104:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465
00000100:00100000:0.0:1767319431.154284:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940518656:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319431.154392:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319431.239874:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319431.239994:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319431.240755:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318464
00000100:00100000:0.0:1767319431.240770:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318464
00000100:00100000:0.0:1767319431.240971:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318336
00000100:00100000:0.0:1767319431.240976:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318336
00000100:00100000:0.0:1767319431.241006:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4488
00000100:00100000:0.0:1767319431.241018:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319431.241125:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (1260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319431.241133:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4488
00000100:00100000:0.0:1767319431.241173:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17063
00000100:00100000:0.0:1767319431.241178:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894318336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319431.241202:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319431.241231:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894318336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (1237us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319431.241238:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17063
00000100:00080000:1.0:1767319431.241850:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319431.341301:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319431.597895:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319432.365362:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319432.621045:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319433.388913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319433.646257:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319434.412910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319434.670968:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319434.732919:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319409/real 1767319409]  req@ffff93cf43dc3100 x1853163940512256/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319434.732955:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf43dc3100 x1853163940512256/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319434.732976:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319434.732981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319434.732988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319434.732990:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319434.732996:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4659
00000100:00080000:2.0:1767319434.732998:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00080000:3.0:1767319434.733003:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767319434.733006:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940512256:0@lo:250:kworker.0
00000100:00080000:3.0:1767319434.733013:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319434.733047:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6300 x1853163940518784/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319434.733084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319434.733087:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319434.733089:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319434.733092:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4679
00000100:00080000:3.0:1767319434.733095:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319434.733098:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319434.733110:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4000 x1853163940518912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319434.733119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319434.733122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319434.733124:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319434.733127:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4679
00000100:00080000:3.0:1767319434.733128:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319434.733131:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319434.733225:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940518784:0@lo:250:kworker.0
00000400:00000100:2.0:1767319434.733280:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940518784 offset 0 length 520: 4
00000100:00100000:2.0:1767319434.733319:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940518912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319434.733348:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319434.733570:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6d80 x1853163940519040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319434.733580:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940518912
00000100:00100000:0.0:1767319434.733590:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940518912
00000100:00100000:0.0:1767319434.733630:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064
00000100:00100000:0.0:1767319434.733638:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940518912:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319434.733663:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940519168:0@lo:400:kworker.0
00010000:00020000:0.0:1767319434.733674:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319434.733705:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319434.733733:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940518912:12345-0@lo:38:kworker.0 Request processed in 93us (382us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319434.733742:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064
00000100:00100000:2.0:1767319434.733799:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940519040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319434.733809:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519168
00000100:00100000:0.0:1767319434.733815:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519168
00000100:00100000:2.0:1767319434.733836:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319434.733875:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319434.733881:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919
00000100:00080000:2.0:1767319434.733883:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319434.733889:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940518912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319434.733894:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940519168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319434.733921:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519040
00000100:00100000:2.0:1767319434.733926:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519040
00000100:00100000:2.0:1767319434.734028:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100
00000100:00100000:2.0:1767319434.734034:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940519040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319434.734046:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319434.734077:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940519040:12345-0@lo:38:kworker.0 Request processed in 41us (241us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319434.734083:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100
00000100:00080000:2.0:1767319434.734110:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319434.734114:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319434.734117:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940519040:0@lo:38:kworker.0
00000100:00080000:2.0:1767319434.734168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319434.734187:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940519296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319434.734215:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319434.734361:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519296
00000100:00100000:2.0:1767319434.734366:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519296
00000100:00100000:2.0:1767319434.734411:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920
00000100:00100000:2.0:1767319434.734419:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940519296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319434.734453:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940519296:12345-0@lo:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319434.734468:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920
00000100:00080000:2.0:1767319434.734484:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319434.734503:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940519296:0@lo:400:kworker.0
00000100:00100000:0.0:1767319434.737053:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940519168:12345-0@lo:400:kworker.0 Request processed in 3148us (3331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319434.738248:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919
00000100:00100000:0.0:1767319434.743843:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940519424:0@lo:400:kworker.0
00000100:00100000:0.0:1767319434.743933:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319434.744043:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519424
00000100:00100000:2.0:1767319434.744052:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519424
00000100:00080000:2.0:1767319434.744082:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319434.744127:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489
00000100:00100000:2.0:1767319434.744136:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940519424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319434.744294:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940519168:0@lo:400:kworker.0
00000100:00080000:3.0:1767319434.745557:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319434.745565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319434.745570:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319434.745575:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4679
00000100:00080000:3.0:1767319434.745580:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319434.745586:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319434.745623:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5500 x1853163940519552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319434.745727:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940519680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319434.745809:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319434.745865:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519680
00000100:00100000:1.0:1767319434.745872:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519680
00000100:00100000:1.0:1767319434.745928:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490
00000100:00100000:1.0:1767319434.745937:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940519680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319434.745981:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940519680:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319434.745988:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490
00000100:00080000:1.0:1767319434.746011:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319434.746042:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940519680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319434.746088:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940519552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319434.746112:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319434.746152:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519552
00000100:00100000:1.0:1767319434.746156:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519552
00000100:00100000:1.0:1767319434.746176:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065
00000100:00100000:1.0:1767319434.746180:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940519552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319434.746201:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319434.747470:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940519552:12345-0@lo:38:kworker.0 Request processed in 1273us (1343us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319434.747481:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065
00000100:00080000:1.0:1767319434.747541:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319434.747547:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319434.747550:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940519552:0@lo:38:kworker.0
00000100:00100000:2.0:1767319434.751424:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940519424:12345-0@lo:400:kworker.0 Request processed in 7276us (7478us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319434.751439:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489
00000100:00080000:3.0:1767319434.751565:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319434.751571:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319434.751575:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319434.751580:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4679
00000100:00080000:3.0:1767319434.751584:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319434.751589:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319434.751631:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940519808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319434.751839:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940519808:0@lo:38:kworker.0
00000100:00100000:1.0:1767319434.751900:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319434.751992:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519808
00000100:00100000:3.0:1767319434.752001:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519808
00000100:00100000:3.0:1767319434.752039:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066
00000100:00100000:3.0:1767319434.752046:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940519808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319434.752066:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319434.752110:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940519808:12345-0@lo:38:kworker.0 Request processed in 63us (209us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319434.752117:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066
00000100:00080000:3.0:1767319434.752162:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319434.752166:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319434.752170:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940519808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319434.752952:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940519424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319435.245841:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940519936:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319435.245919:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319435.246393:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940519936
00000100:00100000:2.0:1767319435.250242:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940519936
00000100:00100000:2.0:1767319435.250331:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466
00000100:00100000:2.0:1767319435.250342:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940519936:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319435.250378:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319435.250962:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940519936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 619us (5039us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319435.250972:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466
00000100:00100000:1.0:1767319435.251057:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940519936:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319435.436917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319435.692949:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319436.269117:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319436.269140:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940520064:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319436.269202:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319436.269350:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520064
00000100:00100000:2.0:1767319436.269357:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520064
00000100:00100000:2.0:1767319436.269413:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467
00000100:00100000:2.0:1767319436.269420:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940520064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319436.269463:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319436.269556:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319436.269594:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940520064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (389us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319436.269602:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467
00000100:00100000:0.0:1767319436.281872:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940520064:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319436.358696:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319436.358873:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318720
00000100:00100000:1.0:1767319436.358888:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318720
00000100:00100000:1.0:1767319436.359022:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4491
00000100:00100000:1.0:1767319436.359037:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894318720:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319436.359161:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894318720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 128us (480us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319436.359171:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4491
00000100:00080000:3.0:1767319436.359508:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319436.364689:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319436.364920:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318592
00000100:00100000:1.0:1767319436.364935:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318592
00000100:00100000:1.0:1767319436.365013:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17067
00000100:00100000:1.0:1767319436.365024:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894318592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319436.365060:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319436.365285:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894318592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 256us (606us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319436.365295:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17067
00000100:00100000:3.0:1767319436.461381:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319436.717097:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319437.485002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319437.741133:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319438.509208:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319438.765117:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319439.532914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319439.789339:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319439.853247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319439.853258:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319439.853260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319439.853264:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319439.853268:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319439.853277:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4684
00000100:00080000:1.0:1767319439.853281:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319439.853290:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319439.853348:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1500 x1853163940520192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319439.853376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319439.853380:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319439.853382:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319439.853386:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4684
00000100:00080000:1.0:1767319439.853388:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319439.853391:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319439.853406:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2d80 x1853163940520320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319439.853487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319439.853490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319439.853492:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319439.853496:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4684
00000100:00080000:1.0:1767319439.853499:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319439.853503:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319439.853514:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d0380 x1853163940520832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319439.853530:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319439.853532:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319439.853534:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319439.853537:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4684
00000100:00080000:1.0:1767319439.853539:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319439.853542:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319439.853554:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72300 x1853163940521088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319439.853580:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940520576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319439.853828:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940520192:0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.853895:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319439.853953:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940520320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.853977:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319439.853992:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940520832:0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.854009:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319439.854029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940521088:0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.854045:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319439.854226:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520192
00000100:00100000:3.0:1767319439.854234:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520192
00000100:00100000:3.0:1767319439.854273:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520832
00000100:00100000:3.0:1767319439.854276:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520832
00000100:00100000:3.0:1767319439.854297:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521088
00000100:00100000:3.0:1767319439.854300:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521088
00000100:00100000:3.0:1767319439.854334:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068
00000100:00100000:3.0:1767319439.854345:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940520192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319439.854372:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319439.854435:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069
00000100:00100000:3.0:1767319439.854436:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940520192:12345-0@lo:38:kworker.0 Request processed in 90us (538us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319439.854458:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940520832:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.854458:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068
00010000:00020000:0.0:1767319439.854490:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319439.854500:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070
00000100:00100000:3.0:1767319439.854506:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940521088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319439.854519:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319439.854629:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940520448:0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.856370:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940520832:12345-0@lo:38:kworker.0 Request processed in 1906us (2347us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319439.856802:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069
00000100:00100000:0.0:1767319439.856941:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940520960:0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.860971:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319439.861112:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319439.861138:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940520704:0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.861211:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319439.861267:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520960
00000100:00100000:0.0:1767319439.861277:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520960
00000100:00100000:0.0:1767319439.861357:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520704
00000100:00100000:0.0:1767319439.861361:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520704
00000100:00100000:0.0:1767319439.861394:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4492
00000100:00100000:0.0:1767319439.861403:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940520960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.861485:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940520960:12345-0@lo:400:kworker.0 Request processed in 82us (525us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319439.861494:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4492
00000100:00100000:0.0:1767319439.861516:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4493
00000100:00100000:0.0:1767319439.861525:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940520704:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.861552:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940520704:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319439.861558:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4493
00000100:00100000:0.0:1767319439.861630:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940520704:0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.861644:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940520960:0@lo:400:kworker.0
00000100:00080000:0.0:1767319439.861734:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319439.861766:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319439.861805:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319439.861809:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940520192:0@lo:38:kworker.0
00000100:00080000:0.0:1767319439.861824:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319439.861828:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319439.861830:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940520832:0@lo:38:kworker.0
00000100:00080000:0.0:1767319439.861841:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319439.861844:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319439.861847:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940521088:0@lo:38:kworker.0
00000100:00100000:0.0:1767319439.861890:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520320
00000100:00100000:0.0:1767319439.861895:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520320
00000100:00100000:0.0:1767319439.861924:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101
00000100:00100000:0.0:1767319439.861929:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940520320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319439.861953:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319439.861993:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940520320:12345-0@lo:38:kworker.0 Request processed in 62us (8015us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319439.861999:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101
00000100:00080000:0.0:1767319439.862025:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319439.862035:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319439.862038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940520320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319439.865434:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940521088:12345-0@lo:38:kworker.0 Request processed in 10915us (11376us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319439.865452:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070
00000100:00100000:2.0:1767319439.865973:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319439.866075:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520448
00000100:00100000:0.0:1767319439.866091:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520448
00000100:00100000:0.0:1767319439.866206:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921
00000100:00100000:0.0:1767319439.866218:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940520448:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.866330:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940520448:12345-0@lo:400:kworker.0 Request processed in 114us (357us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319439.866338:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921
00000100:00080000:3.0:1767319439.866592:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319439.866605:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319439.866807:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940520576
00000100:00100000:0.0:1767319439.866814:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940520576
00000100:00100000:0.0:1767319439.866873:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922
00000100:00100000:0.0:1767319439.866881:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940520576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319439.866930:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940520576:12345-0@lo:400:kworker.0 Request processed in 51us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319439.866937:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922
00000100:00100000:1.0:1767319439.867049:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940520576:0@lo:400:kworker.0
00000100:00080000:3.0:1767319439.867114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319439.867496:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940520448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319440.365941:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319440.365980:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940521216:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319440.366091:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319440.366238:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521216
00000100:00100000:3.0:1767319440.366251:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521216
00000100:00100000:3.0:1767319440.366341:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468
00000100:00100000:3.0:1767319440.366355:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940521216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319440.366400:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319440.366517:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940521216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (425us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319440.366531:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468
00000100:00100000:1.0:1767319440.366904:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940521216:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319440.556988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319440.813101:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319441.389740:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940521344:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319441.389908:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319441.390085:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521344
00000100:00100000:2.0:1767319441.390101:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521344
00000100:00100000:2.0:1767319441.390225:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469
00000100:00100000:2.0:1767319441.390239:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940521344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319441.390286:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319441.390289:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319441.391171:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940521344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 929us (1256us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319441.391182:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469
00000100:00100000:1.0:1767319441.391190:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940521344:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319441.487855:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319441.488022:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319441.497630:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318976
00000100:00100000:1.0:1767319441.497665:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318976
00000100:00100000:1.0:1767319441.497806:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894318848
00000100:00100000:1.0:1767319441.497810:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894318848
00000100:00100000:1.0:1767319441.497842:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4494
00000100:00100000:1.0:1767319441.497854:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318976:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319441.497976:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894318976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (10137us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319441.497985:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4494
00000100:00100000:1.0:1767319441.498008:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17071
00000100:00100000:1.0:1767319441.498012:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894318848:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319441.498040:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319441.498071:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894318848:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (10049us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319441.498077:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17071
00000100:00080000:0.0:1767319441.498867:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319441.582811:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319441.838274:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319442.604963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319442.861057:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319443.631742:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319443.885827:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319444.652942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319444.909046:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319444.973115:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319444.973132:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319444.973136:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319444.973140:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319444.973146:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319444.973155:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4689
00000100:00080000:2.0:1767319444.973161:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319444.973171:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319444.973234:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059880 x1853163940521472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319444.973265:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319444.973270:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319444.973272:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319444.973276:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4689
00000100:00080000:2.0:1767319444.973279:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319444.973283:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319444.973303:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940521600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319444.973398:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319444.973402:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319444.973404:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319444.973409:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4689
00000100:00080000:2.0:1767319444.973412:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319444.973419:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319444.973433:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3100 x1853163940522112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319444.973464:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319444.973468:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319444.973469:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319444.973473:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4689
00000100:00080000:2.0:1767319444.973476:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319444.973480:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319444.973491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2d80 x1853163940522368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319444.973580:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940521984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319444.973678:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319444.973769:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319444.973802:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940522240:0@lo:400:kworker.0
00000100:00100000:2.0:1767319444.973829:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319444.973876:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521984
00000100:00100000:2.0:1767319444.973886:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521984
00000100:00100000:2.0:1767319444.973950:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522240
00000100:00100000:2.0:1767319444.973953:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522240
00000100:00100000:2.0:1767319444.973979:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495
00000100:00100000:2.0:1767319444.973988:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940521984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319444.974051:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940521984:12345-0@lo:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319444.974060:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495
00000100:00100000:2.0:1767319444.974079:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496
00000100:00100000:2.0:1767319444.974086:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940522240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319444.974113:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940522240:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319444.974119:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496
00000100:00080000:2.0:1767319444.974142:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319444.974188:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940522240:0@lo:400:kworker.0
00000100:00100000:2.0:1767319444.974199:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940521984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319444.974701:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940521472:0@lo:38:kworker.0
00000100:00100000:3.0:1767319444.974745:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.974805:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940521600:0@lo:38:kworker.0
00000100:00100000:3.0:1767319444.974835:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.974862:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940522112:0@lo:38:kworker.0
00000100:00100000:3.0:1767319444.974879:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.974895:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940522368:0@lo:38:kworker.0
00000100:00100000:3.0:1767319444.974910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.974943:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521472
00000100:00100000:3.0:1767319444.974949:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521472
00000100:00100000:3.0:1767319444.974983:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522112
00000100:00100000:3.0:1767319444.974986:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522112
00000100:00100000:3.0:1767319444.974997:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522368
00000100:00100000:3.0:1767319444.974999:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522368
00000100:00100000:3.0:1767319444.975010:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17072
00000100:00100000:3.0:1767319444.975014:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940521472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319444.975044:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319444.975096:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940521472:12345-0@lo:38:kworker.0 Request processed in 80us (349us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319444.975103:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17072
00000100:00100000:3.0:1767319444.975122:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17073
00000100:00100000:3.0:1767319444.975125:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940522112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319444.975132:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319444.975150:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940522112:12345-0@lo:38:kworker.0 Request processed in 24us (270us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319444.975154:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17073
00000100:00100000:3.0:1767319444.975161:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17074
00000100:00100000:3.0:1767319444.975165:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940522368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319444.975171:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319444.975186:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940522368:12345-0@lo:38:kworker.0 Request processed in 21us (276us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319444.975190:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17074
00000100:00080000:3.0:1767319444.975222:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319444.975226:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319444.975230:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940521472:0@lo:38:kworker.0
00000100:00080000:3.0:1767319444.975235:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319444.975238:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319444.975240:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940522112:0@lo:38:kworker.0
00000100:00080000:3.0:1767319444.975244:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319444.975246:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319444.975247:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940522368:0@lo:38:kworker.0
00000100:00100000:2.0:1767319444.976285:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521600
00000100:00100000:2.0:1767319444.976302:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521600
00000100:00100000:2.0:1767319444.976376:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102
00000100:00100000:2.0:1767319444.976385:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940521600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319444.976408:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319444.976520:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940521600:12345-0@lo:38:kworker.0 Request processed in 135us (1684us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319444.976528:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102
00000100:00080000:3.0:1767319444.977146:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319444.977156:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319444.977161:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940521600:0@lo:38:kworker.0
00000100:00100000:1.0:1767319444.977532:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940521728:0@lo:400:kworker.0
00000100:00100000:1.0:1767319444.977623:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319444.977687:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319444.977695:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940521856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319444.977720:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.979071:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521728
00000100:00100000:3.0:1767319444.979088:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521728
00000100:00100000:3.0:1767319444.979226:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940521856
00000100:00100000:3.0:1767319444.979230:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940521856
00000100:00100000:1.0:1767319444.979288:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923
00000100:00100000:1.0:1767319444.979302:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940521728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319444.979441:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940521728:12345-0@lo:400:kworker.0 Request processed in 141us (1816us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319444.979463:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923
00000100:00100000:1.0:1767319444.979883:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940521728:0@lo:400:kworker.0
00000100:00080000:0.0:1767319444.982658:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319444.982671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319444.983967:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924
00000100:00100000:3.0:1767319444.983989:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940521856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319444.984109:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940521856:12345-0@lo:400:kworker.0 Request processed in 133us (6389us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319444.984118:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924
00000100:00100000:1.0:1767319444.984209:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940521856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319445.485198:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940522496:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319445.485293:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319445.486216:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522496
00000100:00100000:2.0:1767319445.486234:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522496
00000100:00100000:2.0:1767319445.486303:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1767319445.486311:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940522496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319445.486351:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319445.487495:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940522496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1167us (2183us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319445.487509:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470
00000100:00100000:1.0:1767319445.487821:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940522496:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319445.678272:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319445.933235:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319446.509130:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940522624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319446.509253:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319446.509378:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522624
00000100:00100000:2.0:1767319446.509393:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522624
00000100:00100000:2.0:1767319446.509504:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471
00000100:00100000:2.0:1767319446.509515:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940522624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319446.509569:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319446.509633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319446.509669:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940522624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319446.509678:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471
00000100:00100000:1.0:1767319446.509747:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940522624:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319446.599578:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319446.599621:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319446.599740:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319104
00000100:00100000:0.0:1767319446.599752:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319104
00000100:00100000:0.0:1767319446.599907:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319232
00000100:00100000:0.0:1767319446.599911:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319232
00000100:00080000:3.0:1767319446.599977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319446.611154:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4497
00000100:00100000:1.0:1767319446.611220:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894319232:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319446.611283:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17075
00000100:00100000:2.0:1767319446.611301:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894319104:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319446.611331:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319446.611395:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894319232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 209us (11767us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319446.611407:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4497
00000100:00100000:2.0:1767319446.611482:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894319104:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 179us (11909us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319446.611493:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17075
00000100:00100000:3.0:1767319446.700872:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319446.957248:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319447.725116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319447.981279:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319448.749130:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319449.005052:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319449.773941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319450.034566:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319450.093083:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319450.093095:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319450.093098:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319450.093103:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319450.093108:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319450.093117:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4695
00000100:00080000:2.0:1767319450.093122:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319450.093129:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319450.093173:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940522752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319450.093201:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319450.093205:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319450.093206:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319450.093210:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4695
00000100:00080000:2.0:1767319450.093212:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319450.093216:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319450.093228:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7b80 x1853163940522880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319450.093292:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319450.093296:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319450.093298:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319450.093301:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4695
00000100:00080000:2.0:1767319450.093303:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319450.093307:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319450.093336:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7480 x1853163940523392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319450.093347:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523008:0@lo:400:kworker.0
00000100:00080000:2.0:1767319450.093355:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319450.093359:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319450.093361:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319450.093365:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4695
00000100:00080000:2.0:1767319450.093368:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319450.093372:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319450.093386:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058a80 x1853163940523648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319450.093417:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319450.093488:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319450.093495:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523136:0@lo:400:kworker.0
00000100:00100000:0.0:1767319450.093517:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319450.093539:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940522752:0@lo:38:kworker.0
00000100:00100000:3.0:1767319450.093583:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319450.093612:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523008
00000100:00100000:3.0:1767319450.093616:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940522880:0@lo:38:kworker.0
00000100:00100000:2.0:1767319450.093620:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523008
00000100:00100000:3.0:1767319450.093646:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319450.093666:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940523392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319450.093681:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523136
00000100:00100000:2.0:1767319450.093685:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523136
00000100:00100000:3.0:1767319450.093707:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319450.093723:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925
00000100:00100000:3.0:1767319450.093725:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940523648:0@lo:38:kworker.0
00000100:00100000:2.0:1767319450.093735:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319450.093746:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319450.093794:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522752
00000100:00100000:3.0:1767319450.093799:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522752
00000100:00100000:2.0:1767319450.093816:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523008:12345-0@lo:400:kworker.0 Request processed in 83us (399us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319450.093822:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523392
00000100:00100000:2.0:1767319450.093826:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925
00000100:00100000:3.0:1767319450.093827:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523392
00000100:00100000:3.0:1767319450.093850:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523648
00000100:00100000:2.0:1767319450.093853:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926
00000100:00100000:3.0:1767319450.093855:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523648
00000100:00100000:2.0:1767319450.093864:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319450.093876:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17076
00000100:00100000:3.0:1767319450.093883:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940522752:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319450.093895:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523136:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0
00010000:00020000:3.0:1767319450.093902:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319450.093906:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926
00000100:00080000:2.0:1767319450.093931:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319450.093935:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319450.093958:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940522752:12345-0@lo:38:kworker.0 Request processed in 74us (373us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319450.093965:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17077
00000100:00100000:2.0:1767319450.093971:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940523392:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319450.094023:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940523264:0@lo:400:kworker.0
00000100:00100000:1.0:1767319450.094053:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319450.094068:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319450.094073:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940523520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319450.094093:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319450.094118:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940522880
00000100:00100000:1.0:1767319450.094123:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940522880
00000100:00100000:1.0:1767319450.094146:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103
00000100:00100000:1.0:1767319450.094150:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940522880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319450.094161:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319450.094187:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940522880:12345-0@lo:38:kworker.0 Request processed in 35us (542us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319450.094193:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103
00000100:00100000:1.0:1767319450.094217:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523264
00000100:00100000:1.0:1767319450.094222:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523264
00000100:00100000:0.0:1767319450.094558:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523520
00000100:00100000:0.0:1767319450.094564:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523520
00000100:00100000:3.0:1767319450.095402:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17076
00000100:00100000:3.0:1767319450.095431:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17078
00000100:00100000:3.0:1767319450.095436:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940523648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319450.095452:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319450.095504:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940523648:12345-0@lo:38:kworker.0 Request processed in 66us (1758us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319450.095510:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17078
00000100:00080000:3.0:1767319450.095557:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319450.095562:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319450.095566:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940522752:0@lo:38:kworker.0
00000100:00080000:3.0:1767319450.095577:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319450.095580:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319450.095583:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940522880:0@lo:38:kworker.0
00000100:00080000:3.0:1767319450.095591:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319450.095594:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319450.095596:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940523648:0@lo:38:kworker.0
00000100:00100000:3.0:1767319450.095672:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523136:0@lo:400:kworker.0
00010000:00020000:2.0:1767319450.097497:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319450.097579:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523008:0@lo:400:kworker.0
00000100:00100000:0.0:1767319450.097668:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498
00000100:00100000:0.0:1767319450.097679:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940523520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319450.102113:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940523392:12345-0@lo:38:kworker.0 Request processed in 8129us (8395us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319450.102685:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4499
00000100:00100000:1.0:1767319450.102700:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940523264:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319450.102792:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319450.102799:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319450.102803:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940523392:0@lo:38:kworker.0
00000100:00080000:3.0:1767319450.103153:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319450.103522:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17077
00000100:00100000:1.0:1767319450.107286:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940523264:12345-0@lo:400:kworker.0 Request processed in 4583us (13222us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319450.107302:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4499
00000100:00100000:2.0:1767319450.107529:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940523264:0@lo:400:kworker.0
00000100:00100000:0.0:1767319450.107814:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940523520:12345-0@lo:400:kworker.0 Request processed in 10135us (13716us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319450.107824:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498
00000100:00100000:2.0:1767319450.107916:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940523520:0@lo:400:kworker.0
00000100:00100000:0.0:1767319450.605198:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523776:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319450.605275:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319450.605494:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523776
00000100:00100000:3.0:1767319450.605503:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523776
00000100:00100000:3.0:1767319450.605557:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472
00000100:00100000:3.0:1767319450.605567:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319450.605599:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319450.605653:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940523776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (377us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319450.605661:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472
00000100:00100000:0.0:1767319450.605932:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940523776:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319450.796917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319451.053213:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319451.633555:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940523904:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319451.633635:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319451.633816:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940523904
00000100:00100000:2.0:1767319451.633825:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940523904
00000100:00100000:2.0:1767319451.633875:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473
00000100:00100000:2.0:1767319451.633884:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940523904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319451.633918:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319451.633974:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940523904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (338us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319451.633981:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473
00000100:00100000:1.0:1767319451.634075:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940523904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319451.722766:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767319451.722857:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894319360 offset 0 length 520: 4
00000100:00100000:0.0:1767319451.722888:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319451.723058:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319616
00000100:00100000:2.0:1767319451.723069:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319616
00000100:00100000:2.0:1767319451.723258:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319488
00000100:00100000:2.0:1767319451.723262:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319488
00000100:00100000:2.0:1767319451.723282:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4500
00000100:00100000:0.0:1767319451.723295:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17079
00000100:00100000:2.0:1767319451.723296:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894319616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319451.723319:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894319488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319451.723342:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319451.723403:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894319616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 111us (642us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319451.723405:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894319488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 86us (515us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319451.723420:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4500
00000100:00100000:0.0:1767319451.723426:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17079
00000100:00080000:3.0:1767319451.723684:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319451.820913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319452.080260:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319452.849942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319453.105484:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319453.868969:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319454.124951:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319454.893174:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319455.149814:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319455.213173:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319455.213184:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319455.213187:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319455.213191:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319455.213196:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319455.213296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4700
00000100:00080000:3.0:1767319455.213301:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319455.213309:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319455.213357:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00380 x1853163940524032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319455.213384:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319455.213388:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319455.213391:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319455.213394:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4700
00000100:00080000:3.0:1767319455.213396:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319455.213400:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319455.213414:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01c00 x1853163940524160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319455.213480:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940524288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319455.213546:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319455.213646:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524288
00000100:00100000:1.0:1767319455.213654:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524288
00000100:00100000:1.0:1767319455.213718:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927
00000100:00100000:1.0:1767319455.213727:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940524288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319455.214197:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940524032:0@lo:38:kworker.0
00000100:00100000:0.0:1767319455.214235:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319455.214258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940524160:0@lo:38:kworker.0
00000100:00100000:0.0:1767319455.214318:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319455.214379:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524032
00000100:00100000:0.0:1767319455.214383:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524032
00000100:00100000:0.0:1767319455.214413:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17080
00000100:00100000:0.0:1767319455.214419:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940524032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319455.214439:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319455.214474:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940524032:12345-0@lo:38:kworker.0 Request processed in 54us (238us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319455.214482:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17080
00000100:00080000:0.0:1767319455.214522:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319455.214527:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319455.214530:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940524032:0@lo:38:kworker.0
00000100:00080000:0.0:1767319455.214574:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319455.214592:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940524416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319455.214619:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319455.214653:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524416
00000100:00100000:0.0:1767319455.214657:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524416
00000100:00100000:0.0:1767319455.214687:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928
00000100:00100000:0.0:1767319455.214693:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940524416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319455.214730:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940524416:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319455.214736:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928
00000100:00080000:0.0:1767319455.214750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319455.214768:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940524416:0@lo:400:kworker.0
00000100:00100000:1.0:1767319455.217599:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940524288:12345-0@lo:400:kworker.0 Request processed in 3861us (4040us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319455.217615:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927
00000100:00080000:3.0:1767319455.218296:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319455.218302:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319455.218305:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319455.218311:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4700
00000100:00080000:3.0:1767319455.218315:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319455.218321:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319455.218342:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00380 x1853163940524672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319455.218367:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319455.218370:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319455.218372:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319455.218375:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4700
00000100:00080000:3.0:1767319455.218377:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319455.218381:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319455.218391:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a03800 x1853163940524928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319455.218423:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524160
00000100:00100000:3.0:1767319455.218429:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524160
00000100:00100000:3.0:1767319455.218460:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104
00000100:00100000:3.0:1767319455.218467:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940524160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319455.218487:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319455.218551:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940524160:12345-0@lo:38:kworker.0 Request processed in 83us (4232us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319455.218557:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104
00000100:00100000:3.0:1767319455.218582:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940524800:0@lo:400:kworker.0
00000100:00100000:3.0:1767319455.218619:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319455.218647:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319455.218652:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940524544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319455.218670:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319455.218755:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524800
00000100:00100000:3.0:1767319455.218759:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524800
00000100:00100000:3.0:1767319455.218818:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524544
00000100:00100000:3.0:1767319455.218822:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524544
00000100:00100000:3.0:1767319455.218848:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1767319455.218855:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940524800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319455.218900:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940524800:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319455.218906:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1767319455.218918:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502
00000100:00100000:3.0:1767319455.218925:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940524544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319455.218951:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940524544:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319455.218957:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502
00000100:00100000:3.0:1767319455.218996:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940524544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319455.220851:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940524800:0@lo:400:kworker.0
00000100:00080000:3.0:1767319455.220904:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319455.220926:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940524672:0@lo:38:kworker.0
00000100:00100000:3.0:1767319455.220986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319455.221912:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940524928:0@lo:38:kworker.0
00000100:00100000:3.0:1767319455.221958:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319455.221997:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319455.222002:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319455.222006:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940524160:0@lo:38:kworker.0
00000100:00100000:0.0:1767319455.222926:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524672
00000100:00100000:0.0:1767319455.222936:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524672
00000100:00100000:0.0:1767319455.222975:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940524928
00000100:00100000:0.0:1767319455.222980:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940524928
00000100:00100000:0.0:1767319455.223010:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17081
00000100:00100000:0.0:1767319455.223025:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940524672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319455.223046:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319455.223103:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940524672:12345-0@lo:38:kworker.0 Request processed in 77us (2116us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319455.223110:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17081
00000100:00100000:0.0:1767319455.223127:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17082
00000100:00100000:0.0:1767319455.223131:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940524928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319455.223141:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319455.223164:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940524928:12345-0@lo:38:kworker.0 Request processed in 30us (1205us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319455.223169:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17082
00000100:00080000:3.0:1767319455.223551:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319455.223557:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319455.223561:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940524672:0@lo:38:kworker.0
00000100:00080000:3.0:1767319455.223570:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319455.223573:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319455.223576:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940524928:0@lo:38:kworker.0
00000100:00100000:2.0:1767319455.228335:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940524288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319455.725419:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940525056:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319455.725495:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319455.725954:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525056
00000100:00100000:0.0:1767319455.725964:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525056
00000100:00100000:0.0:1767319455.726023:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474
00000100:00100000:0.0:1767319455.726032:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940525056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319455.726063:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319455.727298:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940525056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1259us (1794us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319455.727311:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474
00000100:00100000:2.0:1767319455.727409:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940525056:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319455.916948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319456.173084:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319456.750922:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940525184:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319456.750991:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319456.751353:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525184
00000100:00100000:0.0:1767319456.751363:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525184
00000100:00100000:0.0:1767319456.751420:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767319456.751429:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940525184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319456.751458:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319456.751516:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940525184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (524us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319456.751523:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475
00000100:00100000:2.0:1767319456.751650:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940525184:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319456.837953:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319456.838287:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319872
00000100:00100000:1.0:1767319456.838299:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319872
00000100:00100000:1.0:1767319456.838399:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4503
00000100:00100000:1.0:1767319456.838412:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894319872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319456.838480:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319456.838495:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894319872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (552us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319456.838504:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4503
00000100:00100000:1.0:1767319456.838523:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894319744
00000100:00100000:1.0:1767319456.838527:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894319744
00000100:00100000:1.0:1767319456.838550:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17083
00000100:00100000:1.0:1767319456.838556:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894319744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319456.838577:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319456.838613:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894319744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (134us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319456.838620:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17083
00000100:00080000:0.0:1767319456.838728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319456.940878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319457.197095:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319457.964896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319458.220906:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319458.989400:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319459.244973:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319459.309528:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319434/real 1767319434]  req@ffff93cf426d6300 x1853163940518784/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319459.309564:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf426d6300 x1853163940518784/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319459 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319459.309594:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319459.309623:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319459.309628:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940518784:0@lo:250:kworker.0
00000100:00080000:2.0:1767319459.309855:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319459.309861:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319459.309865:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319459.309871:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4684
00000100:00080000:2.0:1767319459.309875:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319459.309881:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319459.309915:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a300 x1853163940525312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319459.309941:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319459.309944:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319459.309946:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319459.309949:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4705
00000100:00080000:2.0:1767319459.309952:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319459.309955:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319459.309971:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940525440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319459.309980:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319459.309984:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319459.309985:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319459.309989:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4705
00000100:00080000:2.0:1767319459.309991:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319459.309994:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319459.310004:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059880 x1853163940525568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319459.310074:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319459.310078:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319459.310079:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319459.310082:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4705
00000100:00080000:2.0:1767319459.310084:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319459.310088:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319459.310100:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1f80 x1853163940526080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319459.310136:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319459.310140:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319459.310149:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319459.310152:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4705
00000100:00080000:2.0:1767319459.310154:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319459.310157:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319459.310169:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3100 x1853163940526336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319459.310194:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940526208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319459.310286:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319459.310341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940525312:0@lo:250:kworker.0
00000100:00100000:2.0:1767319459.310348:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319459.310358:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940525952:0@lo:400:kworker.0
00000400:00000100:3.0:1767319459.310370:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940525312 offset 0 length 520: 4
00000100:00100000:2.0:1767319459.310393:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319459.310400:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940525440:0@lo:38:kworker.0
00000100:00100000:3.0:1767319459.310429:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319459.310431:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526208
00000100:00100000:2.0:1767319459.310439:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526208
00000100:00100000:3.0:1767319459.310449:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940525568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319459.310486:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319459.310493:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525952
00000100:00100000:2.0:1767319459.310498:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525952
00000100:00100000:3.0:1767319459.310508:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940526080:0@lo:38:kworker.0
00000100:00100000:2.0:1767319459.310524:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525440
00000100:00100000:2.0:1767319459.310529:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525440
00000100:00100000:3.0:1767319459.310533:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319459.310550:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940526336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319459.310566:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319459.310617:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940525824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319459.310653:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319459.310676:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319459.310682:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940525696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319459.310704:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319459.310734:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525824
00000100:00100000:1.0:1767319459.310738:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525824
00000100:00100000:1.0:1767319459.310766:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525696
00000100:00100000:1.0:1767319459.310804:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525696
00000100:00100000:1.0:1767319459.310830:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929
00000100:00100000:1.0:1767319459.310839:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940525824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319459.310888:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940525824:12345-0@lo:400:kworker.0 Request processed in 50us (234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319459.310897:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929
00000100:00100000:1.0:1767319459.310915:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930
00000100:00100000:1.0:1767319459.310921:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940525696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319459.310947:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940525696:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319459.310955:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930
00000100:00100000:1.0:1767319459.311000:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940525696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319459.311011:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940525824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319459.317457:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940525568
00000100:00100000:3.0:1767319459.317484:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940525568
00000100:00100000:3.0:1767319459.317534:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105
00000100:00100000:3.0:1767319459.317543:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940525568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319459.317565:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319459.317632:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940525568:12345-0@lo:38:kworker.0 Request processed in 90us (7146us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319459.317639:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105
00000100:00100000:2.0:1767319459.324376:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526080
00000100:00100000:3.0:1767319459.324376:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526336
00000100:00100000:2.0:1767319459.324394:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526080
00000100:00100000:3.0:1767319459.324394:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526336
00000100:00100000:3.0:1767319459.324455:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4504
00000100:00100000:3.0:1767319459.324472:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940526208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319459.324569:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940526208:12345-0@lo:400:kworker.0 Request processed in 105us (14282us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319459.327997:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4505
00000100:00100000:2.0:1767319459.328027:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940525952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319459.328521:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940525952:12345-0@lo:400:kworker.0 Request processed in 509us (18128us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319459.328530:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4505
00000100:00100000:2.0:1767319459.328567:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17084
00000100:00100000:2.0:1767319459.328573:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940525440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319459.328596:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319459.328629:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940525440:12345-0@lo:38:kworker.0 Request processed in 56us (18200us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319459.328635:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17084
00000100:00100000:2.0:1767319459.328645:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17085
00000100:00100000:2.0:1767319459.328649:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940526080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319459.328657:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319459.328675:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940526080:12345-0@lo:38:kworker.0 Request processed in 25us (18144us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319459.328680:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17085
00000100:00100000:2.0:1767319459.328689:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17086
00000100:00100000:2.0:1767319459.328693:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940526336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319459.328700:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319459.328718:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940526336:12345-0@lo:38:kworker.0 Request processed in 24us (18151us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319459.329039:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17086
00000100:00080000:2.0:1767319459.329068:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319459.329073:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319459.329076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319459.329392:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4504
00000100:00080000:2.0:1767319459.329394:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319459.329402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319459.329407:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940525440:0@lo:38:kworker.0
00000100:00080000:2.0:1767319459.329421:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319459.329425:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319459.329429:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940525568:0@lo:38:kworker.0
00000100:00080000:2.0:1767319459.329442:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319459.329443:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940525952:0@lo:400:kworker.0
00000100:00080000:2.0:1767319459.329451:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319459.329456:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940526080:0@lo:38:kworker.0
00000100:00080000:2.0:1767319459.329468:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319459.329471:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319459.329474:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940526336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319459.329537:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940526208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319460.013110:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319460.269820:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319460.845295:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940526464:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319460.845384:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319460.845483:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526464
00000100:00100000:2.0:1767319460.845493:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526464
00000100:00100000:2.0:1767319460.845558:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476
00000100:00100000:2.0:1767319460.845569:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940526464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319460.845602:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319460.846505:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940526464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 934us (1116us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319460.846517:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476
00000100:00100000:1.0:1767319460.846623:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940526464:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319461.036963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319461.293007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319461.869280:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319461.869304:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940526592:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319461.869375:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319461.869495:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526592
00000100:00100000:2.0:1767319461.869503:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526592
00000100:00100000:2.0:1767319461.869565:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477
00000100:00100000:2.0:1767319461.869575:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940526592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319461.869607:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319461.869649:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940526592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (274us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319461.869657:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477
00000100:00080000:0.0:1767319461.869764:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319461.869827:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940526592:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319461.958913:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319461.959023:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320128
00000100:00100000:0.0:1767319461.959034:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320128
00000100:00100000:0.0:1767319461.959122:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4506
00000100:00100000:0.0:1767319461.959133:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894320128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319461.959240:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894320128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319461.959249:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4506
00000100:00080000:2.0:1767319461.959371:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319461.961175:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319461.961502:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320000
00000100:00100000:2.0:1767319461.961512:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320000
00000100:00100000:2.0:1767319461.961609:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17087
00000100:00100000:2.0:1767319461.961617:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894320000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319461.961640:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319461.961704:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894320000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 87us (538us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319461.961714:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17087
00000100:00100000:3.0:1767319462.060901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319462.317972:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319463.084919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319463.343328:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319464.111143:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319464.366892:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319464.431154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319464.431165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319464.431168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319464.431172:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319464.431177:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319464.431212:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4709
00000100:00080000:3.0:1767319464.431218:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319464.431226:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319464.431272:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00e00 x1853163940526720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319464.431299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319464.431303:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319464.431305:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319464.431308:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4709
00000100:00080000:3.0:1767319464.431311:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319464.431315:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319464.431327:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a03b80 x1853163940526848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319464.431337:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940526720:0@lo:38:kworker.0
00000100:00080000:3.0:1767319464.431408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319464.431413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319464.431416:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319464.431420:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4709
00000100:00100000:2.0:1767319464.431426:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319464.431426:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319464.431434:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319464.431449:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9f80 x1853163940527360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319464.431468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319464.431471:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319464.431473:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319464.431477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4709
00000100:00080000:3.0:1767319464.431480:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319464.431485:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319464.431498:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940527616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319464.431500:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940526848:0@lo:38:kworker.0
00000100:00100000:3.0:1767319464.431534:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940527488:0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.431535:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319464.431554:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940527360:0@lo:38:kworker.0
00000100:00100000:3.0:1767319464.431576:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319464.431597:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526720
00000100:00100000:2.0:1767319464.431604:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526720
00000100:00100000:3.0:1767319464.431611:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319464.431620:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940527232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.431632:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527488
00000100:00100000:2.0:1767319464.431636:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527488
00000100:00100000:3.0:1767319464.431662:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319464.431733:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940527104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319464.431763:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319464.431820:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319464.431825:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940526976:0@lo:400:kworker.0
00000100:00100000:1.0:1767319464.431843:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319464.431888:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527104
00000100:00100000:1.0:1767319464.431893:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527104
00000100:00100000:1.0:1767319464.431920:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526976
00000100:00100000:1.0:1767319464.431923:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526976
00000100:00100000:1.0:1767319464.431941:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931
00000100:00100000:1.0:1767319464.431949:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940527104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319464.431993:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940527104:12345-0@lo:400:kworker.0 Request processed in 45us (229us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319464.432000:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931
00000100:00100000:1.0:1767319464.432015:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932
00000100:00100000:1.0:1767319464.432021:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940526976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319464.432044:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940526976:12345-0@lo:400:kworker.0 Request processed in 24us (200us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319464.432051:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932
00000100:00100000:2.0:1767319464.432767:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527232
00000100:00100000:2.0:1767319464.432782:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527232
00000100:00100000:2.0:1767319464.432885:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4507
00000100:00100000:2.0:1767319464.432893:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940527488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.433091:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940527488:12345-0@lo:400:kworker.0 Request processed in 198us (1515us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319464.433098:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4507
00000100:00100000:2.0:1767319464.433113:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4508
00000100:00100000:2.0:1767319464.433119:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940527232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.433146:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940527232:12345-0@lo:400:kworker.0 Request processed in 28us (1485us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319464.433152:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4508
00000100:00100000:2.0:1767319464.433164:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088
00000100:00100000:2.0:1767319464.433167:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940526720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319464.433247:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319464.433276:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940526720:12345-0@lo:38:kworker.0 Request processed in 107us (1854us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319464.433283:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088
00000100:00100000:2.0:1767319464.433326:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940527232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.433338:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940527488:0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.433470:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319464.433499:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319464.433503:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319464.433506:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940526720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319464.433525:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940527616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319464.433550:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319464.433575:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527360
00000100:00100000:2.0:1767319464.433580:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527360
00000100:00100000:2.0:1767319464.433594:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527616
00000100:00100000:2.0:1767319464.433596:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527616
00000100:00100000:2.0:1767319464.433605:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089
00000100:00100000:2.0:1767319464.433609:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940527360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319464.433618:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319464.433645:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940527360:12345-0@lo:38:kworker.0 Request processed in 35us (175us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319464.433650:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089
00000100:00100000:2.0:1767319464.433661:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17090
00000100:00100000:2.0:1767319464.433665:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940527616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319464.433672:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319464.433693:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940527616:12345-0@lo:38:kworker.0 Request processed in 27us (143us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319464.433699:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17090
00000100:00080000:2.0:1767319464.433718:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319464.433721:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319464.433725:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940527616:0@lo:38:kworker.0
00000100:00080000:2.0:1767319464.433732:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319464.433735:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319464.433738:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940527360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319464.433889:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940526848
00000100:00100000:2.0:1767319464.433893:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940526848
00000100:00100000:2.0:1767319464.433914:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106
00000100:00100000:2.0:1767319464.433918:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940526848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319464.433929:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319464.434119:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940526848:12345-0@lo:38:kworker.0 Request processed in 198us (2585us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319464.434125:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106
00000100:00080000:2.0:1767319464.434146:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319464.434151:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319464.434155:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319464.434172:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319464.434177:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319464.434179:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940526848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319464.434302:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940526976:0@lo:400:kworker.0
00000100:00100000:2.0:1767319464.434314:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940527104:0@lo:400:kworker.0
00000100:00100000:2.0:1767319465.138305:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319465.396728:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319465.967301:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319465.967327:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940527744:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319465.967396:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319465.967653:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527744
00000100:00100000:1.0:1767319465.967662:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527744
00000100:00100000:1.0:1767319465.967725:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478
00000100:00100000:1.0:1767319465.967734:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940527744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319465.967763:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319465.967834:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940527744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319465.967841:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478
00000100:00100000:3.0:1767319465.968373:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940527744:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319466.157087:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319466.413020:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319466.989388:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319466.989410:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940527872:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319466.989479:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319466.989667:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940527872
00000100:00100000:2.0:1767319466.989676:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940527872
00000100:00100000:2.0:1767319466.989752:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479
00000100:00100000:2.0:1767319466.989762:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940527872:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319466.989818:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319466.989864:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940527872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (385us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319466.989871:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479
00000100:00080000:0.0:1767319466.989984:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319466.990022:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940527872:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319467.079491:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319467.079591:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319467.079673:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320384
00000100:00100000:1.0:1767319467.079684:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320384
00000100:00100000:0.0:1767319467.079688:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320256
00000100:00100000:0.0:1767319467.079696:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320256
00000100:00100000:0.0:1767319467.079750:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4509
00000100:00100000:0.0:1767319467.079842:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894320384:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767319467.079852:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319467.079933:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894320384:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (451us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319467.080054:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17091
00000100:00100000:1.0:1767319467.080061:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894320256:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319467.080092:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319467.080123:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894320256:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 62us (532us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319467.080130:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17091
00000100:00100000:0.0:1767319467.083468:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4509
00000100:00100000:2.0:1767319467.181340:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319467.437029:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319468.204914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319468.465290:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319469.228916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319469.485045:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319469.549029:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319469.549040:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319469.549043:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319469.549048:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319469.549052:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319469.549060:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4714
00000100:00080000:2.0:1767319469.549064:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319469.549071:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319469.549112:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940528000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319469.549173:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319469.549178:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319469.549180:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319469.549183:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4714
00000100:00080000:2.0:1767319469.549185:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319469.549189:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319469.549204:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af480 x1853163940528128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319469.549280:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319469.549284:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319469.549286:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319469.549290:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4714
00000100:00080000:2.0:1767319469.549293:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319469.549298:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319469.549313:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940528256:0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549313:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a00e00 x1853163940528640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319469.549343:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319469.549347:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319469.549348:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319469.549351:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4714
00000100:00080000:2.0:1767319469.549354:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319469.549358:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319469.549371:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2680 x1853163940528896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319469.549384:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319469.549416:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940528512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319469.549449:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319469.549459:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940528384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549460:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319469.549490:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319469.549494:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319469.549502:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940528768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549545:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319469.549553:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528512
00000100:00100000:0.0:1767319469.549563:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528512
00000100:00100000:2.0:1767319469.549579:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528256
00000100:00100000:2.0:1767319469.549584:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528256
00000100:00100000:0.0:1767319469.549631:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528768
00000100:00100000:2.0:1767319469.549632:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528384
00000100:00100000:0.0:1767319469.549637:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528768
00000100:00100000:2.0:1767319469.549638:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528384
00000100:00100000:2.0:1767319469.549669:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933
00000100:00100000:0.0:1767319469.549674:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4510
00000100:00100000:2.0:1767319469.549682:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940528256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319469.549686:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940528512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549740:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940528256:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319469.549749:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933
00000100:00100000:0.0:1767319469.549751:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940528512:12345-0@lo:400:kworker.0 Request processed in 66us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319469.549761:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4510
00000100:00100000:2.0:1767319469.549765:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934
00000100:00100000:2.0:1767319469.549792:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940528384:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549812:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940528384:12345-0@lo:400:kworker.0 Request processed in 42us (323us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319469.549819:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934
00000100:00100000:0.0:1767319469.549820:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4511
00000100:00100000:0.0:1767319469.549831:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940528768:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319469.549846:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319469.549850:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319469.549853:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319469.549870:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940528768:12345-0@lo:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319469.549877:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4511
00000100:00100000:2.0:1767319469.549885:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940528768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319469.549895:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940528512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319469.549918:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940528384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319469.549932:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940528256:0@lo:400:kworker.0
00000100:00100000:3.0:1767319469.550086:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940528000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319469.550108:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319469.550143:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940528128:0@lo:38:kworker.0
00000100:00100000:3.0:1767319469.550167:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319469.550188:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940528640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319469.550201:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319469.550208:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940528896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319469.550221:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319469.550239:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528000
00000100:00100000:3.0:1767319469.550242:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528000
00000100:00100000:3.0:1767319469.550260:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528640
00000100:00100000:3.0:1767319469.550262:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528640
00000100:00100000:0.0:1767319469.550263:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528128
00000100:00100000:0.0:1767319469.550270:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528128
00000100:00100000:3.0:1767319469.550271:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940528896
00000100:00100000:3.0:1767319469.550274:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940528896
00000100:00100000:3.0:1767319469.550286:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17092
00000100:00100000:3.0:1767319469.550290:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940528000:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319469.550301:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107
00010000:00020000:3.0:1767319469.550306:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319469.550308:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940528128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319469.550321:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319469.550356:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940528000:12345-0@lo:38:kworker.0 Request processed in 63us (244us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319469.550361:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940528128:12345-0@lo:38:kworker.0 Request processed in 52us (192us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319469.550369:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17092
00000100:00100000:0.0:1767319469.550373:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107
00000100:00100000:3.0:1767319469.550394:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17093
00000100:00100000:3.0:1767319469.550400:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940528640:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319469.550404:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17094
00000100:00100000:0.0:1767319469.550412:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940528896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319469.550415:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767319469.550425:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319469.550448:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940528640:12345-0@lo:38:kworker.0 Request processed in 46us (243us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319469.550455:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17093
00000100:00100000:0.0:1767319469.550462:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940528896:12345-0@lo:38:kworker.0 Request processed in 48us (237us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319469.550469:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17094
00000100:00080000:3.0:1767319469.550488:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319469.550494:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319469.550498:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940528000:0@lo:38:kworker.0
00000100:00080000:3.0:1767319469.550507:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319469.550510:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319469.550513:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940528128:0@lo:38:kworker.0
00000100:00080000:3.0:1767319469.550519:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319469.550522:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319469.550525:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940528640:0@lo:38:kworker.0
00000100:00080000:3.0:1767319469.550533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319469.550535:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319469.550537:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940528896:0@lo:38:kworker.0
00000100:00100000:2.0:1767319470.252905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319470.509515:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319471.085040:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940529024:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319471.085118:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319471.086811:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529024
00000100:00100000:1.0:1767319471.086823:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529024
00000100:00100000:1.0:1767319471.086963:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480
00000100:00100000:1.0:1767319471.086973:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940529024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319471.087011:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319471.087093:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940529024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (1974us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319471.087100:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480
00000100:00100000:0.0:1767319471.087307:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940529024:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319471.089101:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319471.277795:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319471.532942:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319472.109436:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940529152:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319472.109525:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319472.109723:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529152
00000100:00100000:3.0:1767319472.109734:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529152
00000100:00100000:3.0:1767319472.109834:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481
00000100:00100000:3.0:1767319472.109846:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940529152:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319472.109854:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767319472.109877:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319472.121640:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940529152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11786us (12103us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319472.121657:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481
00000100:00100000:2.0:1767319472.123386:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940529152:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319472.199385:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319472.199518:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319472.200131:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320512
00000100:00100000:2.0:1767319472.200143:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320512
00000100:00100000:0.0:1767319472.200390:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320640
00000100:00100000:0.0:1767319472.200396:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320640
00000100:00100000:0.0:1767319472.200855:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4512
00000100:00100000:0.0:1767319472.200868:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894320640:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319472.200967:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894320640:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (1448us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319472.200975:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4512
00000100:00100000:0.0:1767319472.200996:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17095
00000100:00100000:0.0:1767319472.201000:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894320512:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319472.201022:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319472.201050:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894320512:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (1679us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319472.201056:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17095
00000100:00080000:1.0:1767319472.201424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319472.300959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319472.557895:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319473.325478:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319473.581428:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319474.348936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319474.609194:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319474.668965:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319474.668975:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319474.668978:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319474.668983:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319474.668988:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319474.668995:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4719
00000100:00080000:0.0:1767319474.669000:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319474.669006:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319474.669043:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940529280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319474.669068:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319474.669071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319474.669073:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319474.669076:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4719
00000100:00080000:0.0:1767319474.669079:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319474.669081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319474.669103:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940529408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319474.669163:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:0.0:1767319474.669182:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319474.669183:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940529664:0@lo:400:kworker.0
00000100:00080000:0.0:1767319474.669189:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319474.669192:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319474.669196:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4719
00000100:00080000:0.0:1767319474.669199:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319474.669203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319474.669216:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a680 x1853163940529920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319474.669232:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319474.669236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319474.669237:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319474.669240:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4719
00000100:00080000:0.0:1767319474.669242:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319474.669245:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319474.669254:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797aa00 x1853163940530176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319474.669275:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940529792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319474.669330:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940529280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319474.669387:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940530048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319474.669388:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319474.669438:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319474.669479:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529792
00000100:00100000:2.0:1767319474.669479:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530048
00000100:00100000:0.0:1767319474.669488:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529792
00000100:00100000:2.0:1767319474.669488:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530048
00000100:00100000:2.0:1767319474.669559:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4513
00000100:00100000:2.0:1767319474.669570:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940530048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319474.669641:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940530048:12345-0@lo:400:kworker.0 Request processed in 73us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319474.669648:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4513
00000100:00100000:2.0:1767319474.669693:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940530048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319474.669722:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4514
00000100:00100000:0.0:1767319474.669730:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940529792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319474.669799:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940529792:12345-0@lo:400:kworker.0 Request processed in 43us (384us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319474.669803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319474.669807:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4514
00000100:00100000:0.0:1767319474.669842:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940529792:0@lo:400:kworker.0
00000100:00100000:3.0:1767319474.676352:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319474.676468:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940529536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319474.676538:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319474.680489:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319474.680530:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529280
00000100:00100000:1.0:1767319474.680533:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940529408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319474.680541:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529280
00000100:00100000:1.0:1767319474.680580:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319474.680596:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17096
00000100:00100000:1.0:1767319474.680602:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940529920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319474.680606:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940529280:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319474.680631:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767319474.680631:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319474.680650:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940530176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319474.680677:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940529280:12345-0@lo:38:kworker.0 Request processed in 72us (197us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319474.680681:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319474.680695:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17096
00000100:00100000:3.0:1767319474.680717:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529920
00000100:00100000:3.0:1767319474.680721:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529920
00000100:00080000:1.0:1767319474.680723:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319474.680730:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319474.680734:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940529280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319474.680736:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530176
00000100:00100000:3.0:1767319474.680741:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530176
00000100:00100000:3.0:1767319474.680760:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17097
00000100:00100000:1.0:1767319474.680804:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17098
00000100:00100000:1.0:1767319474.680810:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940530176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319474.680822:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319474.680852:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940530176:12345-0@lo:38:kworker.0 Request processed in 40us (171us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319474.680858:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17098
00000100:00080000:1.0:1767319474.680884:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319474.680888:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319474.680891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940530176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319474.680976:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940529920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319474.680989:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319474.681025:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940529920:12345-0@lo:38:kworker.0 Request processed in 259us (397us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319474.681032:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17097
00000100:00100000:3.0:1767319474.681058:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529408
00000100:00100000:3.0:1767319474.681062:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529408
00000100:00100000:3.0:1767319474.681079:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108
00000100:00100000:3.0:1767319474.681083:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940529408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319474.681104:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319474.681127:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940529408:12345-0@lo:38:kworker.0 Request processed in 43us (548us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319474.681133:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108
00000100:00080000:1.0:1767319474.681293:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319474.681298:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319474.681301:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940529408:0@lo:38:kworker.0
00000100:00080000:1.0:1767319474.681310:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319474.681313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319474.681316:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940529920:0@lo:38:kworker.0
00000100:00100000:0.0:1767319474.683497:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529664
00000100:00100000:0.0:1767319474.683512:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529664
00000100:00080000:1.0:1767319474.683869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319474.684030:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940529536
00000100:00100000:0.0:1767319474.684035:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940529536
00000100:00100000:0.0:1767319474.684081:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935
00000100:00080000:1.0:1767319474.684085:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319474.684100:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940529664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319474.684401:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936
00000100:00100000:3.0:1767319474.684413:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940529536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319474.684480:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940529536:12345-0@lo:400:kworker.0 Request processed in 70us (7941us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319474.684487:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936
00000100:00100000:0.0:1767319474.684567:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940529664:12345-0@lo:400:kworker.0 Request processed in 478us (8220us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319474.684574:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935
00000100:00100000:1.0:1767319474.684791:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940529664:0@lo:400:kworker.0
00000100:00100000:1.0:1767319474.684807:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940529536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319475.373054:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319475.639103:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319476.205649:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940530304:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319476.205728:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319476.206007:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530304
00000100:00100000:0.0:1767319476.206016:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530304
00000100:00100000:0.0:1767319476.206071:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482
00000100:00100000:0.0:1767319476.206094:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940530304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319476.206127:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767319476.206212:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319476.207623:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940530304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1538us (1889us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319476.207636:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1767319476.208111:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940530304:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319476.296907:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767319476.296952:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894320768 offset 0 length 520: 4
00000100:00100000:3.0:1767319476.297218:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321024
00000100:00100000:3.0:1767319476.297228:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321024
00000100:00100000:1.0:1767319476.297379:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319476.297626:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894320896
00000100:00100000:3.0:1767319476.297630:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894320896
00000100:00100000:3.0:1767319476.297644:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4515
00000100:00100000:3.0:1767319476.297655:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894321024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319476.297731:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894321024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (833us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319476.297738:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4515
00000100:00100000:3.0:1767319476.297758:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17099
00000100:00100000:3.0:1767319476.297762:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894320896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319476.297817:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319476.297851:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894320896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 87us (471us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319476.297856:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17099
00000100:00080000:0.0:1767319476.300295:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319476.396956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319476.653027:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319477.231010:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940530432:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319477.231110:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319477.231241:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530432
00000100:00100000:0.0:1767319477.231249:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530432
00000100:00100000:0.0:1767319477.231311:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483
00000100:00100000:0.0:1767319477.231320:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940530432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319477.231349:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319477.231397:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940530432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (287us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319477.231403:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483
00000100:00080000:1.0:1767319477.231933:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319477.232029:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940530432:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319477.420941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319477.679892:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319478.445788:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319478.704153:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319479.470492:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319479.725079:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319479.788905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319479.788913:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319479.788916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319479.788919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319479.788922:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319479.788929:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4724
00000100:00080000:0.0:1767319479.788933:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319479.788940:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319479.788978:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a300 x1853163940530560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319479.789013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319479.789017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319479.789018:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319479.789022:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4724
00000100:00080000:0.0:1767319479.789024:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319479.789027:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319479.789041:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797ad80 x1853163940530688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319479.789109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319479.789111:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319479.789112:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319479.789114:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4724
00000100:00080000:0.0:1767319479.789116:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319479.789119:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319479.789126:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a680 x1853163940531200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319479.789136:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319479.789139:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319479.789140:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319479.789143:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4724
00000100:00080000:0.0:1767319479.789145:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319479.789147:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319479.789152:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978e00 x1853163940531456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319479.789165:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940530560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319479.789177:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940530816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319479.789326:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940531328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319479.794518:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.794599:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940530688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319479.794651:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.794671:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940531200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319479.794694:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.794730:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940531456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319479.794751:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.794813:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530560
00000100:00100000:1.0:1767319479.794821:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530560
00000100:00100000:1.0:1767319479.794855:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531200
00000100:00100000:1.0:1767319479.794859:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531200
00000100:00100000:1.0:1767319479.794872:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531456
00000100:00100000:1.0:1767319479.794874:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531456
00000100:00100000:1.0:1767319479.794891:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17100
00000100:00100000:1.0:1767319479.794898:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940530560:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319479.794934:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319479.794991:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940530560:12345-0@lo:38:kworker.0 Request processed in 92us (481us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319479.794999:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17100
00000100:00100000:1.0:1767319479.795024:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17101
00000100:00100000:1.0:1767319479.795028:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940531200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319479.795037:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319479.795164:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940531200:12345-0@lo:38:kworker.0 Request processed in 133us (468us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319479.795171:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17101
00000100:00100000:1.0:1767319479.795183:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17102
00000100:00100000:1.0:1767319479.795187:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940531456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319479.795196:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319479.795220:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940531456:12345-0@lo:38:kworker.0 Request processed in 31us (467us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319479.795225:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17102
00000100:00100000:1.0:1767319479.795244:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530688
00000100:00100000:1.0:1767319479.795248:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530688
00000100:00100000:1.0:1767319479.795267:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109
00000100:00100000:1.0:1767319479.795272:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940530688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319479.795281:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319479.795309:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940530688:12345-0@lo:38:kworker.0 Request processed in 36us (658us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319479.795315:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109
00000100:00080000:1.0:1767319479.795373:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319479.795378:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319479.795381:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940531456:0@lo:38:kworker.0
00000100:00080000:1.0:1767319479.795393:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319479.795396:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319479.795400:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940530560:0@lo:38:kworker.0
00000100:00080000:1.0:1767319479.795407:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319479.795410:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319479.795413:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940530688:0@lo:38:kworker.0
00000100:00080000:1.0:1767319479.795420:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319479.795423:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319479.795425:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940531200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319479.795483:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940531072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319479.795509:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.795539:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531072
00000100:00100000:1.0:1767319479.795543:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531072
00000100:00100000:1.0:1767319479.795582:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4516
00000100:00100000:1.0:1767319479.795589:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940531072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319479.795629:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940531072:12345-0@lo:400:kworker.0 Request processed in 41us (119us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319479.795635:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4516
00000100:00080000:1.0:1767319479.795653:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319479.795675:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940531072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319479.798145:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319479.798212:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319479.798224:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940530944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319479.798270:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319479.798314:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530816
00000100:00100000:0.0:1767319479.798336:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530816
00000100:00100000:0.0:1767319479.798386:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940530944
00000100:00100000:0.0:1767319479.798389:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940530944
00000100:00100000:0.0:1767319479.798410:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937
00000100:00100000:0.0:1767319479.798417:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940530816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319479.798467:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940530816:12345-0@lo:400:kworker.0 Request processed in 51us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319479.798474:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937
00000100:00100000:0.0:1767319479.798489:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938
00000100:00100000:0.0:1767319479.798495:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940530944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319479.798518:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940530944:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319479.798523:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938
00000100:00080000:0.0:1767319479.798539:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319479.798543:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319479.798586:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940530944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319479.798597:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940530816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319479.807683:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319479.807863:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531328
00000100:00100000:1.0:1767319479.807872:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531328
00000100:00100000:1.0:1767319479.807952:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4517
00000100:00100000:1.0:1767319479.807962:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940531328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319479.808041:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940531328:12345-0@lo:400:kworker.0 Request processed in 80us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319479.808057:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4517
00000100:00100000:3.0:1767319479.808429:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940531328:0@lo:400:kworker.0
00000100:00080000:0.0:1767319479.808491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319480.495770:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319480.749033:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319481.325567:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940531584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319481.325658:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319481.325863:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531584
00000100:00100000:2.0:1767319481.325873:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531584
00000100:00100000:2.0:1767319481.325952:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484
00000100:00100000:2.0:1767319481.325962:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940531584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319481.325994:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767319481.326067:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319481.327285:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940531584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1318us (1620us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319481.327296:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484
00000100:00100000:0.0:1767319481.327299:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940531584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319481.417502:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319481.417599:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319481.417736:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321280
00000100:00100000:1.0:1767319481.417747:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321280
00000100:00100000:2.0:1767319481.417749:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321152
00000100:00100000:2.0:1767319481.417753:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321152
00000100:00100000:2.0:1767319481.417823:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4518
00000100:00100000:2.0:1767319481.417849:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894321280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767319481.418146:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319481.418533:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17103
00000100:00100000:1.0:1767319481.418540:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319481.418562:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319481.419358:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894321280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1508us (1860us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319481.419373:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4518
00000100:00100000:1.0:1767319481.420095:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1550us (2492us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319481.420105:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17103
00000100:00100000:2.0:1767319481.516905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319481.773073:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319482.349071:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319482.349095:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940531712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319482.349165:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319482.349295:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531712
00000100:00100000:1.0:1767319482.349305:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531712
00000100:00100000:1.0:1767319482.349371:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485
00000100:00100000:1.0:1767319482.349380:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940531712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319482.349410:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319482.349460:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940531712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (293us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319482.349466:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485
00000100:00100000:1.0:1767319482.349516:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940531712:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319482.350039:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319482.540914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319482.797744:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319483.566181:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319483.826278:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319484.589559:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319484.846457:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319484.908910:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319459/real 1767319459]  req@ffff93cf4705a300 x1853163940525312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319484.908944:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4705a300 x1853163940525312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319484.908965:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319484.908986:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319484.908990:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940525312:0@lo:250:kworker.0
00000100:00080000:1.0:1767319484.909316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319484.909322:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319484.909325:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319484.909331:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4709
00000100:00080000:1.0:1767319484.909335:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319484.909342:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319484.909377:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adfb80 x1853163940531840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319484.909404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319484.909408:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319484.909410:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319484.909414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4729
00000100:00080000:1.0:1767319484.909416:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319484.909419:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319484.909434:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940531968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319484.909442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319484.909446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319484.909447:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319484.909451:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4729
00000100:00080000:1.0:1767319484.909453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319484.909457:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319484.909479:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf480 x1853163940532096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319484.909506:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940531840:0@lo:250:kworker.0
00000100:00080000:1.0:1767319484.909549:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319484.909553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319484.909555:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000400:00000100:2.0:1767319484.909555:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940531840 offset 0 length 520: 4
00000100:00080000:1.0:1767319484.909558:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4729
00000100:00080000:1.0:1767319484.909560:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319484.909564:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319484.909575:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940532608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319484.909589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319484.909592:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940531968:0@lo:38:kworker.0
00000100:00080000:1.0:1767319484.909593:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319484.909595:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319484.909599:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4729
00000100:00080000:1.0:1767319484.909601:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319484.909605:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319484.909614:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222a00 x1853163940532864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319484.909623:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319484.909635:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940532480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319484.909639:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940532096:0@lo:38:kworker.0
00000100:00100000:1.0:1767319484.909660:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319484.909660:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319484.909680:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319484.909685:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940532736:0@lo:400:kworker.0
00000100:00100000:2.0:1767319484.909694:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940532608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319484.909705:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319484.909727:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319484.909797:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940532224:0@lo:400:kworker.0
00000100:00100000:2.0:1767319484.909857:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940532864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319484.910288:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940532352:0@lo:400:kworker.0
00000100:00100000:3.0:1767319484.911827:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319484.912602:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319484.912603:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319484.912675:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532224
00000100:00100000:0.0:1767319484.912794:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532224
00000100:00100000:0.0:1767319484.912850:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532352
00000100:00100000:0.0:1767319484.912853:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532352
00000100:00100000:0.0:1767319484.912876:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939
00000100:00100000:0.0:1767319484.912886:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940532224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319484.912946:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940532224:12345-0@lo:400:kworker.0 Request processed in 62us (1123us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319484.912953:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939
00000100:00100000:0.0:1767319484.912972:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940
00000100:00100000:0.0:1767319484.912979:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940532352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319484.913025:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940532352:12345-0@lo:400:kworker.0 Request processed in 46us (428us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319484.913032:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940
00000100:00100000:0.0:1767319484.913078:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940532352:0@lo:400:kworker.0
00000100:00100000:3.0:1767319484.914981:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940532224:0@lo:400:kworker.0
00000100:00100000:2.0:1767319484.918634:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532096
00000100:00100000:2.0:1767319484.918651:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532096
00000100:00100000:2.0:1767319484.918724:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110
00000100:00100000:2.0:1767319484.918731:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940532096:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319484.918754:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319484.918831:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940532096:12345-0@lo:38:kworker.0 Request processed in 99us (9169us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319484.918838:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110
00000100:00100000:3.0:1767319484.919588:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940531968
00000100:00100000:3.0:1767319484.919596:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940531968
00000100:00100000:3.0:1767319484.919629:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532480
00000100:00100000:3.0:1767319484.919633:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532480
00000100:00100000:3.0:1767319484.919667:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532736
00000100:00100000:3.0:1767319484.919671:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532736
00000100:00100000:3.0:1767319484.919717:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532608
00000100:00100000:3.0:1767319484.919721:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532608
00000100:00100000:3.0:1767319484.919731:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532864
00000100:00100000:3.0:1767319484.919734:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532864
00000100:00100000:3.0:1767319484.919747:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519
00000100:00100000:3.0:1767319484.919756:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940532480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319484.919833:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940532480:12345-0@lo:400:kworker.0 Request processed in 79us (10172us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319484.919840:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519
00000100:00100000:3.0:1767319484.919856:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4520
00000100:00100000:3.0:1767319484.919862:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940532736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319484.919890:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940532736:12345-0@lo:400:kworker.0 Request processed in 29us (10184us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319484.919900:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4520
00000100:00100000:3.0:1767319484.919910:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17104
00000100:00100000:3.0:1767319484.919914:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940531968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319484.919929:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319484.919954:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940531968:12345-0@lo:38:kworker.0 Request processed in 38us (10330us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319484.919960:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17104
00000100:00100000:3.0:1767319484.919970:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17105
00000100:00100000:3.0:1767319484.919974:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940532608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319484.919982:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319484.920016:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940532608:12345-0@lo:38:kworker.0 Request processed in 40us (10287us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319484.920021:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17105
00000100:00100000:3.0:1767319484.920033:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17106
00000100:00100000:3.0:1767319484.920037:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940532864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319484.920045:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319484.920069:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940532864:12345-0@lo:38:kworker.0 Request processed in 31us (7472us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319484.920074:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17106
00000100:00100000:3.0:1767319484.920126:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940532736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319484.920139:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940532480:0@lo:400:kworker.0
00000100:00080000:3.0:1767319484.920182:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319484.920187:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319484.920190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319484.920213:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319484.920219:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319484.920223:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940532608:0@lo:38:kworker.0
00000100:00080000:3.0:1767319484.920232:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319484.920236:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319484.920238:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940532864:0@lo:38:kworker.0
00000100:00080000:3.0:1767319484.920247:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319484.920250:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319484.920253:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940531968:0@lo:38:kworker.0
00000100:00080000:3.0:1767319484.920261:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319484.920264:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319484.920267:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940532096:0@lo:38:kworker.0
00000100:00100000:2.0:1767319485.613088:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319485.869348:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319486.445270:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319486.445293:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940532992:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319486.445361:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319486.445503:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940532992
00000100:00100000:3.0:1767319486.445513:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940532992
00000100:00100000:3.0:1767319486.445585:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486
00000100:00100000:3.0:1767319486.445597:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940532992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319486.445627:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319486.445676:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940532992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (314us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319486.445685:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486
00000100:00100000:3.0:1767319486.445731:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940532992:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319486.445797:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319486.536305:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319486.536351:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319486.536435:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321408
00000100:00100000:1.0:1767319486.536447:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321408
00000100:00100000:1.0:1767319486.536503:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321536
00000100:00100000:1.0:1767319486.536554:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321536
00000100:00100000:1.0:1767319486.536612:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4521
00000100:00100000:1.0:1767319486.536622:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894321536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319486.536694:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894321536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319486.536701:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4521
00000100:00100000:1.0:1767319486.536719:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17107
00000100:00100000:1.0:1767319486.536724:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319486.536744:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319486.536766:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 41us (483us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319486.536855:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319486.536950:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17107
00000100:00100000:2.0:1767319486.638019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319486.893029:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319487.469160:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940533120:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319487.469250:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319487.469903:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533120
00000100:00100000:0.0:1767319487.469914:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533120
00000100:00100000:0.0:1767319487.470007:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487
00000100:00100000:0.0:1767319487.470017:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940533120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319487.470062:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319487.470207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319487.470451:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940533120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 434us (1199us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319487.470459:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487
00000100:00100000:2.0:1767319487.471399:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940533120:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319487.661555:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319487.918944:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319488.684925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319488.942028:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319489.708905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319489.966922:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319490.028980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319490.028993:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319490.028996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319490.029001:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319490.029007:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319490.029015:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4734
00000100:00080000:0.0:1767319490.029020:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319490.029028:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319490.029080:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940533248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319490.029107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319490.029110:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319490.029112:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319490.029117:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4734
00000100:00080000:0.0:1767319490.029119:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319490.029123:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319490.029140:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8000 x1853163940533376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319490.029187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940533248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319490.029212:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940533504:0@lo:400:kworker.0
00000100:00080000:0.0:1767319490.029300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319490.029304:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940533760:0@lo:400:kworker.0
00000100:00080000:0.0:1767319490.029305:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319490.029308:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319490.029317:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4734
00000100:00080000:0.0:1767319490.029319:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319490.029324:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319490.029339:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399f100 x1853163940533888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319490.029361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319490.029365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319490.029367:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319490.029370:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4734
00000100:00080000:0.0:1767319490.029373:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319490.029376:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319490.029387:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3b80 x1853163940534144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319490.029430:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940533632:0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.029709:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.029827:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940534016:0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.029856:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.029890:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534016
00000100:00100000:1.0:1767319490.029898:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534016
00000100:00100000:1.0:1767319490.030482:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4522
00000100:00100000:1.0:1767319490.030493:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940534016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.030570:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940534016:12345-0@lo:400:kworker.0 Request processed in 78us (712us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319490.030577:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4522
00000100:00100000:1.0:1767319490.030622:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940534016:0@lo:400:kworker.0
00000100:00080000:1.0:1767319490.030662:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319490.030698:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533504
00000100:00100000:1.0:1767319490.030703:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533504
00000100:00100000:1.0:1767319490.030949:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941
00000100:00100000:1.0:1767319490.030967:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940533504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.031009:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940533504:12345-0@lo:400:kworker.0 Request processed in 44us (1300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319490.031014:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941
00000100:00080000:1.0:1767319490.031030:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319490.031048:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940533504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319490.037479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319490.037559:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940533376:0@lo:38:kworker.0
00000100:00100000:3.0:1767319490.037606:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.037628:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533248
00000100:00100000:1.0:1767319490.037638:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533248
00000100:00100000:3.0:1767319490.037639:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533376
00000100:00100000:3.0:1767319490.037645:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533376
00000100:00100000:3.0:1767319490.037689:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111
00000100:00100000:1.0:1767319490.037690:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17108
00000100:00100000:3.0:1767319490.037704:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940533376:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319490.037705:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940533248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319490.037735:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319490.037808:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940533248:12345-0@lo:38:kworker.0 Request processed in 108us (340us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319490.037815:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17108
00010000:00020000:3.0:1767319490.041935:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319490.042408:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940533376:12345-0@lo:38:kworker.0 Request processed in 4705us (4798us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319490.042420:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111
00000100:00080000:3.0:1767319490.042720:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319490.042726:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319490.042731:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940533376:0@lo:38:kworker.0
00000100:00100000:3.0:1767319490.043699:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940533888:0@lo:38:kworker.0
00000100:00100000:3.0:1767319490.043761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319490.043822:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940534144:0@lo:38:kworker.0
00000100:00100000:3.0:1767319490.043846:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.043883:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534144
00000100:00100000:3.0:1767319490.043883:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533888
00000100:00100000:3.0:1767319490.043890:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533888
00000100:00100000:1.0:1767319490.043891:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534144
00000100:00100000:3.0:1767319490.043928:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17109
00000100:00100000:3.0:1767319490.043935:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940533888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319490.043975:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319490.043982:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17110
00000100:00100000:1.0:1767319490.043989:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940534144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319490.044002:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319490.044009:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940533888:12345-0@lo:38:kworker.0 Request processed in 72us (247us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319490.044017:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17109
00000100:00100000:1.0:1767319490.044040:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940534144:12345-0@lo:38:kworker.0 Request processed in 49us (192us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319490.044047:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17110
00000100:00080000:3.0:1767319490.044252:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319490.044257:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319490.044261:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940534144:0@lo:38:kworker.0
00000100:00080000:3.0:1767319490.044272:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319490.044275:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319490.044278:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940533248:0@lo:38:kworker.0
00000100:00080000:3.0:1767319490.044297:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319490.044300:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319490.044303:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940533888:0@lo:38:kworker.0
00000100:00100000:2.0:1767319490.044646:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.044765:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533760
00000100:00100000:1.0:1767319490.044805:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533760
00000100:00100000:1.0:1767319490.044854:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4523
00000100:00100000:1.0:1767319490.044861:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940533760:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319490.045076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319490.045102:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940533760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.045219:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940533760:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319490.045227:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4523
00000100:00100000:0.0:1767319490.045351:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319490.045466:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940533632
00000100:00100000:1.0:1767319490.045471:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940533632
00000100:00100000:1.0:1767319490.045528:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942
00000100:00100000:1.0:1767319490.045536:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940533632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319490.045583:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940533632:12345-0@lo:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319490.045590:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942
00000100:00080000:2.0:1767319490.045638:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319490.046303:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940533632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319490.737036:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319490.990336:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319491.565131:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319491.565169:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940534272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319491.565239:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319491.565309:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534272
00000100:00100000:2.0:1767319491.565318:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534272
00000100:00100000:2.0:1767319491.565444:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488
00000100:00100000:2.0:1767319491.565453:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940534272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319491.565549:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319491.565606:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940534272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (366us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319491.565614:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488
00000100:00100000:0.0:1767319491.565678:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940534272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319491.654111:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319491.656106:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319491.661492:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321664
00000100:00100000:2.0:1767319491.661492:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321792
00000100:00100000:1.0:1767319491.661507:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321664
00000100:00100000:2.0:1767319491.661507:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321792
00000100:00100000:1.0:1767319491.661557:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17111
00000100:00100000:1.0:1767319491.661565:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321664:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:2.0:1767319491.661576:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4524
00000100:00100000:2.0:1767319491.661582:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894321792:12345-192.168.202.21@tcp:400:kworker.0
00010000:00020000:1.0:1767319491.661588:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319491.661692:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319491.664124:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894321664:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 2545us (8023us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319491.664141:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17111
00000100:00100000:3.0:1767319491.664142:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894321792:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 2559us (10052us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319491.664150:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4524
00000100:00100000:2.0:1767319491.758596:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319492.013028:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319492.591673:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319492.591696:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940534400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319492.591765:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319492.592162:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534400
00000100:00100000:3.0:1767319492.592170:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534400
00000100:00100000:3.0:1767319492.592355:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489
00000100:00100000:3.0:1767319492.592367:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940534400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319492.592397:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319492.592448:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940534400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (682us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319492.592455:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489
00000100:00100000:3.0:1767319492.592503:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940534400:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319492.596061:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319492.780918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319493.037034:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319493.804895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319494.061210:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319494.828965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319495.085193:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319495.150543:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319495.150554:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319495.150558:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319495.150562:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319495.150568:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319495.150577:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4740
00000100:00080000:2.0:1767319495.150582:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319495.150590:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319495.150639:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb480 x1853163940534528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319495.150678:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319495.150682:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319495.150683:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319495.150687:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4740
00000100:00080000:2.0:1767319495.150690:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319495.150693:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319495.150709:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8000 x1853163940534656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319495.150795:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940534528:0@lo:38:kworker.0
00000100:00080000:2.0:1767319495.150818:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319495.150822:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319495.150825:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319495.150828:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4740
00000100:00080000:2.0:1767319495.150831:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319495.150836:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319495.150851:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa300 x1853163940535168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319495.150870:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319495.150876:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319495.150877:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319495.150881:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319495.150885:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4740
00000100:00080000:2.0:1767319495.150889:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319495.150893:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319495.150916:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9f80 x1853163940535424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319495.150950:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940535296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319495.150954:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940534656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319495.150993:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319495.150999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319495.151023:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319495.151028:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940535168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319495.151034:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940535040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319495.151055:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319495.151093:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534528
00000100:00100000:2.0:1767319495.151102:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534528
00000100:00100000:2.0:1767319495.151131:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535296
00000100:00100000:2.0:1767319495.151133:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535296
00000100:00100000:2.0:1767319495.151162:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535168
00000100:00100000:2.0:1767319495.151165:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535168
00000100:00100000:2.0:1767319495.151183:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4525
00000100:00100000:1.0:1767319495.151188:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940534912:0@lo:400:kworker.0
00000100:00100000:2.0:1767319495.151194:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940535296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319495.151248:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940534784:0@lo:400:kworker.0
00000100:00100000:1.0:1767319495.160295:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319495.161007:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17112
00000100:00100000:2.0:1767319495.161017:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940534528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319495.161042:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319495.161095:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940534528:12345-0@lo:38:kworker.0 Request processed in 78us (10223us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319495.161103:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17112
00000100:00100000:2.0:1767319495.161126:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17113
00000100:00100000:2.0:1767319495.161131:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940535168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319495.161140:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319495.161182:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940535168:12345-0@lo:38:kworker.0 Request processed in 37us (10115us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319495.161188:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17113
00000100:00100000:2.0:1767319495.161211:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319495.161243:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535040
00000100:00100000:2.0:1767319495.161250:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535040
00000100:00100000:2.0:1767319495.161299:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4526
00000100:00100000:2.0:1767319495.161306:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940535040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319495.162555:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534912
00000100:00100000:1.0:1767319495.162566:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534912
00000100:00100000:1.0:1767319495.162615:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943
00000100:00100000:1.0:1767319495.162624:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940534912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319495.163817:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940535040:12345-0@lo:400:kworker.0 Request processed in 2504us (2597us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319495.163831:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4526
00000100:00100000:2.0:1767319495.163918:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940535040:0@lo:400:kworker.0
00000100:00080000:2.0:1767319495.163949:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319495.163954:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319495.164005:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940535296:12345-0@lo:400:kworker.0 Request processed in 12815us (13012us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319495.164013:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4525
00000100:00100000:2.0:1767319495.164043:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940535296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319495.164105:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534656
00000100:00100000:2.0:1767319495.164112:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534656
00000100:00100000:2.0:1767319495.164144:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112
00000100:00100000:2.0:1767319495.164151:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940534656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319495.164259:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319495.164312:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940534656:12345-0@lo:38:kworker.0 Request processed in 160us (13313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319495.164320:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112
00000100:00100000:1.0:1767319495.164385:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940534912:12345-0@lo:400:kworker.0 Request processed in 1761us (4096us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319495.164395:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943
00000100:00100000:1.0:1767319495.164440:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940534912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319495.167132:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319495.167527:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940534784
00000100:00100000:2.0:1767319495.167539:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940534784
00000100:00100000:2.0:1767319495.167622:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944
00000100:00100000:2.0:1767319495.167633:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940534784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319495.167699:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940534784:12345-0@lo:400:kworker.0 Request processed in 68us (574us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319495.167706:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944
00000100:00080000:0.0:1767319495.167770:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319495.167834:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940534784:0@lo:400:kworker.0
00000100:00080000:3.0:1767319495.169038:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319495.169047:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319495.169052:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940535168:0@lo:38:kworker.0
00000100:00100000:3.0:1767319495.169063:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940535424:0@lo:38:kworker.0
00000100:00100000:3.0:1767319495.170121:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319495.170175:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319495.170181:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319495.170185:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940534528:0@lo:38:kworker.0
00000100:00080000:3.0:1767319495.170200:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319495.170205:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319495.170208:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940534656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319495.170415:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535424
00000100:00100000:2.0:1767319495.170425:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535424
00000100:00100000:2.0:1767319495.170479:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17114
00000100:00100000:2.0:1767319495.170487:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940535424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319495.170510:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319495.170563:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940535424:12345-0@lo:38:kworker.0 Request processed in 76us (446us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319495.170570:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17114
00000100:00080000:3.0:1767319495.170745:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319495.170750:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319495.170753:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940535424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319495.854540:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319496.110814:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319496.687327:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940535552:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319496.687395:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319496.687544:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535552
00000100:00100000:1.0:1767319496.687559:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535552
00000100:00100000:1.0:1767319496.687614:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490
00000100:00100000:1.0:1767319496.687622:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940535552:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319496.687649:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319496.687953:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940535552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 330us (555us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319496.687960:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490
00000100:00100000:0.0:1767319496.688106:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940535552:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319496.775136:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319496.775471:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322048
00000100:00100000:2.0:1767319496.775483:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322048
00000100:00100000:2.0:1767319496.775563:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4527
00000100:00100000:2.0:1767319496.775573:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894322048:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319496.775680:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894322048:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 109us (553us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319496.775691:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4527
00000100:00080000:0.0:1767319496.776117:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319496.780764:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319496.781016:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894321920
00000100:00100000:3.0:1767319496.781029:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894321920
00000100:00100000:3.0:1767319496.781084:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17115
00000100:00100000:3.0:1767319496.781093:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894321920:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319496.781696:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319496.781840:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894321920:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 745us (1086us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319496.781849:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17115
00000100:00100000:2.0:1767319496.877866:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319497.135015:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319497.709377:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319497.709399:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940535680:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319497.709469:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319497.709766:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535680
00000100:00100000:1.0:1767319497.709797:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535680
00000100:00100000:1.0:1767319497.709873:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491
00000100:00100000:1.0:1767319497.709896:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940535680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319497.709937:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319497.709998:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940535680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (529us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319497.710006:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491
00000100:00100000:2.0:1767319497.710055:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940535680:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319497.710108:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319497.900911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319498.157058:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319498.924943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319499.182445:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319499.948913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319500.207843:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319500.269137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319500.269151:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319500.269154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319500.269159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319500.269164:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319500.269173:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4745
00000100:00080000:3.0:1767319500.269180:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319500.269188:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319500.269237:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50aded80 x1853163940535808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319500.269257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319500.269261:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319500.269262:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319500.269265:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4745
00000100:00080000:3.0:1767319500.269268:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319500.269271:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319500.269288:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940535936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319500.269367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319500.269369:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319500.269371:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319500.269375:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4745
00000100:00080000:3.0:1767319500.269377:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319500.269381:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319500.269391:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760f800 x1853163940536448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319500.269404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319500.269406:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319500.269408:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319500.269411:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4745
00000100:00080000:3.0:1767319500.269413:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319500.269416:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319500.269426:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ea00 x1853163940536704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319500.269495:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940536576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319500.269561:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319500.269640:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319500.269675:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319500.269754:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319500.269760:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319500.269805:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319500.269850:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536064
00000100:00100000:1.0:1767319500.269868:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536064
00000100:00100000:1.0:1767319500.269923:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536192
00000100:00100000:1.0:1767319500.269927:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536192
00000100:00100000:1.0:1767319500.270041:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945
00000100:00100000:1.0:1767319500.270050:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319500.270348:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536064:12345-0@lo:400:kworker.0 Request processed in 298us (670us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319500.270357:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945
00000100:00100000:1.0:1767319500.270375:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946
00000100:00100000:1.0:1767319500.270381:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319500.270408:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536192:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319500.270414:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946
00000100:00080000:1.0:1767319500.270456:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319500.270460:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319500.270492:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940535808:0@lo:38:kworker.0
00000100:00100000:1.0:1767319500.270525:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940536320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319500.270881:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319500.270971:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319500.270984:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319500.280098:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940535936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319500.280166:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319500.280187:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940536448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319500.280209:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319500.280651:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535936
00000100:00100000:1.0:1767319500.280660:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535936
00000100:00100000:1.0:1767319500.280719:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113
00000100:00100000:1.0:1767319500.280727:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940535936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319500.280755:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319500.280821:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940535936:12345-0@lo:38:kworker.0 Request processed in 93us (654us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319500.280829:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113
00000100:00100000:3.0:1767319500.284488:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536576
00000100:00100000:3.0:1767319500.284511:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536576
00000100:00100000:3.0:1767319500.284606:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940535808
00000100:00100000:3.0:1767319500.284610:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940535808
00000100:00100000:3.0:1767319500.284635:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4528
00000100:00100000:3.0:1767319500.284649:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940536576:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319500.284807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319500.284852:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17116
00000100:00100000:1.0:1767319500.284868:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940535808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319500.284891:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319500.284972:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940535808:12345-0@lo:38:kworker.0 Request processed in 111us (14091us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319500.284982:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17116
00000100:00100000:3.0:1767319500.284982:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940536576:12345-0@lo:400:kworker.0 Request processed in 337us (15418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319500.284994:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4528
00000100:00100000:1.0:1767319500.285053:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940536576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319500.285342:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319500.285381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940536704:0@lo:38:kworker.0
00000100:00100000:2.0:1767319500.285416:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319500.285437:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536448
00000100:00100000:2.0:1767319500.285441:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536448
00000100:00100000:2.0:1767319500.285467:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536320
00000100:00100000:2.0:1767319500.285470:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536320
00000100:00100000:2.0:1767319500.285496:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536704
00000100:00100000:2.0:1767319500.285499:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536704
00000100:00100000:2.0:1767319500.285510:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4529
00000100:00100000:2.0:1767319500.285516:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940536320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319500.285552:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940536320:12345-0@lo:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319500.285558:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4529
00000100:00100000:2.0:1767319500.285571:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17117
00000100:00100000:2.0:1767319500.285575:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940536448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319500.285586:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319500.285610:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940536448:12345-0@lo:38:kworker.0 Request processed in 34us (5401us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319500.285615:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17117
00000100:00100000:2.0:1767319500.285624:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17118
00000100:00100000:2.0:1767319500.285628:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940536704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319500.285635:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319500.285653:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940536704:12345-0@lo:38:kworker.0 Request processed in 24us (237us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319500.285657:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17118
00000100:00080000:2.0:1767319500.285672:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319500.287041:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940536320:0@lo:400:kworker.0
00000100:00080000:2.0:1767319500.287100:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319500.287105:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319500.287109:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940536704:0@lo:38:kworker.0
00000100:00080000:2.0:1767319500.287128:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319500.287132:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319500.287135:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940535808:0@lo:38:kworker.0
00000100:00080000:2.0:1767319500.287145:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319500.287149:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319500.287152:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940535936:0@lo:38:kworker.0
00000100:00080000:2.0:1767319500.287160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319500.287164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319500.287167:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940536448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319500.972906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319501.229429:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319501.805742:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319501.805771:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940536832:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319501.805891:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319501.806548:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536832
00000100:00100000:2.0:1767319501.806557:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536832
00000100:00100000:2.0:1767319501.806611:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492
00000100:00100000:2.0:1767319501.806620:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940536832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319501.806650:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319501.806867:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940536832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 246us (975us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319501.806875:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492
00000100:00100000:1.0:1767319501.806966:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940536832:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319501.897229:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319501.897349:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767319501.897423:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894322432 offset 0 length 520: 4
00000100:00100000:0.0:1767319501.897514:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322304
00000100:00100000:0.0:1767319501.897525:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322304
00000100:00100000:0.0:1767319501.897608:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322176
00000100:00100000:0.0:1767319501.897611:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322176
00000100:00100000:0.0:1767319501.897631:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4530
00000100:00100000:0.0:1767319501.897640:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894322304:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319501.897724:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894322304:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319501.897732:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4530
00000100:00100000:0.0:1767319501.898236:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17119
00000100:00100000:0.0:1767319501.898242:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894322176:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319501.898263:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319501.898297:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894322176:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (948us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319501.898304:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17119
00000100:00080000:2.0:1767319501.898407:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319501.996948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319502.253079:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319502.829993:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319502.830018:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536960:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319502.830085:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319502.830199:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940536960
00000100:00100000:1.0:1767319502.830218:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940536960
00000100:00100000:1.0:1767319502.830283:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493
00000100:00100000:1.0:1767319502.830294:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319502.830325:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319502.830370:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940536960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319502.830377:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493
00000100:00100000:0.0:1767319502.830616:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940536960:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319502.832582:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319503.020935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319503.277268:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319504.044981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319504.301106:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319505.069025:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319505.325171:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319505.389341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319505.389354:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319505.389357:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319505.389361:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319505.389366:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319505.389374:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4750
00000100:00080000:2.0:1767319505.389378:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319505.389385:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319505.389429:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459faa00 x1853163940537088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319505.389447:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319505.389451:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319505.389454:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319505.389458:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4750
00000100:00080000:2.0:1767319505.389460:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319505.389464:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319505.389479:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940537216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319505.389574:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319505.389577:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319505.389579:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319505.389582:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4750
00000100:00080000:2.0:1767319505.389585:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319505.389589:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319505.389601:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210a80 x1853163940537728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319505.389615:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319505.389618:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319505.389621:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319505.389623:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4750
00000100:00080000:2.0:1767319505.389625:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319505.389628:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319505.389637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211880 x1853163940537984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319505.389666:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940537856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319505.389745:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.389753:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940537088:0@lo:38:kworker.0
00000100:00100000:1.0:1767319505.389805:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319505.389846:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319505.389850:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537856
00000100:00100000:2.0:1767319505.389855:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940537600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.389859:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537856
00000100:00100000:2.0:1767319505.389882:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.389915:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537088
00000100:00100000:1.0:1767319505.389919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537088
00000100:00100000:1.0:1767319505.389937:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537600
00000100:00100000:1.0:1767319505.389941:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537600
00000100:00100000:1.0:1767319505.389966:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531
00000100:00100000:1.0:1767319505.389974:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940537856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.390029:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940537856:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319505.390035:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531
00000100:00100000:1.0:1767319505.390052:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532
00000100:00100000:1.0:1767319505.390059:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940537600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.390085:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940537600:12345-0@lo:400:kworker.0 Request processed in 27us (203us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319505.390091:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532
00000100:00100000:1.0:1767319505.390104:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17120
00000100:00100000:1.0:1767319505.390120:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940537088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319505.390140:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319505.390170:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940537088:12345-0@lo:38:kworker.0 Request processed in 59us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319505.390176:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17120
00000100:00100000:1.0:1767319505.390386:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940537600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.390397:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940537856:0@lo:400:kworker.0
00000100:00080000:1.0:1767319505.390433:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319505.390438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319505.390442:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940537088:0@lo:38:kworker.0
00000100:00100000:1.0:1767319505.390449:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940537216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319505.390479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.390516:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940537728:0@lo:38:kworker.0
00000100:00100000:3.0:1767319505.390535:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940537344:0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.390543:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.390568:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537728
00000100:00100000:1.0:1767319505.390572:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537728
00000100:00100000:3.0:1767319505.390592:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.390597:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17121
00000100:00100000:1.0:1767319505.390603:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940537728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319505.390616:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319505.390627:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319505.390635:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940537472:0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.390648:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940537728:12345-0@lo:38:kworker.0 Request processed in 42us (104us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319505.390657:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17121
00000100:00100000:3.0:1767319505.390663:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.390684:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537344
00000100:00100000:1.0:1767319505.390689:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537344
00000100:00100000:1.0:1767319505.390722:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537472
00000100:00080000:3.0:1767319505.390723:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319505.390726:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537472
00000100:00080000:3.0:1767319505.390730:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319505.390765:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947
00000100:00100000:2.0:1767319505.390799:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537216
00000100:00100000:2.0:1767319505.390804:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537216
00000100:00100000:3.0:1767319505.390817:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940537344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319505.390841:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114
00000100:00100000:2.0:1767319505.390849:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940537216:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319505.390862:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940537344:12345-0@lo:400:kworker.0 Request processed in 89us (270us total) trans 0 rc 0/0
00010000:00020000:2.0:1767319505.390863:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319505.390873:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947
00000100:00100000:2.0:1767319505.390899:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940537216:12345-0@lo:38:kworker.0 Request processed in 49us (418us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319505.390907:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114
00000100:00100000:3.0:1767319505.390928:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940537344:0@lo:400:kworker.0
00000100:00080000:0.0:1767319505.392026:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319505.392034:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319505.392038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940537728:0@lo:38:kworker.0
00000100:00100000:0.0:1767319505.392048:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940537984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319505.392306:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319505.392367:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319505.392372:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319505.392375:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940537216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319505.392524:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940537984
00000100:00100000:2.0:1767319505.392529:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940537984
00000100:00100000:2.0:1767319505.392576:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17122
00000100:00100000:2.0:1767319505.392581:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940537984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319505.392599:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319505.392643:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940537984:12345-0@lo:38:kworker.0 Request processed in 60us (337us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319505.392650:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17122
00000100:00080000:0.0:1767319505.392840:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319505.392845:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319505.392848:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940537984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319505.394056:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948
00000100:00100000:1.0:1767319505.394070:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940537472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319505.394156:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940537472:12345-0@lo:400:kworker.0 Request processed in 90us (3494us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319505.394163:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948
00000100:00100000:2.0:1767319505.394218:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940537472:0@lo:400:kworker.0
00000100:00080000:3.0:1767319505.394389:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319506.092934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319506.351551:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319506.925496:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319506.925520:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940538112:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319506.925594:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319506.925727:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538112
00000100:00100000:3.0:1767319506.925736:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538112
00000100:00100000:3.0:1767319506.925814:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494
00000100:00100000:3.0:1767319506.925824:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940538112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319506.925857:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319506.925925:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940538112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (331us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319506.925933:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494
00000100:00100000:0.0:1767319506.926218:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940538112:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319507.017142:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319507.017192:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319507.017243:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322688
00000100:00100000:2.0:1767319507.017256:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322688
00000100:00100000:0.0:1767319507.017288:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322560
00000100:00100000:0.0:1767319507.017295:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322560
00000100:00100000:0.0:1767319507.017358:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4533
00000100:00080000:3.0:1767319507.017370:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319507.017413:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894322688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319507.017490:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894322688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 125us (360us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319507.017496:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4533
00000100:00100000:0.0:1767319507.017512:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17123
00000100:00100000:0.0:1767319507.017515:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894322560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319507.017535:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319507.017554:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894322560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (362us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319507.017558:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17123
00000100:00100000:2.0:1767319507.117749:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319507.373095:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319507.949667:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319507.949693:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940538240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319507.949817:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.953694:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538240
00000100:00100000:1.0:1767319507.954935:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538240
00000100:00100000:1.0:1767319507.955375:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495
00000100:00100000:1.0:1767319507.955389:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940538240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319507.955448:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319507.955583:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940538240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 197us (5764us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319507.955591:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495
00000100:00080000:3.0:1767319507.955728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319507.956013:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940538240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319508.140932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319508.397758:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319509.166141:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319509.421005:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319509.487155:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319484/real 1767319484]  req@ffff93cf50adfb80 x1853163940531840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319509.487188:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf50adfb80 x1853163940531840/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319509.487206:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319509.487236:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319509.487239:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940531840:0@lo:250:kworker.0
00000100:00080000:2.0:1767319509.487412:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319509.487418:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319509.487421:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319509.487426:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4734
00000100:00080000:2.0:1767319509.487430:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319509.487436:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319509.487467:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212d80 x1853163940538368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319509.487495:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319509.487499:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319509.487501:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319509.487504:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4755
00000100:00080000:2.0:1767319509.487506:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319509.487510:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319509.487526:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211f80 x1853163940538496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319509.487535:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319509.487539:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319509.487540:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319509.487543:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4755
00000100:00080000:2.0:1767319509.487546:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319509.487549:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319509.487561:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940538624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319509.487627:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319509.487670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940538368:0@lo:250:kworker.0
00000400:00000100:0.0:1767319509.487736:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940538368 offset 0 length 520: 4
00000100:00100000:0.0:1767319509.487826:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940538496:0@lo:38:kworker.0
00000100:00100000:0.0:1767319509.487863:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319509.487884:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940538624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319509.487908:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319509.487945:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538496
00000100:00100000:0.0:1767319509.487952:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538496
00000100:00100000:0.0:1767319509.487987:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17124
00000100:00100000:0.0:1767319509.487994:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940538496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319509.488015:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319509.488055:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940538496:12345-0@lo:38:kworker.0 Request processed in 60us (191us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319509.488062:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17124
00000100:00100000:0.0:1767319509.488084:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538624
00000100:00100000:0.0:1767319509.488088:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538624
00000100:00100000:0.0:1767319509.488108:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115
00000100:00100000:0.0:1767319509.488113:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940538624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319509.488123:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319509.488148:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940538624:12345-0@lo:38:kworker.0 Request processed in 33us (238us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319509.488154:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115
00000100:00080000:0.0:1767319509.488190:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319509.488194:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319509.488198:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940538496:0@lo:38:kworker.0
00000100:00080000:0.0:1767319509.488208:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319509.488211:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319509.488213:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940538624:0@lo:38:kworker.0
00000100:00100000:3.0:1767319509.492051:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940538880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319509.492130:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319509.492170:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940538752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319509.492191:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319509.493516:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319509.493521:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319509.493525:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319509.493531:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4755
00000100:00080000:2.0:1767319509.493536:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319509.493543:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319509.493565:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940539136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319509.493591:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319509.493594:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319509.493596:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319509.493600:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4755
00000100:00080000:2.0:1767319509.493602:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319509.493605:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319509.493616:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211880 x1853163940539392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319509.493646:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940539008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.493922:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319509.493954:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319509.493960:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940539264:0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.493984:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319509.494020:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539008
00000100:00100000:2.0:1767319509.494027:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539008
00000100:00100000:2.0:1767319509.494076:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539264
00000100:00100000:2.0:1767319509.494080:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539264
00000100:00100000:2.0:1767319509.494103:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4534
00000100:00100000:2.0:1767319509.494112:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940539008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.494160:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940539008:12345-0@lo:400:kworker.0 Request processed in 49us (237us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319509.494167:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4534
00000100:00100000:2.0:1767319509.494185:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4535
00000100:00100000:2.0:1767319509.494191:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940539264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.494221:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940539264:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319509.494227:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4535
00000100:00100000:2.0:1767319509.494272:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940539264:0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.494283:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940539008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319509.494307:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940539136:0@lo:38:kworker.0
00000100:00100000:2.0:1767319509.494331:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319509.494348:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940539392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319509.494368:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319509.494393:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539136
00000100:00100000:2.0:1767319509.494397:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539136
00000100:00100000:2.0:1767319509.494416:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539392
00000100:00100000:2.0:1767319509.494418:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539392
00000100:00100000:2.0:1767319509.494434:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17125
00000100:00100000:2.0:1767319509.494439:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940539136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319509.494458:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319509.494489:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940539136:12345-0@lo:38:kworker.0 Request processed in 48us (158us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319509.494496:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17125
00000100:00100000:2.0:1767319509.494507:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17126
00000100:00100000:2.0:1767319509.494511:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940539392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319509.494520:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319509.494544:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940539392:12345-0@lo:38:kworker.0 Request processed in 31us (175us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319509.494549:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17126
00000100:00080000:2.0:1767319509.494576:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319509.494581:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319509.494585:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940539136:0@lo:38:kworker.0
00000100:00080000:2.0:1767319509.494593:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319509.494596:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319509.494599:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940539392:0@lo:38:kworker.0
00000100:00080000:3.0:1767319509.499021:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319509.499160:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538880
00000100:00100000:1.0:1767319509.499173:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538880
00000100:00100000:1.0:1767319509.499273:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940538752
00000100:00100000:1.0:1767319509.499277:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940538752
00000100:00100000:1.0:1767319509.499302:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949
00000100:00100000:1.0:1767319509.499311:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940538880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319509.499412:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940538880:12345-0@lo:400:kworker.0 Request processed in 102us (7282us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319509.499420:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949
00000100:00100000:1.0:1767319509.499438:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950
00000100:00100000:1.0:1767319509.499444:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940538752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319509.499474:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940538752:12345-0@lo:400:kworker.0 Request processed in 30us (7282us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319509.499479:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950
00000100:00080000:3.0:1767319509.499551:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319509.499554:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319509.499596:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940538880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319509.499610:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940538752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319510.188987:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319510.445066:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319511.212984:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319511.468984:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319512.044997:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319512.045028:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940539520:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319512.045101:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319512.045168:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539520
00000100:00100000:3.0:1767319512.045178:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539520
00000100:00100000:3.0:1767319512.045248:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496
00000100:00100000:3.0:1767319512.045258:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940539520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319512.045292:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319512.045343:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940539520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (242us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319512.045350:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496
00000100:00080000:0.0:1767319512.046045:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319512.046090:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940539520:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319512.140993:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319512.141043:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319512.141147:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322944
00000100:00100000:3.0:1767319512.141159:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322944
00000100:00100000:3.0:1767319512.141230:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894322816
00000100:00100000:3.0:1767319512.141233:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894322816
00000100:00100000:3.0:1767319512.141253:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4536
00000100:00100000:3.0:1767319512.141266:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894322944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319512.141345:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894322944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319512.141353:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4536
00000100:00100000:3.0:1767319512.141375:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17127
00000100:00100000:3.0:1767319512.141380:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894322816:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319512.141402:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319512.141443:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894322816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (388us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319512.141450:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17127
00000100:00080000:0.0:1767319512.141858:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319512.236936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319512.497315:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319513.069219:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319513.069244:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940539648:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319513.069311:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319513.069432:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539648
00000100:00100000:1.0:1767319513.069440:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539648
00000100:00100000:1.0:1767319513.069508:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497
00000100:00100000:1.0:1767319513.069517:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940539648:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319513.069546:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319513.069590:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940539648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319513.069598:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497
00000100:00080000:3.0:1767319513.069669:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319513.069751:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940539648:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319513.260935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319513.517035:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319514.284919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319514.543706:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319514.605122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319514.605133:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319514.605136:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319514.605140:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319514.605145:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319514.605153:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4759
00000100:00080000:3.0:1767319514.605159:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319514.605167:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319514.605215:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ce00 x1853163940539776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319514.605246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319514.605250:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319514.605252:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319514.605255:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4759
00000100:00080000:3.0:1767319514.605258:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319514.605262:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319514.605274:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940539904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319514.605318:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940539776:0@lo:38:kworker.0
00000100:00080000:3.0:1767319514.605350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319514.605355:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319514.605356:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319514.605360:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4759
00000100:00080000:3.0:1767319514.605364:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319514.605369:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319514.605381:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d180 x1853163940540416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319514.605401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319514.605404:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319514.605406:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319514.605410:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4759
00000100:00080000:3.0:1767319514.605415:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319514.605416:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319514.605421:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319514.605433:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319514.605436:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e680 x1853163940540672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319514.605466:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940540288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319514.605478:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319514.605500:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940539904:0@lo:38:kworker.0
00000100:00100000:3.0:1767319514.605510:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319514.605516:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319514.605525:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.605834:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319514.605859:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940540416:0@lo:38:kworker.0
00000100:00100000:0.0:1767319514.605885:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319514.605902:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940540672:0@lo:38:kworker.0
00000100:00100000:0.0:1767319514.605936:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319514.605966:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940540544:0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.605990:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319514.606022:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539776
00000100:00100000:0.0:1767319514.606042:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539776
00000100:00100000:0.0:1767319514.606072:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540288
00000100:00100000:0.0:1767319514.606075:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540288
00000100:00100000:0.0:1767319514.606115:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540416
00000100:00100000:0.0:1767319514.606119:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540416
00000100:00100000:0.0:1767319514.606127:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540672
00000100:00100000:0.0:1767319514.606129:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540672
00000100:00100000:0.0:1767319514.606137:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540544
00000100:00100000:0.0:1767319514.606139:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540544
00000100:00100000:0.0:1767319514.606157:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4537
00000100:00100000:0.0:1767319514.606165:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940540288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319514.606244:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940540288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319514.606277:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4538
00000100:00100000:3.0:1767319514.606288:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940540544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319514.606326:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940540544:12345-0@lo:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319514.606337:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4538
00000100:00100000:3.0:1767319514.606362:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17128
00000100:00100000:3.0:1767319514.606366:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940539776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319514.606386:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319514.606421:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940539776:12345-0@lo:38:kworker.0 Request processed in 53us (1009us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319514.606426:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17128
00000100:00100000:3.0:1767319514.606438:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17129
00000100:00100000:3.0:1767319514.606441:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940540416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319514.606450:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319514.606470:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940540416:12345-0@lo:38:kworker.0 Request processed in 27us (585us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319514.606475:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17129
00000100:00100000:3.0:1767319514.606486:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17130
00000100:00100000:3.0:1767319514.606489:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940540672:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319514.606497:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319514.606521:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940540672:12345-0@lo:38:kworker.0 Request processed in 30us (584us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319514.606526:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17130
00000100:00080000:3.0:1767319514.606543:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319514.606566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319514.606571:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319514.606575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940540416:0@lo:38:kworker.0
00000100:00080000:3.0:1767319514.606584:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319514.606587:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319514.606590:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940540672:0@lo:38:kworker.0
00000100:00080000:3.0:1767319514.606596:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319514.606599:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319514.606602:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940539776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319514.606660:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940539904
00000100:00100000:3.0:1767319514.606664:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940539904
00000100:00100000:3.0:1767319514.606685:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116
00000100:00100000:3.0:1767319514.606689:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940539904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319514.606699:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319514.607881:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940540288:12345-0@lo:400:kworker.0 Request processed in 1712us (2368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319514.607893:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4537
00000100:00100000:0.0:1767319514.608231:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940540544:0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.609410:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540032
00000100:00100000:0.0:1767319514.609420:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540032
00000100:00100000:0.0:1767319514.609913:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951
00000100:00100000:0.0:1767319514.609926:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.610471:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540032:12345-0@lo:400:kworker.0 Request processed in 546us (4991us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319514.610556:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951
00000100:00080000:0.0:1767319514.610588:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319514.610844:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319514.610850:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319514.610853:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940539904:0@lo:38:kworker.0
00000100:00100000:3.0:1767319514.612432:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940539904:12345-0@lo:38:kworker.0 Request processed in 36us (894us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319514.612452:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116
00000100:00100000:1.0:1767319514.613912:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319514.614012:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.614088:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540160
00000100:00100000:0.0:1767319514.614096:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540160
00000100:00100000:0.0:1767319514.614163:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952
00000100:00100000:0.0:1767319514.614173:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319514.614295:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540160:12345-0@lo:400:kworker.0 Request processed in 123us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319514.614302:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952
00000100:00100000:1.0:1767319514.614933:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540160:0@lo:400:kworker.0
00000100:00100000:2.0:1767319515.308921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319515.568214:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319516.334930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319516.589838:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319517.165991:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319517.166016:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940540800:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319517.166097:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319517.166317:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540800
00000100:00100000:3.0:1767319517.166325:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540800
00000100:00100000:3.0:1767319517.166394:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498
00000100:00100000:3.0:1767319517.166406:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940540800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319517.166439:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319517.166486:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940540800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319517.166494:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498
00000100:00100000:3.0:1767319517.166547:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940540800:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319517.166829:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319517.255476:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319517.258413:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323200
00000100:00100000:0.0:1767319517.258429:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323200
00000100:00100000:0.0:1767319517.258518:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4539
00000100:00100000:0.0:1767319517.258525:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894323200:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767319517.258796:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319517.259207:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894323200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 681us (3738us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319517.259216:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4539
00000100:00100000:1.0:1767319517.261235:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319517.261534:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323072
00000100:00100000:0.0:1767319517.261546:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323072
00000100:00100000:0.0:1767319517.261591:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17131
00000100:00100000:0.0:1767319517.261612:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894323072:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319517.261637:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319517.261736:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894323072:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 125us (511us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319517.261744:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17131
00000100:00100000:2.0:1767319517.358884:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319517.614075:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319518.191689:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319518.191720:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540928:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319518.191805:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319518.192019:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940540928
00000100:00100000:1.0:1767319518.192028:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940540928
00000100:00100000:1.0:1767319518.192098:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499
00000100:00100000:1.0:1767319518.192108:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319518.192139:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319518.192193:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940540928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (389us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319518.192201:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499
00000100:00100000:2.0:1767319518.192292:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940540928:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319518.195127:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319518.380920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319518.636984:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319519.404931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319519.661472:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319519.724934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319519.724946:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319519.724948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319519.724952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319519.724957:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319519.724966:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4764
00000100:00080000:3.0:1767319519.724971:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319519.724979:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319519.725020:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940541056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319519.725092:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940541056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319519.725211:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319519.725425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319519.725429:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319519.725431:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319519.725436:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4764
00000100:00080000:3.0:1767319519.725438:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319519.725442:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319519.725459:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ea00 x1853163940541184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319519.725600:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541056
00000100:00100000:1.0:1767319519.725608:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541056
00000100:00100000:1.0:1767319519.725655:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17132
00000100:00100000:1.0:1767319519.725663:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319519.725694:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319519.725910:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940541184:0@lo:38:kworker.0
00000100:00100000:0.0:1767319519.725945:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319519.726014:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541184
00000100:00100000:2.0:1767319519.726020:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541184
00000100:00100000:2.0:1767319519.726045:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117
00000100:00100000:2.0:1767319519.726050:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940541184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319519.726060:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319519.726105:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940541184:12345-0@lo:38:kworker.0 Request processed in 54us (159us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319519.726111:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117
00000100:00080000:3.0:1767319519.728881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319519.728888:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319519.728891:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319519.728898:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4764
00000100:00080000:3.0:1767319519.728902:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319519.728908:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319519.728924:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760ce00 x1853163940541696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319519.728940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319519.728944:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319519.728945:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319519.728948:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4764
00000100:00080000:3.0:1767319519.728950:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319519.728953:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319519.728962:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d180 x1853163940541952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319519.728995:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940541568:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729053:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319519.729239:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319519.729246:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940541824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729272:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319519.729303:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541568
00000100:00100000:3.0:1767319519.729309:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541568
00000100:00100000:3.0:1767319519.729355:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541824
00000100:00100000:3.0:1767319519.729358:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541824
00000100:00100000:3.0:1767319519.729398:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4540
00000100:00100000:3.0:1767319519.729406:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940541568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729518:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940541568:12345-0@lo:400:kworker.0 Request processed in 113us (464us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319519.729526:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4540
00000100:00100000:3.0:1767319519.729544:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4541
00000100:00100000:3.0:1767319519.729550:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940541824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729576:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940541824:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319519.729582:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4541
00000100:00080000:3.0:1767319519.729599:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319519.729632:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940541824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729640:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940541568:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729693:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940541440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.729720:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319519.729749:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319519.729755:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940541312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.730129:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319519.730163:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541440
00000100:00100000:3.0:1767319519.730167:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541440
00000100:00100000:3.0:1767319519.730195:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541312
00000100:00100000:3.0:1767319519.730198:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541312
00000100:00100000:3.0:1767319519.730221:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953
00000100:00100000:3.0:1767319519.730226:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940541440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.730260:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940541440:12345-0@lo:400:kworker.0 Request processed in 33us (539us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319519.730266:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953
00000100:00100000:3.0:1767319519.730278:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954
00000100:00100000:3.0:1767319519.730283:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940541312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.730309:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940541312:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319519.730315:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954
00000100:00080000:3.0:1767319519.730335:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319519.730352:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940541312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319519.730592:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940541440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319519.731921:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541056:12345-0@lo:38:kworker.0 Request processed in 6251us (6703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319519.731932:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17132
00000100:00080000:0.0:1767319519.736017:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319519.736030:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319519.736035:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940541056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319519.736082:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940541696:0@lo:38:kworker.0
00000100:00100000:0.0:1767319519.736141:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319519.736180:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940541952:0@lo:38:kworker.0
00000100:00100000:0.0:1767319519.736199:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319519.736225:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319519.736229:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319519.736232:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940541184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319519.736695:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541696
00000100:00100000:1.0:1767319519.736702:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541696
00000100:00100000:1.0:1767319519.736748:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940541952
00000100:00100000:1.0:1767319519.736751:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940541952
00000100:00100000:1.0:1767319519.736800:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17133
00000100:00100000:1.0:1767319519.736807:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319519.736827:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319519.736875:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541696:12345-0@lo:38:kworker.0 Request processed in 67us (733us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319519.736882:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17133
00000100:00100000:1.0:1767319519.736897:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17134
00000100:00100000:1.0:1767319519.736901:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319519.736910:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319519.736931:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940541952:12345-0@lo:38:kworker.0 Request processed in 29us (731us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319519.736936:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17134
00000100:00080000:0.0:1767319519.737204:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319519.737210:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319519.737213:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940541696:0@lo:38:kworker.0
00000100:00080000:0.0:1767319519.737221:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319519.737223:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319519.737225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940541952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319520.428916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319520.684977:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319521.453177:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319521.709574:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319522.285096:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940542080:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319522.285189:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319522.285311:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542080
00000100:00100000:3.0:1767319522.285320:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542080
00000100:00100000:3.0:1767319522.285393:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1767319522.285403:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940542080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319522.285443:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767319522.285688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319522.288959:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940542080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3545us (3758us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319522.288975:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500
00000100:00100000:2.0:1767319522.289704:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940542080:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319522.378978:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319522.379041:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319522.379386:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323456
00000100:00100000:3.0:1767319522.379396:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323456
00000100:00100000:3.0:1767319522.379481:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323328
00000100:00100000:3.0:1767319522.379485:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323328
00000100:00100000:3.0:1767319522.379506:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4542
00000100:00100000:3.0:1767319522.379517:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894323456:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319522.379603:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894323456:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (638us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319522.379611:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4542
00000100:00100000:3.0:1767319522.379633:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17135
00000100:00100000:3.0:1767319522.379637:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894323328:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319522.379670:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319522.379712:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894323328:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 72us (670us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319522.379719:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17135
00000100:00080000:1.0:1767319522.380164:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319522.476907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319522.733096:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319523.309098:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319523.309123:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940542208:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319523.309209:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319523.312230:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542208
00000100:00100000:3.0:1767319523.312250:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542208
00000100:00100000:3.0:1767319523.312342:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501
00000100:00100000:3.0:1767319523.312354:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940542208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319523.312387:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319523.312475:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940542208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (3264us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319523.312482:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501
00000100:00100000:2.0:1767319523.312757:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940542208:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319523.312929:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319523.500972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319523.757132:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319524.524898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319524.781005:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319524.845403:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319524.845416:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319524.845419:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319524.845422:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319524.845427:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319524.845435:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4769
00000100:00080000:0.0:1767319524.845440:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319524.845447:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319524.845489:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92a00 x1853163940542336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319524.845510:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319524.845513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319524.845516:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319524.845520:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4769
00000100:00080000:0.0:1767319524.845522:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319524.845526:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319524.845540:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91500 x1853163940542464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319524.845580:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940542592:0@lo:400:kworker.0
00000100:00080000:0.0:1767319524.845598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319524.845601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319524.845603:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319524.845607:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4769
00000100:00080000:0.0:1767319524.845609:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319524.845613:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319524.845681:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319524.845695:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940542848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319524.845706:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319524.845811:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92300 x1853163940542976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319524.845831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319524.845834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319524.845835:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319524.845838:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4769
00000100:00080000:0.0:1767319524.845841:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319524.845844:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319524.845856:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91180 x1853163940543232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319524.845899:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940542336:0@lo:38:kworker.0
00000100:00100000:1.0:1767319524.846227:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319524.846282:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940543104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319524.846308:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319524.846348:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542848
00000100:00100000:1.0:1767319524.846359:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542848
00000100:00100000:1.0:1767319524.846415:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543104
00000100:00100000:1.0:1767319524.846418:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543104
00000100:00100000:1.0:1767319524.846446:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4543
00000100:00100000:1.0:1767319524.846452:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940542848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319524.846503:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940542848:12345-0@lo:400:kworker.0 Request processed in 49us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319524.846509:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4543
00000100:00100000:1.0:1767319524.846526:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544
00000100:00100000:1.0:1767319524.846533:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940543104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319524.846553:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940543104:12345-0@lo:400:kworker.0 Request processed in 21us (245us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319524.846556:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544
00000100:00080000:1.0:1767319524.846568:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319524.846594:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940543104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319524.846601:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940542848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319524.846919:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319524.846928:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940542720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319524.846960:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319524.847001:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542592
00000100:00100000:1.0:1767319524.847006:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542592
00000100:00100000:3.0:1767319524.847007:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542720
00000100:00100000:3.0:1767319524.847012:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542720
00000100:00100000:1.0:1767319524.847037:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955
00000100:00100000:1.0:1767319524.847044:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940542592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319524.847048:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1767319524.847058:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940542720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319524.847077:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940542592:12345-0@lo:400:kworker.0 Request processed in 34us (1372us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319524.847083:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955
00000100:00100000:3.0:1767319524.847102:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940542720:12345-0@lo:400:kworker.0 Request processed in 44us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319524.847109:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1767319524.847146:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940542720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319524.847156:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940542592:0@lo:400:kworker.0
00000100:00080000:1.0:1767319524.847280:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319524.847329:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319524.847357:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940542464:0@lo:38:kworker.0
00000100:00100000:0.0:1767319524.847374:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319524.847388:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940542976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319524.847400:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319524.847412:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940543232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319524.847426:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319524.847442:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542464
00000100:00100000:2.0:1767319524.847448:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542464
00000100:00100000:0.0:1767319524.847457:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542336
00000100:00100000:0.0:1767319524.847462:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542336
00000100:00100000:2.0:1767319524.847477:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118
00000100:00100000:2.0:1767319524.847484:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940542464:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319524.847489:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940542976
00000100:00100000:0.0:1767319524.847493:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940542976
00010000:00020000:2.0:1767319524.847504:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319524.847508:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543232
00000100:00100000:0.0:1767319524.847512:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543232
00000100:00100000:0.0:1767319524.847533:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17136
00000100:00100000:0.0:1767319524.847538:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940542336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319524.847549:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319524.847593:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17137
00000100:00100000:1.0:1767319524.847596:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940542976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319524.847603:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319524.847721:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138
00000100:00100000:3.0:1767319524.847725:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940543232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319524.847732:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319524.847896:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940542464:12345-0@lo:38:kworker.0 Request processed in 410us (519us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319524.847904:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118
00000100:00100000:0.0:1767319524.849297:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940542336:12345-0@lo:38:kworker.0 Request processed in 1753us (1962us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319524.849305:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17136
00000100:00080000:0.0:1767319524.849348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319524.849351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319524.849354:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940542336:0@lo:38:kworker.0
00000100:00080000:0.0:1767319524.849362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319524.849364:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319524.849367:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940542464:0@lo:38:kworker.0
00000100:00100000:1.0:1767319524.850338:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940542976:12345-0@lo:38:kworker.0 Request processed in 2735us (2932us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319524.850347:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17137
00000100:00080000:2.0:1767319524.850390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319524.850501:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319524.850505:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940542976:0@lo:38:kworker.0
00000100:00100000:3.0:1767319524.851299:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940543232:12345-0@lo:38:kworker.0 Request processed in 3568us (3868us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319524.851309:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138
00000100:00080000:2.0:1767319524.851370:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319524.851376:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319524.851379:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940543232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319525.548915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319525.805025:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319526.573008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319526.833799:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319527.406402:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319527.406443:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940543360:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319527.406561:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319527.406846:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543360
00000100:00100000:0.0:1767319527.406856:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543360
00000100:00100000:0.0:1767319527.406955:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502
00000100:00100000:0.0:1767319527.406967:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940543360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319527.407008:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319527.407065:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940543360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (503us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319527.407073:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502
00000100:00080000:1.0:1767319527.407343:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319527.407387:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940543360:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319527.497131:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319527.497220:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323712
00000100:00100000:2.0:1767319527.497231:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323712
00000100:00080000:3.0:1767319527.497413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319527.497459:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4545
00000100:00100000:0.0:1767319527.497474:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894323712:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319527.497569:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894323712:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (440us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319527.497578:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4545
00000100:00100000:1.0:1767319527.499888:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767319527.499944:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894323840 offset 0 length 520: 4
00000100:00100000:2.0:1767319527.499959:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323584
00000100:00100000:2.0:1767319527.499971:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323584
00000100:00100000:2.0:1767319527.500024:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17139
00000100:00100000:2.0:1767319527.500034:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894323584:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319527.500059:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319527.500128:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894323584:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (252us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319527.500136:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17139
00000100:00100000:2.0:1767319527.597755:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319527.853194:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319528.429232:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940543488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319528.429310:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319528.429460:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543488
00000100:00100000:0.0:1767319528.429469:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543488
00000100:00100000:0.0:1767319528.429546:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503
00000100:00100000:0.0:1767319528.429554:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940543488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319528.429585:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319528.429666:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940543488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (355us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319528.429674:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503
00000100:00100000:0.0:1767319528.429916:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940543488:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319528.430051:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319528.620928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319528.876990:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319529.645023:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319529.901240:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319529.968256:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319529.968269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319529.968272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319529.968276:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319529.968281:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319529.968290:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4774
00000100:00080000:3.0:1767319529.968295:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319529.968303:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319529.968345:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940543616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319529.968374:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319529.968377:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319529.968379:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319529.968383:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4774
00000100:00080000:3.0:1767319529.968385:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319529.968389:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319529.968404:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940543744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319529.968418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940543616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319529.968495:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319529.968500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319529.968505:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319529.968507:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319529.968512:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4774
00000100:00080000:3.0:1767319529.968515:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319529.968520:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319529.968581:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319529.968633:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319529.968704:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940543744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319529.968733:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319529.968769:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543744
00000100:00100000:2.0:1767319529.968792:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543744
00000100:00100000:2.0:1767319529.968824:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119
00000100:00100000:2.0:1767319529.968830:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940543744:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319529.968852:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319529.968892:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940543744:12345-0@lo:38:kworker.0 Request processed in 60us (157us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319529.968899:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119
00000100:00080000:2.0:1767319529.968939:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319529.968943:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319529.968947:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940543744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319529.968980:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319529.968988:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940544128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319529.969014:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319529.969051:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544000
00000100:00100000:2.0:1767319529.969056:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544000
00000100:00100000:2.0:1767319529.969112:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957
00000100:00100000:2.0:1767319529.969119:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319529.969154:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544000:12345-0@lo:400:kworker.0 Request processed in 36us (521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319529.969159:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957
00000100:00100000:1.0:1767319529.969254:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940543872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319529.969286:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319529.969329:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543616
00000100:00100000:1.0:1767319529.969333:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543616
00000100:00100000:1.0:1767319529.969356:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544128
00000100:00100000:1.0:1767319529.969360:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544128
00000100:00100000:1.0:1767319529.969392:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4546
00000100:00100000:1.0:1767319529.969400:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940544128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319529.969438:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940544128:12345-0@lo:400:kworker.0 Request processed in 39us (423us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319529.969444:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4546
00000100:00100000:1.0:1767319529.969459:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17140
00000100:00100000:1.0:1767319529.969463:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940543616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319529.969474:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319529.969503:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940543616:12345-0@lo:38:kworker.0 Request processed in 39us (1008us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319529.969509:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17140
00000100:00080000:1.0:1767319529.969525:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319529.969552:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940544128:0@lo:400:kworker.0
00000100:00080000:1.0:1767319529.969575:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319529.969579:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319529.969582:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940543616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319529.970190:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940543872
00000100:00100000:2.0:1767319529.970198:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940543872
00000100:00100000:3.0:1767319529.970238:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940544256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319529.970250:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958
00000100:00100000:2.0:1767319529.970261:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940543872:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319529.970278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319529.970282:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319529.970286:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319529.970290:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4774
00000100:00080000:3.0:1767319529.970294:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319529.970299:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319529.970311:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940544512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319529.970314:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940543872:12345-0@lo:400:kworker.0 Request processed in 54us (1026us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319529.970331:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958
00000100:00100000:3.0:1767319529.970345:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319529.970358:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940544384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319529.970372:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940544256:0@lo:38:kworker.0
00000100:00100000:3.0:1767319529.970398:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319529.970460:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544384
00000100:00100000:1.0:1767319529.970465:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544384
00000100:00080000:2.0:1767319529.970564:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319529.970700:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4547
00000100:00100000:1.0:1767319529.970707:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940544384:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319529.971505:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940543872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319529.971557:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319529.971584:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940544512:0@lo:38:kworker.0
00000100:00100000:2.0:1767319529.971627:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319529.971665:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544256
00000100:00100000:2.0:1767319529.971670:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544256
00000100:00100000:2.0:1767319529.971691:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544512
00000100:00100000:2.0:1767319529.971694:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544512
00000100:00100000:2.0:1767319529.971708:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17141
00000100:00100000:2.0:1767319529.971713:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940544256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319529.971733:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319529.971769:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940544256:12345-0@lo:38:kworker.0 Request processed in 55us (211us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319529.971794:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17141
00000100:00100000:2.0:1767319529.971809:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17142
00000100:00100000:2.0:1767319529.971812:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940544512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319529.971821:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319529.971844:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940544512:12345-0@lo:38:kworker.0 Request processed in 31us (216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319529.971850:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17142
00000100:00080000:2.0:1767319529.971882:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319529.971887:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319529.971891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940544256:0@lo:38:kworker.0
00000100:00080000:2.0:1767319529.971898:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319529.971901:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319529.971904:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940544512:0@lo:38:kworker.0
00000100:00080000:2.0:1767319529.971930:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319529.972699:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319529.972797:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940544384:12345-0@lo:400:kworker.0 Request processed in 2089us (2398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319529.972805:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4547
00000100:00100000:3.0:1767319529.972877:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940544384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319530.668943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319530.927130:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319531.692892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319531.951052:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319532.526082:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319532.526109:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319532.526198:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319532.526432:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544640
00000100:00100000:0.0:1767319532.526442:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544640
00000100:00100000:0.0:1767319532.526512:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504
00000100:00100000:0.0:1767319532.526522:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319532.526571:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319532.526623:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319532.526629:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504
00000100:00100000:1.0:1767319532.526656:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544640:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319532.526983:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319532.615880:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319532.618941:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324096
00000100:00100000:1.0:1767319532.618957:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324096
00000100:00100000:1.0:1767319532.619066:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4548
00000100:00100000:1.0:1767319532.619077:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894324096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319532.619179:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894324096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (3309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319532.619187:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4548
00000100:00080000:3.0:1767319532.619825:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319532.633896:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319532.634055:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894323968
00000100:00100000:1.0:1767319532.634069:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894323968
00000100:00100000:1.0:1767319532.634127:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17143
00000100:00100000:1.0:1767319532.634136:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894323968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319532.634161:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319532.634246:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894323968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 110us (359us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319532.634258:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17143
00000100:00100000:2.0:1767319532.718436:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319532.978472:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319533.550238:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319533.550307:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319533.550812:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940544768
00000100:00100000:0.0:1767319533.550822:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940544768
00000100:00080000:2.0:1767319533.550886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319533.550889:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505
00000100:00100000:0.0:1767319533.550900:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319533.550945:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319533.551005:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940544768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (698us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319533.551013:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505
00000100:00100000:2.0:1767319533.551072:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940544768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319533.743150:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319533.998278:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319534.063177:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319509/real 1767319509]  req@ffff93d071212d80 x1853163940538368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319534 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319534.063214:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d071212d80 x1853163940538368/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319534 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319534.063243:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319534.063254:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319534.063257:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940538368:0@lo:250:kworker.0
00000100:00080000:1.0:1767319534.065310:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319534.065320:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319534.065323:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319534.065331:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4759
00000100:00080000:1.0:1767319534.065336:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319534.065343:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319534.065381:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8e00 x1853163940544896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319534.065413:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319534.065417:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319534.065418:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319534.065422:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4780
00000100:00080000:1.0:1767319534.065424:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319534.065428:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319534.065443:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8b480 x1853163940545024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319534.065452:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319534.065455:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319534.065457:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319534.065460:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4780
00000100:00080000:1.0:1767319534.065462:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319534.065465:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319534.065478:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940545152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319534.065537:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319534.065540:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319534.065542:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319534.065546:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4780
00000100:00080000:1.0:1767319534.065558:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319534.065562:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319534.065573:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940545664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319534.065588:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319534.065591:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319534.065593:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319534.065596:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4780
00000100:00080000:1.0:1767319534.065598:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319534.065602:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319534.065612:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073410000 x1853163940545920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319534.065642:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940545408:0@lo:400:kworker.0
00000100:00100000:1.0:1767319534.065708:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319534.065793:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319534.065799:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940545280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319534.065840:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319534.065866:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940545536:0@lo:400:kworker.0
00000100:00100000:1.0:1767319534.065891:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319534.065910:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319534.065915:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940545792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319534.065934:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319534.067082:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545408
00000100:00100000:2.0:1767319534.067094:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545408
00000100:00100000:3.0:1767319534.067131:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940544896:0@lo:250:kworker.0
00000100:00100000:2.0:1767319534.067148:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545280
00000100:00100000:2.0:1767319534.067152:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545280
00000400:00000100:3.0:1767319534.067168:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940544896 offset 0 length 520: 4
00000100:00100000:2.0:1767319534.067183:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959
00000100:00100000:2.0:1767319534.067190:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940545408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319534.067194:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940545024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319534.067218:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319534.067235:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940545152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319534.067256:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940545408:12345-0@lo:400:kworker.0 Request processed in 66us (1547us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319534.067257:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319534.067263:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959
00000100:00100000:3.0:1767319534.067273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940545664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319534.067280:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960
00000100:00100000:2.0:1767319534.067285:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940545280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319534.067291:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319534.067307:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940545920:0@lo:38:kworker.0
00000100:00100000:2.0:1767319534.067311:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940545280:12345-0@lo:400:kworker.0 Request processed in 26us (1471us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319534.067316:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960
00000100:00100000:3.0:1767319534.067327:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319534.067442:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545152
00000100:00100000:3.0:1767319534.067446:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545152
00000100:00100000:3.0:1767319534.067467:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120
00000100:00100000:3.0:1767319534.067471:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940545152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319534.067490:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319534.067526:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940545152:12345-0@lo:38:kworker.0 Request processed in 53us (266us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319534.067532:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120
00000100:00100000:2.0:1767319534.067738:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545536
00000100:00100000:2.0:1767319534.067743:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545536
00000100:00100000:2.0:1767319534.067792:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545792
00000100:00100000:2.0:1767319534.067795:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545792
00000100:00100000:2.0:1767319534.067809:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545024
00000100:00100000:2.0:1767319534.067812:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545024
00000100:00100000:2.0:1767319534.067819:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545664
00000100:00100000:2.0:1767319534.067821:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545664
00000100:00100000:2.0:1767319534.067827:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940545920
00000100:00100000:2.0:1767319534.067829:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940545920
00000100:00100000:2.0:1767319534.067838:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4549
00000100:00100000:2.0:1767319534.067844:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940545536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319534.068036:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940545536:12345-0@lo:400:kworker.0 Request processed in 191us (2143us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319534.068042:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4549
00000100:00100000:2.0:1767319534.068054:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550
00000100:00100000:2.0:1767319534.068060:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940545792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319534.068088:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940545792:12345-0@lo:400:kworker.0 Request processed in 28us (2152us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319534.068094:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550
00000100:00100000:2.0:1767319534.068105:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17144
00000100:00100000:2.0:1767319534.068108:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319534.068190:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319534.068220:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545024:12345-0@lo:38:kworker.0 Request processed in 110us (1002us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319534.068226:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17144
00000100:00100000:2.0:1767319534.068334:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17145
00000100:00100000:2.0:1767319534.068339:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319534.068349:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319534.068376:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545664:12345-0@lo:38:kworker.0 Request processed in 35us (1083us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319534.068381:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17145
00000100:00100000:2.0:1767319534.068391:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17146
00000100:00100000:2.0:1767319534.068395:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319534.068404:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319534.068423:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940545920:12345-0@lo:38:kworker.0 Request processed in 27us (1096us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319534.068428:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17146
00000100:00100000:2.0:1767319534.068476:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940545792:0@lo:400:kworker.0
00000100:00100000:2.0:1767319534.068487:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940545536:0@lo:400:kworker.0
00000100:00080000:2.0:1767319534.068544:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319534.068561:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319534.068564:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940545024:0@lo:38:kworker.0
00000100:00080000:2.0:1767319534.068575:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319534.068578:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319534.068581:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940545152:0@lo:38:kworker.0
00000100:00080000:2.0:1767319534.068590:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319534.068593:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319534.068596:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940545664:0@lo:38:kworker.0
00000100:00080000:2.0:1767319534.068602:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319534.068605:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319534.068607:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940545920:0@lo:38:kworker.0
00000100:00100000:2.0:1767319534.070438:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940545280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319534.070453:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940545408:0@lo:400:kworker.0
00000100:00080000:2.0:1767319534.070491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319534.070497:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319534.767064:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319535.021947:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319535.788896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319536.045591:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319536.813832:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319537.069057:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319537.645126:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319537.645153:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940546048:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319537.645225:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319537.645355:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546048
00000100:00100000:1.0:1767319537.645363:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546048
00000100:00100000:1.0:1767319537.645430:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506
00000100:00100000:1.0:1767319537.645439:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940546048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319537.645469:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319537.645530:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940546048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319537.645538:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506
00000100:00100000:1.0:1767319537.645587:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940546048:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319537.645813:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319537.739738:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319537.739937:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319537.741040:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324352
00000100:00100000:1.0:1767319537.741053:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324352
00000100:00100000:1.0:1767319537.741131:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324224
00000100:00100000:1.0:1767319537.741135:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324224
00000100:00100000:1.0:1767319537.741165:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4551
00000100:00100000:1.0:1767319537.741176:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894324352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319537.741264:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894324352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (1536us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319537.741283:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4551
00000100:00100000:1.0:1767319537.741302:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17147
00000100:00100000:1.0:1767319537.741307:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894324224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319537.741327:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319537.741353:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894324224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (1416us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319537.741362:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17147
00000100:00080000:2.0:1767319537.741840:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319537.836912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319538.093140:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319538.669637:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940546176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319538.669720:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319538.670572:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546176
00000100:00100000:0.0:1767319538.670582:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546176
00000100:00100000:0.0:1767319538.670657:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507
00000100:00100000:0.0:1767319538.670666:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940546176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319538.670701:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319538.670771:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940546176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1050us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319538.670799:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507
00000100:00080000:2.0:1767319538.670923:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319538.671016:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940546176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319538.860872:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319539.117500:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319539.181629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319539.181640:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319539.181643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319539.181647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319539.181652:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319539.181660:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4784
00000100:00080000:3.0:1767319539.181665:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319539.181671:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319539.181712:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1880 x1853163940546304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319539.182293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319539.182298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319539.182300:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319539.182305:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4784
00000100:00080000:3.0:1767319539.182308:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319539.182312:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319539.182332:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3b80 x1853163940546432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319539.182390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319539.182394:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319539.182396:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319539.182400:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4784
00000100:00080000:3.0:1767319539.182402:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319539.182407:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319539.182417:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2d80 x1853163940546944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319539.182431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319539.182435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319539.182436:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319539.182440:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4784
00000100:00080000:3.0:1767319539.182442:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319539.182447:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319539.182457:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0380 x1853163940547200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319539.183649:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940546560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.183726:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.183806:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319539.183814:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940546688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.183835:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.183869:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546560
00000100:00100000:2.0:1767319539.183877:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546560
00000100:00100000:2.0:1767319539.183927:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546688
00000100:00100000:2.0:1767319539.183930:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546688
00000100:00100000:2.0:1767319539.183950:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961
00000100:00100000:2.0:1767319539.183958:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940546560:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184005:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940546560:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319539.184012:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961
00000100:00100000:2.0:1767319539.184027:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962
00000100:00100000:2.0:1767319539.184032:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940546688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184057:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940546688:12345-0@lo:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319539.184062:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962
00000100:00080000:2.0:1767319539.184077:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319539.184107:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940546688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184117:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940546560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184152:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940546816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184178:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.184201:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319539.184206:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940547072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184224:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.184253:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546816
00000100:00100000:2.0:1767319539.184257:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546816
00000100:00100000:2.0:1767319539.184284:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547072
00000100:00100000:2.0:1767319539.184287:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547072
00000100:00100000:2.0:1767319539.184303:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4552
00000100:00100000:2.0:1767319539.184309:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940546816:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319539.184325:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319539.184339:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940546816:12345-0@lo:400:kworker.0 Request processed in 31us (161us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319539.184345:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4552
00000100:00100000:2.0:1767319539.184355:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4553
00000100:00100000:2.0:1767319539.184361:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940547072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184386:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940547072:12345-0@lo:400:kworker.0 Request processed in 25us (161us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319539.184392:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4553
00000100:00100000:2.0:1767319539.184415:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940547072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319539.184424:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940546816:0@lo:400:kworker.0
00000100:00100000:1.0:1767319539.184435:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940546304:0@lo:38:kworker.0
00000100:00100000:1.0:1767319539.184465:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.184476:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546304
00000100:00100000:2.0:1767319539.184479:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546304
00000100:00100000:1.0:1767319539.184494:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940546432:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184498:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17148
00000100:00100000:2.0:1767319539.184518:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940546304:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319539.184531:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767319539.184539:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319539.184549:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940546944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184565:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940546304:12345-0@lo:38:kworker.0 Request processed in 62us (100us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319539.184568:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.184571:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17148
00000100:00100000:2.0:1767319539.184581:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546944
00000100:00100000:1.0:1767319539.184583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940547200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184584:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546944
00000100:00100000:2.0:1767319539.184600:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17149
00000100:00100000:1.0:1767319539.184602:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319539.184604:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940546944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319539.184613:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319539.184621:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319539.184626:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319539.184629:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940546304:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184632:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940546944:12345-0@lo:38:kworker.0 Request processed in 27us (63us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319539.184637:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319539.184638:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17149
00000100:00080000:1.0:1767319539.184640:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319539.184642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940546944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184645:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547200
00000100:00100000:2.0:1767319539.184648:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547200
00000100:00100000:2.0:1767319539.184657:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17150
00000100:00100000:2.0:1767319539.184660:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940547200:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319539.184664:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940546432
00000100:00100000:1.0:1767319539.184666:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940546432
00010000:00020000:2.0:1767319539.184669:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319539.184687:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121
00000100:00100000:1.0:1767319539.184692:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940546432:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.184692:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940547200:12345-0@lo:38:kworker.0 Request processed in 30us (89us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319539.184698:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17150
00010000:00020000:1.0:1767319539.184702:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319539.184724:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940546432:12345-0@lo:38:kworker.0 Request processed in 31us (191us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319539.184752:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121
00000100:00080000:1.0:1767319539.184792:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319539.184797:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319539.184800:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940546432:0@lo:38:kworker.0
00000100:00080000:1.0:1767319539.184808:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319539.184811:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319539.184813:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940547200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319539.885647:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319540.143847:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319540.908906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319541.165349:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319541.933181:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319542.194629:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319542.765051:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319542.765074:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940547328:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319542.765139:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319542.765340:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547328
00000100:00100000:0.0:1767319542.765349:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547328
00000100:00100000:0.0:1767319542.765413:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508
00000100:00100000:0.0:1767319542.765422:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940547328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319542.765451:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319542.765513:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940547328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (372us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319542.765524:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508
00000100:00100000:0.0:1767319542.765574:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940547328:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319542.765807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319542.855437:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319542.855498:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319542.857556:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324480
00000100:00100000:0.0:1767319542.857577:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324480
00000100:00100000:0.0:1767319542.857716:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324608
00000100:00100000:0.0:1767319542.857721:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324608
00000100:00100000:0.0:1767319542.857821:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4554
00000100:00100000:0.0:1767319542.857834:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894324608:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319542.857936:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894324608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 105us (2437us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319542.857944:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4554
00000100:00100000:0.0:1767319542.857967:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17151
00000100:00100000:0.0:1767319542.857973:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894324480:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319542.857998:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319542.858027:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894324480:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (2601us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319542.858035:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17151
00000100:00080000:1.0:1767319542.858307:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319542.956891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319543.213030:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319543.789133:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319543.789159:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940547456:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319543.789230:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319543.789317:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547456
00000100:00100000:1.0:1767319543.789326:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547456
00000100:00080000:3.0:1767319543.789361:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319543.789405:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509
00000100:00100000:1.0:1767319543.789427:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940547456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319543.789458:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319543.789543:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940547456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319543.789551:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509
00000100:00100000:3.0:1767319543.789857:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940547456:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319543.982662:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319544.237426:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319544.301262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319544.301284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319544.301287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319544.301292:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319544.301296:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319544.301306:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4789
00000100:00080000:0.0:1767319544.301312:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319544.301320:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319544.301378:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91500 x1853163940547584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319544.301420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319544.301424:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319544.301426:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319544.301430:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4789
00000100:00080000:0.0:1767319544.301433:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319544.301438:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319544.301464:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adca80 x1853163940547712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319544.301546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319544.301550:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319544.301552:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319544.301556:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4789
00000100:00080000:0.0:1767319544.301559:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319544.301565:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319544.301579:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09180 x1853163940548224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319544.301600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319544.301604:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319544.301606:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319544.301612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4789
00000100:00080000:0.0:1767319544.301614:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319544.301619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319544.301633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0b480 x1853163940548480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319544.301669:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940547968:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.301750:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319544.301860:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319544.301870:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940547840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.301898:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319544.301935:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940548096:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.301969:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319544.301999:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319544.302007:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940548352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302037:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319544.302087:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547968
00000100:00100000:0.0:1767319544.302095:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547968
00000100:00100000:0.0:1767319544.302149:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547840
00000100:00100000:0.0:1767319544.302152:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547840
00000100:00100000:0.0:1767319544.302206:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963
00000100:00100000:0.0:1767319544.302218:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940547968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302276:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940547968:12345-0@lo:400:kworker.0 Request processed in 62us (528us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319544.302285:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963
00000100:00100000:0.0:1767319544.302314:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964
00000100:00100000:0.0:1767319544.302323:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940547840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302362:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940547840:12345-0@lo:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319544.302369:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964
00000100:00100000:0.0:1767319544.302404:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548096
00000100:00100000:0.0:1767319544.302409:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548096
00000100:00100000:0.0:1767319544.302444:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548352
00000100:00100000:0.0:1767319544.302447:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548352
00000100:00100000:0.0:1767319544.302492:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4555
00000100:00100000:0.0:1767319544.302501:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940548096:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302545:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940548096:12345-0@lo:400:kworker.0 Request processed in 46us (576us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319544.302553:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4555
00000100:00100000:0.0:1767319544.302572:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4556
00000100:00100000:0.0:1767319544.302580:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940548352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302613:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940548352:12345-0@lo:400:kworker.0 Request processed in 35us (577us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319544.302620:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4556
00000100:00100000:0.0:1767319544.302684:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940548352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302704:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940548096:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302754:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940547840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319544.302771:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940547968:0@lo:400:kworker.0
00000100:00100000:1.0:1767319544.303122:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940547584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319544.303167:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319544.303198:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940547712:0@lo:38:kworker.0
00000100:00100000:1.0:1767319544.303230:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319544.303258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940548224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319544.303303:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319544.303329:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940548480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319544.303355:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319544.303407:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547712
00000100:00100000:1.0:1767319544.303413:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547712
00000100:00100000:1.0:1767319544.303447:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122
00000100:00100000:1.0:1767319544.303468:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940547712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319544.303492:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319544.303535:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940547712:12345-0@lo:38:kworker.0 Request processed in 80us (305us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319544.303544:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122
00000100:00100000:1.0:1767319544.303577:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940547584
00000100:00100000:1.0:1767319544.303582:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940547584
00000100:00100000:1.0:1767319544.303607:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548224
00000100:00100000:1.0:1767319544.303610:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548224
00000100:00100000:1.0:1767319544.303630:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548480
00000100:00100000:1.0:1767319544.303633:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548480
00000100:00100000:1.0:1767319544.303657:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17152
00000100:00100000:1.0:1767319544.303664:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940547584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319544.303675:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319544.303709:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940547584:12345-0@lo:38:kworker.0 Request processed in 44us (543us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319544.303716:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17152
00000100:00100000:1.0:1767319544.303735:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17153
00000100:00100000:1.0:1767319544.303740:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940548224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319544.303750:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319544.303809:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940548224:12345-0@lo:38:kworker.0 Request processed in 66us (505us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319544.303816:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17153
00000100:00100000:1.0:1767319544.303836:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17154
00000100:00100000:1.0:1767319544.303841:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940548480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319544.303852:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319544.303884:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940548480:12345-0@lo:38:kworker.0 Request processed in 41us (529us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319544.303892:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17154
00000100:00080000:1.0:1767319544.303951:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319544.303958:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319544.303963:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940547584:0@lo:38:kworker.0
00000100:00080000:1.0:1767319544.303978:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319544.303983:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319544.303987:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940547712:0@lo:38:kworker.0
00000100:00080000:1.0:1767319544.303998:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319544.304003:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319544.304008:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940548224:0@lo:38:kworker.0
00000100:00080000:1.0:1767319544.304020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319544.304024:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319544.304028:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940548480:0@lo:38:kworker.0
00000100:00080000:3.0:1767319544.306858:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319544.306872:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319545.004951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319545.262417:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319546.029106:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319546.288084:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319547.052995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319547.309122:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319547.887333:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940548608:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319547.887482:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.887549:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548608
00000100:00100000:1.0:1767319547.887558:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548608
00000100:00100000:1.0:1767319547.887625:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510
00000100:00100000:1.0:1767319547.887636:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940548608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319547.887666:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319547.887721:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940548608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319547.887728:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510
00000100:00080000:3.0:1767319547.887794:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319547.887872:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940548608:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319547.975925:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319547.975980:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319547.976046:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324864
00000100:00100000:0.0:1767319547.976058:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324864
00000100:00100000:0.0:1767319547.976133:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894324736
00000100:00100000:0.0:1767319547.976137:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894324736
00000100:00100000:0.0:1767319547.976173:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4557
00000100:00100000:0.0:1767319547.976190:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894324864:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319547.976272:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894324864:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319547.976280:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4557
00000100:00100000:0.0:1767319547.976299:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17155
00000100:00100000:0.0:1767319547.976303:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894324736:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319547.976323:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319547.976343:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894324736:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (363us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319547.976349:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17155
00000100:00080000:3.0:1767319547.976535:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319548.076934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319548.339141:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319548.909710:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940548736:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319548.909815:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319548.909958:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548736
00000100:00100000:3.0:1767319548.909969:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548736
00000100:00100000:3.0:1767319548.910037:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511
00000100:00100000:3.0:1767319548.910050:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940548736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319548.910085:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319548.910190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319548.915041:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940548736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4981us (5210us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319548.915053:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940548736:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319548.915062:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511
00000100:00100000:3.0:1767319549.101120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319549.358692:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319549.424586:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319549.424599:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319549.424602:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319549.424606:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319549.424611:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319549.424621:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4794
00000100:00080000:2.0:1767319549.424626:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319549.424634:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319549.424679:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a300 x1853163940548864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319549.424710:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319549.424714:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319549.424715:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319549.424718:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4794
00000100:00080000:2.0:1767319549.424721:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319549.424724:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319549.424743:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940548992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319549.424831:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319549.424835:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319549.424837:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319549.424841:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4794
00000100:00080000:2.0:1767319549.424843:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319549.424848:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319549.424858:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba25c00 x1853163940549504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319549.424874:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319549.424877:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319549.424879:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319549.424882:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4794
00000100:00080000:2.0:1767319549.424885:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319549.424888:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319549.424898:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940549760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319549.424934:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940549632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319549.425004:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319549.425044:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549632
00000100:00100000:2.0:1767319549.425050:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549632
00000100:00100000:2.0:1767319549.425102:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4558
00000100:00100000:2.0:1767319549.425111:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940549632:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319549.425221:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940548864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319549.425308:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940549248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319549.425326:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940549120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319549.426701:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319549.426792:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940548992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.426830:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319549.426869:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548992
00000100:00100000:3.0:1767319549.426876:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548992
00000100:00100000:3.0:1767319549.426917:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123
00000100:00100000:3.0:1767319549.426924:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940548992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319549.426948:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319549.426981:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940548992:12345-0@lo:38:kworker.0 Request processed in 56us (149us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319549.426989:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123
00000100:00080000:3.0:1767319549.427041:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319549.427046:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319549.427050:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940548992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.427057:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940549504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.427079:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319549.427102:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940548864
00000100:00100000:3.0:1767319549.427105:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940548864
00000100:00100000:3.0:1767319549.427123:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549504
00000100:00100000:3.0:1767319549.427125:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549504
00000100:00100000:3.0:1767319549.427625:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17156
00000100:00100000:3.0:1767319549.427632:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940548864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319549.427646:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319549.427685:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940548864:12345-0@lo:38:kworker.0 Request processed in 52us (988us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319549.427691:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17156
00000100:00100000:3.0:1767319549.427709:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17157
00000100:00100000:3.0:1767319549.427713:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940549504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319549.427722:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319549.427747:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940549504:12345-0@lo:38:kworker.0 Request processed in 32us (666us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319549.427752:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17157
00000100:00080000:3.0:1767319549.427816:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319549.427821:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319549.427823:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940549504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.427831:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940549760:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.427854:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319549.427875:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549760
00000100:00100000:3.0:1767319549.427879:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549760
00000100:00100000:3.0:1767319549.427898:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17158
00000100:00100000:3.0:1767319549.427902:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940549760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319549.427911:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319549.427935:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940549760:12345-0@lo:38:kworker.0 Request processed in 31us (81us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319549.427940:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17158
00000100:00080000:3.0:1767319549.427963:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319549.427967:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319549.427970:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940549760:0@lo:38:kworker.0
00000100:00080000:3.0:1767319549.428002:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319549.428006:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319549.428009:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940548864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319549.428052:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319549.428060:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940549376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319549.428083:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319549.428102:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549376
00000100:00100000:3.0:1767319549.428106:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549376
00000100:00100000:3.0:1767319549.428355:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4559
00000100:00100000:3.0:1767319549.428363:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940549376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319549.428475:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940549632:12345-0@lo:400:kworker.0 Request processed in 3364us (3469us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319549.428483:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4558
00000100:00100000:2.0:1767319549.428537:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940549632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319549.428622:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940549376:0@lo:400:kworker.0
00000100:00080000:2.0:1767319549.428661:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319549.428751:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940549376:12345-0@lo:400:kworker.0 Request processed in 388us (665us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319549.428758:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4559
00000100:00100000:1.0:1767319549.432749:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319549.432839:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549120
00000100:00100000:2.0:1767319549.432850:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549120
00000100:00100000:2.0:1767319549.432928:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965
00000100:00100000:2.0:1767319549.432939:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940549120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319549.433008:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940549120:12345-0@lo:400:kworker.0 Request processed in 72us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319549.433098:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965
00000100:00100000:1.0:1767319549.438027:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940549120:0@lo:400:kworker.0
00000100:00080000:3.0:1767319549.438523:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319549.439310:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319549.440361:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549248
00000100:00100000:1.0:1767319549.440373:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549248
00000100:00100000:1.0:1767319549.440447:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966
00000100:00100000:1.0:1767319549.440458:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940549248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319549.440604:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940549248:12345-0@lo:400:kworker.0 Request processed in 149us (1298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319549.440612:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966
00000100:00100000:0.0:1767319549.448103:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940549248:0@lo:400:kworker.0
00000100:00100000:3.0:1767319550.124992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319550.380999:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319551.149263:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319551.419164:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319552.080994:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767319552.081035:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894324992 offset 0 length 520: 4
00000100:00100000:0.0:1767319552.081060:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319552.081453:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325248
00000100:00100000:3.0:1767319552.081464:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325248
00000100:00100000:3.0:1767319552.081647:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325120
00000100:00100000:3.0:1767319552.081652:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325120
00000100:00100000:1.0:1767319552.081685:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4560
00000100:00100000:1.0:1767319552.081698:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894325248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319552.081814:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894325248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 118us (829us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319552.081822:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4560
00000100:00100000:1.0:1767319552.081846:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17159
00000100:00100000:1.0:1767319552.081850:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319552.081872:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319552.081899:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (838us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319552.081906:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17159
00000100:00080000:0.0:1767319552.082438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319552.173059:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319552.429457:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319553.017459:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940549888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319553.017529:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319553.017661:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940549888
00000100:00100000:3.0:1767319553.017670:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940549888
00000100:00100000:3.0:1767319553.017725:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512
00000100:00100000:3.0:1767319553.017738:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940549888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319553.017770:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767319553.018015:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319553.018079:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940549888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 344us (547us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319553.018087:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512
00000100:00100000:2.0:1767319553.018170:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940549888:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319553.196886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319553.453020:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319554.029258:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319554.029485:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940550016:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319554.029565:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319554.029717:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550016
00000100:00100000:3.0:1767319554.029725:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550016
00000100:00100000:3.0:1767319554.029833:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513
00000100:00100000:3.0:1767319554.029844:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940550016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319554.029872:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319554.029928:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940550016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (363us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319554.029934:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513
00000100:00080000:0.0:1767319554.030002:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319554.030023:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940550016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319554.222506:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319554.477008:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319554.541474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319554.541485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319554.541488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319554.541492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319554.541496:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319554.541504:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4799
00000100:00080000:3.0:1767319554.541509:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319554.541516:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319554.541557:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1880 x1853163940550144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319554.541642:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940550144:0@lo:38:kworker.0
00000100:00100000:1.0:1767319554.541727:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319554.541918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319554.541923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319554.541925:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319554.541928:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4799
00000100:00080000:3.0:1767319554.541931:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319554.541934:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319554.541953:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0700 x1853163940550272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319554.542104:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550144
00000100:00100000:2.0:1767319554.542113:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550144
00000100:00100000:2.0:1767319554.542173:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17160
00000100:00100000:2.0:1767319554.542182:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940550144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319554.542204:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319554.542594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940550272:0@lo:38:kworker.0
00000100:00100000:1.0:1767319554.542899:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319554.543018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319554.543022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319554.543025:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319554.543029:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4799
00000100:00080000:3.0:1767319554.543032:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319554.543036:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319554.543050:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940550656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319554.543077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319554.543080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319554.543082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319554.543086:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4799
00000100:00080000:3.0:1767319554.543088:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319554.543092:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319554.543103:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26d80 x1853163940550912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319554.543135:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940550528:0@lo:400:kworker.0
00000100:00100000:3.0:1767319554.543179:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319554.543201:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319554.543207:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940550400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319554.543235:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319554.543275:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940550784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319554.543299:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319554.543349:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550400
00000100:00100000:3.0:1767319554.543354:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550400
00000100:00100000:3.0:1767319554.543432:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967
00000100:00100000:3.0:1767319554.543440:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940550400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319554.543490:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940550400:12345-0@lo:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319554.543498:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967
00000100:00100000:3.0:1767319554.543549:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940550400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319554.543750:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550272
00000100:00100000:0.0:1767319554.543755:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550272
00000100:00100000:0.0:1767319554.543801:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124
00000100:00100000:0.0:1767319554.543807:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940550272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319554.543822:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319554.543859:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940550272:12345-0@lo:38:kworker.0 Request processed in 51us (960us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319554.543865:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124
00000100:00100000:0.0:1767319554.543883:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550528
00000100:00100000:0.0:1767319554.543887:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550528
00000100:00100000:0.0:1767319554.543920:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550784
00000100:00100000:0.0:1767319554.543923:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550784
00000100:00100000:0.0:1767319554.543944:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4561
00000100:00100000:0.0:1767319554.543950:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940550528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319554.543986:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940550528:12345-0@lo:400:kworker.0 Request processed in 36us (806us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319554.543992:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4561
00000100:00100000:0.0:1767319554.544005:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4562
00000100:00100000:0.0:1767319554.544010:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940550784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319554.544043:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940550784:12345-0@lo:400:kworker.0 Request processed in 33us (742us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319554.544049:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4562
00000100:00080000:0.0:1767319554.544065:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319554.544089:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940550784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319554.544111:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940550528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319554.544855:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940550144:12345-0@lo:38:kworker.0 Request processed in 2670us (3123us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319554.544863:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17160
00000100:00080000:1.0:1767319554.545049:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319554.545055:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319554.545058:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940550144:0@lo:38:kworker.0
00000100:00100000:1.0:1767319554.545082:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940550656:0@lo:38:kworker.0
00000100:00100000:1.0:1767319554.545120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319554.545151:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940550912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319554.545168:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550656
00000100:00100000:2.0:1767319554.545174:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550656
00000100:00100000:2.0:1767319554.545205:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17161
00000100:00100000:2.0:1767319554.545212:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940550656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319554.545229:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319554.545559:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940550656:12345-0@lo:38:kworker.0 Request processed in 344us (435us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319554.545567:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319554.545570:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17161
00000100:00080000:1.0:1767319554.545643:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319554.545648:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319554.545651:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940550272:0@lo:38:kworker.0
00000100:00080000:1.0:1767319554.545668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319554.545671:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319554.545674:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940550656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319554.546064:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940550912
00000100:00100000:3.0:1767319554.546070:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940550912
00000100:00100000:3.0:1767319554.546151:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17162
00000100:00100000:3.0:1767319554.546273:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940550912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319554.546292:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319554.546390:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940550912:12345-0@lo:38:kworker.0 Request processed in 231us (825us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319554.546397:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17162
00000100:00080000:1.0:1767319554.546452:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319554.546457:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319554.546460:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940550912:0@lo:38:kworker.0
00000100:00100000:3.0:1767319555.244903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319555.501600:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319556.268894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319556.525087:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319557.190540:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319557.191224:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325504
00000100:00100000:2.0:1767319557.191235:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325504
00000100:00100000:3.0:1767319557.191237:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319557.191321:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325376
00000100:00100000:2.0:1767319557.191325:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325376
00000100:00100000:2.0:1767319557.191352:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4563
00000100:00100000:2.0:1767319557.191363:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894325504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319557.191442:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17163
00000100:00100000:2.0:1767319557.191445:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894325504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (912us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319557.191452:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325376:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:2.0:1767319557.191461:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4563
00010000:00020000:3.0:1767319557.191479:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319557.191508:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 58us (274us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319557.191515:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17163
00000100:00080000:0.0:1767319557.193205:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319557.293005:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319557.549037:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319558.128422:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319558.128448:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940551040:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319558.128523:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319558.128712:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551040
00000100:00100000:1.0:1767319558.128721:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551040
00000100:00100000:1.0:1767319558.128815:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514
00000100:00100000:1.0:1767319558.128825:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940551040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319558.128856:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319558.128914:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940551040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (391us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319558.128922:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514
00000100:00080000:0.0:1767319558.129019:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319558.129110:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940551040:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319558.319378:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319558.573026:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319559.149207:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319559.149230:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940551168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319559.149310:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319559.149682:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551168
00000100:00100000:1.0:1767319559.149691:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551168
00000100:00100000:1.0:1767319559.149832:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1767319559.149843:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940551168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319559.149874:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319559.149931:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940551168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319559.149940:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515
00000100:00100000:3.0:1767319559.150013:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940551168:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319559.150080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319559.340905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319559.598665:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319559.666985:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319534/real 1767319534]  req@ffff93d06d3e8e00 x1853163940544896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319559.667035:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d3e8e00 x1853163940544896/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319559.667056:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319559.667072:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319559.667077:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940544896:0@lo:250:kworker.0
00000100:00080000:0.0:1767319559.667423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319559.667428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319559.667432:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319559.667436:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4784
00000100:00080000:0.0:1767319559.667440:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319559.667447:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319559.667477:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0bb80 x1853163940551296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319559.667500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319559.667504:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319559.667505:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319559.667508:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4804
00000100:00080000:0.0:1767319559.667511:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319559.667513:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319559.667525:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0aa00 x1853163940551424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319559.667534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319559.667537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319559.667538:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319559.667541:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4804
00000100:00080000:0.0:1767319559.667543:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319559.667546:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319559.667554:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08e00 x1853163940551552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319559.667644:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940551680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319559.667705:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319559.667809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319559.667813:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319559.667814:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319559.667818:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4804
00000100:00080000:0.0:1767319559.667820:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319559.667823:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319559.667833:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08700 x1853163940551936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319559.667846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319559.667849:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319559.667850:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319559.667854:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4804
00000100:00080000:0.0:1767319559.667856:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319559.667858:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319559.667866:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08000 x1853163940552192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319559.667886:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940551808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319559.667920:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319559.667943:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319559.667948:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940552064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319559.667970:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319559.668009:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551808
00000100:00100000:0.0:1767319559.668018:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551808
00000100:00100000:0.0:1767319559.668098:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552064
00000100:00100000:0.0:1767319559.668102:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552064
00000100:00100000:0.0:1767319559.668129:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4564
00000100:00100000:0.0:1767319559.668138:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940551808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319559.668193:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940551808:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319559.668201:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4564
00000100:00100000:0.0:1767319559.668219:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4565
00000100:00100000:0.0:1767319559.668225:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940552064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319559.668524:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940551296:0@lo:250:kworker.0
00000400:00000100:1.0:1767319559.668547:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940551296 offset 0 length 520: 4
00000100:00100000:1.0:1767319559.668567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940551424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319559.668599:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319559.668620:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940551552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319559.668641:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319559.668656:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940551936:0@lo:38:kworker.0
00000100:00100000:1.0:1767319559.668674:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319559.668689:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940552192:0@lo:38:kworker.0
00000100:00100000:1.0:1767319559.668708:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319559.668732:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551552
00000100:00100000:1.0:1767319559.668735:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551552
00000100:00100000:1.0:1767319559.668756:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125
00000100:00100000:1.0:1767319559.668760:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940551552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319559.668794:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319559.668824:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940551552:12345-0@lo:38:kworker.0 Request processed in 62us (181us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319559.668829:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125
00000100:00100000:1.0:1767319559.668845:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551424
00000100:00100000:1.0:1767319559.668848:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551424
00000100:00100000:1.0:1767319559.668858:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551936
00000100:00100000:1.0:1767319559.668860:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551936
00000100:00100000:1.0:1767319559.668866:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552192
00000100:00100000:1.0:1767319559.668868:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552192
00000100:00100000:1.0:1767319559.668875:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17164
00000100:00100000:1.0:1767319559.668879:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940551424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319559.668887:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319559.668907:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940551424:12345-0@lo:38:kworker.0 Request processed in 27us (308us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319559.668913:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17164
00000100:00100000:1.0:1767319559.668921:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17165
00000100:00100000:1.0:1767319559.668925:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940551936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319559.668933:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319559.668952:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940551936:12345-0@lo:38:kworker.0 Request processed in 26us (277us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319559.668957:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17165
00000100:00100000:1.0:1767319559.668967:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17166
00000100:00100000:1.0:1767319559.668970:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940552192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319559.668979:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319559.668999:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940552192:12345-0@lo:38:kworker.0 Request processed in 27us (290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319559.669004:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17166
00000100:00080000:1.0:1767319559.669039:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319559.669043:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319559.669046:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940551424:0@lo:38:kworker.0
00000100:00080000:1.0:1767319559.669055:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319559.669058:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319559.669061:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940551552:0@lo:38:kworker.0
00000100:00080000:1.0:1767319559.669082:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319559.669085:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319559.669088:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940551936:0@lo:38:kworker.0
00000100:00080000:1.0:1767319559.669095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319559.669099:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319559.669102:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940552192:0@lo:38:kworker.0
00000100:00080000:1.0:1767319559.669155:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319559.669187:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940551808:0@lo:400:kworker.0
00000100:00100000:1.0:1767319559.669224:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940551680
00000100:00100000:1.0:1767319559.669228:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940551680
00000100:00100000:1.0:1767319559.669490:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968
00000100:00100000:1.0:1767319559.669497:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940551680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319559.669685:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940552064:12345-0@lo:400:kworker.0 Request processed in 1460us (1712us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319559.669693:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4565
00000100:00100000:0.0:1767319559.669727:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940552064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319559.674079:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940551680:12345-0@lo:400:kworker.0 Request processed in 4564us (6355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319559.674096:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968
00000100:00100000:2.0:1767319559.674947:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940551680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319560.366832:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319560.621916:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319561.389223:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319561.645562:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319562.312054:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319562.312169:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325760
00000100:00100000:0.0:1767319562.312180:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325760
00000100:00100000:0.0:1767319562.312276:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4566
00000100:00100000:0.0:1767319562.312288:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894325760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319562.312471:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894325760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 186us (427us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319562.312477:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4566
00000100:00080000:1.0:1767319562.315583:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319562.316546:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319562.318141:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325632
00000100:00100000:0.0:1767319562.318155:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325632
00000100:00100000:0.0:1767319562.318249:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17167
00000100:00100000:0.0:1767319562.318268:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319562.318303:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319562.318379:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894325632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 119us (1838us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319562.318387:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17167
00000100:00100000:3.0:1767319562.412962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319562.669539:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319563.252712:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940552320:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319563.252821:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319563.252955:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552320
00000100:00100000:1.0:1767319563.252964:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552320
00000100:00100000:1.0:1767319563.253037:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516
00000100:00100000:1.0:1767319563.253046:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940552320:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319563.253090:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319563.253146:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940552320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (324us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319563.253164:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516
00000100:00100000:3.0:1767319563.253311:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940552320:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319563.254153:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319563.436921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319563.693012:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319564.280714:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319564.280741:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940552448:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319564.280857:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319564.281582:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552448
00000100:00100000:1.0:1767319564.281592:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552448
00000100:00100000:1.0:1767319564.281673:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767319564.281682:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940552448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319564.281715:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319564.281810:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940552448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (916us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319564.281818:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767319564.281876:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940552448:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319564.281981:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319564.461078:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319564.718011:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319564.782520:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319564.782529:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319564.782531:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319564.782534:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319564.782537:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319564.782542:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4809
00000100:00080000:1.0:1767319564.782547:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319564.782552:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319564.782587:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ce00 x1853163940552576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319564.782612:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319564.782615:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319564.782616:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319564.782618:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4809
00000100:00080000:1.0:1767319564.782620:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319564.782622:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319564.782629:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ea00 x1853163940552704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319564.782674:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319564.782676:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1767319564.782684:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940552832:0@lo:400:kworker.0
00000100:00080000:1.0:1767319564.782689:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319564.782692:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4809
00000100:00080000:1.0:1767319564.782695:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319564.782699:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319564.782710:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08a80 x1853163940553088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319564.782733:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319564.782736:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319564.782738:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319564.782741:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4809
00000100:00080000:1.0:1767319564.782743:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319564.782747:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319564.782748:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319564.782757:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08700 x1853163940553344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319564.782804:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552832
00000100:00100000:1.0:1767319564.782810:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552832
00000100:00100000:0.0:1767319564.782826:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319564.782832:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940552960:0@lo:400:kworker.0
00000100:00100000:1.0:1767319564.782853:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969
00000100:00100000:0.0:1767319564.782857:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319564.782861:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940552832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319564.782883:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552960
00000100:00100000:0.0:1767319564.782886:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552960
00000100:00100000:1.0:1767319564.782910:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940552832:12345-0@lo:400:kworker.0 Request processed in 48us (161us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319564.782917:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969
00000100:00100000:0.0:1767319564.782918:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4567
00000100:00100000:0.0:1767319564.782923:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940552960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319564.782951:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940552960:12345-0@lo:400:kworker.0 Request processed in 27us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319564.782956:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4567
00000100:00100000:1.0:1767319564.782956:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940552832:0@lo:400:kworker.0
00000100:00080000:0.0:1767319564.782971:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319564.782975:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940552960:0@lo:400:kworker.0
00000100:00100000:0.0:1767319564.782992:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940553216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319564.783015:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319564.783035:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553216
00000100:00100000:0.0:1767319564.783039:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553216
00000100:00100000:2.0:1767319564.783050:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940552576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319564.783061:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4568
00000100:00100000:0.0:1767319564.783066:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940553216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319564.783078:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319564.783091:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940553216:12345-0@lo:400:kworker.0 Request processed in 25us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319564.783096:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4568
00000100:00080000:1.0:1767319564.783151:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319564.783169:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940553216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319564.786376:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552576
00000100:00100000:2.0:1767319564.786388:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940552704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319564.786391:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552576
00000100:00100000:2.0:1767319564.786502:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319564.786523:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940553088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319564.786544:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319564.789992:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553088
00000100:00100000:0.0:1767319564.790011:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553088
00000100:00100000:2.0:1767319564.790059:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940553344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319564.790071:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17168
00000100:00100000:0.0:1767319564.790080:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940552576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319564.790108:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319564.790133:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319564.790154:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940552576:12345-0@lo:38:kworker.0 Request processed in 75us (7075us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319564.790160:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17168
00000100:00100000:0.0:1767319564.790175:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553344
00000100:00100000:0.0:1767319564.790178:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553344
00000100:00100000:0.0:1767319564.790188:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17169
00000100:00100000:0.0:1767319564.790192:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940553088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319564.790202:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319564.790228:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940553088:12345-0@lo:38:kworker.0 Request processed in 34us (3682us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319564.790316:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17169
00000100:00100000:0.0:1767319564.790329:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17170
00000100:00100000:0.0:1767319564.790333:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940553344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319564.790342:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319564.790366:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940553344:12345-0@lo:38:kworker.0 Request processed in 32us (232us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319564.790371:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17170
00000100:00080000:2.0:1767319564.791420:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319564.791427:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319564.791431:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940552576:0@lo:38:kworker.0
00000100:00080000:2.0:1767319564.791447:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319564.791449:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319564.791451:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940553088:0@lo:38:kworker.0
00000100:00080000:2.0:1767319564.791456:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319564.791458:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319564.791460:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940553344:0@lo:38:kworker.0
00000100:00100000:2.0:1767319564.791492:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940552704
00000100:00100000:2.0:1767319564.791496:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940552704
00000100:00100000:2.0:1767319564.791524:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126
00000100:00100000:2.0:1767319564.791528:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940552704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319564.791538:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319564.791572:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940552704:12345-0@lo:38:kworker.0 Request processed in 43us (5070us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319564.791575:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126
00000100:00080000:0.0:1767319564.791819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319564.791824:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319564.791827:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940552704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319565.486500:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319565.741656:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319566.509448:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319566.770302:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319567.430056:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319567.430171:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326016
00000100:00100000:2.0:1767319567.430182:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326016
00000100:00080000:1.0:1767319567.430267:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319567.430458:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4569
00000100:00100000:2.0:1767319567.430469:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894326016:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319567.430539:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894326016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (494us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319567.430547:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4569
00000100:00100000:3.0:1767319567.430704:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319567.430742:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894325888
00000100:00100000:1.0:1767319567.430747:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894325888
00000100:00100000:1.0:1767319567.430809:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17171
00000100:00100000:1.0:1767319567.430814:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894325888:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319567.430834:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319567.430871:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894325888:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (168us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319567.430878:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17171
00000100:00100000:3.0:1767319567.538108:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319567.796716:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319568.365188:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940553472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319568.365277:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319568.365601:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553472
00000100:00100000:3.0:1767319568.365609:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553472
00000100:00100000:3.0:1767319568.365683:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518
00000100:00100000:3.0:1767319568.365693:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940553472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319568.365731:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319568.365800:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940553472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (522us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319568.365809:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518
00000100:00100000:2.0:1767319568.365890:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940553472:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319568.366979:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319568.557758:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319568.813000:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319569.389691:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940553600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319569.389755:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319569.389845:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553600
00000100:00100000:3.0:1767319569.389853:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553600
00000100:00100000:3.0:1767319569.389899:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519
00000100:00100000:3.0:1767319569.389909:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940553600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319569.389938:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319569.389975:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940553600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319569.389982:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519
00000100:00100000:3.0:1767319569.390025:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940553600:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319569.390518:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319569.584593:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319569.838119:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319569.901755:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319569.901764:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319569.901767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319569.901771:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319569.901790:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319569.901797:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4814
00000100:00080000:3.0:1767319569.901801:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319569.901807:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319569.901844:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddf80 x1853163940553728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319569.901870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319569.901874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319569.901876:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319569.901879:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4814
00000100:00080000:3.0:1767319569.901882:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319569.901885:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319569.901896:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dce00 x1853163940553856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319569.901952:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319569.902019:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940553728:0@lo:38:kworker.0
00000100:00100000:0.0:1767319569.902080:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319569.902144:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940553856:0@lo:38:kworker.0
00000100:00100000:0.0:1767319569.902167:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319569.902200:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553856
00000100:00100000:0.0:1767319569.902206:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553856
00000100:00100000:0.0:1767319569.902249:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127
00000100:00100000:0.0:1767319569.902257:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940553856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319569.902277:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319569.902315:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940553856:12345-0@lo:38:kworker.0 Request processed in 58us (147us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319569.902322:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127
00000100:00080000:0.0:1767319569.902356:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319569.902360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319569.902363:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940553856:0@lo:38:kworker.0
00000100:00100000:1.0:1767319569.902510:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553728
00000100:00100000:1.0:1767319569.902515:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553728
00000100:00100000:1.0:1767319569.902545:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17172
00000100:00100000:1.0:1767319569.902550:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940553728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319569.902560:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319569.902591:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940553728:12345-0@lo:38:kworker.0 Request processed in 40us (510us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319569.902597:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17172
00000100:00080000:1.0:1767319569.902628:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319569.902631:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319569.902634:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940553728:0@lo:38:kworker.0
00000100:00080000:3.0:1767319569.902814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319569.902818:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319569.902820:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319569.902824:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4814
00000100:00080000:3.0:1767319569.902827:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319569.902831:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319569.902843:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dce00 x1853163940554240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319569.902861:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319569.902864:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319569.902866:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319569.902869:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4814
00000100:00080000:3.0:1767319569.902872:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319569.902875:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319569.902887:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d880 x1853163940554496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319569.902944:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940554112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319569.902971:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319569.902997:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319569.903002:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940554368:0@lo:400:kworker.0
00000100:00100000:0.0:1767319569.903020:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319569.903077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940554240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319569.903101:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319569.903135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940554496:0@lo:38:kworker.0
00000100:00100000:1.0:1767319569.903153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319569.903176:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554112
00000100:00100000:1.0:1767319569.903179:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554112
00000100:00100000:1.0:1767319569.903210:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554368
00000100:00100000:1.0:1767319569.903213:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554368
00000100:00100000:1.0:1767319569.903238:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554240
00000100:00100000:1.0:1767319569.903241:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554240
00000100:00100000:1.0:1767319569.903250:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554496
00000100:00100000:1.0:1767319569.903253:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554496
00000100:00100000:1.0:1767319569.903262:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4570
00000100:00100000:1.0:1767319569.903268:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940554112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319569.903304:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940554112:12345-0@lo:400:kworker.0 Request processed in 37us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319569.903310:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4570
00000100:00100000:1.0:1767319569.903321:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4571
00000100:00100000:1.0:1767319569.903326:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940554368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319569.903348:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940554368:12345-0@lo:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319569.903354:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4571
00000100:00100000:1.0:1767319569.903362:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17173
00000100:00100000:1.0:1767319569.903366:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940554240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319569.903376:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319569.903398:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940554240:12345-0@lo:38:kworker.0 Request processed in 30us (295us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319569.903403:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17173
00000100:00100000:1.0:1767319569.903412:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17174
00000100:00100000:1.0:1767319569.903416:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940554496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319569.903425:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319569.903441:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940554496:12345-0@lo:38:kworker.0 Request processed in 24us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319569.903447:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17174
00000100:00080000:1.0:1767319569.903459:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319569.903478:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940554368:0@lo:400:kworker.0
00000100:00100000:1.0:1767319569.903486:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940554112:0@lo:400:kworker.0
00000100:00080000:1.0:1767319569.903505:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319569.903508:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319569.903511:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940554240:0@lo:38:kworker.0
00000100:00080000:1.0:1767319569.903517:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319569.903520:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319569.903523:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940554496:0@lo:38:kworker.0
00000100:00100000:2.0:1767319569.911251:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940553984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319569.911329:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319569.911486:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940553984
00000100:00100000:0.0:1767319569.911495:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940553984
00000100:00100000:0.0:1767319569.911556:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970
00000100:00100000:0.0:1767319569.911565:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940553984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319569.911634:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940553984:12345-0@lo:400:kworker.0 Request processed in 69us (304us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319569.911641:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970
00000100:00100000:2.0:1767319569.913176:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940553984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319570.606355:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319570.861013:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319571.634912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319571.885075:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319572.556700:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319572.556741:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319572.556851:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326272
00000100:00100000:0.0:1767319572.556860:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326272
00000100:00100000:0.0:1767319572.556918:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326144
00000100:00100000:0.0:1767319572.556920:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326144
00000100:00100000:0.0:1767319572.556934:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4572
00000100:00100000:0.0:1767319572.556941:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894326272:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319572.557013:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894326272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319572.557019:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4572
00000100:00100000:0.0:1767319572.557031:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17175
00000100:00100000:0.0:1767319572.557034:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894326144:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319572.557051:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319572.557067:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894326144:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 32us (326us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319572.557071:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17175
00000100:00080000:3.0:1767319572.557520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319572.653136:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319572.909054:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319573.485197:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319573.485223:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940554624:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319573.485299:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319573.485811:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554624
00000100:00100000:0.0:1767319573.485821:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554624
00000100:00100000:0.0:1767319573.485893:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520
00000100:00100000:0.0:1767319573.485903:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940554624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319573.485931:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319573.485979:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940554624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (680us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319573.485986:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520
00000100:00080000:3.0:1767319573.486083:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319573.486121:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940554624:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319573.677901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319573.933110:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319574.510138:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319574.510163:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940554752:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319574.510251:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319574.510308:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554752
00000100:00100000:1.0:1767319574.510318:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554752
00000100:00100000:1.0:1767319574.510389:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521
00000100:00100000:1.0:1767319574.510399:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940554752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319574.510440:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319574.510486:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940554752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (235us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319574.510494:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521
00000100:00080000:3.0:1767319574.511264:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319574.512223:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940554752:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319574.704809:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319574.957618:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319575.021116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319575.021126:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319575.021129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319575.021134:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319575.021138:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319575.021145:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4819
00000100:00080000:0.0:1767319575.021149:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319575.021157:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319575.021222:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9f80 x1853163940554880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319575.021249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319575.021253:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319575.021254:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319575.021257:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4819
00000100:00080000:0.0:1767319575.021259:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319575.021263:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319575.021279:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9880 x1853163940555008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319575.021353:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555136:0@lo:400:kworker.0
00000100:00080000:0.0:1767319575.021355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319575.021363:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319575.021365:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319575.021368:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4819
00000100:00080000:0.0:1767319575.021371:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319575.021375:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319575.021387:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879e300 x1853163940555520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319575.021426:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319575.021427:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319575.021433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319575.021435:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319575.021440:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4819
00000100:00080000:0.0:1767319575.021443:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319575.021447:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319575.021460:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cc380 x1853163940555776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319575.021485:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940555648:0@lo:400:kworker.0
00000100:00100000:2.0:1767319575.021504:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319575.021514:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555264:0@lo:400:kworker.0
00000100:00100000:0.0:1767319575.021522:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319575.021546:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319575.021553:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319575.021562:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940555392:0@lo:400:kworker.0
00000100:00100000:0.0:1767319575.021589:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319575.021593:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555136
00000100:00100000:2.0:1767319575.021602:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555136
00000100:00100000:0.0:1767319575.021624:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555648
00000100:00100000:0.0:1767319575.021630:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555648
00000100:00100000:1.0:1767319575.021671:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555264
00000100:00100000:1.0:1767319575.021677:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555264
00000100:00100000:1.0:1767319575.021726:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971
00000100:00100000:1.0:1767319575.021736:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319575.021765:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555392
00000100:00100000:3.0:1767319575.021792:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555392
00000100:00100000:1.0:1767319575.021822:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555264:12345-0@lo:400:kworker.0 Request processed in 87us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319575.021830:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971
00000100:00100000:1.0:1767319575.021854:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940554880:0@lo:38:kworker.0
00000100:00100000:1.0:1767319575.021880:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319575.021898:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940555008:0@lo:38:kworker.0
00000100:00100000:1.0:1767319575.021919:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319575.021934:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940555520:0@lo:38:kworker.0
00000100:00100000:1.0:1767319575.021953:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319575.021968:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940555776:0@lo:38:kworker.0
00000100:00100000:1.0:1767319575.021986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319575.022014:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940554880
00000100:00100000:1.0:1767319575.022018:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940554880
00000100:00100000:1.0:1767319575.022037:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555520
00000100:00100000:1.0:1767319575.022039:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555520
00000100:00100000:1.0:1767319575.022046:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555776
00000100:00100000:1.0:1767319575.022048:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555776
00000100:00100000:1.0:1767319575.022057:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17176
00000100:00100000:1.0:1767319575.022062:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940554880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319575.022081:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319575.022115:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940554880:12345-0@lo:38:kworker.0 Request processed in 52us (235us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319575.022121:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17176
00000100:00100000:1.0:1767319575.022134:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17177
00000100:00100000:1.0:1767319575.022138:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940555520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319575.022146:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319575.022168:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940555520:12345-0@lo:38:kworker.0 Request processed in 29us (214us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319575.022174:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17177
00000100:00100000:1.0:1767319575.022196:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17178
00000100:00100000:1.0:1767319575.022199:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940555776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319575.022209:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319575.022232:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940555776:12345-0@lo:38:kworker.0 Request processed in 31us (244us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319575.022237:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17178
00000100:00100000:1.0:1767319575.022254:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555008
00000100:00100000:1.0:1767319575.022258:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555008
00000100:00100000:1.0:1767319575.022278:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128
00000100:00100000:1.0:1767319575.022283:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940555008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319575.022291:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319575.022314:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940555008:12345-0@lo:38:kworker.0 Request processed in 30us (394us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319575.022320:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128
00000100:00080000:1.0:1767319575.022361:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319575.022366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319575.022370:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940554880:0@lo:38:kworker.0
00000100:00080000:1.0:1767319575.022380:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319575.022383:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319575.022386:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940555008:0@lo:38:kworker.0
00000100:00080000:1.0:1767319575.022393:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319575.022396:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319575.022400:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940555520:0@lo:38:kworker.0
00000100:00080000:1.0:1767319575.022407:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319575.022410:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319575.022412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940555776:0@lo:38:kworker.0
00000100:00100000:1.0:1767319575.022451:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555264:0@lo:400:kworker.0
00000100:00100000:2.0:1767319575.025007:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972
00000100:00100000:2.0:1767319575.025025:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319575.025107:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555136:12345-0@lo:400:kworker.0 Request processed in 89us (3681us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319575.025114:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972
00000100:00100000:1.0:1767319575.025251:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555136:0@lo:400:kworker.0
00000100:00080000:2.0:1767319575.026355:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319575.026361:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4573
00000100:00080000:2.0:1767319575.026363:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319575.026373:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940555648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319575.026445:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940555648:12345-0@lo:400:kworker.0 Request processed in 76us (4924us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319575.026452:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4573
00000100:00100000:1.0:1767319575.026543:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940555648:0@lo:400:kworker.0
00000100:00100000:3.0:1767319575.026810:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4574
00000100:00100000:3.0:1767319575.026821:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940555392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319575.026869:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940555392:12345-0@lo:400:kworker.0 Request processed in 50us (5279us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319575.026876:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4574
00000100:00100000:1.0:1767319575.026961:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940555392:0@lo:400:kworker.0
00000100:00100000:2.0:1767319575.724919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319575.981769:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319576.748963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319577.004997:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319577.671018:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319577.671084:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319577.671169:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326528
00000100:00100000:2.0:1767319577.671180:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326528
00000100:00100000:2.0:1767319577.671257:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326400
00000100:00100000:2.0:1767319577.671261:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326400
00000100:00100000:2.0:1767319577.671281:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4575
00000100:00100000:2.0:1767319577.671290:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894326528:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319577.671371:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894326528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (366us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319577.671379:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4575
00000100:00100000:0.0:1767319577.671452:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17179
00000100:00100000:0.0:1767319577.671459:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894326400:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319577.671479:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319577.671526:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894326400:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 66us (441us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319577.671532:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17179
00000100:00080000:3.0:1767319577.671818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767319577.672922:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894326656 offset 0 length 520: 4
00000100:00100000:2.0:1767319577.773054:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319578.029371:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319578.609337:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555904:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319578.609412:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319578.609644:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940555904
00000100:00100000:0.0:1767319578.609655:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940555904
00000100:00100000:0.0:1767319578.609733:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522
00000100:00100000:0.0:1767319578.609743:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555904:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319578.609818:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319578.609870:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940555904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (457us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319578.609878:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522
00000100:00080000:2.0:1767319578.609946:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319578.609989:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940555904:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319578.796890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319579.053009:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319579.629558:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940556032:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319579.629627:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319579.629804:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556032
00000100:00100000:3.0:1767319579.629813:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556032
00000100:00100000:3.0:1767319579.629881:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523
00000100:00100000:3.0:1767319579.629892:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940556032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319579.629923:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319579.629968:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940556032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319579.629975:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523
00000100:00100000:3.0:1767319579.630021:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940556032:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319579.630676:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319579.820951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319580.077555:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319580.141009:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319580.141020:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319580.141023:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319580.141027:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319580.141032:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319580.141039:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4825
00000100:00080000:2.0:1767319580.141043:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319580.141049:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319580.141090:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ea00 x1853163940556160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319580.141110:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319580.141113:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319580.141115:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319580.141118:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4825
00000100:00080000:2.0:1767319580.141120:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319580.141124:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319580.141146:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ce00 x1853163940556288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319580.141215:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319580.141219:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319580.141221:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319580.141225:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4825
00000100:00080000:2.0:1767319580.141227:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319580.141231:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319580.141243:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940556800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319580.141257:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319580.141260:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319580.141262:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319580.141265:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4825
00000100:00080000:2.0:1767319580.141267:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319580.141270:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319580.141280:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d197100 x1853163940557056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319580.141311:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940556672:0@lo:400:kworker.0
00000100:00100000:2.0:1767319580.141379:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319580.141407:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556672
00000100:00100000:0.0:1767319580.141415:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556672
00000100:00100000:2.0:1767319580.141437:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319580.141443:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940556928:0@lo:400:kworker.0
00000100:00100000:2.0:1767319580.141464:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319580.141467:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4576
00000100:00100000:0.0:1767319580.141476:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940556672:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319580.141498:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319580.141525:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556928
00000100:00100000:2.0:1767319580.141528:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556928
00000100:00100000:0.0:1767319580.141529:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940556672:12345-0@lo:400:kworker.0 Request processed in 54us (149us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319580.141536:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4576
00000100:00100000:0.0:1767319580.141553:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4577
00000100:00100000:0.0:1767319580.141558:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940556928:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319580.141566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319580.141596:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940556672:0@lo:400:kworker.0
00000100:00100000:2.0:1767319580.141636:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940556160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319580.141651:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940556544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319580.141716:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940556416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319580.152434:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940556928:12345-0@lo:400:kworker.0 Request processed in 10859us (10952us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319580.152454:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4577
00000100:00100000:0.0:1767319580.152553:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940556928:0@lo:400:kworker.0
00000100:00100000:2.0:1767319580.152888:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319580.152931:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940556288:0@lo:38:kworker.0
00000100:00100000:0.0:1767319580.152934:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556160
00000100:00100000:0.0:1767319580.152940:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556160
00000100:00100000:2.0:1767319580.152967:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319580.152978:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17180
00000100:00100000:0.0:1767319580.152984:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940556160:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319580.152985:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940556800:0@lo:38:kworker.0
00000100:00100000:2.0:1767319580.153006:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319580.153038:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940557056:0@lo:38:kworker.0
00000100:00100000:2.0:1767319580.153059:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319580.153091:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556288
00000100:00100000:2.0:1767319580.153095:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556288
00000100:00100000:2.0:1767319580.153116:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129
00000100:00100000:2.0:1767319580.153120:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940556288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319580.153320:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319580.153362:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940556288:12345-0@lo:38:kworker.0 Request processed in 238us (392us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319580.153368:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129
00000100:00100000:2.0:1767319580.153389:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556800
00000100:00100000:2.0:1767319580.153392:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556800
00000100:00100000:2.0:1767319580.153409:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557056
00000100:00100000:2.0:1767319580.153412:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557056
00000100:00100000:2.0:1767319580.153426:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17181
00000100:00100000:2.0:1767319580.153430:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940556800:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319580.153439:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319580.153451:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319580.153460:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940556800:12345-0@lo:38:kworker.0 Request processed in 28us (453us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319580.153466:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17181
00000100:00100000:2.0:1767319580.153475:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17182
00000100:00100000:2.0:1767319580.153479:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940557056:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319580.153488:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556416
00010000:00020000:2.0:1767319580.153489:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319580.153491:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556416
00000100:00100000:2.0:1767319580.153524:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940557056:12345-0@lo:38:kworker.0 Request processed in 31us (451us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319580.153530:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17182
00000100:00100000:3.0:1767319580.153532:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973
00000100:00100000:3.0:1767319580.153541:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940556416:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319580.153565:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319580.153570:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319580.153573:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940556288:0@lo:38:kworker.0
00000100:00100000:3.0:1767319580.153579:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940556416:12345-0@lo:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319580.153581:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319580.153584:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319580.153585:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973
00000100:00100000:2.0:1767319580.153587:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940556800:0@lo:38:kworker.0
00000100:00080000:2.0:1767319580.153593:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319580.153596:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319580.153598:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940557056:0@lo:38:kworker.0
00000100:00080000:3.0:1767319580.153606:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319580.153623:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940556416:0@lo:400:kworker.0
00010000:00020000:0.0:1767319580.153946:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319580.154004:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940556160:12345-0@lo:38:kworker.0 Request processed in 1005us (1103us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319580.154012:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17180
00000100:00080000:2.0:1767319580.154325:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319580.154330:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319580.154333:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940556160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319580.160892:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319580.161182:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940556544
00000100:00100000:3.0:1767319580.161192:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940556544
00000100:00100000:3.0:1767319580.161270:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974
00000100:00100000:3.0:1767319580.161280:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940556544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319580.161352:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940556544:12345-0@lo:400:kworker.0 Request processed in 74us (467us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319580.161359:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974
00000100:00100000:2.0:1767319580.162014:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940556544:0@lo:400:kworker.0
00000100:00100000:2.0:1767319580.844918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319581.101625:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319581.869787:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319582.125419:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319582.790430:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319582.790538:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326912
00000100:00100000:0.0:1767319582.790548:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326912
00000100:00100000:0.0:1767319582.790631:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4578
00000100:00100000:0.0:1767319582.790641:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894326912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319582.790728:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894326912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319582.790737:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4578
00000100:00080000:3.0:1767319582.791216:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319582.793046:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319582.793220:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894326784
00000100:00100000:2.0:1767319582.793230:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894326784
00000100:00100000:2.0:1767319582.793281:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17183
00000100:00100000:2.0:1767319582.793289:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894326784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319582.793314:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319582.793380:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894326784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 90us (342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319582.793387:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17183
00000100:00100000:2.0:1767319582.893024:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319583.151692:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319583.725148:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319583.725176:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940557184:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319583.725265:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319583.725397:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557184
00000100:00100000:1.0:1767319583.725410:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557184
00000100:00100000:1.0:1767319583.725496:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524
00000100:00100000:1.0:1767319583.725505:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940557184:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319583.725540:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319583.725592:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940557184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319583.725599:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524
00000100:00100000:1.0:1767319583.725646:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940557184:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319583.725844:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319583.916914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319584.173146:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319584.238516:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319559/real 1767319559]  req@ffff93d070a0bb80 x1853163940551296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319584.238550:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d070a0bb80 x1853163940551296/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319584.238570:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319584.238590:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319584.238594:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940551296:0@lo:250:kworker.0
00000100:00080000:2.0:1767319584.238680:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319584.238687:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319584.238690:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319584.238696:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4809
00000100:00080000:2.0:1767319584.238700:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319584.238706:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319584.238745:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940557312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319584.239083:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319584.239088:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319584.239098:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319584.239102:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4830
00000100:00080000:2.0:1767319584.239105:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319584.239109:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319584.239125:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194380 x1853163940557440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319584.239136:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319584.239139:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319584.239141:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319584.239144:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4830
00000100:00080000:2.0:1767319584.239146:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319584.239150:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319584.239163:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196680 x1853163940557568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319584.239233:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940557696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319584.239303:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319584.239420:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319584.239423:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319584.239425:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319584.239428:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4830
00000100:00080000:2.0:1767319584.239430:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319584.239434:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319584.239445:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195500 x1853163940558080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319584.239503:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557696
00000100:00100000:3.0:1767319584.239511:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557696
00000100:00100000:3.0:1767319584.239554:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975
00000100:00100000:3.0:1767319584.239561:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940557696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.239629:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940557312:0@lo:250:kworker.0
00000400:00000100:0.0:1767319584.239652:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940557312 offset 0 length 520: 4
00000100:00100000:0.0:1767319584.239670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940557440:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.239692:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.239708:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940557568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.239727:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.239741:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940558080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.239759:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.239819:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557440
00000100:00100000:0.0:1767319584.239823:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557440
00000100:00100000:0.0:1767319584.239842:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558080
00000100:00100000:0.0:1767319584.239845:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558080
00000100:00100000:0.0:1767319584.239859:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17184
00000100:00100000:0.0:1767319584.239864:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940557440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319584.239880:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319584.239918:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940557440:12345-0@lo:38:kworker.0 Request processed in 53us (224us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319584.239925:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17184
00000100:00100000:0.0:1767319584.239941:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185
00000100:00100000:0.0:1767319584.239945:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940558080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319584.239955:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319584.239976:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940558080:12345-0@lo:38:kworker.0 Request processed in 29us (215us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319584.239981:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185
00000100:00080000:0.0:1767319584.240008:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319584.240012:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319584.240015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940557440:0@lo:38:kworker.0
00000100:00080000:0.0:1767319584.240022:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319584.240025:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319584.240028:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940558080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.240068:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557568
00000100:00100000:0.0:1767319584.240072:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557568
00000100:00100000:0.0:1767319584.240090:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130
00000100:00100000:0.0:1767319584.240104:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940557568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319584.240114:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319584.240138:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940557568:12345-0@lo:38:kworker.0 Request processed in 33us (410us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319584.240144:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130
00000100:00100000:0.0:1767319584.240158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940557952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240179:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.240194:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319584.240199:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940557824:0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240216:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.240243:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940558208:0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240263:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.240285:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557952
00000100:00100000:0.0:1767319584.240288:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557952
00000100:00100000:0.0:1767319584.240315:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558208
00000100:00100000:0.0:1767319584.240318:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558208
00000100:00100000:0.0:1767319584.240331:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4579
00000100:00100000:0.0:1767319584.240335:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940557952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240363:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940557952:12345-0@lo:400:kworker.0 Request processed in 28us (184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319584.240368:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4579
00000100:00100000:0.0:1767319584.240379:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4580
00000100:00100000:0.0:1767319584.240384:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940558208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240405:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940558208:12345-0@lo:400:kworker.0 Request processed in 22us (142us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319584.240413:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4580
00000100:00080000:0.0:1767319584.240427:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319584.240447:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940557952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240465:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940558208:0@lo:400:kworker.0
00000100:00080000:0.0:1767319584.240481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319584.240484:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319584.240487:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940557568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.240529:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940557824
00000100:00100000:0.0:1767319584.240532:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940557824
00000100:00100000:0.0:1767319584.240557:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976
00000100:00100000:0.0:1767319584.240562:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940557824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.240593:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940557824:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319584.240598:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976
00000100:00080000:0.0:1767319584.240613:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319584.240630:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940557824:0@lo:400:kworker.0
00000100:00080000:2.0:1767319584.243808:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319584.243820:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319584.243825:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319584.243833:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4830
00000100:00080000:2.0:1767319584.243838:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319584.243844:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319584.243885:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196a00 x1853163940558336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319584.247395:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940558336:0@lo:38:kworker.0
00000100:00100000:0.0:1767319584.247489:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319584.247553:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558336
00000100:00100000:0.0:1767319584.247560:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558336
00000100:00100000:0.0:1767319584.247596:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186
00000100:00100000:0.0:1767319584.247603:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940558336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319584.247626:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319584.247668:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940558336:12345-0@lo:38:kworker.0 Request processed in 64us (178us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319584.247675:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186
00000100:00080000:0.0:1767319584.247715:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319584.247719:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319584.247723:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940558336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319584.251634:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940557696:12345-0@lo:400:kworker.0 Request processed in 12063us (12321us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319584.251650:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975
00000100:00100000:1.0:1767319584.254308:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940557696:0@lo:400:kworker.0
00000100:00100000:0.0:1767319584.750355:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319584.750381:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940558464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319584.750457:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319584.750563:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558464
00000100:00100000:3.0:1767319584.750571:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558464
00000100:00100000:3.0:1767319584.750634:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525
00000100:00100000:3.0:1767319584.750644:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940558464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319584.750677:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319584.750801:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940558464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (343us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319584.750810:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525
00000100:00100000:2.0:1767319584.754767:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940558464:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319584.946675:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319585.200201:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319585.964949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319586.222890:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319586.988905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319587.245085:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319587.909658:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319587.909837:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327168
00000100:00100000:0.0:1767319587.909849:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327168
00000100:00100000:0.0:1767319587.909987:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4581
00000100:00100000:0.0:1767319587.909998:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894327168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319587.910087:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894327168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (442us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319587.910095:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4581
00000100:00080000:2.0:1767319587.910178:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319587.910312:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319587.910442:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327040
00000100:00100000:0.0:1767319587.910447:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327040
00000100:00100000:0.0:1767319587.910477:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17187
00000100:00100000:0.0:1767319587.910483:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894327040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319587.910505:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319587.910562:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894327040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 77us (250us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319587.910569:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17187
00000100:00100000:2.0:1767319588.012912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319588.269150:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319588.845105:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319588.845128:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940558592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319588.845228:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319588.845472:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558592
00000100:00100000:1.0:1767319588.845480:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558592
00000100:00080000:2.0:1767319588.845611:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319588.845672:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526
00000100:00100000:1.0:1767319588.845682:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940558592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319588.845728:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319588.845806:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940558592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (577us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319588.845813:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526
00000100:00100000:2.0:1767319588.845885:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940558592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319589.036942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319589.293472:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319589.361744:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319589.361754:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319589.361757:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319589.361762:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319589.361807:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319589.361816:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4834
00000100:00080000:0.0:1767319589.361820:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319589.361827:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319589.361879:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cd880 x1853163940558720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319589.361917:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319589.361921:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319589.361923:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319589.361926:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4834
00000100:00080000:0.0:1767319589.361929:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319589.361933:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319589.361947:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cf100 x1853163940558848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319589.362014:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319589.362017:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319589.362019:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319589.362023:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4834
00000100:00080000:0.0:1767319589.362025:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319589.362029:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319589.362038:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cdc00 x1853163940559360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319589.362088:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319589.362092:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319589.362093:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319589.362097:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4834
00000100:00080000:0.0:1767319589.362100:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319589.362103:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319589.362112:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cc380 x1853163940559616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319589.362206:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940559104:0@lo:400:kworker.0
00000100:00100000:2.0:1767319589.362283:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362416:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319589.362423:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940559232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319589.362450:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362492:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559232
00000100:00100000:2.0:1767319589.362500:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559232
00000100:00100000:2.0:1767319589.362554:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4582
00000100:00100000:2.0:1767319589.362565:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940559232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319589.362613:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940559232:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319589.362620:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4582
00000100:00080000:2.0:1767319589.362640:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319589.362655:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940558720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319589.362679:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362695:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940558848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319589.362732:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362748:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940559360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319589.362766:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362801:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940559616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319589.362821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319589.362850:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558848
00000100:00100000:2.0:1767319589.362853:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558848
00000100:00100000:2.0:1767319589.362875:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131
00000100:00100000:2.0:1767319589.362880:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940558848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319589.362898:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319589.362928:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940558848:12345-0@lo:38:kworker.0 Request processed in 47us (195us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319589.362934:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131
00000100:00100000:2.0:1767319589.362949:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558720
00000100:00100000:2.0:1767319589.362952:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558720
00000100:00100000:2.0:1767319589.362993:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559360
00000100:00100000:2.0:1767319589.362996:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559360
00000100:00100000:2.0:1767319589.363020:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559616
00000100:00100000:2.0:1767319589.363023:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559616
00000100:00100000:2.0:1767319589.363034:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17188
00000100:00100000:2.0:1767319589.363037:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940558720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319589.363061:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319589.363087:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940558720:12345-0@lo:38:kworker.0 Request processed in 48us (407us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319589.363093:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17188
00000100:00100000:2.0:1767319589.363104:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189
00000100:00100000:2.0:1767319589.363107:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940559360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319589.363116:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319589.363137:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940559360:12345-0@lo:38:kworker.0 Request processed in 28us (370us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319589.363142:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189
00000100:00100000:2.0:1767319589.363152:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17190
00000100:00100000:2.0:1767319589.363155:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940559616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319589.363164:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319589.363186:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940559616:12345-0@lo:38:kworker.0 Request processed in 29us (364us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319589.363191:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17190
00000100:00080000:2.0:1767319589.363235:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319589.363239:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319589.363243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940558720:0@lo:38:kworker.0
00000100:00080000:2.0:1767319589.363253:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319589.363256:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319589.363259:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940558848:0@lo:38:kworker.0
00000100:00080000:2.0:1767319589.363266:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319589.363268:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319589.363271:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940559360:0@lo:38:kworker.0
00000100:00080000:2.0:1767319589.363276:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319589.363280:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319589.363282:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940559616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319589.363317:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940559232:0@lo:400:kworker.0
00000100:00100000:0.0:1767319589.363573:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559104
00000100:00100000:0.0:1767319589.363578:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559104
00000100:00100000:0.0:1767319589.363627:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977
00000100:00100000:0.0:1767319589.363634:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940559104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319589.363674:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940559104:12345-0@lo:400:kworker.0 Request processed in 41us (1391us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319589.363680:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977
00000100:00100000:3.0:1767319589.363820:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940558976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319589.363854:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319589.363885:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319589.363892:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940559488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319589.363957:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319589.363989:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559488
00000100:00100000:3.0:1767319589.363993:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559488
00000100:00100000:3.0:1767319589.364040:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4583
00000100:00100000:3.0:1767319589.364060:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940559488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319589.364092:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940559488:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319589.364113:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4583
00000100:00100000:3.0:1767319589.364143:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940559488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319589.364238:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940558976
00000100:00100000:0.0:1767319589.364242:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940558976
00000100:00100000:0.0:1767319589.364282:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978
00000100:00100000:0.0:1767319589.364289:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940558976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319589.364320:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940558976:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319589.364325:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978
00000100:00100000:3.0:1767319589.364392:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940558976:0@lo:400:kworker.0
00000100:00080000:2.0:1767319589.364656:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319589.364661:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319589.364685:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940559104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319589.869265:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319589.869519:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940559744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319589.869601:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319589.869727:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559744
00000100:00100000:0.0:1767319589.869736:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559744
00000100:00100000:0.0:1767319589.869817:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527
00000100:00100000:0.0:1767319589.869828:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940559744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319589.869857:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319589.869898:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940559744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319589.869905:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527
00000100:00100000:1.0:1767319589.870587:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940559744:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319590.060860:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319590.322013:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319591.084905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319591.344108:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319592.109406:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319592.377225:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319593.045700:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319593.045749:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319593.046042:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327424
00000100:00100000:1.0:1767319593.046053:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327424
00000100:00100000:1.0:1767319593.046174:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327296
00000100:00100000:1.0:1767319593.046178:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327296
00000100:00100000:1.0:1767319593.046214:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4584
00000100:00100000:1.0:1767319593.046224:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894327424:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319593.046306:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894327424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (616us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319593.046313:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4584
00000100:00100000:1.0:1767319593.046332:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17191
00000100:00100000:1.0:1767319593.046336:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894327296:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319593.046359:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319593.046383:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894327296:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (633us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319593.046389:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17191
00000100:00080000:3.0:1767319593.047109:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319593.133249:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319593.389037:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319593.965088:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940559872:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319593.965163:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319593.965319:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940559872
00000100:00100000:0.0:1767319593.965330:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940559872
00000100:00100000:0.0:1767319593.965394:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528
00000100:00100000:0.0:1767319593.965403:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940559872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319593.965434:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319593.965479:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940559872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319593.965486:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528
00000100:00080000:2.0:1767319593.965547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319593.965583:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940559872:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319594.157236:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319594.413065:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319594.477204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319594.477215:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319594.477217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319594.477221:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319594.477225:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319594.477233:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4839
00000100:00080000:0.0:1767319594.477237:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319594.477244:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319594.477300:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cca80 x1853163940560000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319594.477370:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940560000:0@lo:38:kworker.0
00000100:00100000:1.0:1767319594.477493:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319594.477584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319594.477589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319594.477591:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319594.477606:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4839
00000100:00080000:0.0:1767319594.477608:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319594.477611:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319594.477624:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469ce300 x1853163940560128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319594.477913:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560000
00000100:00100000:3.0:1767319594.477922:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560000
00000100:00100000:3.0:1767319594.477962:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17192
00000100:00100000:3.0:1767319594.477969:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940560000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319594.477989:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319594.478157:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940560128:0@lo:38:kworker.0
00000100:00100000:1.0:1767319594.478181:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319594.478304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319594.478306:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319594.478308:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319594.478311:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4839
00000100:00080000:0.0:1767319594.478313:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319594.478316:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319594.478324:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cdc00 x1853163940560640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319594.478334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319594.478336:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319594.478337:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319594.478339:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4839
00000100:00080000:0.0:1767319594.478340:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319594.478342:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319594.478348:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cd880 x1853163940560896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319594.478364:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940560512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478390:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319594.478423:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319594.478430:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940560384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478478:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319594.478517:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560512
00000100:00100000:0.0:1767319594.478520:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560512
00000100:00100000:0.0:1767319594.478558:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4585
00000100:00100000:0.0:1767319594.478565:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b832850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940560512:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478605:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b832850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940560512:12345-0@lo:400:kworker.0 Request processed in 40us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319594.478611:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4585
00000100:00080000:0.0:1767319594.478628:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319594.478649:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940560512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478686:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560384
00000100:00100000:0.0:1767319594.478688:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560384
00000100:00100000:0.0:1767319594.478707:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979
00000100:00100000:0.0:1767319594.478711:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940560384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478732:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940560384:12345-0@lo:400:kworker.0 Request processed in 21us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319594.478736:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979
00000100:00080000:0.0:1767319594.478747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319594.478755:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940560384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478765:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940560256:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478795:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319594.478807:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319594.478810:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940560768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478821:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319594.478834:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560256
00000100:00100000:0.0:1767319594.478836:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560256
00000100:00100000:0.0:1767319594.478849:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980
00000100:00100000:0.0:1767319594.478853:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940560256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478884:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940560256:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319594.478887:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980
00000100:00100000:0.0:1767319594.478898:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560768
00000100:00100000:0.0:1767319594.478900:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560768
00000100:00100000:0.0:1767319594.478916:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4586
00000100:00100000:0.0:1767319594.478919:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940560768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478951:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940560768:12345-0@lo:400:kworker.0 Request processed in 31us (128us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319594.478955:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4586
00000100:00080000:0.0:1767319594.478963:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319594.478974:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940560768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319594.478979:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940560256:0@lo:400:kworker.0
00000100:00100000:3.0:1767319594.480113:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940560000:12345-0@lo:38:kworker.0 Request processed in 2135us (2612us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319594.480124:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17192
00000100:00100000:2.0:1767319594.481694:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560128
00000100:00100000:2.0:1767319594.481706:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560128
00000100:00100000:2.0:1767319594.481741:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132
00000100:00100000:2.0:1767319594.481748:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940560128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319594.481769:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319594.481868:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940560128:12345-0@lo:38:kworker.0 Request processed in 119us (3684us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319594.481874:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132
00000100:00080000:1.0:1767319594.481961:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319594.481966:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319594.481970:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940560000:0@lo:38:kworker.0
00000100:00100000:1.0:1767319594.481993:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940560640:0@lo:38:kworker.0
00000100:00100000:1.0:1767319594.482038:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319594.482061:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940560896:0@lo:38:kworker.0
00000100:00100000:1.0:1767319594.482078:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319594.482110:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319594.482114:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319594.482118:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940560128:0@lo:38:kworker.0
00000100:00100000:3.0:1767319594.482275:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560640
00000100:00100000:3.0:1767319594.482280:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560640
00000100:00100000:3.0:1767319594.482363:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940560896
00000100:00100000:3.0:1767319594.482367:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940560896
00000100:00100000:0.0:1767319594.482484:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17193
00000100:00100000:0.0:1767319594.482491:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940560640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319594.482502:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319594.482553:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940560640:12345-0@lo:38:kworker.0 Request processed in 61us (514us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319594.482559:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17193
00000100:00100000:0.0:1767319594.482576:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17194
00000100:00100000:0.0:1767319594.482579:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940560896:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319594.482589:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319594.482613:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940560896:12345-0@lo:38:kworker.0 Request processed in 32us (534us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319594.482618:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17194
00000100:00080000:1.0:1767319594.482809:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319594.482813:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319594.482817:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940560640:0@lo:38:kworker.0
00000100:00080000:1.0:1767319594.482825:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319594.482828:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319594.482831:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940560896:0@lo:38:kworker.0
00000100:00100000:2.0:1767319594.991239:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319594.991264:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940561024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319594.991333:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319594.991502:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561024
00000100:00100000:1.0:1767319594.991510:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561024
00000100:00100000:1.0:1767319594.991559:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529
00000100:00100000:1.0:1767319594.991568:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940561024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319594.991597:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319594.991650:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940561024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319594.991657:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529
00000100:00100000:2.0:1767319594.992877:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940561024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319595.180906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319595.437651:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319596.204976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319596.473610:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319597.228949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319597.485178:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319598.160998:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319598.161640:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319598.161857:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327680
00000100:00100000:2.0:1767319598.161868:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327680
00000100:00100000:2.0:1767319598.161976:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327552
00000100:00100000:2.0:1767319598.161980:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327552
00000100:00100000:2.0:1767319598.162010:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4587
00000100:00100000:2.0:1767319598.162022:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894327680:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319598.162104:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894327680:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (1116us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319598.162113:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4587
00000100:00100000:2.0:1767319598.162135:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17195
00000100:00100000:2.0:1767319598.162141:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894327552:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319598.162162:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319598.162190:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894327552:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (551us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319598.162197:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17195
00000100:00080000:3.0:1767319598.166838:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319598.252871:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319598.510737:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319599.090538:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940561152:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319599.090635:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319599.090819:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561152
00000100:00100000:1.0:1767319599.090828:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561152
00000100:00100000:1.0:1767319599.090897:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1767319599.090907:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940561152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319599.090936:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319599.090993:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940561152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319599.091001:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530
00000100:00100000:0.0:1767319599.091374:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940561152:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319599.092328:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319599.277359:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319599.533006:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319599.596998:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319599.597012:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319599.597015:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319599.597019:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319599.597023:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319599.597030:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4844
00000100:00080000:2.0:1767319599.597035:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319599.597041:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319599.597124:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196300 x1853163940561280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319599.597210:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319599.597214:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319599.597216:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319599.597221:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4844
00000100:00080000:2.0:1767319599.597224:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319599.597229:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319599.597236:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940561280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319599.597305:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194a80 x1853163940561408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319599.597372:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319599.597375:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319599.597376:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319599.597380:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4844
00000100:00080000:2.0:1767319599.597383:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319599.597386:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319599.597397:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d197b80 x1853163940561792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319599.597413:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319599.597416:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319599.597418:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319599.597421:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4844
00000100:00080000:2.0:1767319599.597424:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319599.597427:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319599.597437:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194700 x1853163940562048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319599.597446:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319599.597456:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940561536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319599.597458:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940561664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319599.597524:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319599.597524:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319599.597589:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940561920:0@lo:400:kworker.0
00000100:00100000:3.0:1767319599.598736:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561664
00000100:00100000:2.0:1767319599.598741:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561536
00000100:00100000:3.0:1767319599.598745:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561664
00000100:00100000:2.0:1767319599.598746:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561536
00000100:00100000:3.0:1767319599.598820:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4588
00000100:00100000:3.0:1767319599.598833:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940561664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319599.599018:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940561664:12345-0@lo:400:kworker.0 Request processed in 189us (1493us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319599.599026:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4588
00000100:00080000:3.0:1767319599.599603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319599.599656:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940561664:0@lo:400:kworker.0
00000100:00080000:3.0:1767319599.600534:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319599.600548:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981
00000100:00100000:2.0:1767319599.600558:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940561536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319599.600621:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940561536:12345-0@lo:400:kworker.0 Request processed in 65us (3096us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319599.600628:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981
00000100:00100000:3.0:1767319599.600651:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940561536:0@lo:400:kworker.0
00000100:00100000:1.0:1767319599.601029:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319599.601085:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940561408:0@lo:38:kworker.0
00000100:00100000:0.0:1767319599.601088:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319599.601128:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319599.601148:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940561792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319599.601167:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561408
00000100:00100000:1.0:1767319599.601171:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319599.601173:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561408
00000100:00100000:1.0:1767319599.601194:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940562048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319599.601200:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133
00000100:00100000:0.0:1767319599.601206:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940561408:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319599.601217:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319599.601250:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561280
00000100:00100000:1.0:1767319599.601254:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561280
00000100:00100000:1.0:1767319599.601276:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561920
00000100:00100000:1.0:1767319599.601279:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561920
00000100:00100000:1.0:1767319599.601313:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940561792
00000100:00100000:1.0:1767319599.601316:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940561792
00000100:00100000:3.0:1767319599.601319:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562048
00000100:00100000:3.0:1767319599.601324:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562048
00010000:00020000:0.0:1767319599.601361:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319599.601399:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940561408:12345-0@lo:38:kworker.0 Request processed in 192us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319599.601407:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133
00000100:00100000:0.0:1767319599.601473:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4589
00000100:00100000:0.0:1767319599.601482:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940561920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319599.601517:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940561920:12345-0@lo:400:kworker.0 Request processed in 38us (432us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319599.601522:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4589
00000100:00100000:0.0:1767319599.601534:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17196
00000100:00100000:0.0:1767319599.601537:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940561280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319599.601544:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319599.601563:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940561280:12345-0@lo:38:kworker.0 Request processed in 24us (535us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319599.601568:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17196
00000100:00080000:0.0:1767319599.601584:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319599.601604:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940561920:0@lo:400:kworker.0
00000100:00080000:0.0:1767319599.601637:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319599.601640:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319599.601643:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940561408:0@lo:38:kworker.0
00000100:00080000:0.0:1767319599.601648:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319599.601651:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319599.601653:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940561280:0@lo:38:kworker.0
00000100:00100000:1.0:1767319599.602259:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17197
00000100:00100000:1.0:1767319599.602264:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940561792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319599.602276:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319599.602320:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17198
00000100:00100000:3.0:1767319599.602326:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319599.602339:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319599.602340:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940561792:12345-0@lo:38:kworker.0 Request processed in 53us (1147us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319599.602351:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17197
00000100:00080000:0.0:1767319599.602352:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319599.602360:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319599.602364:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940561792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319599.602372:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562048:12345-0@lo:38:kworker.0 Request processed in 45us (1156us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767319599.602373:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319599.602377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319599.602379:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940562048:0@lo:38:kworker.0
00000100:00100000:3.0:1767319599.602379:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17198
00000100:00100000:2.0:1767319600.109284:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319600.112252:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940562176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319600.112353:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319600.112911:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562176
00000100:00100000:0.0:1767319600.112920:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562176
00000100:00100000:0.0:1767319600.112993:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531
00000100:00100000:0.0:1767319600.113004:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940562176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319600.113085:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319600.113147:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940562176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (793us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319600.113154:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531
00000100:00100000:2.0:1767319600.113364:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940562176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319600.300930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319600.558734:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319601.329004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319601.582053:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767319602.250344:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894327808 offset 0 length 520: 4
00000100:00100000:2.0:1767319602.250385:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319602.250456:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319602.250636:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894327936
00000100:00100000:3.0:1767319602.250645:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894327936
00000100:00100000:3.0:1767319602.250688:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328064
00000100:00100000:3.0:1767319602.250690:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328064
00000100:00100000:3.0:1767319602.250739:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4590
00000100:00080000:2.0:1767319602.250743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319602.250762:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894328064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319602.250966:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894328064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 207us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319602.250974:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4590
00000100:00100000:3.0:1767319602.250995:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17199
00000100:00100000:3.0:1767319602.250999:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894327936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319602.251016:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319602.251036:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894327936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 36us (651us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319602.251040:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17199
00000100:00100000:2.0:1767319602.350080:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319602.607165:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319603.372966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319603.628965:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319604.206401:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319604.206426:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940562304:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319604.206496:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319604.206656:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562304
00000100:00100000:1.0:1767319604.206665:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562304
00000100:00100000:1.0:1767319604.206735:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532
00000100:00100000:1.0:1767319604.206745:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940562304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319604.206798:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319604.206849:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940562304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319604.206857:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532
00000100:00100000:1.0:1767319604.206905:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940562304:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319604.209033:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319604.397302:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319604.653084:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319604.717541:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319604.717553:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319604.717556:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319604.717559:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319604.717564:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319604.717571:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4849
00000100:00080000:3.0:1767319604.717575:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319604.717583:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319604.717623:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98e00 x1853163940562432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319604.717647:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319604.717651:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319604.717653:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319604.717657:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4849
00000100:00080000:3.0:1767319604.717659:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319604.717662:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319604.717676:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98380 x1853163940562560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319604.717738:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319604.717741:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319604.717743:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319604.717746:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4849
00000100:00080000:3.0:1767319604.717748:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319604.717752:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319604.717762:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9aa00 x1853163940562944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319604.717800:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319604.717803:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319604.717805:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319604.717808:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4849
00000100:00080000:3.0:1767319604.717810:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319604.717814:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319604.717825:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99500 x1853163940563200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319604.717962:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319604.717980:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940563072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319604.718043:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319604.718102:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940562688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319604.718129:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319604.718152:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319604.718157:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940562816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319604.718176:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319604.718201:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562688
00000100:00100000:2.0:1767319604.718208:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562688
00000100:00100000:2.0:1767319604.718272:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982
00000100:00100000:2.0:1767319604.718282:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940562688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319604.718328:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940562688:12345-0@lo:400:kworker.0 Request processed in 48us (197us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319604.718334:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982
00000100:00080000:2.0:1767319604.718353:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319604.718382:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940562688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319604.718857:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940562432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319604.718889:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319604.718917:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940562560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319604.718941:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319604.718956:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940562944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319604.718975:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319604.718991:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940563200:0@lo:38:kworker.0
00000100:00100000:0.0:1767319604.719011:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319604.719042:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563072
00000100:00100000:0.0:1767319604.719046:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563072
00000100:00100000:0.0:1767319604.719076:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562816
00000100:00100000:0.0:1767319604.719079:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562816
00000100:00100000:0.0:1767319604.719095:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562432
00000100:00100000:0.0:1767319604.719098:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562432
00000100:00100000:0.0:1767319604.719106:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562944
00000100:00100000:0.0:1767319604.719108:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562944
00000100:00100000:0.0:1767319604.719114:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563200
00000100:00100000:0.0:1767319604.719116:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563200
00000100:00100000:0.0:1767319604.719125:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4591
00000100:00100000:0.0:1767319604.719131:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940563072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319604.719166:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940563072:12345-0@lo:400:kworker.0 Request processed in 34us (1123us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319604.719172:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4591
00000100:00100000:0.0:1767319604.719185:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4592
00000100:00100000:0.0:1767319604.719191:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940562816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319604.719219:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940562816:12345-0@lo:400:kworker.0 Request processed in 29us (1041us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319604.719224:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4592
00000100:00100000:0.0:1767319604.719235:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17200
00000100:00100000:0.0:1767319604.719239:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319604.719259:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319604.719291:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562432:12345-0@lo:38:kworker.0 Request processed in 50us (401us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319604.719297:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17200
00000100:00100000:0.0:1767319604.719308:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17201
00000100:00100000:0.0:1767319604.719311:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319604.719320:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319604.719346:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940562944:12345-0@lo:38:kworker.0 Request processed in 33us (370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319604.719350:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17201
00000100:00100000:0.0:1767319604.719362:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17202
00000100:00100000:0.0:1767319604.719365:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940563200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319604.719373:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319604.719392:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940563200:12345-0@lo:38:kworker.0 Request processed in 25us (380us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319604.719397:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17202
00000100:00080000:0.0:1767319604.719451:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319604.719456:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319604.719460:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940562432:0@lo:38:kworker.0
00000100:00080000:0.0:1767319604.719468:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319604.719471:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319604.719474:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940562944:0@lo:38:kworker.0
00000100:00080000:0.0:1767319604.719481:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319604.719484:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319604.719486:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940563200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319604.720994:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940562560
00000100:00100000:2.0:1767319604.721004:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940562560
00000100:00100000:2.0:1767319604.721046:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134
00000100:00100000:2.0:1767319604.721053:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940562560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319604.721069:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319604.721135:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940562560:12345-0@lo:38:kworker.0 Request processed in 81us (2192us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319604.721142:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134
00000100:00080000:2.0:1767319604.721161:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319604.721192:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940563072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319604.721228:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940562816:0@lo:400:kworker.0
00000100:00080000:3.0:1767319604.721335:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319604.721340:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319604.721343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940562560:0@lo:38:kworker.0
00000100:00100000:1.0:1767319605.229209:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319605.229232:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940563328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319605.229301:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319605.229417:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563328
00000100:00100000:3.0:1767319605.229426:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563328
00000100:00100000:3.0:1767319605.229478:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533
00000100:00100000:3.0:1767319605.229486:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940563328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319605.229515:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319605.229563:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940563328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (262us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319605.229570:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533
00000100:00100000:0.0:1767319605.229804:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940563328:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319605.420910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319605.677246:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319606.444972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319606.701347:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319607.370258:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319607.370495:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319607.379188:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328192
00000100:00100000:3.0:1767319607.379204:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328192
00000100:00100000:1.0:1767319607.379207:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328320
00000100:00100000:1.0:1767319607.379215:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328320
00000100:00100000:3.0:1767319607.379571:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17203
00000100:00100000:3.0:1767319607.379581:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894328192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319607.379605:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319607.379918:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894328192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 336us (9668us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319607.379928:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17203
00000100:00100000:1.0:1767319607.382369:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4593
00000100:00100000:1.0:1767319607.382388:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894328320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319607.382473:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894328320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (11978us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319607.382480:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4593
00000100:00080000:2.0:1767319607.382662:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319607.470017:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319607.725097:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319608.495957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319608.750939:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319609.325088:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319609.325120:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940563456:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319609.325207:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.325391:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563456
00000100:00100000:1.0:1767319609.325402:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563456
00000100:00080000:0.0:1767319609.325545:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319609.328967:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534
00000100:00100000:1.0:1767319609.328991:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940563456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319609.329025:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319609.329114:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940563456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (3907us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319609.329122:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534
00000100:00100000:0.0:1767319609.329232:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940563456:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319609.516900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319609.773037:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319609.836935:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319584/real 1767319584]  req@ffff93d06d195f80 x1853163940557312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319609.836970:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d195f80 x1853163940557312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319609.836992:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319609.837012:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319609.837015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940557312:0@lo:250:kworker.0
00000100:00080000:3.0:1767319609.837191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319609.837197:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319609.837200:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319609.837204:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4834
00000100:00080000:3.0:1767319609.837209:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319609.837215:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319609.837246:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9b800 x1853163940563584/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319609.837268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319609.837271:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319609.837273:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319609.837276:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4854
00000100:00080000:3.0:1767319609.837278:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319609.837282:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319609.837300:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98000 x1853163940563712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319609.837309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319609.837312:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319609.837314:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319609.837317:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4854
00000100:00080000:3.0:1767319609.837319:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319609.837322:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319609.837335:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99180 x1853163940563840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319609.837391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319609.837394:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319609.837396:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319609.837400:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4854
00000100:00080000:3.0:1767319609.837402:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319609.837407:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319609.837419:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98380 x1853163940564224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319609.837428:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940563968:0@lo:400:kworker.0
00000100:00080000:3.0:1767319609.837438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319609.837442:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319609.837443:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319609.837446:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4854
00000100:00080000:3.0:1767319609.837449:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319609.837452:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319609.837463:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98700 x1853163940564480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319609.837489:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940564352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319609.837511:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319609.837529:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319609.837587:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563968
00000100:00100000:2.0:1767319609.837594:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563968
00000100:00100000:0.0:1767319609.837602:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940564096:0@lo:400:kworker.0
00000100:00100000:2.0:1767319609.837661:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983
00000100:00100000:2.0:1767319609.837673:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940563968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319609.837681:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319609.837716:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564352
00000100:00100000:0.0:1767319609.837720:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564352
00000100:00100000:2.0:1767319609.837736:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940563968:12345-0@lo:400:kworker.0 Request processed in 66us (226us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319609.837748:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983
00000100:00100000:0.0:1767319609.837755:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564096
00000100:00100000:0.0:1767319609.837760:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564096
00000100:00100000:2.0:1767319609.837817:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940563968:0@lo:400:kworker.0
00000100:00100000:0.0:1767319609.837823:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4594
00000100:00100000:0.0:1767319609.837832:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940564352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319609.837878:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940564352:12345-0@lo:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319609.837879:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319609.837886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319609.837889:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4594
00000100:00100000:2.0:1767319609.837910:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4595
00000100:00100000:2.0:1767319609.837918:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940564096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319609.837953:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940563584:0@lo:250:kworker.0
00000100:00100000:2.0:1767319609.837955:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940564096:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0
00000400:00000100:1.0:1767319609.837991:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940563584 offset 0 length 520: 4
00000100:00100000:1.0:1767319609.838011:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940563712:0@lo:38:kworker.0
00000100:00100000:1.0:1767319609.838033:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.838050:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940563840:0@lo:38:kworker.0
00000100:00100000:1.0:1767319609.838070:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.838084:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940564224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319609.838100:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.838112:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940564480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319609.838128:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.838150:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563712
00000100:00100000:1.0:1767319609.838154:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563712
00000100:00100000:2.0:1767319609.839509:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4595
00000100:00100000:0.0:1767319609.839516:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564224
00000100:00100000:0.0:1767319609.839525:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564224
00000100:00100000:2.0:1767319609.839542:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564480
00000100:00100000:2.0:1767319609.839548:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564480
00000100:00100000:0.0:1767319609.839555:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17204
00000100:00100000:0.0:1767319609.839564:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940564224:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319609.839571:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205
00000100:00100000:2.0:1767319609.839577:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940564480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319609.839588:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767319609.839592:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319609.839658:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940564224:12345-0@lo:38:kworker.0 Request processed in 94us (1556us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319609.839665:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17204
00000100:00100000:0.0:1767319609.839714:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940563840
00000100:00100000:0.0:1767319609.839718:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940563840
00000100:00100000:0.0:1767319609.839740:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135
00000100:00100000:0.0:1767319609.839745:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940563840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319609.839755:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319609.839797:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940563840:12345-0@lo:38:kworker.0 Request processed in 50us (1725us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319609.839803:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135
00000100:00100000:0.0:1767319609.839851:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940564096:0@lo:400:kworker.0
00000100:00080000:0.0:1767319609.839899:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319609.839904:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319609.839907:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940563840:0@lo:38:kworker.0
00000100:00080000:0.0:1767319609.839921:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319609.839924:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319609.839927:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940564224:0@lo:38:kworker.0
00000100:00100000:2.0:1767319609.840682:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940564480:12345-0@lo:38:kworker.0 Request processed in 1024us (2472us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319609.840693:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205
00000100:00080000:0.0:1767319609.842985:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319609.842998:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319609.843003:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940564480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319609.847023:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206
00000100:00100000:1.0:1767319609.847035:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940563712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319609.847056:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319609.847124:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940563712:12345-0@lo:38:kworker.0 Request processed in 90us (9091us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319609.847129:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206
00000100:00080000:0.0:1767319609.847242:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319609.847249:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940564352:0@lo:400:kworker.0
00000100:00080000:0.0:1767319609.847251:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319609.847258:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940563712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319610.349146:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940564608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319610.349232:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319610.349920:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564608
00000100:00100000:1.0:1767319610.349930:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564608
00000100:00100000:1.0:1767319610.350042:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535
00000100:00100000:1.0:1767319610.350053:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940564608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319610.350099:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319610.350165:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940564608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (933us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319610.350172:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535
00000100:00100000:2.0:1767319610.350336:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940564608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319610.541035:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319610.808532:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319611.565498:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319611.821015:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319612.490978:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319612.491102:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319612.499001:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328576
00000100:00100000:1.0:1767319612.499021:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328576
00000100:00100000:1.0:1767319612.499139:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328448
00000100:00100000:1.0:1767319612.499143:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328448
00000100:00100000:1.0:1767319612.499183:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4596
00000100:00100000:1.0:1767319612.499197:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894328576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319612.499199:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17207
00000100:00100000:3.0:1767319612.499211:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894328448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319612.499237:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319612.499318:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319612.499563:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894328576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 369us (8594us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319612.499572:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4596
00000100:00100000:3.0:1767319612.500064:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894328448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 850us (8959us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319612.500072:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17207
00000100:00100000:2.0:1767319612.588988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319612.845062:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319613.613057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319613.869207:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319614.445271:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319614.445304:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940564736:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319614.445371:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319614.445572:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564736
00000100:00100000:1.0:1767319614.445582:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564736
00000100:00100000:1.0:1767319614.445648:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536
00000100:00100000:1.0:1767319614.445657:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940564736:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319614.445685:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319614.445730:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940564736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319614.445736:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536
00000100:00080000:2.0:1767319614.445911:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319614.445947:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940564736:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319614.636927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319614.893234:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319614.956950:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319614.956963:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319614.956977:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319614.956981:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319614.956986:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319614.956995:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4859
00000100:00080000:3.0:1767319614.957000:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319614.957008:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319614.957054:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9aa00 x1853163940564864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319614.957081:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319614.957084:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319614.957087:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319614.957091:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4859
00000100:00080000:3.0:1767319614.957093:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319614.957096:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319614.957111:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b98e00 x1853163940564992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319614.957163:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319614.957166:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319614.957168:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319614.957171:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4859
00000100:00080000:3.0:1767319614.957174:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319614.957177:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319614.957187:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99880 x1853163940565376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319614.957204:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319614.957206:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319614.957207:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319614.957209:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4859
00000100:00080000:3.0:1767319614.957211:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319614.957213:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319614.957219:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9b480 x1853163940565632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319614.957351:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940565120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319614.957431:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.957549:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940564864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319614.957594:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.957642:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940564992:0@lo:38:kworker.0
00000100:00100000:0.0:1767319614.957666:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.957682:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940565376:0@lo:38:kworker.0
00000100:00100000:0.0:1767319614.957701:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.957721:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940565632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319614.957736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.957761:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564992
00000100:00100000:0.0:1767319614.957767:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564992
00000100:00100000:0.0:1767319614.957807:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136
00000100:00100000:0.0:1767319614.957823:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940564992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319614.957842:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319614.957874:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940564992:12345-0@lo:38:kworker.0 Request processed in 62us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319614.957879:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136
00000100:00100000:0.0:1767319614.957898:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940564864
00000100:00100000:0.0:1767319614.957900:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940564864
00000100:00100000:0.0:1767319614.957911:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565376
00000100:00100000:0.0:1767319614.957913:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565376
00000100:00100000:0.0:1767319614.957923:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565632
00000100:00100000:0.0:1767319614.957925:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565632
00000100:00100000:0.0:1767319614.957938:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17208
00000100:00100000:0.0:1767319614.957943:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940564864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319614.957958:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319614.957993:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940564864:12345-0@lo:38:kworker.0 Request processed in 49us (398us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319614.957999:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17208
00000100:00100000:0.0:1767319614.958011:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17209
00000100:00100000:0.0:1767319614.958014:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940565376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319614.958023:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319614.958044:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940565376:12345-0@lo:38:kworker.0 Request processed in 28us (343us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319614.958049:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17209
00000100:00100000:0.0:1767319614.958059:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17210
00000100:00100000:0.0:1767319614.958063:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940565632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319614.958072:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319614.958091:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940565632:12345-0@lo:38:kworker.0 Request processed in 26us (352us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319614.958096:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17210
00000100:00100000:0.0:1767319614.958122:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319614.958131:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940565504:0@lo:400:kworker.0
00000100:00100000:0.0:1767319614.958154:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319614.958176:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565504
00000100:00100000:0.0:1767319614.958180:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565504
00000100:00100000:0.0:1767319614.958215:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4597
00000100:00100000:0.0:1767319614.958221:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940565504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319614.958262:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940565504:12345-0@lo:400:kworker.0 Request processed in 41us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319614.958267:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4597
00000100:00100000:0.0:1767319614.958313:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940565504:0@lo:400:kworker.0
00000100:00080000:0.0:1767319614.958336:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319614.958340:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319614.958343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940564864:0@lo:38:kworker.0
00000100:00080000:0.0:1767319614.958351:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319614.958354:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319614.958357:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940564992:0@lo:38:kworker.0
00000100:00080000:0.0:1767319614.958363:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319614.958365:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319614.958368:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940565376:0@lo:38:kworker.0
00000100:00080000:0.0:1767319614.958376:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319614.958379:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319614.958381:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940565632:0@lo:38:kworker.0
00000100:00100000:2.0:1767319614.958518:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940565248:0@lo:400:kworker.0
00000100:00100000:2.0:1767319614.958549:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319614.958577:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565248
00000100:00100000:2.0:1767319614.958580:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565248
00000100:00100000:2.0:1767319614.958604:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4598
00000100:00100000:2.0:1767319614.958609:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940565248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319614.958639:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940565248:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319614.958645:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4598
00000100:00080000:2.0:1767319614.958662:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319614.958680:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940565248:0@lo:400:kworker.0
00000100:00100000:3.0:1767319614.959040:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565120
00000100:00100000:3.0:1767319614.959046:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565120
00000100:00100000:3.0:1767319614.959137:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984
00000100:00100000:3.0:1767319614.959148:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940565120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319614.959195:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940565120:12345-0@lo:400:kworker.0 Request processed in 50us (1763us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319614.959201:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984
00000100:00100000:1.0:1767319614.959274:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940565120:0@lo:400:kworker.0
00000100:00080000:2.0:1767319614.959346:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319615.472021:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319615.472046:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940565760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319615.472113:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319615.472257:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565760
00000100:00100000:3.0:1767319615.472265:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565760
00000100:00100000:3.0:1767319615.473195:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537
00000100:00100000:3.0:1767319615.473208:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940565760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319615.473240:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319615.473301:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940565760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319615.473309:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537
00000100:00100000:0.0:1767319615.473393:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940565760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319615.660979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319615.916996:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319616.684917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319616.941189:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319617.612808:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319617.612861:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319617.617618:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328704
00000100:00100000:3.0:1767319617.617634:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328704
00000100:00100000:1.0:1767319617.617743:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328832
00000100:00100000:1.0:1767319617.617748:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328832
00000100:00080000:2.0:1767319617.617847:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319617.617856:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4599
00000100:00100000:1.0:1767319617.617869:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894328832:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319617.617878:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17211
00000100:00100000:2.0:1767319617.617884:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894328704:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319617.617903:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319617.617964:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894328832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (5100us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319617.617973:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4599
00000100:00100000:2.0:1767319617.623626:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894328704:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 5727us (10929us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319617.623643:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17211
00000100:00100000:2.0:1767319617.708918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319617.965557:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319618.733020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319618.989251:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319619.566154:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319619.566183:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940565888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319619.566254:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319619.566408:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940565888
00000100:00100000:3.0:1767319619.566418:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940565888
00000100:00100000:3.0:1767319619.566485:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538
00000100:00100000:3.0:1767319619.566497:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940565888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319619.566528:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767319619.566567:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319619.566575:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940565888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (320us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319619.566583:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538
00000100:00100000:0.0:1767319619.566642:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940565888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319619.756920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319620.013191:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319620.078868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319620.078879:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319620.078882:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319620.078887:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319620.078891:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319620.078899:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4864
00000100:00080000:0.0:1767319620.078904:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319620.078911:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319620.078951:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340aa00 x1853163940566016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319620.078968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319620.078972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319620.078973:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319620.078977:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4864
00000100:00080000:0.0:1767319620.078979:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319620.078983:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319620.078999:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cd880 x1853163940566144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319620.079266:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940566272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319620.079331:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319620.079412:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566272
00000100:00100000:3.0:1767319620.079421:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566272
00000100:00100000:3.0:1767319620.079477:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985
00000100:00100000:3.0:1767319620.079487:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940566272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.079503:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940566016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319620.079542:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319620.079579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319620.079582:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319620.079583:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767319620.079607:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940566144:0@lo:38:kworker.0
00000100:00080000:0.0:1767319620.079617:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4864
00000100:00080000:0.0:1767319620.079619:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319620.079621:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319620.079634:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469ce680 x1853163940566656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319620.079673:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319620.079691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940566656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319620.079704:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319620.079726:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566016
00000100:00100000:2.0:1767319620.079729:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566016
00000100:00100000:2.0:1767319620.079743:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566656
00000100:00100000:2.0:1767319620.079745:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566656
00000100:00100000:2.0:1767319620.079760:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17212
00000100:00100000:2.0:1767319620.079763:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940566016:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319620.079811:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319620.079851:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940566016:12345-0@lo:38:kworker.0 Request processed in 85us (307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319620.079862:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17212
00000100:00100000:2.0:1767319620.079877:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17213
00000100:00100000:2.0:1767319620.079881:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940566656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319620.079892:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319620.079914:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940566656:12345-0@lo:38:kworker.0 Request processed in 31us (207us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319620.079920:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17213
00000100:00080000:2.0:1767319620.079961:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319620.079966:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319620.079973:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940566656:0@lo:38:kworker.0
00000100:00080000:2.0:1767319620.079989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319620.079992:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319620.079995:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940566016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319620.080094:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566144
00000100:00100000:2.0:1767319620.080098:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566144
00000100:00100000:2.0:1767319620.080127:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137
00000100:00100000:2.0:1767319620.080135:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940566144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319620.080145:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319620.080193:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940566144:12345-0@lo:38:kworker.0 Request processed in 60us (519us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319620.080205:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137
00000100:00100000:2.0:1767319620.080424:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940566400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080453:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319620.080489:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319620.080496:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940566528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080526:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319620.080555:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940566784:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080673:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319620.080708:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566400
00000100:00100000:2.0:1767319620.080712:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566400
00000100:00100000:2.0:1767319620.080753:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986
00000100:00100000:2.0:1767319620.080761:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940566400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080834:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940566400:12345-0@lo:400:kworker.0 Request processed in 74us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319620.080840:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986
00000100:00100000:2.0:1767319620.080870:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940566400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080886:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566528
00000100:00100000:2.0:1767319620.080889:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566528
00000100:00100000:2.0:1767319620.080916:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566784
00000100:00100000:2.0:1767319620.080919:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566784
00000100:00100000:2.0:1767319620.080938:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4600
00000100:00100000:2.0:1767319620.080945:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940566528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.080979:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940566528:12345-0@lo:400:kworker.0 Request processed in 34us (455us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319620.080985:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4600
00000100:00100000:2.0:1767319620.080996:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4601
00000100:00100000:2.0:1767319620.081003:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940566784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.081032:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940566784:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319620.081038:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4601
00000100:00100000:2.0:1767319620.081060:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940566784:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.081080:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940566528:0@lo:400:kworker.0
00000100:00080000:2.0:1767319620.081102:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319620.081106:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319620.081110:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940566144:0@lo:38:kworker.0
00000100:00080000:2.0:1767319620.081146:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319620.081152:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319620.083104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319620.083114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319620.083118:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319620.083126:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4864
00000100:00080000:0.0:1767319620.083131:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319620.083139:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319620.083139:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940566272:12345-0@lo:400:kworker.0 Request processed in 3649us (3801us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319620.083154:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985
00000100:00100000:0.0:1767319620.083489:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cea00 x1853163940566912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319620.083594:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940566272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319620.084817:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940566912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319620.084897:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319620.085630:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940566912
00000100:00100000:1.0:1767319620.085643:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940566912
00000100:00100000:1.0:1767319620.085705:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17214
00000100:00100000:1.0:1767319620.085714:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940566912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319620.085740:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319620.085947:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940566912:12345-0@lo:38:kworker.0 Request processed in 231us (1048us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319620.085957:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17214
00000100:00080000:3.0:1767319620.087508:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319620.087519:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319620.087525:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940566912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319620.589109:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940567040:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319620.589187:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319620.593236:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567040
00000100:00100000:0.0:1767319620.593252:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567040
00000100:00100000:0.0:1767319620.593373:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539
00000100:00100000:0.0:1767319620.593383:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940567040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319620.593428:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319620.593515:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940567040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (4326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319620.593525:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539
00000100:00100000:1.0:1767319620.593624:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940567040:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319620.780867:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319621.037482:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319621.807114:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319622.068843:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319622.727406:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319622.727552:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894328960
00000100:00100000:1.0:1767319622.727563:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894328960
00000100:00100000:1.0:1767319622.727621:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17215
00000100:00100000:1.0:1767319622.727629:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894328960:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319622.727654:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319622.727721:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894328960:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (325us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319622.727729:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17215
00000100:00100000:3.0:1767319622.732048:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319622.732459:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329088
00000100:00100000:2.0:1767319622.732472:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329088
00000100:00100000:2.0:1767319622.732571:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4602
00000100:00100000:2.0:1767319622.732583:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894329088:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319622.732668:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894329088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (632us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319622.732676:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4602
00000100:00080000:0.0:1767319622.733206:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319622.831509:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319623.085062:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319623.852965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319624.109061:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319624.689155:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940567168:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319624.689220:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319624.689334:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567168
00000100:00100000:1.0:1767319624.689343:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567168
00000100:00100000:1.0:1767319624.689410:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540
00000100:00100000:1.0:1767319624.689420:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940567168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319624.689449:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319624.689500:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940567168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (278us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319624.689509:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540
00000100:00100000:2.0:1767319624.689540:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940567168:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319624.689648:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319624.877711:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319625.133147:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319625.197475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319625.197487:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319625.197491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319625.197495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319625.197499:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319625.197508:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4870
00000100:00080000:3.0:1767319625.197525:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319625.197533:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319625.197574:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99180 x1853163940567296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319625.197603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319625.197607:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319625.197609:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319625.197613:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4870
00000100:00080000:3.0:1767319625.197615:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319625.197619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319625.197633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99f80 x1853163940567424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319625.197702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319625.197705:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319625.197707:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319625.197710:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4870
00000100:00080000:3.0:1767319625.197712:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319625.197716:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319625.197759:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9a680 x1853163940567936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319625.197795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319625.197798:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319625.197800:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319625.197804:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4870
00000100:00080000:3.0:1767319625.197807:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319625.197810:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319625.197821:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9b480 x1853163940568192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319625.198439:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940567680:0@lo:400:kworker.0
00000100:00100000:2.0:1767319625.198506:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319625.198620:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940567808:0@lo:400:kworker.0
00000100:00100000:1.0:1767319625.198654:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319625.198744:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940567552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319625.198808:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940567296:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.198834:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319625.198860:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940567424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.198883:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319625.199161:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567808
00000100:00100000:2.0:1767319625.199169:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567808
00000100:00100000:3.0:1767319625.199407:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567296
00000100:00100000:3.0:1767319625.199412:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567296
00000100:00100000:3.0:1767319625.199449:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17216
00000100:00100000:3.0:1767319625.199455:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940567296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319625.199476:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319625.199532:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940567296:12345-0@lo:38:kworker.0 Request processed in 75us (696us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319625.199539:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17216
00000100:00100000:3.0:1767319625.199563:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567680
00000100:00100000:3.0:1767319625.199566:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567680
00000100:00100000:3.0:1767319625.199596:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987
00000100:00100000:3.0:1767319625.199603:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940567680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319625.199635:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940567680:12345-0@lo:400:kworker.0 Request processed in 34us (1130us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319625.199640:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987
00000100:00100000:3.0:1767319625.199683:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567424
00000100:00100000:3.0:1767319625.199687:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567424
00000100:00100000:3.0:1767319625.199706:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138
00000100:00100000:3.0:1767319625.199710:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940567424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319625.199729:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319625.199755:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940567424:12345-0@lo:38:kworker.0 Request processed in 44us (872us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319625.199761:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138
00000100:00100000:3.0:1767319625.199797:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319625.199818:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319625.199825:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940568064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319625.199849:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319625.199870:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568064
00000100:00100000:3.0:1767319625.199873:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568064
00000100:00100000:2.0:1767319625.200020:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4603
00000100:00080000:0.0:1767319625.200167:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319625.200230:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319625.200236:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319625.200240:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940567424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.200246:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940567936:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.200269:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319625.200281:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940568192:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.200294:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319625.200316:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319625.200319:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319625.200321:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940567296:0@lo:38:kworker.0
00000100:00100000:1.0:1767319625.200440:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567552
00000100:00100000:1.0:1767319625.200444:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567552
00000100:00100000:1.0:1767319625.200471:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988
00000100:00100000:1.0:1767319625.200478:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940567552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319625.200515:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940567552:12345-0@lo:400:kworker.0 Request processed in 38us (717us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319625.200522:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988
00000100:00100000:1.0:1767319625.200545:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940567936
00000100:00100000:1.0:1767319625.200549:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940567936
00000100:00100000:1.0:1767319625.200559:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568192
00000100:00100000:1.0:1767319625.200560:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568192
00000100:00100000:1.0:1767319625.200566:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17217
00000100:00100000:1.0:1767319625.200569:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940567936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319625.200577:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319625.200597:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940567936:12345-0@lo:38:kworker.0 Request processed in 27us (328us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319625.200601:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17217
00000100:00100000:1.0:1767319625.200607:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17218
00000100:00100000:1.0:1767319625.200610:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940568192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319625.200615:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319625.200626:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940568192:12345-0@lo:38:kworker.0 Request processed in 16us (331us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319625.200629:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17218
00000100:00080000:1.0:1767319625.200643:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319625.200646:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319625.200648:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940567936:0@lo:38:kworker.0
00000100:00080000:1.0:1767319625.200652:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319625.200654:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319625.200656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940568192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319625.200849:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940567808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319625.200871:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4604
00000100:00100000:3.0:1767319625.200878:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940568064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319625.200888:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940567808:12345-0@lo:400:kworker.0 Request processed in 863us (2233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319625.200894:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4603
00000100:00100000:3.0:1767319625.200904:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940568064:12345-0@lo:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319625.200910:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4604
00000100:00100000:3.0:1767319625.200935:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940568064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319625.200936:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940567808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319625.200945:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940567552:0@lo:400:kworker.0
00000100:00100000:2.0:1767319625.200959:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940567680:0@lo:400:kworker.0
00000100:00080000:0.0:1767319625.201434:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319625.709892:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319625.709919:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940568320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319625.710001:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319625.710343:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568320
00000100:00100000:2.0:1767319625.710352:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568320
00000100:00100000:2.0:1767319625.710445:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541
00000100:00100000:2.0:1767319625.710454:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940568320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319625.710483:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319625.710529:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940568320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (528us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319625.710536:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541
00000100:00100000:1.0:1767319625.710602:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940568320:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319625.900930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319626.157356:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319626.925323:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319627.181697:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319627.848554:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319627.848890:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329472
00000100:00100000:1.0:1767319627.848902:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329472
00000100:00100000:1.0:1767319627.848992:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4605
00000100:00100000:1.0:1767319627.849005:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894329472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319627.849152:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894329472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 149us (607us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319627.849162:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4605
00000100:00080000:0.0:1767319627.849245:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319627.864474:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894329216 offset 0 length 520: 4
00000100:00100000:2.0:1767319627.864626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319627.866634:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329344
00000100:00100000:3.0:1767319627.866648:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329344
00000100:00100000:3.0:1767319627.866711:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17219
00000100:00100000:3.0:1767319627.866720:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894329344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319627.866747:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319627.866860:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894329344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 139us (2234us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319627.866868:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17219
00000100:00100000:2.0:1767319627.948947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319628.205537:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319628.972886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319629.229588:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319629.813042:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319629.813068:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940568448:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319629.813225:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319629.813464:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568448
00000100:00100000:1.0:1767319629.813472:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568448
00000100:00100000:1.0:1767319629.813533:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542
00000100:00100000:1.0:1767319629.813542:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940568448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319629.813571:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319629.813616:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940568448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319629.813624:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542
00000100:00100000:3.0:1767319629.813644:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940568448:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319629.813690:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319629.996890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319630.253696:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319630.317088:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319630.317098:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319630.317100:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319630.317104:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319630.317108:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319630.317116:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4875
00000100:00080000:1.0:1767319630.317121:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319630.317129:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319630.317173:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08a80 x1853163940568576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319630.317198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319630.317202:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319630.317203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319630.317206:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4875
00000100:00080000:1.0:1767319630.317208:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319630.317211:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319630.317224:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09500 x1853163940568704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319630.317285:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319630.317288:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319630.317290:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319630.317293:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4875
00000100:00080000:1.0:1767319630.317296:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319630.317300:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319630.317310:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08000 x1853163940569216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319630.317324:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319630.317327:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319630.317329:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319630.317332:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4875
00000100:00080000:1.0:1767319630.317334:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319630.317339:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319630.317444:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940568576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319630.317454:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940569344:0@lo:400:kworker.0
00000100:00100000:1.0:1767319630.317491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09180 x1853163940569472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319630.317517:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940568960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319630.317559:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940568832:0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.320317:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319630.320429:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940569088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.320460:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319630.320497:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569344
00000100:00100000:0.0:1767319630.320505:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569344
00000100:00100000:0.0:1767319630.320563:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569088
00000100:00100000:0.0:1767319630.320567:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569088
00000100:00100000:0.0:1767319630.320593:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4606
00000100:00100000:0.0:1767319630.320600:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940569344:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.320653:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940569344:12345-0@lo:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319630.320660:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4606
00000100:00100000:0.0:1767319630.320687:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4607
00000100:00100000:0.0:1767319630.320694:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940569088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.320723:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940569088:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319630.320730:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4607
00000100:00080000:0.0:1767319630.320749:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319630.320794:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940569088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.320823:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940569344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319630.320918:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319630.320954:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940568704:0@lo:38:kworker.0
00000100:00100000:2.0:1767319630.320982:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319630.321008:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940569216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319630.321030:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319630.321055:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940569472:0@lo:38:kworker.0
00000100:00100000:2.0:1767319630.321076:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319630.322386:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568576
00000100:00100000:0.0:1767319630.322397:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568576
00000100:00100000:0.0:1767319630.322441:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569216
00000100:00100000:0.0:1767319630.322445:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569216
00000100:00100000:0.0:1767319630.322462:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569472
00000100:00100000:0.0:1767319630.322465:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569472
00000100:00100000:0.0:1767319630.322485:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17220
00000100:00100000:0.0:1767319630.322491:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940568576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319630.322522:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319630.322581:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940568576:12345-0@lo:38:kworker.0 Request processed in 89us (1663us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319630.322588:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17220
00000100:00100000:0.0:1767319630.322603:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17221
00000100:00100000:0.0:1767319630.322606:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940569216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319630.322616:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319630.322638:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940569216:12345-0@lo:38:kworker.0 Request processed in 30us (1607us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319630.322643:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17221
00000100:00100000:0.0:1767319630.322655:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17222
00000100:00100000:0.0:1767319630.322659:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940569472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319630.322668:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319630.322704:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940569472:12345-0@lo:38:kworker.0 Request processed in 43us (1627us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319630.322709:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17222
00000100:00100000:0.0:1767319630.322753:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568704
00000100:00100000:0.0:1767319630.322758:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568704
00000100:00100000:0.0:1767319630.322805:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139
00000100:00100000:0.0:1767319630.322810:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940568704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319630.322820:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319630.322847:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940568704:12345-0@lo:38:kworker.0 Request processed in 35us (1863us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319630.322852:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139
00000100:00100000:1.0:1767319630.323681:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319630.323849:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319630.323854:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319630.323858:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940569472:0@lo:38:kworker.0
00000100:00080000:2.0:1767319630.323869:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319630.323872:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319630.323875:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940568576:0@lo:38:kworker.0
00000100:00080000:2.0:1767319630.323885:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319630.323887:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319630.323891:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940568704:0@lo:38:kworker.0
00000100:00080000:2.0:1767319630.323898:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319630.323900:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319630.323903:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940569216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319630.324299:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568960
00000100:00100000:0.0:1767319630.324305:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568960
00000100:00100000:0.0:1767319630.324368:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989
00000100:00100000:0.0:1767319630.324376:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940568960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319630.324425:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940568960:12345-0@lo:400:kworker.0 Request processed in 50us (754us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319630.324432:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989
00000100:00080000:1.0:1767319630.325145:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319630.325178:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940568960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319630.325344:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319630.328667:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940568832
00000100:00100000:2.0:1767319630.328689:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940568832
00000100:00100000:2.0:1767319630.328758:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990
00000100:00100000:2.0:1767319630.328767:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940568832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319630.328884:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940568832:12345-0@lo:400:kworker.0 Request processed in 118us (3540us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319630.328892:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990
00000100:00100000:3.0:1767319630.329035:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940568832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319630.830078:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319630.840767:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940569600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319630.840875:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319630.842651:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569600
00000100:00100000:1.0:1767319630.842675:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569600
00000100:00100000:1.0:1767319630.842749:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543
00000100:00100000:1.0:1767319630.842759:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940569600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319630.842824:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319630.842901:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940569600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (2025us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319630.842909:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543
00000100:00100000:2.0:1767319630.843702:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940569600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319631.021056:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319631.276986:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319632.044879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319632.302125:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319632.968031:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319632.968078:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319632.968272:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329600
00000100:00100000:1.0:1767319632.968284:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329600
00000100:00100000:1.0:1767319632.968339:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329728
00000100:00100000:1.0:1767319632.968342:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329728
00000100:00100000:1.0:1767319632.968404:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4608
00000100:00100000:1.0:1767319632.968442:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894329728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319632.968546:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894329728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 106us (467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319632.968565:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4608
00000100:00100000:1.0:1767319632.968585:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17223
00000100:00100000:1.0:1767319632.968591:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894329600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319632.968616:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319632.968671:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894329600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (643us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319632.968678:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17223
00000100:00080000:3.0:1767319632.968974:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319633.070849:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319633.325735:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319634.092878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319634.349237:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319634.413026:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319609/real 1767319609]  req@ffff93d046b9b800 x1853163940563584/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319634 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319634.413061:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d046b9b800 x1853163940563584/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319634 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319634.413091:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319634.413115:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319634.413119:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940563584:0@lo:250:kworker.0
00000100:00080000:1.0:1767319634.413285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319634.413291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319634.413293:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319634.413298:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4859
00000100:00080000:1.0:1767319634.413302:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319634.413308:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319634.413345:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08380 x1853163940569728/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319634.413372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319634.413376:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319634.413378:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319634.413382:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4880
00000100:00080000:1.0:1767319634.413385:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319634.413387:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319634.413410:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08e00 x1853163940569856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319634.413418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319634.413420:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319634.413422:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319634.413426:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4880
00000100:00080000:1.0:1767319634.413429:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319634.413432:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319634.413457:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0aa00 x1853163940569984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319634.413520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319634.413523:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319634.413525:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319634.413542:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4880
00000100:00080000:1.0:1767319634.413544:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319634.413548:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319634.413559:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08a80 x1853163940570496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319634.413574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319634.413577:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319634.413579:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319634.413582:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4880
00000100:00080000:1.0:1767319634.413584:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319634.413587:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319634.413596:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0b480 x1853163940570752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319634.413621:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940570624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319634.413696:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319634.413755:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319634.413761:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940570368:0@lo:400:kworker.0
00000100:00100000:1.0:1767319634.413802:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.414017:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570624
00000100:00100000:2.0:1767319634.414025:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570624
00000100:00100000:2.0:1767319634.414094:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570368
00000100:00100000:2.0:1767319634.414098:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570368
00000100:00100000:2.0:1767319634.414120:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4609
00000100:00100000:2.0:1767319634.414129:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940570624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319634.414194:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940570624:12345-0@lo:400:kworker.0 Request processed in 65us (497us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319634.414202:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4609
00000100:00100000:2.0:1767319634.414222:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4610
00000100:00100000:2.0:1767319634.414229:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940570368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319634.414253:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940570368:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319634.414259:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4610
00000100:00100000:2.0:1767319634.414282:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940569728:0@lo:250:kworker.0
00000400:00000100:2.0:1767319634.414306:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940569728 offset 0 length 520: 4
00000100:00100000:2.0:1767319634.414323:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940569856:0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414349:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.414367:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940569984:0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414392:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.414423:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940570496:0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414444:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.414459:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940570752:0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414476:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.414503:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569984
00000100:00100000:2.0:1767319634.414507:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569984
00000100:00100000:2.0:1767319634.414525:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140
00000100:00100000:2.0:1767319634.414530:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940569984:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319634.414589:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570112:0@lo:400:kworker.0
00000100:00100000:3.0:1767319634.414622:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319634.414652:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319634.414658:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570240:0@lo:400:kworker.0
00000100:00100000:3.0:1767319634.414682:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319634.414720:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940569856
00000100:00100000:3.0:1767319634.414724:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940569856
00000100:00100000:3.0:1767319634.414742:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570496
00000100:00100000:3.0:1767319634.414744:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570496
00010000:00020000:2.0:1767319634.414751:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319634.414754:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570752
00000100:00100000:3.0:1767319634.414756:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570752
00000100:00100000:3.0:1767319634.414765:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17224
00000100:00100000:3.0:1767319634.414770:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940569856:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414804:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940569984:12345-0@lo:38:kworker.0 Request processed in 272us (411us total) trans 0 rc -19/-19
00010000:00020000:3.0:1767319634.414804:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319634.414810:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140
00000100:00100000:3.0:1767319634.414827:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940569856:12345-0@lo:38:kworker.0 Request processed in 57us (482us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319634.414828:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570112
00000100:00100000:2.0:1767319634.414831:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570112
00000100:00100000:3.0:1767319634.414833:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17224
00000100:00100000:3.0:1767319634.414845:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17225
00000100:00100000:3.0:1767319634.414849:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940570496:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319634.414852:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570240
00000100:00100000:2.0:1767319634.414854:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570240
00010000:00020000:3.0:1767319634.414857:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319634.414870:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991
00000100:00100000:2.0:1767319634.414876:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319634.414877:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940570496:12345-0@lo:38:kworker.0 Request processed in 27us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319634.414882:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17225
00000100:00100000:3.0:1767319634.414891:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17226
00000100:00100000:3.0:1767319634.414895:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940570752:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319634.414904:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319634.414907:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570112:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319634.414913:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991
00000100:00100000:3.0:1767319634.414922:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940570752:12345-0@lo:38:kworker.0 Request processed in 25us (445us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319634.414924:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992
00000100:00100000:3.0:1767319634.414927:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17226
00000100:00100000:2.0:1767319634.414929:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319634.414954:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570240:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319634.414959:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992
00000100:00100000:3.0:1767319634.414975:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940570368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319634.414985:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940570624:0@lo:400:kworker.0
00000100:00080000:3.0:1767319634.415018:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319634.415023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319634.415025:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940569856:0@lo:38:kworker.0
00000100:00080000:3.0:1767319634.415032:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319634.415035:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319634.415037:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940569984:0@lo:38:kworker.0
00000100:00080000:3.0:1767319634.415043:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319634.415045:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319634.415048:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940570496:0@lo:38:kworker.0
00000100:00080000:3.0:1767319634.415053:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319634.415056:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319634.415058:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940570752:0@lo:38:kworker.0
00000100:00100000:3.0:1767319634.415086:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570240:0@lo:400:kworker.0
00000100:00100000:3.0:1767319634.415094:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570112:0@lo:400:kworker.0
00000100:00080000:1.0:1767319634.416114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319634.416121:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319634.416124:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319634.929137:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570880:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319634.929236:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319634.929770:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940570880
00000100:00100000:2.0:1767319634.929808:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940570880
00000100:00100000:2.0:1767319634.929866:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544
00000100:00100000:2.0:1767319634.929874:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319634.929904:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319634.929955:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940570880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (720us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319634.929963:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544
00000100:00100000:3.0:1767319634.930135:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940570880:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319635.118226:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319635.373033:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319635.949177:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940571008:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319635.949261:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319635.949313:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571008
00000100:00100000:1.0:1767319635.949321:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571008
00000100:00100000:1.0:1767319635.949368:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545
00000100:00100000:1.0:1767319635.949378:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940571008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319635.949408:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319635.949469:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940571008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (217us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319635.949477:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545
00000100:00100000:0.0:1767319635.949533:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940571008:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319636.140879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319636.398259:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319637.164958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319637.421112:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319638.086886:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319638.086971:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319638.087060:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329984
00000100:00100000:0.0:1767319638.087070:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329984
00000100:00100000:0.0:1767319638.087145:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894329856
00000100:00100000:0.0:1767319638.087149:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894329856
00000100:00100000:0.0:1767319638.087169:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4611
00000100:00100000:0.0:1767319638.087180:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894329984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319638.087254:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894329984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (379us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319638.087261:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4611
00000100:00100000:0.0:1767319638.087280:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17227
00000100:00100000:0.0:1767319638.087284:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894329856:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319638.087303:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319638.087328:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894329856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (357us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319638.087333:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17227
00000100:00080000:1.0:1767319638.087809:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319638.188889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319638.448707:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319639.212914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319639.470430:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319639.533283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319639.533294:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319639.533297:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319639.533300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319639.533305:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319639.533313:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4884
00000100:00080000:1.0:1767319639.533318:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319639.533326:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319639.533364:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08000 x1853163940571136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319639.533392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319639.533397:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319639.533399:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319639.533402:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4884
00000100:00080000:1.0:1767319639.533405:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319639.533408:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319639.533422:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0b480 x1853163940571264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319639.533466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319639.533470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319639.533471:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319639.533475:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4884
00000100:00080000:1.0:1767319639.533477:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319639.533481:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319639.533683:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940571520:0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.533759:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.533849:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319639.533856:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940571392:0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.533880:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.533905:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940571136:0@lo:38:kworker.0
00000100:00100000:3.0:1767319639.533931:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.533945:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940571264:0@lo:38:kworker.0
00000100:00100000:3.0:1767319639.533965:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.534002:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940571648:0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.534023:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.534053:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571136
00000100:00100000:3.0:1767319639.534059:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571136
00000100:00100000:3.0:1767319639.534089:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571648
00000100:00100000:3.0:1767319639.534092:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571648
00000100:00100000:3.0:1767319639.534128:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4612
00000100:00100000:3.0:1767319639.534140:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940571648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.534187:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940571648:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319639.534194:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4612
00000100:00100000:3.0:1767319639.534212:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17228
00000100:00100000:3.0:1767319639.534217:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940571136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319639.534234:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319639.534263:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940571136:12345-0@lo:38:kworker.0 Request processed in 44us (330us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319639.534269:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17228
00000100:00100000:3.0:1767319639.534305:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940571648:0@lo:400:kworker.0
00000100:00080000:3.0:1767319639.534331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319639.534337:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319639.534339:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940571136:0@lo:38:kworker.0
00000100:00100000:3.0:1767319639.534364:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571520
00000100:00100000:3.0:1767319639.534368:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571520
00000100:00100000:3.0:1767319639.534392:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571392
00000100:00100000:3.0:1767319639.534395:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571392
00000100:00100000:3.0:1767319639.534411:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993
00000100:00100000:3.0:1767319639.534417:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940571520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.534452:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940571520:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319639.534457:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993
00000100:00100000:3.0:1767319639.534468:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994
00000100:00100000:3.0:1767319639.534474:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940571392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.534853:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940571392:12345-0@lo:400:kworker.0 Request processed in 379us (972us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319639.534859:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994
00000100:00100000:3.0:1767319639.534887:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940571392:0@lo:400:kworker.0
00000100:00100000:3.0:1767319639.534896:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940571520:0@lo:400:kworker.0
00000100:00080000:3.0:1767319639.534921:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319639.534925:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319639.534927:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319639.534998:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09880 x1853163940571776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319639.535040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319639.535044:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319639.535046:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319639.535049:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4884
00000100:00080000:1.0:1767319639.535052:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319639.535056:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319639.535068:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09180 x1853163940572032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319639.535087:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319639.535096:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940571904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319639.535120:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319639.535147:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571904
00000100:00100000:1.0:1767319639.535151:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571904
00000100:00100000:1.0:1767319639.535181:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4613
00000100:00100000:1.0:1767319639.535188:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940571904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319639.535218:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940571904:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319639.535224:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4613
00000100:00080000:1.0:1767319639.535237:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319639.535253:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940571904:0@lo:400:kworker.0
00000100:00100000:0.0:1767319639.535470:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571264
00000100:00100000:0.0:1767319639.535474:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571264
00000100:00100000:0.0:1767319639.535502:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141
00000100:00100000:0.0:1767319639.535507:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940571264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319639.535521:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319639.535548:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940571264:12345-0@lo:38:kworker.0 Request processed in 40us (1582us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319639.535553:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141
00000100:00100000:3.0:1767319639.535765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940571776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319639.535818:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319639.535843:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940572032:0@lo:38:kworker.0
00000100:00100000:3.0:1767319639.535863:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319639.535890:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319639.535895:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319639.535898:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940571264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319639.536003:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940571776
00000100:00100000:2.0:1767319639.536008:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940571776
00000100:00100000:2.0:1767319639.536031:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572032
00000100:00100000:2.0:1767319639.536035:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572032
00000100:00100000:2.0:1767319639.536050:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17229
00000100:00100000:2.0:1767319639.536055:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940571776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319639.536064:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319639.536095:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940571776:12345-0@lo:38:kworker.0 Request processed in 40us (276us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319639.536101:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17229
00000100:00100000:2.0:1767319639.536111:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17230
00000100:00100000:2.0:1767319639.536114:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940572032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319639.536122:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319639.536143:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940572032:12345-0@lo:38:kworker.0 Request processed in 28us (280us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319639.536149:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17230
00000100:00080000:2.0:1767319639.536170:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319639.536174:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319639.536177:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940571776:0@lo:38:kworker.0
00000100:00080000:2.0:1767319639.536184:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319639.536187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319639.536189:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940572032:0@lo:38:kworker.0
00000100:00100000:2.0:1767319640.045014:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940572160:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319640.045079:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319640.045348:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572160
00000100:00100000:1.0:1767319640.045357:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572160
00000100:00100000:1.0:1767319640.045408:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546
00000100:00100000:1.0:1767319640.045417:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940572160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319640.045446:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319640.045627:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940572160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 210us (547us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319640.045634:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546
00000100:00100000:2.0:1767319640.045715:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940572160:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319640.236891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319640.492955:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319641.069202:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940572288:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319641.069279:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319641.069367:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572288
00000100:00100000:1.0:1767319641.069375:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572288
00000100:00100000:1.0:1767319641.069440:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547
00000100:00100000:1.0:1767319641.069450:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940572288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319641.069489:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319641.069673:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319641.073957:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940572288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4498us (4666us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319641.073975:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547
00000100:00100000:2.0:1767319641.074116:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940572288:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319641.260919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319641.519019:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319642.285089:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319642.541133:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319643.208145:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319643.209947:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330112
00000100:00100000:3.0:1767319643.209968:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330112
00000100:00100000:3.0:1767319643.210105:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17231
00000100:00100000:3.0:1767319643.210114:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894330112:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319643.210140:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319643.210247:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894330112:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 132us (2122us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319643.210254:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17231
00000100:00100000:1.0:1767319643.215071:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319643.215362:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330240
00000100:00100000:3.0:1767319643.215770:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330240
00000100:00100000:3.0:1767319643.215925:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4614
00000100:00100000:3.0:1767319643.215939:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894330240:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319643.216100:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894330240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 165us (1039us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319643.216108:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4614
00000100:00080000:1.0:1767319643.216289:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319643.308981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319643.565020:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319644.333125:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319644.589413:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319644.653086:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319644.653096:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319644.653100:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319644.653104:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319644.653108:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319644.653115:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4889
00000100:00080000:3.0:1767319644.653120:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319644.653127:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319644.653265:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b9ad80 x1853163940572416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319644.653293:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319644.653297:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319644.653299:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319644.653302:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4889
00000100:00080000:3.0:1767319644.653305:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319644.653309:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319644.653322:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d046b99880 x1853163940572544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319644.653395:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319644.653399:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319644.653401:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319644.653405:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4889
00000100:00080000:3.0:1767319644.653407:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319644.653411:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319644.653424:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50ad9180 x1853163940573056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319644.653490:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319644.653493:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319644.653495:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319644.653499:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4889
00000100:00080000:3.0:1767319644.653501:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319644.653505:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319644.653516:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879e300 x1853163940573312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319644.653552:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940572928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319644.653624:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319644.653695:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319644.653702:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940573184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319644.653726:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319644.653758:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572928
00000100:00100000:3.0:1767319644.653765:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572928
00000100:00100000:3.0:1767319644.653841:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573184
00000100:00100000:3.0:1767319644.653844:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573184
00000100:00100000:3.0:1767319644.653869:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4615
00000100:00100000:3.0:1767319644.653876:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940572928:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319644.653925:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940572928:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319644.653932:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4615
00000100:00100000:3.0:1767319644.653950:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4616
00000100:00100000:3.0:1767319644.653956:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940573184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319644.653982:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940573184:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319644.653988:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4616
00000100:00080000:3.0:1767319644.654005:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319644.654034:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940573184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319644.654045:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940572928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319644.654128:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940572672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319644.654263:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319644.654297:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319644.654303:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940572800:0@lo:400:kworker.0
00000100:00100000:1.0:1767319644.654324:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319644.655367:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940572416:0@lo:38:kworker.0
00000100:00100000:2.0:1767319644.655418:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319644.655442:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940572544:0@lo:38:kworker.0
00000100:00100000:2.0:1767319644.655467:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319644.655485:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940573056:0@lo:38:kworker.0
00000100:00100000:2.0:1767319644.655519:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319644.655536:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940573312:0@lo:38:kworker.0
00000100:00100000:2.0:1767319644.655569:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319644.655605:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572544
00000100:00100000:2.0:1767319644.655611:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572544
00000100:00100000:2.0:1767319644.655636:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142
00000100:00100000:2.0:1767319644.655642:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940572544:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319644.655661:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319644.655699:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940572544:12345-0@lo:38:kworker.0 Request processed in 55us (230us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319644.655706:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142
00000100:00100000:2.0:1767319644.655725:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572416
00000100:00100000:2.0:1767319644.655729:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572416
00000100:00100000:2.0:1767319644.655747:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573056
00000100:00100000:2.0:1767319644.655749:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573056
00000100:00100000:2.0:1767319644.655761:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573312
00000100:00100000:2.0:1767319644.655764:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573312
00000100:00100000:2.0:1767319644.655797:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17232
00000100:00100000:2.0:1767319644.655801:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940572416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319644.655810:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319644.655836:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940572416:12345-0@lo:38:kworker.0 Request processed in 34us (418us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319644.655842:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17232
00000100:00100000:2.0:1767319644.655853:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17233
00000100:00100000:2.0:1767319644.655856:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940573056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319644.655864:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319644.655886:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940573056:12345-0@lo:38:kworker.0 Request processed in 28us (366us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319644.655891:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17233
00000100:00100000:2.0:1767319644.655901:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17234
00000100:00100000:2.0:1767319644.655905:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940573312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319644.655913:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319644.655933:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940573312:12345-0@lo:38:kworker.0 Request processed in 27us (364us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319644.655938:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17234
00000100:00080000:2.0:1767319644.655979:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319644.655984:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319644.655987:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940572416:0@lo:38:kworker.0
00000100:00080000:2.0:1767319644.655996:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319644.655999:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319644.656003:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940572544:0@lo:38:kworker.0
00000100:00080000:2.0:1767319644.656013:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319644.656016:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319644.656019:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940573056:0@lo:38:kworker.0
00000100:00080000:2.0:1767319644.656025:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319644.656028:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319644.656030:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940573312:0@lo:38:kworker.0
00000100:00100000:0.0:1767319644.656300:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572672
00000100:00100000:0.0:1767319644.656306:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572672
00000100:00100000:0.0:1767319644.656362:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940572800
00000100:00100000:0.0:1767319644.656365:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940572800
00000100:00100000:0.0:1767319644.656389:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995
00000100:00100000:0.0:1767319644.656395:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940572672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319644.656445:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940572672:12345-0@lo:400:kworker.0 Request processed in 50us (2181us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319644.656450:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995
00000100:00100000:0.0:1767319644.656466:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996
00000100:00100000:0.0:1767319644.656472:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940572800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319644.656499:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940572800:12345-0@lo:400:kworker.0 Request processed in 28us (2174us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319644.656505:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996
00000100:00100000:0.0:1767319644.656556:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940572800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319644.656568:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d046b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940572672:0@lo:400:kworker.0
00000100:00080000:2.0:1767319644.658688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319644.658699:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319645.165264:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319645.165288:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940573440:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319645.165360:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319645.166386:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573440
00000100:00100000:1.0:1767319645.166400:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573440
00000100:00100000:1.0:1767319645.166573:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548
00000100:00100000:1.0:1767319645.166583:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940573440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319645.166615:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319645.166695:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940573440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1334us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319645.166702:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548
00000100:00100000:2.0:1767319645.166801:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940573440:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319645.356896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319645.612967:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319646.189231:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940573568:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319646.189301:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319646.189689:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573568
00000100:00100000:3.0:1767319646.189695:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573568
00000100:00100000:3.0:1767319646.189747:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549
00000100:00100000:3.0:1767319646.189755:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940573568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319646.189806:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319646.189846:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940573568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (545us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319646.189851:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549
00000100:00080000:2.0:1767319646.190040:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319646.190073:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940573568:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319646.383111:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319646.638931:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319647.404928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319647.661029:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319648.326200:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319648.326303:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319648.326997:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330496
00000100:00100000:3.0:1767319648.327010:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330496
00000100:00080000:2.0:1767319648.327156:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319648.327206:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330368
00000100:00100000:3.0:1767319648.327211:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330368
00000100:00100000:0.0:1767319648.327324:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4617
00000100:00100000:0.0:1767319648.327337:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894330496:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319648.327436:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894330496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (1260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319648.327444:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4617
00000100:00100000:0.0:1767319648.327464:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17235
00000100:00100000:0.0:1767319648.327469:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894330368:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319648.327499:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319648.327534:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894330368:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 63us (1231us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319648.327541:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17235
00000100:00100000:3.0:1767319648.429097:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319648.685037:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319649.453012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319649.709637:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319649.772915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319649.772925:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319649.772927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319649.772931:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319649.772936:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319649.772946:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4894
00000100:00080000:3.0:1767319649.772950:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319649.772958:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319649.773001:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879c380 x1853163940573696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319649.773024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319649.773027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319649.773028:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319649.773031:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4894
00000100:00080000:3.0:1767319649.773033:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319649.773035:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319649.773042:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ed80 x1853163940573824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319649.773101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319649.773103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319649.773105:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319649.773107:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4894
00000100:00080000:3.0:1767319649.773108:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319649.773111:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319649.773117:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f800 x1853163940574336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319649.773127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319649.773129:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319649.773131:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319649.773135:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4894
00000100:00080000:3.0:1767319649.773137:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319649.773141:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319649.773151:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879ce00 x1853163940574592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319649.773184:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940574208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319649.773252:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319649.773310:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319649.773314:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940574464:0@lo:400:kworker.0
00000100:00100000:3.0:1767319649.773332:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319649.773414:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940573952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773441:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319649.773467:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319649.773470:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940574080:0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773483:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319649.773522:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574208
00000100:00100000:0.0:1767319649.773528:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574208
00000100:00100000:0.0:1767319649.773569:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574464
00000100:00100000:0.0:1767319649.773571:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574464
00000100:00100000:0.0:1767319649.773590:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4618
00000100:00100000:0.0:1767319649.773595:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940574208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773636:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940574208:12345-0@lo:400:kworker.0 Request processed in 41us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319649.773642:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4618
00000100:00100000:0.0:1767319649.773659:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4619
00000100:00100000:0.0:1767319649.773665:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940574464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773692:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940574464:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319649.773698:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4619
00000100:00100000:0.0:1767319649.773717:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573952
00000100:00100000:0.0:1767319649.773720:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573952
00000100:00100000:0.0:1767319649.773744:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574080
00000100:00100000:0.0:1767319649.773747:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574080
00000100:00100000:0.0:1767319649.773766:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997
00000100:00100000:0.0:1767319649.773806:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940573952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773832:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940573952:12345-0@lo:400:kworker.0 Request processed in 61us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319649.773836:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997
00000100:00100000:0.0:1767319649.773844:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998
00000100:00100000:0.0:1767319649.773848:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940574080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773863:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940574080:12345-0@lo:400:kworker.0 Request processed in 16us (380us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319649.773866:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998
00000100:00100000:0.0:1767319649.773907:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940574080:0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773913:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940573952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773931:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940574464:0@lo:400:kworker.0
00000100:00100000:0.0:1767319649.773936:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940574208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319649.774612:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940573696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.774667:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319649.774699:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940573824:0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.774725:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319649.774759:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940574336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.774802:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319649.774821:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940574592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.774843:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319649.774866:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573696
00000100:00100000:1.0:1767319649.774878:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573696
00000100:00100000:2.0:1767319649.774879:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940573824
00000100:00100000:2.0:1767319649.774885:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940573824
00000100:00100000:1.0:1767319649.774909:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574336
00000100:00100000:1.0:1767319649.774913:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574336
00000100:00100000:2.0:1767319649.774914:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143
00000100:00100000:2.0:1767319649.774921:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940573824:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319649.774939:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319649.774944:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574592
00000100:00100000:1.0:1767319649.774948:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574592
00000100:00100000:1.0:1767319649.774965:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17236
00000100:00100000:1.0:1767319649.774972:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940573696:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.774978:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940573824:12345-0@lo:38:kworker.0 Request processed in 55us (251us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767319649.774985:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319649.774987:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143
00000100:00080000:2.0:1767319649.775008:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319649.775014:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319649.775017:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319649.775025:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940573696:12345-0@lo:38:kworker.0 Request processed in 52us (356us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319649.775031:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17237
00000100:00100000:2.0:1767319649.775040:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940574336:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319649.775043:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17236
00010000:00020000:2.0:1767319649.775053:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319649.775062:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17238
00000100:00100000:1.0:1767319649.775075:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940574592:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319649.775081:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940574336:12345-0@lo:38:kworker.0 Request processed in 40us (277us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767319649.775087:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319649.775091:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17237
00000100:00080000:2.0:1767319649.775122:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319649.775124:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940574592:12345-0@lo:38:kworker.0 Request processed in 54us (279us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319649.775131:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17238
00000100:00080000:2.0:1767319649.775963:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319649.775969:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940573696:0@lo:38:kworker.0
00000100:00080000:2.0:1767319649.775986:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319649.775990:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319649.775993:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940573824:0@lo:38:kworker.0
00000100:00080000:2.0:1767319649.776001:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319649.776004:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319649.776007:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940574336:0@lo:38:kworker.0
00000100:00080000:2.0:1767319649.776015:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319649.776018:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319649.776021:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940574592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319650.286342:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319650.293034:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940574720:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319650.293141:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319650.293369:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574720
00000100:00100000:3.0:1767319650.293378:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574720
00000100:00100000:3.0:1767319650.293442:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550
00000100:00100000:3.0:1767319650.293452:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940574720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319650.293486:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319650.293560:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940574720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (432us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319650.293568:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550
00000100:00100000:2.0:1767319650.293877:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940574720:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319650.476938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319650.733499:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319651.309091:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940574848:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319651.309174:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319651.309358:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574848
00000100:00100000:3.0:1767319651.309370:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574848
00000100:00100000:3.0:1767319651.309451:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551
00000100:00100000:3.0:1767319651.309466:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940574848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319651.309504:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319651.309553:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940574848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (377us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319651.309563:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551
00000100:00080000:2.0:1767319651.309816:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319651.309854:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940574848:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319651.500852:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319651.757759:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767319652.425985:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894330624 offset 0 length 520: 4
00000100:00100000:2.0:1767319652.426031:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319652.426141:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319652.434831:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330752
00000100:00100000:0.0:1767319652.434847:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330752
00000100:00100000:0.0:1767319652.434900:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894330880
00000100:00100000:0.0:1767319652.434904:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894330880
00000100:00100000:0.0:1767319652.434974:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4620
00000100:00100000:0.0:1767319652.434985:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894330880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319652.435070:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894330880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (8928us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319652.435078:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4620
00000100:00100000:0.0:1767319652.435098:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17239
00000100:00100000:0.0:1767319652.435102:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894330752:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:3.0:1767319652.436323:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767319652.437096:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319652.437251:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894330752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 2144us (11217us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319652.437260:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17239
00000100:00100000:3.0:1767319652.524964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319652.781081:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319653.548908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319653.804929:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319654.573044:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319654.829351:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319654.896523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319654.896534:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319654.896537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319654.896541:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319654.896546:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319654.896553:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4899
00000100:00080000:0.0:1767319654.896558:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319654.896566:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319654.896608:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cea00 x1853163940574976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319654.896646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319654.896650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319654.896652:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319654.896654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4899
00000100:00080000:0.0:1767319654.896657:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319654.896660:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319654.896674:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cdc00 x1853163940575104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319654.896735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319654.896739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319654.896740:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319654.896743:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4899
00000100:00080000:0.0:1767319654.896746:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319654.896749:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319654.896762:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469ce300 x1853163940575616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319654.896810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319654.896814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319654.896815:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319654.896819:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4899
00000100:00080000:0.0:1767319654.896821:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319654.896824:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319654.896835:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469ce680 x1853163940575872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319654.896864:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940575360:0@lo:400:kworker.0
00000100:00100000:0.0:1767319654.896929:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319654.896997:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319654.897004:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940575232:0@lo:400:kworker.0
00000100:00100000:0.0:1767319654.897027:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319654.897070:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575360
00000100:00100000:0.0:1767319654.897077:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575360
00000100:00100000:0.0:1767319654.897138:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575232
00000100:00100000:0.0:1767319654.897142:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575232
00000100:00100000:0.0:1767319654.897166:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999
00000100:00100000:0.0:1767319654.897174:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940575360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319654.897222:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940575360:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319654.897229:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999
00000100:00100000:0.0:1767319654.897246:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000
00000100:00100000:0.0:1767319654.897252:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940575232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319654.897278:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940575232:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319654.897284:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000
00000100:00080000:0.0:1767319654.897303:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319654.897307:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319654.897339:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940575232:0@lo:400:kworker.0
00000100:00100000:0.0:1767319654.897350:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940575360:0@lo:400:kworker.0
00000100:00100000:3.0:1767319654.897540:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940574976:0@lo:38:kworker.0
00000100:00100000:3.0:1767319654.897573:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319654.897601:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940575104:0@lo:38:kworker.0
00000100:00100000:3.0:1767319654.897621:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319654.897636:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940575616:0@lo:38:kworker.0
00000100:00100000:3.0:1767319654.897652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319654.897664:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940575872:0@lo:38:kworker.0
00000100:00100000:3.0:1767319654.897680:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319654.897881:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940575488:0@lo:400:kworker.0
00000100:00100000:1.0:1767319654.897912:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319654.897942:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319654.897948:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940575744:0@lo:400:kworker.0
00000100:00100000:1.0:1767319654.897970:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319654.897994:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940574976
00000100:00100000:1.0:1767319654.897998:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940574976
00000100:00100000:1.0:1767319654.898016:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575616
00000100:00100000:1.0:1767319654.898020:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575616
00000100:00100000:1.0:1767319654.898028:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575872
00000100:00100000:1.0:1767319654.898030:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575872
00000100:00100000:1.0:1767319654.898038:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575488
00000100:00100000:1.0:1767319654.898040:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575488
00000100:00100000:1.0:1767319654.898062:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575744
00000100:00100000:1.0:1767319654.898064:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575744
00000100:00100000:1.0:1767319654.898078:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4621
00000100:00100000:1.0:1767319654.898083:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940575488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319654.898116:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940575488:12345-0@lo:400:kworker.0 Request processed in 33us (204us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319654.898125:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4621
00000100:00100000:1.0:1767319654.898138:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4622
00000100:00100000:1.0:1767319654.898144:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940575744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319654.898170:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940575744:12345-0@lo:400:kworker.0 Request processed in 27us (199us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319654.898175:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4622
00000100:00100000:1.0:1767319654.898185:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17240
00000100:00100000:1.0:1767319654.898189:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940574976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319654.898207:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319654.898237:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940574976:12345-0@lo:38:kworker.0 Request processed in 46us (663us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319654.898243:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17240
00000100:00100000:1.0:1767319654.898254:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17241
00000100:00100000:1.0:1767319654.898257:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940575616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319654.898266:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319654.898288:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940575616:12345-0@lo:38:kworker.0 Request processed in 29us (634us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319654.898293:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17241
00000100:00100000:1.0:1767319654.898305:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17242
00000100:00100000:1.0:1767319654.898309:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940575872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319654.898316:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319654.898337:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940575872:12345-0@lo:38:kworker.0 Request processed in 27us (656us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319654.898343:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17242
00000100:00080000:1.0:1767319654.898358:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319654.898378:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940575744:0@lo:400:kworker.0
00000100:00100000:1.0:1767319654.898388:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940575488:0@lo:400:kworker.0
00000100:00080000:1.0:1767319654.898409:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319654.898414:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319654.898417:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940574976:0@lo:38:kworker.0
00000100:00080000:1.0:1767319654.898424:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319654.898428:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319654.898431:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940575616:0@lo:38:kworker.0
00000100:00080000:1.0:1767319654.898437:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319654.898440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319654.898442:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940575872:0@lo:38:kworker.0
00000100:00100000:2.0:1767319654.898640:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940575104
00000100:00100000:2.0:1767319654.898647:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940575104
00000100:00100000:2.0:1767319654.898667:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144
00000100:00100000:2.0:1767319654.898672:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940575104:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319654.898682:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319654.898719:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940575104:12345-0@lo:38:kworker.0 Request processed in 46us (1096us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319654.898724:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144
00000100:00080000:1.0:1767319654.899764:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319654.899794:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319654.899799:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940575104:0@lo:38:kworker.0
00000100:00100000:2.0:1767319655.406172:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940576000:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319655.406233:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319655.406375:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576000
00000100:00100000:1.0:1767319655.406382:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576000
00000100:00100000:1.0:1767319655.406422:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767319655.406428:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940576000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319655.406487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319655.406539:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940576000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319655.406546:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552
00000100:00100000:2.0:1767319655.406838:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940576000:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319655.596913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319655.853418:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319656.429363:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940576128:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319656.429481:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319656.429885:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576128
00000100:00100000:1.0:1767319656.429895:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576128
00000100:00100000:1.0:1767319656.429974:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553
00000100:00100000:1.0:1767319656.429984:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940576128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319656.430030:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319656.430087:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940576128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (606us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319656.430095:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553
00000100:00100000:1.0:1767319656.430156:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940576128:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319656.431541:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319656.620971:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319656.876995:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319657.542966:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319657.543014:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319657.543212:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331136
00000100:00100000:1.0:1767319657.543223:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331136
00000100:00080000:2.0:1767319657.543294:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319657.543308:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331008
00000100:00100000:1.0:1767319657.543313:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331008
00000100:00100000:1.0:1767319657.543335:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4623
00000100:00100000:1.0:1767319657.543344:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894331136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319657.543460:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894331136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 116us (502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319657.543586:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17243
00000100:00100000:2.0:1767319657.543593:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894331008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319657.543614:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319657.543644:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894331008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319657.543652:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17243
00000100:00100000:1.0:1767319657.547390:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4623
00000100:00100000:3.0:1767319657.646755:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319657.901309:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319658.668898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319658.927572:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319659.693216:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319659.951844:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319660.012903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319660.012914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319660.012917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319660.012921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319660.012925:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319660.012933:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4904
00000100:00080000:0.0:1767319660.012938:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319660.012945:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319660.012989:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adce00 x1853163940576256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319660.013015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319660.013019:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319660.013020:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319660.013024:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4904
00000100:00080000:0.0:1767319660.013026:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319660.013029:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319660.013043:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc000 x1853163940576384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319660.013102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319660.013105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319660.013107:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319660.013110:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4904
00000100:00080000:0.0:1767319660.013112:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319660.013116:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319660.013128:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940576896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319660.013144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319660.013147:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319660.013149:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767319660.013149:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940576640:0@lo:400:kworker.0
00000100:00080000:0.0:1767319660.013152:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4904
00000100:00080000:0.0:1767319660.013154:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319660.013157:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319660.013165:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf480 x1853163940577152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319660.013182:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940576768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319660.013215:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319660.013215:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319660.013295:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940576512:0@lo:400:kworker.0
00000100:00100000:3.0:1767319660.015229:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319634/real 1767319634]  req@ffff93d070a08380 x1853163940569728/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319660.015257:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d070a08380 x1853163940569728/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319660.015277:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940576256:0@lo:38:kworker.0
00000100:00100000:1.0:1767319660.019133:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319660.019251:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940577024:0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019307:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319660.019342:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576768
00000100:00100000:1.0:1767319660.019350:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576768
00000100:00100000:1.0:1767319660.019415:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577024
00000100:00100000:1.0:1767319660.019419:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577024
00000100:00100000:1.0:1767319660.019446:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4624
00000100:00100000:1.0:1767319660.019456:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940576768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019505:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940576768:12345-0@lo:400:kworker.0 Request processed in 51us (6290us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319660.019512:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4624
00000100:00100000:1.0:1767319660.019528:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4625
00000100:00100000:1.0:1767319660.019534:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940577024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019564:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940577024:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319660.019569:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4625
00000100:00080000:1.0:1767319660.019585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319660.019641:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940577024:0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019683:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576640
00000100:00100000:1.0:1767319660.019686:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576640
00000100:00100000:1.0:1767319660.019713:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576512
00000100:00100000:1.0:1767319660.019717:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576512
00000100:00100000:1.0:1767319660.019734:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001
00000100:00100000:1.0:1767319660.019739:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940576640:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019795:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940576640:12345-0@lo:400:kworker.0 Request processed in 32us (6557us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319660.019802:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001
00000100:00100000:1.0:1767319660.019813:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002
00000100:00100000:1.0:1767319660.019818:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940576512:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319660.019848:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940576512:12345-0@lo:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319660.019853:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002
00000100:00080000:1.0:1767319660.019869:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319660.019872:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319660.019890:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940576512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319660.024121:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940576640:0@lo:400:kworker.0
00000100:00100000:0.0:1767319660.024510:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940576768:0@lo:400:kworker.0
00000100:00100000:3.0:1767319660.024617:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319660.024885:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940576384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319660.024921:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319660.024945:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940576896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319660.024967:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319660.025013:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576384
00000100:00100000:0.0:1767319660.025020:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576384
00000100:00100000:0.0:1767319660.025061:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145
00000100:00100000:0.0:1767319660.025068:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940576384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319660.025087:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319660.025121:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940576384:12345-0@lo:38:kworker.0 Request processed in 53us (199us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319660.025127:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145
00000100:00100000:3.0:1767319660.032510:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940577152:0@lo:38:kworker.0
00000100:00100000:3.0:1767319660.032574:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319660.038598:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576256
00000100:00100000:1.0:1767319660.038614:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576256
00000100:00100000:1.0:1767319660.038684:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940576896
00000100:00100000:1.0:1767319660.038688:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940576896
00000100:00100000:1.0:1767319660.038715:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17244
00000100:00100000:1.0:1767319660.038723:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940576256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319660.038746:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319660.038839:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940576256:12345-0@lo:38:kworker.0 Request processed in 116us (14220us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319660.038847:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17244
00000100:00100000:1.0:1767319660.038864:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17245
00000100:00100000:1.0:1767319660.038868:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940576896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319660.038877:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319660.038901:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940576896:12345-0@lo:38:kworker.0 Request processed in 31us (13932us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319660.038907:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17245
00000100:00080000:3.0:1767319660.039646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319660.039671:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319660.039676:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940569728:0@lo:250:kworker.0
00000100:00080000:3.0:1767319660.039722:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319660.039726:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319660.039729:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940576256:0@lo:38:kworker.0
00000100:00080000:3.0:1767319660.039738:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319660.039742:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319660.039744:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940576384:0@lo:38:kworker.0
00000100:00080000:3.0:1767319660.039752:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319660.039756:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319660.039758:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940576896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319660.039846:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577152
00000100:00100000:0.0:1767319660.039852:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577152
00000100:00100000:0.0:1767319660.039890:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17246
00000100:00100000:0.0:1767319660.039896:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940577152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319660.039912:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319660.039954:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940577152:12345-0@lo:38:kworker.0 Request processed in 58us (7379us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319660.039960:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17246
00000100:00080000:1.0:1767319660.040278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319660.040284:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319660.040287:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319660.040292:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4884
00000100:00080000:1.0:1767319660.040309:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319660.040314:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319660.040341:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a08e00 x1853163940577280/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319660.040912:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940577280:0@lo:250:kworker.0
00000400:00000100:3.0:1767319660.040951:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940577280 offset 0 length 520: 4
00000100:00080000:3.0:1767319660.040995:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319660.041001:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319660.041005:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940577152:0@lo:38:kworker.0
00000100:00100000:3.0:1767319660.526994:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319660.527019:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940577408:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319660.527093:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319660.527185:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577408
00000100:00100000:0.0:1767319660.527204:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577408
00000100:00100000:0.0:1767319660.527260:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554
00000100:00100000:0.0:1767319660.527270:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940577408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319660.527299:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319660.527352:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940577408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319660.527359:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554
00000100:00100000:3.0:1767319660.527528:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940577408:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319660.716879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319660.973795:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319661.552696:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940577536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319661.552905:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319661.557068:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577536
00000100:00100000:1.0:1767319661.557187:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577536
00000100:00100000:1.0:1767319661.557383:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555
00000100:00100000:1.0:1767319661.557427:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940577536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319661.557465:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319661.557568:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940577536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (4663us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319661.557577:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555
00000100:00100000:3.0:1767319661.557682:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940577536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319661.740912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319661.997008:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319662.664217:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319662.664312:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319662.664488:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331392
00000100:00100000:3.0:1767319662.664563:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331392
00000100:00100000:3.0:1767319662.664639:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331264
00000100:00100000:3.0:1767319662.664643:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331264
00000100:00100000:3.0:1767319662.664663:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4626
00000100:00100000:3.0:1767319662.664674:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894331392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319662.664745:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894331392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (537us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319662.664753:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4626
00000100:00100000:3.0:1767319662.664770:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17247
00000100:00100000:3.0:1767319662.664805:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894331264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319662.664826:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319662.664851:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894331264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (538us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319662.664857:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17247
00000100:00080000:2.0:1767319662.665469:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319662.768536:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319663.021055:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319663.788930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319664.044998:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319664.812966:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319665.075351:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319665.133459:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319665.133467:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319665.133469:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319665.133478:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319665.133482:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319665.133489:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4910
00000100:00080000:2.0:1767319665.133492:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319665.133497:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319665.133529:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70700 x1853163940577664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319665.133633:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319665.133636:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319665.133637:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319665.133640:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4910
00000100:00080000:2.0:1767319665.133641:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319665.133644:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319665.133654:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72680 x1853163940577792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319665.133702:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940577920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319665.133756:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319665.133848:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577920
00000100:00100000:1.0:1767319665.133855:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577920
00000100:00100000:1.0:1767319665.133897:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003
00000100:00100000:1.0:1767319665.133903:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940577920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.134009:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940577664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319665.134033:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319665.134047:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940577792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319665.134059:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319665.134080:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577664
00000100:00100000:3.0:1767319665.134082:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577664
00000100:00100000:3.0:1767319665.134110:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17248
00000100:00100000:3.0:1767319665.134113:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940577664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319665.134127:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319665.134149:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940577664:12345-0@lo:38:kworker.0 Request processed in 35us (114us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319665.134153:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17248
00000100:00080000:3.0:1767319665.134185:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319665.134189:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319665.134192:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940577664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319665.134226:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940577792
00000100:00100000:3.0:1767319665.134230:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940577792
00000100:00100000:3.0:1767319665.134248:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146
00000100:00100000:3.0:1767319665.134252:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940577792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319665.134261:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319665.134290:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940577792:12345-0@lo:38:kworker.0 Request processed in 36us (228us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319665.134295:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146
00000100:00080000:3.0:1767319665.134316:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319665.134320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319665.134322:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940577792:0@lo:38:kworker.0
00000100:00080000:3.0:1767319665.134366:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319665.134400:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578048:0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.134424:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319665.134455:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578048
00000100:00100000:3.0:1767319665.134459:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578048
00000100:00100000:3.0:1767319665.134497:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004
00000100:00100000:3.0:1767319665.134503:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.134525:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578048:12345-0@lo:400:kworker.0 Request processed in 25us (102us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319665.134538:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004
00000100:00080000:3.0:1767319665.134548:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319665.134560:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319665.136052:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940577920:12345-0@lo:400:kworker.0 Request processed in 2140us (2286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319665.136065:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003
00000100:00100000:0.0:1767319665.136428:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940577920:0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.136788:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:2.0:1767319665.136870:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319665.136876:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319665.136879:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319665.136885:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4910
00000100:00080000:2.0:1767319665.136889:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319665.136894:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319665.136917:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b73100 x1853163940578304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319665.136997:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940578304:0@lo:38:kworker.0
00000100:00100000:0.0:1767319665.137051:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319665.137393:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578304
00000100:00100000:1.0:1767319665.137401:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578304
00000100:00100000:1.0:1767319665.137441:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17249
00000100:00100000:1.0:1767319665.137448:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940578304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319665.137469:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319665.137518:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940578304:12345-0@lo:38:kworker.0 Request processed in 68us (465us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319665.137524:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17249
00000100:00080000:0.0:1767319665.137733:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319665.137738:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319665.137741:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940578304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319665.137817:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940578432:0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.137925:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319665.138247:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940578176:0@lo:400:kworker.0
00000100:00100000:3.0:1767319665.138272:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319665.138335:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319665.138340:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319665.138342:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319665.138346:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4910
00000100:00080000:2.0:1767319665.138349:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319665.138362:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319665.138385:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70e00 x1853163940578560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319665.138483:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940578560:0@lo:38:kworker.0
00000100:00100000:2.0:1767319665.138800:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319665.139307:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578432
00000100:00100000:1.0:1767319665.139315:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578432
00000100:00100000:1.0:1767319665.139382:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578176
00000100:00100000:1.0:1767319665.139386:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578176
00000100:00100000:1.0:1767319665.139411:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4627
00000100:00100000:1.0:1767319665.139418:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940578432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319665.139620:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940578432:12345-0@lo:400:kworker.0 Request processed in 202us (1693us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319665.139628:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4627
00000100:00100000:1.0:1767319665.139646:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628
00000100:00100000:1.0:1767319665.139653:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940578176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319665.139682:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940578176:12345-0@lo:400:kworker.0 Request processed in 30us (1410us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319665.139688:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628
00000100:00100000:1.0:1767319665.139737:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940578432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319665.139747:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940578176:0@lo:400:kworker.0
00000100:00080000:3.0:1767319665.139862:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319665.140673:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578560
00000100:00100000:1.0:1767319665.140680:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578560
00000100:00100000:1.0:1767319665.140742:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17250
00000100:00100000:1.0:1767319665.140747:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940578560:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319665.140769:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319665.140854:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940578560:12345-0@lo:38:kworker.0 Request processed in 96us (2043us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319665.140861:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17250
00000100:00080000:0.0:1767319665.140925:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319665.140931:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319665.140935:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940578560:0@lo:38:kworker.0
00000100:00100000:3.0:1767319665.648099:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319665.648125:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578688:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319665.648201:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319665.650405:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578688
00000100:00100000:1.0:1767319665.650420:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578688
00000100:00100000:1.0:1767319665.650496:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556
00000100:00100000:1.0:1767319665.650507:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319665.650557:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319665.650652:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (2450us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319665.650659:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556
00000100:00100000:2.0:1767319665.650826:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578688:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319665.837210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319666.092997:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319666.669589:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319666.669666:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319666.670123:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578816
00000100:00100000:3.0:1767319666.670131:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578816
00000100:00100000:3.0:1767319666.670191:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557
00000100:00100000:3.0:1767319666.670200:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319666.670229:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319666.670288:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940578816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (623us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319666.670295:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557
00000100:00100000:2.0:1767319666.670446:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940578816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319666.861086:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319667.117449:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319667.785958:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319667.786012:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319667.786127:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331648
00000100:00100000:1.0:1767319667.786138:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331648
00000100:00100000:1.0:1767319667.786230:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331520
00000100:00100000:1.0:1767319667.786234:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331520
00000100:00100000:1.0:1767319667.786259:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4629
00000100:00100000:1.0:1767319667.786268:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894331648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319667.786360:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894331648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (416us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319667.786368:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4629
00000100:00100000:1.0:1767319667.786387:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17251
00000100:00100000:1.0:1767319667.786392:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894331520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319667.786412:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319667.786439:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894331520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (426us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319667.786445:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17251
00000100:00080000:0.0:1767319667.786592:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319667.884979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319668.142014:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319668.908903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319669.165633:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319669.932912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319670.189271:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319670.253164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319670.253174:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319670.253177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319670.253181:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319670.253185:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319670.253192:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4915
00000100:00080000:0.0:1767319670.253196:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319670.253202:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319670.253242:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf480 x1853163940578944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319670.253267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319670.253270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319670.253272:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319670.253276:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4915
00000100:00080000:0.0:1767319670.253278:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319670.253281:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319670.253294:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940579072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319670.253359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319670.253364:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319670.253366:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319670.253369:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4915
00000100:00080000:0.0:1767319670.253372:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319670.253376:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319670.253386:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc380 x1853163940579584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319670.253400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319670.253403:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319670.253405:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319670.253408:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4915
00000100:00080000:0.0:1767319670.253410:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319670.253414:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319670.253429:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add180 x1853163940579840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319670.253458:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940579712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.253508:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319670.253524:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253538:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253594:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319670.253601:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.253621:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253663:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940579456:0@lo:400:kworker.0
00000100:00100000:3.0:1767319670.253672:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940578944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319670.253686:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253722:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579200
00000100:00100000:3.0:1767319670.253723:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253730:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579200
00000100:00100000:3.0:1767319670.253751:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940579072:0@lo:38:kworker.0
00000100:00100000:3.0:1767319670.253801:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.253808:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579328
00000100:00100000:1.0:1767319670.253813:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579328
00000100:00100000:1.0:1767319670.253843:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005
00000100:00100000:1.0:1767319670.253852:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.253907:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579200:12345-0@lo:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319670.253913:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005
00000100:00100000:1.0:1767319670.253930:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006
00000100:00100000:1.0:1767319670.253936:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.253962:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579328:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319670.253968:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006
00000100:00100000:1.0:1767319670.254007:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.254016:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579200:0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.254050:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579072
00000100:00100000:1.0:1767319670.254054:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579072
00000100:00100000:1.0:1767319670.254072:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147
00000100:00100000:1.0:1767319670.254076:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940579072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319670.254093:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319670.254120:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940579072:12345-0@lo:38:kworker.0 Request processed in 42us (319us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319670.254125:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147
00000100:00100000:1.0:1767319670.254145:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579712
00000100:00100000:1.0:1767319670.254149:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579712
00000100:00100000:1.0:1767319670.254172:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579456
00000100:00100000:1.0:1767319670.254175:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579456
00000100:00100000:1.0:1767319670.254190:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940578944
00000100:00100000:1.0:1767319670.254192:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940578944
00000100:00100000:1.0:1767319670.254207:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4630
00000100:00100000:1.0:1767319670.254214:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940579712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.254243:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940579712:12345-0@lo:400:kworker.0 Request processed in 30us (719us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319670.254248:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4630
00000100:00100000:1.0:1767319670.254260:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4631
00000100:00100000:1.0:1767319670.254266:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940579456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319670.254294:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940579456:12345-0@lo:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319670.254299:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4631
00000100:00100000:1.0:1767319670.254321:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17252
00000100:00100000:1.0:1767319670.254325:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940578944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319670.254335:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319670.254358:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940578944:12345-0@lo:38:kworker.0 Request processed in 32us (636us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319670.254364:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17252
00000100:00100000:1.0:1767319670.254395:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940579456:0@lo:400:kworker.0
00000100:00080000:0.0:1767319670.254565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319670.254570:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319670.254572:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319670.257111:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940579712:0@lo:400:kworker.0
00000100:00100000:3.0:1767319670.261586:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940579584:0@lo:38:kworker.0
00000100:00100000:3.0:1767319670.261689:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319670.261743:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940579840:0@lo:38:kworker.0
00000100:00100000:3.0:1767319670.261769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319670.261827:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579584
00000100:00100000:0.0:1767319670.261835:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579584
00000100:00080000:3.0:1767319670.261846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319670.261853:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319670.261858:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940578944:0@lo:38:kworker.0
00000100:00080000:3.0:1767319670.261873:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319670.261876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319670.261879:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940579072:0@lo:38:kworker.0
00000100:00100000:0.0:1767319670.261886:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579840
00000100:00100000:0.0:1767319670.261890:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579840
00000100:00100000:0.0:1767319670.261915:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17253
00000100:00100000:0.0:1767319670.261923:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940579584:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319670.261945:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17254
00010000:00020000:0.0:1767319670.261947:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319670.261953:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940579840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319670.261966:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319670.262001:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940579584:12345-0@lo:38:kworker.0 Request processed in 76us (321us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319670.262012:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17253
00000100:00100000:3.0:1767319670.262019:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940579840:12345-0@lo:38:kworker.0 Request processed in 53us (236us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319670.262029:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17254
00000100:00080000:3.0:1767319670.262060:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319670.262064:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319670.262067:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940579584:0@lo:38:kworker.0
00000100:00080000:3.0:1767319670.262074:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319670.262077:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319670.262080:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940579840:0@lo:38:kworker.0
00000100:00100000:2.0:1767319670.769099:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319670.769175:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319670.769368:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940579968
00000100:00100000:1.0:1767319670.769378:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940579968
00000100:00100000:1.0:1767319670.769439:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558
00000100:00100000:1.0:1767319670.769450:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319670.769489:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319670.769551:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940579968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319670.769559:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558
00000100:00100000:2.0:1767319670.769659:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940579968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319670.956907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319671.213098:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319671.789163:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319671.789197:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940580096:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319671.789266:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319671.789350:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580096
00000100:00100000:0.0:1767319671.789360:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580096
00000100:00100000:0.0:1767319671.789415:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559
00000100:00100000:0.0:1767319671.789425:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940580096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319671.789457:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319671.789680:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940580096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (413us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319671.789688:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559
00000100:00100000:2.0:1767319671.789808:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940580096:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319671.980910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319672.240561:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319672.902270:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319672.902365:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319672.902644:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331776
00000100:00100000:1.0:1767319672.902654:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331776
00000100:00100000:1.0:1767319672.902703:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894331904
00000100:00100000:1.0:1767319672.902707:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894331904
00000100:00100000:1.0:1767319672.902771:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4632
00000100:00080000:2.0:1767319672.902926:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319672.903013:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894331904:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319672.903091:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894331904:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (723us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319672.903395:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17255
00000100:00100000:2.0:1767319672.903403:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894331776:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319672.903424:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319672.903455:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894331776:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (1194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319672.903462:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17255
00000100:00100000:1.0:1767319672.904055:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4632
00000100:00100000:2.0:1767319673.004907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319673.261164:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319674.028911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319674.287066:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319675.052882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319675.310647:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319675.373009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319675.373020:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319675.373023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319675.373027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319675.373031:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319675.373039:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4920
00000100:00080000:1.0:1767319675.373044:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319675.373051:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319675.373095:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09880 x1853163940580224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319675.373121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319675.373124:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319675.373126:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319675.373129:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4920
00000100:00080000:1.0:1767319675.373132:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319675.373135:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319675.373148:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a0b800 x1853163940580352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319675.373225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319675.373229:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319675.373231:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319675.373234:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4920
00000100:00080000:1.0:1767319675.373237:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319675.373240:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319675.373268:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319675.373293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319675.373296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319675.373298:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319675.373302:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4920
00000100:00080000:1.0:1767319675.373304:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319675.373307:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319675.373321:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88700 x1853163940581120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319675.373354:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940580992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319675.373419:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319675.373476:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319675.373481:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940580736:0@lo:400:kworker.0
00000100:00100000:1.0:1767319675.373497:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319675.373521:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580992
00000100:00100000:1.0:1767319675.373527:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580992
00000100:00100000:1.0:1767319675.373572:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580736
00000100:00100000:1.0:1767319675.373575:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580736
00000100:00100000:1.0:1767319675.373597:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4633
00000100:00100000:1.0:1767319675.373607:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940580992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319675.373652:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940580992:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319675.373657:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4633
00000100:00100000:1.0:1767319675.373670:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4634
00000100:00100000:1.0:1767319675.373674:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940580736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319675.373688:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940580736:12345-0@lo:400:kworker.0 Request processed in 14us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319675.373692:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4634
00000100:00100000:1.0:1767319675.373719:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940580736:0@lo:400:kworker.0
00000100:00100000:1.0:1767319675.373725:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940580992:0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.373868:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940580480:0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.373894:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319675.373920:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319675.373923:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940580608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.373935:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319675.373963:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580480
00000100:00100000:0.0:1767319675.373967:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580480
00000100:00100000:0.0:1767319675.373996:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580608
00000100:00100000:0.0:1767319675.373999:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580608
00000100:00100000:0.0:1767319675.374019:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007
00000100:00100000:0.0:1767319675.374024:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940580480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.374049:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940580480:12345-0@lo:400:kworker.0 Request processed in 25us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319675.374053:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007
00000100:00100000:0.0:1767319675.374062:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008
00000100:00100000:0.0:1767319675.374065:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940580608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.374079:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940580608:12345-0@lo:400:kworker.0 Request processed in 15us (144us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319675.374083:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008
00000100:00100000:0.0:1767319675.374102:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940580608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319675.374107:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940580480:0@lo:400:kworker.0
00000100:00080000:2.0:1767319675.374251:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319675.374256:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319675.374267:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319675.374514:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940580224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319675.374540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319675.374566:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940580352:0@lo:38:kworker.0
00000100:00100000:3.0:1767319675.374589:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319675.374613:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940580864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319675.374632:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319675.374650:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940581120:0@lo:38:kworker.0
00000100:00100000:3.0:1767319675.374665:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319675.374686:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580224
00000100:00100000:3.0:1767319675.374689:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580224
00000100:00100000:3.0:1767319675.374705:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580864
00000100:00100000:3.0:1767319675.374706:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580864
00000100:00100000:3.0:1767319675.374713:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581120
00000100:00100000:3.0:1767319675.374715:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581120
00000100:00100000:3.0:1767319675.374724:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17256
00000100:00100000:3.0:1767319675.374728:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940580224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319675.374742:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319675.374763:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940580224:12345-0@lo:38:kworker.0 Request processed in 35us (223us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319675.374767:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17256
00000100:00100000:3.0:1767319675.374793:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17257
00000100:00100000:3.0:1767319675.374795:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940580864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319675.374801:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319675.374815:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940580864:12345-0@lo:38:kworker.0 Request processed in 19us (183us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319675.374818:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17257
00000100:00100000:3.0:1767319675.374824:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17258
00000100:00100000:3.0:1767319675.374826:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940581120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319675.374831:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319675.374844:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940581120:12345-0@lo:38:kworker.0 Request processed in 16us (178us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319675.374847:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17258
00000100:00080000:3.0:1767319675.374865:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319675.374869:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319675.374871:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940580224:0@lo:38:kworker.0
00000100:00080000:3.0:1767319675.374876:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319675.374878:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319675.374879:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940580864:0@lo:38:kworker.0
00000100:00080000:3.0:1767319675.374883:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319675.374885:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319675.374886:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940581120:0@lo:38:kworker.0
00000100:00100000:1.0:1767319675.375193:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940580352
00000100:00100000:1.0:1767319675.375197:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940580352
00000100:00100000:1.0:1767319675.375219:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148
00000100:00100000:1.0:1767319675.375223:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940580352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319675.375231:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319675.375381:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319675.375384:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319675.375386:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940580352:0@lo:38:kworker.0
00000100:00100000:1.0:1767319675.375476:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940580352:12345-0@lo:38:kworker.0 Request processed in 251us (886us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319675.375481:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148
00000100:00100000:2.0:1767319675.885134:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319675.885161:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940581248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319675.885235:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319675.885424:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581248
00000100:00100000:3.0:1767319675.885432:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581248
00000100:00100000:3.0:1767319675.885540:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560
00000100:00100000:3.0:1767319675.885551:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940581248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319675.885583:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319675.885638:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940581248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319675.885645:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560
00000100:00100000:2.0:1767319675.885728:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940581248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319676.082738:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319676.334170:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319676.909311:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319676.909333:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940581376:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319676.909396:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319676.909639:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581376
00000100:00100000:0.0:1767319676.909647:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581376
00000100:00100000:0.0:1767319676.909697:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561
00000100:00100000:0.0:1767319676.909707:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940581376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319676.909733:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319676.909803:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940581376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (405us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319676.909810:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561
00000100:00100000:1.0:1767319676.909977:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940581376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319676.998127:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319676.998494:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332288
00000100:00100000:0.0:1767319676.998506:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332288
00000100:00100000:0.0:1767319676.998595:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4635
00000100:00100000:0.0:1767319676.998606:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894332288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319676.998688:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894332288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (575us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319676.998696:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4635
00000100:00080000:3.0:1767319676.998840:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319676.999058:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894332032 offset 0 length 520: 4
00000100:00100000:2.0:1767319676.999157:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319676.999757:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332160
00000100:00100000:1.0:1767319676.999764:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332160
00000100:00100000:1.0:1767319676.999827:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17259
00000100:00100000:1.0:1767319676.999834:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894332160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319676.999856:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319676.999906:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894332160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (758us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319676.999914:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17259
00000100:00100000:2.0:1767319677.100919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319677.357036:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319678.125198:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319678.382492:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319679.148893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319679.407481:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319680.173026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319680.429294:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319680.493081:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319680.493092:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319680.493095:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319680.493099:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319680.493104:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319680.493113:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4925
00000100:00080000:2.0:1767319680.493118:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319680.493125:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319680.493167:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92d80 x1853163940581504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319680.493194:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319680.493198:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319680.493200:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767319680.493372:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940581504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319680.493457:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319680.493671:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4925
00000100:00080000:2.0:1767319680.493676:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319680.493681:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319680.493698:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93800 x1853163940581632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319680.493767:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319680.493770:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319680.493794:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319680.493798:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4925
00000100:00080000:2.0:1767319680.493800:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319680.493804:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319680.493815:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91880 x1853163940582144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319680.493831:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319680.493834:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319680.493836:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319680.493839:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4925
00000100:00080000:2.0:1767319680.493841:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319680.493845:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319680.493854:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92680 x1853163940582400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319680.493883:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940582272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.493914:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319680.493935:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319680.493940:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940582016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.493961:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319680.493992:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581504
00000100:00100000:2.0:1767319680.494000:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581504
00000100:00100000:2.0:1767319680.494027:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582272
00000100:00100000:2.0:1767319680.494030:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582272
00000100:00100000:2.0:1767319680.494061:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582016
00000100:00100000:2.0:1767319680.494063:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582016
00000100:00100000:2.0:1767319680.494084:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4636
00000100:00100000:2.0:1767319680.494091:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940582272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.494139:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940582272:12345-0@lo:400:kworker.0 Request processed in 48us (224us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319680.494146:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4636
00000100:00100000:2.0:1767319680.494162:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4637
00000100:00100000:2.0:1767319680.494168:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940582016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.494196:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940582016:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319680.494201:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4637
00000100:00100000:1.0:1767319680.494298:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940581760:0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.494313:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17260
00000100:00100000:2.0:1767319680.494319:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940581504:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319680.494338:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767319680.494341:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319680.494378:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940581504:12345-0@lo:38:kworker.0 Request processed in 58us (922us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319680.494384:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17260
00000100:00100000:1.0:1767319680.494386:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319680.494397:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940581888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.494431:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940582016:0@lo:400:kworker.0
00000100:00080000:3.0:1767319680.494466:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319680.494497:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940581632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319680.494625:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581760
00000100:00100000:0.0:1767319680.494630:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581760
00000100:00100000:0.0:1767319680.494666:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009
00000100:00100000:0.0:1767319680.494673:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940581760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319680.497359:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319680.497445:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581888
00000100:00100000:1.0:1767319680.497451:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581888
00000100:00100000:1.0:1767319680.497501:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010
00000100:00100000:1.0:1767319680.497509:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940581888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319680.497522:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940582272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319680.497567:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940581888:12345-0@lo:400:kworker.0 Request processed in 57us (212us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319680.497575:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010
00000100:00080000:2.0:1767319680.497587:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319680.497594:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319680.497618:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940581888:0@lo:400:kworker.0
00000100:00100000:3.0:1767319680.497729:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319680.497769:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940582144:0@lo:38:kworker.0
00000100:00100000:3.0:1767319680.497902:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319680.497921:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940582400:0@lo:38:kworker.0
00000100:00100000:3.0:1767319680.497943:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319680.497971:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319680.497977:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319680.497980:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940581504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319680.498007:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582144
00000100:00100000:3.0:1767319680.498011:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582144
00000100:00100000:3.0:1767319680.498032:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582400
00000100:00100000:0.0:1767319680.498205:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940581760:12345-0@lo:400:kworker.0 Request processed in 3532us (3867us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319680.498226:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009
00000100:00100000:2.0:1767319680.498269:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17261
00000100:00100000:2.0:1767319680.498276:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940582144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319680.498296:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319680.498475:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940582144:12345-0@lo:38:kworker.0 Request processed in 196us (571us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319680.498483:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17261
00000100:00080000:0.0:1767319680.498571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319680.498576:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319680.498579:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940582144:0@lo:38:kworker.0
00000100:00100000:1.0:1767319680.498900:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940581632
00000100:00100000:1.0:1767319680.498906:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940581632
00000100:00100000:1.0:1767319680.498945:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149
00000100:00100000:1.0:1767319680.498951:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940581632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319680.498965:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319680.499012:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940581632:12345-0@lo:38:kworker.0 Request processed in 60us (1283us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319680.499018:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149
00000100:00100000:1.0:1767319680.499057:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940581760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319680.499120:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582400
00000100:00100000:3.0:1767319680.499151:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17262
00000100:00100000:3.0:1767319680.499156:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940582400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319680.499168:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319680.499197:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940582400:12345-0@lo:38:kworker.0 Request processed in 39us (1252us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319680.499203:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17262
00000100:00080000:2.0:1767319680.499329:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319680.499334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319680.499338:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940581632:0@lo:38:kworker.0
00000100:00080000:2.0:1767319680.499346:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319680.499349:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319680.499352:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940582400:0@lo:38:kworker.0
00000100:00100000:2.0:1767319681.006468:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940582528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319681.006544:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319681.007026:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582528
00000100:00100000:1.0:1767319681.007035:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582528
00000100:00100000:1.0:1767319681.007084:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562
00000100:00100000:1.0:1767319681.007093:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940582528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319681.007136:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319681.007194:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940582528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (649us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319681.007202:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562
00000100:00100000:2.0:1767319681.007441:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940582528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319681.197116:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319681.453051:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319682.029382:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940582656:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319682.029457:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319682.029522:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582656
00000100:00100000:3.0:1767319682.029531:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582656
00000100:00100000:3.0:1767319682.029603:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563
00000100:00100000:3.0:1767319682.029615:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940582656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319682.029645:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319682.029709:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940582656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (251us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319682.029717:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563
00000100:00100000:2.0:1767319682.029835:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940582656:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319682.029867:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319682.120843:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319682.120929:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319682.121097:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332544
00000100:00100000:3.0:1767319682.121109:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332544
00000100:00100000:3.0:1767319682.121192:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332416
00000100:00100000:3.0:1767319682.121196:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332416
00000100:00100000:3.0:1767319682.121230:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4638
00000100:00100000:3.0:1767319682.121243:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894332544:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767319682.121249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319682.121288:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17263
00000100:00100000:0.0:1767319682.121294:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894332416:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319682.121316:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319682.121331:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894332544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (501us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319682.121339:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4638
00000100:00100000:0.0:1767319682.121341:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894332416:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (413us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319682.121347:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17263
00000100:00100000:2.0:1767319682.221898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319682.478853:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319683.244896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319683.502793:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319684.269304:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319684.525657:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319685.292875:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319685.549684:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319685.613179:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.613190:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319685.613194:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.613198:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319685.613202:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319685.613210:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4930
00000100:00080000:2.0:1767319685.613215:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319685.613222:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319685.613267:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93100 x1853163940582784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319685.613294:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.613297:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319685.613299:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319685.613302:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4930
00000100:00080000:2.0:1767319685.613305:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319685.613308:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319685.613323:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91500 x1853163940582912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319685.613387:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.613391:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319685.613393:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319685.613397:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4930
00000100:00080000:2.0:1767319685.613398:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319685.613401:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319685.613410:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90380 x1853163940583424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319685.613422:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.613424:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319685.613425:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319685.613427:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4930
00000100:00080000:2.0:1767319685.613428:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319685.613430:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319685.613435:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2d80 x1853163940583680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319685.613460:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583168:0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613526:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319685.613575:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319685.613579:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583040:0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613594:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319685.613610:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940583296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613626:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319685.613636:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319685.613639:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940583552:0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613650:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319685.613670:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583296
00000100:00100000:2.0:1767319685.613676:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583296
00000100:00100000:2.0:1767319685.613714:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583552
00000100:00100000:2.0:1767319685.613715:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583552
00000100:00100000:2.0:1767319685.613730:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4639
00000100:00100000:2.0:1767319685.613735:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940583296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613790:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940583296:12345-0@lo:400:kworker.0 Request processed in 37us (146us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319685.613796:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4639
00000100:00100000:2.0:1767319685.613809:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4640
00000100:00100000:2.0:1767319685.613813:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940583552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613829:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940583552:12345-0@lo:400:kworker.0 Request processed in 16us (178us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319685.613832:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4640
00000100:00100000:2.0:1767319685.613856:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940583552:0@lo:400:kworker.0
00000100:00100000:2.0:1767319685.613861:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940583296:0@lo:400:kworker.0
00000100:00100000:0.0:1767319685.614019:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583168
00000100:00100000:0.0:1767319685.614024:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583168
00000100:00100000:0.0:1767319685.614061:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583040
00000100:00100000:0.0:1767319685.614065:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583040
00000100:00100000:0.0:1767319685.614093:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011
00000100:00100000:0.0:1767319685.614100:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319685.614139:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583168:12345-0@lo:400:kworker.0 Request processed in 40us (612us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319685.614146:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011
00000100:00100000:0.0:1767319685.614158:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012
00000100:00100000:0.0:1767319685.614163:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319685.614198:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583040:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319685.614204:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012
00000100:00080000:0.0:1767319685.614218:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319685.614222:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319685.614224:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319685.614241:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319660/real 1767319660]  req@ffff93d070a08e00 x1853163940577280/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319685.614258:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d070a08e00 x1853163940577280/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319685.614270:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940582784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319685.614295:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319685.614313:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940582912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319685.614335:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319685.614348:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940583424:0@lo:38:kworker.0
00000100:00100000:0.0:1767319685.614360:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319685.614366:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940583680:0@lo:38:kworker.0
00000100:00100000:0.0:1767319685.614377:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319685.614386:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319685.614393:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319685.614395:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940577280:0@lo:250:kworker.0
00000100:00100000:0.0:1767319685.614414:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582912
00000100:00100000:0.0:1767319685.614417:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582912
00000100:00100000:0.0:1767319685.614430:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150
00000100:00100000:0.0:1767319685.614433:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940582912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319685.614446:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319685.614474:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940582912:12345-0@lo:38:kworker.0 Request processed in 40us (139us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319685.614480:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150
00000100:00100000:0.0:1767319685.614495:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940582784
00000100:00100000:0.0:1767319685.614498:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940582784
00000100:00100000:0.0:1767319685.614513:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583424
00000100:00100000:0.0:1767319685.614516:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583424
00000100:00100000:0.0:1767319685.614528:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583680
00000100:00100000:0.0:1767319685.614530:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583680
00000100:00100000:0.0:1767319685.614539:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17264
00000100:00100000:0.0:1767319685.614542:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940582784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319685.614548:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319685.614565:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940582784:12345-0@lo:38:kworker.0 Request processed in 22us (270us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319685.614568:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17264
00000100:00100000:0.0:1767319685.614575:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17265
00000100:00100000:0.0:1767319685.614577:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940583424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319685.614581:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319685.614592:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940583424:12345-0@lo:38:kworker.0 Request processed in 14us (231us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319685.614595:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17265
00000100:00100000:0.0:1767319685.614601:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17266
00000100:00100000:0.0:1767319685.614603:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940583680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319685.614608:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319685.614618:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940583680:12345-0@lo:38:kworker.0 Request processed in 14us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319685.614621:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17266
00000100:00100000:0.0:1767319685.614641:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319685.614647:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583168:0@lo:400:kworker.0
00000100:00080000:0.0:1767319685.614661:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319685.614663:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319685.614665:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940582784:0@lo:38:kworker.0
00000100:00080000:0.0:1767319685.614669:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319685.614671:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319685.614673:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940582912:0@lo:38:kworker.0
00000100:00080000:0.0:1767319685.614676:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319685.614678:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319685.614680:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940583424:0@lo:38:kworker.0
00000100:00080000:0.0:1767319685.614683:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319685.614685:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319685.614686:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940583680:0@lo:38:kworker.0
00000100:00080000:2.0:1767319685.615191:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319685.615196:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319685.615199:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319685.615203:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4910
00000100:00080000:2.0:1767319685.615206:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319685.615210:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319685.615231:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1880 x1853163940583808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319685.615306:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940583808:0@lo:250:kworker.0
00000400:00000100:1.0:1767319685.615341:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940583808 offset 0 length 520: 4
00000100:00100000:0.0:1767319686.128210:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319686.128338:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583936:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319686.128421:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319686.128652:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940583936
00000100:00100000:1.0:1767319686.128661:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940583936
00000100:00100000:1.0:1767319686.128722:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564
00000100:00100000:1.0:1767319686.128732:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583936:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319686.128769:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319686.128855:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940583936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (432us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319686.128864:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564
00000100:00100000:0.0:1767319686.128994:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940583936:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319686.317968:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319686.573008:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319687.151593:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940584064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319687.151681:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319687.152023:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584064
00000100:00100000:0.0:1767319687.152034:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584064
00000100:00100000:0.0:1767319687.152189:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565
00000100:00100000:0.0:1767319687.152199:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940584064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319687.152230:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319687.152343:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940584064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (661us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319687.152350:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565
00000100:00080000:2.0:1767319687.152463:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319687.154640:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940584064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319687.239646:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319687.239702:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319687.239807:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332800
00000100:00100000:1.0:1767319687.239817:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332800
00000100:00100000:1.0:1767319687.239897:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332672
00000100:00100000:1.0:1767319687.239900:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332672
00000100:00100000:1.0:1767319687.239922:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4641
00000100:00100000:1.0:1767319687.239933:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894332800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319687.240002:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894332800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319687.240010:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4641
00000100:00100000:1.0:1767319687.240028:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17267
00000100:00100000:1.0:1767319687.240033:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894332672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319687.240055:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319687.240079:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894332672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (378us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319687.240085:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17267
00000100:00080000:3.0:1767319687.240249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319687.340912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319687.597280:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319688.365714:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319688.621001:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319689.388922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319689.644998:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319690.412933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319690.669556:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319690.733109:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319690.733130:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319690.733133:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319690.733137:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319690.733141:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319690.733150:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4935
00000100:00080000:0.0:1767319690.733155:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319690.733162:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319690.733225:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add180 x1853163940584192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319690.733251:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319690.733255:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319690.733256:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319690.733260:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4935
00000100:00080000:0.0:1767319690.733263:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319690.733266:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319690.733282:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf480 x1853163940584320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319690.733343:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319690.733346:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319690.733347:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319690.733350:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4935
00000100:00080000:0.0:1767319690.733363:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319690.733367:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319690.733378:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cce00 x1853163940584832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319690.733394:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319690.733397:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319690.733399:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319690.733403:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4935
00000100:00080000:0.0:1767319690.733405:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319690.733409:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319690.733419:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469ce680 x1853163940585088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319690.733670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940584192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319690.733757:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319690.733840:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940584320:0@lo:38:kworker.0
00000100:00100000:2.0:1767319690.733865:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319690.733878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940584832:0@lo:38:kworker.0
00000100:00100000:2.0:1767319690.733894:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319690.733910:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940585088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319690.733927:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.734179:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940584576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.734213:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.734254:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319690.734259:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940584448:0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.734279:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.734302:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940584704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.734324:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.734340:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319690.734344:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940584960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.734363:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.734393:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584192
00000100:00100000:3.0:1767319690.734401:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584192
00000100:00100000:3.0:1767319690.734431:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584832
00000100:00100000:3.0:1767319690.734434:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584832
00000100:00100000:0.0:1767319690.734443:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585088
00000100:00100000:3.0:1767319690.734443:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584704
00000100:00100000:3.0:1767319690.734445:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584704
00000100:00100000:0.0:1767319690.734446:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585088
00000100:00100000:0.0:1767319690.734460:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584960
00000100:00100000:0.0:1767319690.734462:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584960
00000100:00100000:3.0:1767319690.734482:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4642
00000100:00100000:2.0:1767319690.734526:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584576
00000100:00100000:2.0:1767319690.734530:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584576
00000100:00100000:2.0:1767319690.734559:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584448
00000100:00100000:2.0:1767319690.734562:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584448
00000100:00100000:2.0:1767319690.734583:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013
00000100:00100000:2.0:1767319690.734589:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940584576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319690.734642:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940584576:12345-0@lo:400:kworker.0 Request processed in 53us (427us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319690.734649:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013
00000100:00100000:2.0:1767319690.734715:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014
00000100:00100000:2.0:1767319690.734722:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940584448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319690.734752:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940584448:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319690.734758:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014
00000100:00100000:3.0:1767319690.734860:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940584704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.734896:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940584704:12345-0@lo:400:kworker.0 Request processed in 407us (570us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319690.738705:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4643
00000100:00100000:0.0:1767319690.738857:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940584960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319690.738986:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940584960:12345-0@lo:400:kworker.0 Request processed in 154us (4620us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319690.738995:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4643
00000100:00100000:0.0:1767319690.739034:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17268
00000100:00100000:0.0:1767319690.739039:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940584192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319690.739062:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319690.739862:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940584192:12345-0@lo:38:kworker.0 Request processed in 818us (6102us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319690.739872:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17268
00000100:00100000:0.0:1767319690.739894:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17269
00000100:00100000:0.0:1767319690.739899:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940584832:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319690.739913:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319690.739941:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940584832:12345-0@lo:38:kworker.0 Request processed in 40us (6045us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319690.739947:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17269
00000100:00100000:0.0:1767319690.739959:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17270
00000100:00100000:0.0:1767319690.739965:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940585088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319690.739975:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319690.739999:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940585088:12345-0@lo:38:kworker.0 Request processed in 33us (6071us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319690.740005:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17270
00000100:00100000:0.0:1767319690.740054:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940584320
00000100:00100000:0.0:1767319690.740062:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940584320
00000100:00080000:2.0:1767319690.740230:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319690.740237:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319690.740241:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940584192:0@lo:38:kworker.0
00000100:00080000:2.0:1767319690.740253:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319690.740257:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319690.740260:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940584832:0@lo:38:kworker.0
00000100:00080000:2.0:1767319690.740269:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319690.740273:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319690.740275:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940585088:0@lo:38:kworker.0
00000100:00080000:2.0:1767319690.740306:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319690.740311:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319690.740314:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319690.740356:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940584448:0@lo:400:kworker.0
00000100:00100000:2.0:1767319690.740367:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940584576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319690.740403:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940584960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319690.740413:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940584704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319690.740649:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4642
00000100:00100000:0.0:1767319690.741113:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151
00000100:00100000:0.0:1767319690.741129:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940584320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319690.741146:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319690.741231:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940584320:12345-0@lo:38:kworker.0 Request processed in 110us (7364us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319690.741237:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151
00000100:00080000:3.0:1767319690.741344:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319690.741349:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319690.741353:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940584320:0@lo:38:kworker.0
00000100:00100000:0.0:1767319691.245431:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940585216:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319691.245518:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319691.245541:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585216
00000100:00100000:1.0:1767319691.245552:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585216
00000100:00100000:1.0:1767319691.245608:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566
00000100:00100000:1.0:1767319691.245619:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940585216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319691.245650:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319691.245719:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940585216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (201us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319691.245727:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566
00000100:00100000:0.0:1767319691.246179:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940585216:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319691.436837:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319691.693218:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319692.269455:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319692.269479:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940585344:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319692.269546:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319692.269680:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585344
00000100:00100000:0.0:1767319692.269688:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585344
00000100:00080000:2.0:1767319692.269743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319692.269764:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567
00000100:00100000:0.0:1767319692.269795:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940585344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319692.269835:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319692.269890:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940585344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (343us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319692.269896:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567
00000100:00100000:2.0:1767319692.270130:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940585344:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319692.358576:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319692.358825:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333056
00000100:00100000:2.0:1767319692.358838:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333056
00000100:00100000:2.0:1767319692.358926:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4644
00000100:00100000:2.0:1767319692.358936:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894333056:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319692.359031:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894333056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (465us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319692.359038:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4644
00000100:00100000:3.0:1767319692.359345:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319692.359368:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894332928
00000100:00100000:3.0:1767319692.359372:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894332928
00000100:00100000:1.0:1767319692.359447:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17271
00000100:00100000:1.0:1767319692.359454:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894332928:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319692.359478:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319692.359512:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894332928:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (167us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319692.359518:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17271
00000100:00080000:0.0:1767319692.360318:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319692.460887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319692.717001:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319693.488245:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319693.741563:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319694.509682:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319694.764997:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319695.532942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319695.788998:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319695.853427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319695.853440:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319695.853443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319695.853456:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319695.853460:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319695.853469:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4940
00000100:00080000:2.0:1767319695.853474:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319695.853483:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319695.853528:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3b80 x1853163940585472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319695.853556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319695.853559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319695.853560:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319695.853563:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4940
00000100:00080000:2.0:1767319695.853565:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319695.853568:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319695.853581:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b2d80 x1853163940585600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319695.853636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319695.853640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319695.853641:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319695.853644:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4940
00000100:00080000:2.0:1767319695.853646:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319695.853650:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319695.853660:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add180 x1853163940586112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319695.853676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319695.853679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319695.853681:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319695.853684:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4940
00000100:00080000:2.0:1767319695.853686:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319695.853689:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319695.853698:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91500 x1853163940586368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319695.853722:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940585984:0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.853846:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940585856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.853892:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319695.853948:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319695.853952:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940585728:0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.853971:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319695.854013:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585856
00000100:00100000:1.0:1767319695.854021:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585856
00000100:00100000:1.0:1767319695.854070:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585728
00000100:00100000:1.0:1767319695.854090:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585728
00000100:00100000:1.0:1767319695.854115:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015
00000100:00100000:1.0:1767319695.854123:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940585856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.854191:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940585856:12345-0@lo:400:kworker.0 Request processed in 68us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319695.854199:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015
00000100:00100000:1.0:1767319695.854215:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016
00000100:00100000:1.0:1767319695.854221:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940585728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.854247:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940585728:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319695.854253:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016
00000100:00100000:1.0:1767319695.854297:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940585728:0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.854307:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940585856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319695.854451:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940586240:0@lo:400:kworker.0
00000100:00100000:3.0:1767319695.854485:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.854527:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940585472:0@lo:38:kworker.0
00000100:00100000:3.0:1767319695.854551:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.854570:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940585600:0@lo:38:kworker.0
00000100:00100000:3.0:1767319695.854592:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.854609:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940586112:0@lo:38:kworker.0
00000100:00100000:3.0:1767319695.854630:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.854647:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940586368:0@lo:38:kworker.0
00000100:00100000:3.0:1767319695.854668:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.854695:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585600
00000100:00100000:3.0:1767319695.854699:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585600
00000100:00100000:3.0:1767319695.854720:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152
00000100:00100000:3.0:1767319695.854725:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940585600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319695.854745:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319695.854817:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940585600:12345-0@lo:38:kworker.0 Request processed in 90us (223us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319695.854823:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152
00000100:00100000:3.0:1767319695.854845:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586240
00000100:00100000:3.0:1767319695.854848:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586240
00000100:00100000:3.0:1767319695.854875:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585472
00000100:00100000:3.0:1767319695.854879:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585472
00000100:00100000:3.0:1767319695.854892:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586112
00000100:00100000:3.0:1767319695.854895:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586112
00000100:00100000:3.0:1767319695.854902:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586368
00000100:00100000:3.0:1767319695.854905:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586368
00000100:00100000:3.0:1767319695.854913:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4645
00000100:00100000:3.0:1767319695.854921:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940586240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319695.854954:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940586240:12345-0@lo:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319695.854960:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4645
00000100:00100000:3.0:1767319695.854972:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17272
00000100:00100000:3.0:1767319695.854976:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940585472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319695.854985:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319695.855007:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940585472:12345-0@lo:38:kworker.0 Request processed in 29us (455us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319695.855013:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17272
00000100:00100000:3.0:1767319695.855024:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17273
00000100:00100000:3.0:1767319695.855027:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940586112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319695.855036:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319695.855056:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940586112:12345-0@lo:38:kworker.0 Request processed in 26us (424us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319695.855062:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17273
00000100:00100000:3.0:1767319695.855071:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17274
00000100:00100000:3.0:1767319695.855085:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940586368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319695.855094:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319695.855114:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940586368:12345-0@lo:38:kworker.0 Request processed in 27us (445us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319695.855120:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17274
00000100:00100000:3.0:1767319695.855422:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940586240:0@lo:400:kworker.0
00000100:00080000:3.0:1767319695.855453:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319695.855458:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319695.855461:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940585472:0@lo:38:kworker.0
00000100:00080000:3.0:1767319695.855468:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319695.855470:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319695.855473:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940585600:0@lo:38:kworker.0
00000100:00080000:3.0:1767319695.855479:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319695.855482:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319695.855485:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940586112:0@lo:38:kworker.0
00000100:00080000:3.0:1767319695.855491:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319695.855494:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319695.855496:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940586368:0@lo:38:kworker.0
00000100:00080000:0.0:1767319695.855620:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319695.855631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319695.855633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319695.856069:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319695.856233:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940585984
00000100:00100000:1.0:1767319695.856239:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940585984
00000100:00100000:1.0:1767319695.856295:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4646
00000100:00100000:1.0:1767319695.856302:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940585984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319695.856350:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940585984:12345-0@lo:400:kworker.0 Request processed in 48us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319695.856356:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4646
00000100:00080000:0.0:1767319695.856414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319695.858320:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940585984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319696.365344:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319696.365367:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940586496:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319696.365432:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319696.366246:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586496
00000100:00100000:1.0:1767319696.366256:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586496
00000100:00100000:1.0:1767319696.366313:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568
00000100:00100000:1.0:1767319696.366321:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940586496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319696.366351:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319696.366414:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940586496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (981us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319696.366421:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568
00000100:00100000:2.0:1767319696.366636:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940586496:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319696.559102:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319696.813031:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319697.392034:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940586624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319697.392147:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319697.393464:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586624
00000100:00100000:0.0:1767319697.393477:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586624
00000100:00100000:0.0:1767319697.393564:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569
00000100:00100000:0.0:1767319697.393575:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940586624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319697.393608:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319697.393698:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940586624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (1550us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319697.393705:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569
00000100:00080000:2.0:1767319697.393977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319697.394002:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940586624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319697.496491:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319697.496603:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319697.506952:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333312
00000100:00100000:3.0:1767319697.506968:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333312
00000100:00100000:3.0:1767319697.507128:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333184
00000100:00100000:1.0:1767319697.507884:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4647
00000100:00100000:1.0:1767319697.507902:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894333312:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319697.507997:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894333312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (11514us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319697.508004:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4647
00000100:00100000:3.0:1767319697.509323:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333184
00000100:00100000:3.0:1767319697.509371:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17275
00000100:00100000:3.0:1767319697.509379:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894333184:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319697.509404:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319697.509472:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894333184:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (12867us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319697.509479:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17275
00000100:00080000:2.0:1767319697.512325:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319697.581041:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319697.838681:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319698.605356:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319698.868686:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319699.629640:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319699.885225:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319700.653863:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319700.909019:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319700.973511:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319700.973523:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319700.973526:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319700.973530:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319700.973535:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319700.973543:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4945
00000100:00080000:1.0:1767319700.973547:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319700.973555:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319700.973607:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88700 x1853163940586752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319700.973638:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319700.973642:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319700.973644:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319700.973647:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4945
00000100:00080000:1.0:1767319700.973650:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319700.973653:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319700.973668:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89180 x1853163940586880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319700.973738:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319700.973741:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319700.973743:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319700.973746:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4945
00000100:00080000:1.0:1767319700.973749:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319700.973752:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319700.973762:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9500 x1853163940587392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319700.973797:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319700.973800:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319700.973802:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319700.973805:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4945
00000100:00080000:1.0:1767319700.973808:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319700.973811:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319700.973832:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940587648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319700.973857:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940587264:0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.973922:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319700.973982:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319700.973988:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940587520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.974012:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319700.974054:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587264
00000100:00100000:1.0:1767319700.974061:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587264
00000100:00100000:1.0:1767319700.974120:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587520
00000100:00100000:1.0:1767319700.974124:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587520
00000100:00100000:1.0:1767319700.974150:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4648
00000100:00100000:1.0:1767319700.974159:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940587264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.974218:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940587264:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319700.974225:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4648
00000100:00100000:1.0:1767319700.974243:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4649
00000100:00100000:1.0:1767319700.974249:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940587520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.974276:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940587520:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319700.974281:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4649
00000100:00080000:1.0:1767319700.974298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319700.974717:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940586752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319700.974750:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319700.974793:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940586880:0@lo:38:kworker.0
00000100:00100000:0.0:1767319700.974830:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319700.974846:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940587392:0@lo:38:kworker.0
00000100:00100000:0.0:1767319700.974865:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319700.974882:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940587648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319700.974900:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319700.974930:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586880
00000100:00100000:0.0:1767319700.974935:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586880
00000100:00100000:0.0:1767319700.974959:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153
00000100:00100000:0.0:1767319700.974964:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940586880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319700.974984:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319700.975016:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940586880:12345-0@lo:38:kworker.0 Request processed in 50us (185us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319700.975022:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153
00000100:00100000:0.0:1767319700.975054:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940586752
00000100:00100000:0.0:1767319700.975058:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940586752
00000100:00100000:0.0:1767319700.975072:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587392
00000100:00100000:0.0:1767319700.975074:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587392
00000100:00100000:0.0:1767319700.975083:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587648
00000100:00100000:0.0:1767319700.975086:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587648
00000100:00100000:0.0:1767319700.975096:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17276
00000100:00100000:0.0:1767319700.975100:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940586752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319700.975109:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319700.975135:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940586752:12345-0@lo:38:kworker.0 Request processed in 33us (384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319700.975140:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17276
00000100:00100000:0.0:1767319700.975151:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17277
00000100:00100000:0.0:1767319700.975154:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940587392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319700.975163:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319700.975181:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940587392:12345-0@lo:38:kworker.0 Request processed in 25us (316us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319700.975186:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17277
00000100:00100000:0.0:1767319700.975206:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17278
00000100:00100000:0.0:1767319700.975210:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940587648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319700.975219:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319700.975241:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940587648:12345-0@lo:38:kworker.0 Request processed in 29us (340us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319700.975247:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17278
00000100:00080000:0.0:1767319700.975275:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319700.975280:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319700.975283:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940586752:0@lo:38:kworker.0
00000100:00080000:0.0:1767319700.975292:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319700.975295:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319700.975297:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940586880:0@lo:38:kworker.0
00000100:00080000:0.0:1767319700.975305:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319700.975308:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319700.975311:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940587392:0@lo:38:kworker.0
00000100:00080000:0.0:1767319700.975316:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319700.975319:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319700.975321:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940587648:0@lo:38:kworker.0
00000100:00100000:2.0:1767319700.975758:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319700.975830:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319700.975861:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319700.975867:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319700.975894:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319700.975943:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587008
00000100:00100000:2.0:1767319700.975949:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587008
00000100:00100000:2.0:1767319700.975990:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587136
00000100:00100000:2.0:1767319700.975993:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587136
00000100:00100000:2.0:1767319700.976016:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017
00000100:00100000:2.0:1767319700.976023:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319700.976080:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587008:12345-0@lo:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319700.976087:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017
00000100:00100000:2.0:1767319700.976101:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018
00000100:00100000:2.0:1767319700.976106:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319700.976134:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587136:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319700.976139:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018
00000100:00080000:2.0:1767319700.976162:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319700.976166:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319700.976187:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587136:0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.976584:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940587520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319700.976608:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940587264:0@lo:400:kworker.0
00000100:00100000:2.0:1767319700.976760:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319701.485684:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587776:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319701.485799:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319701.486092:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587776
00000100:00100000:1.0:1767319701.486103:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587776
00000100:00100000:1.0:1767319701.486165:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570
00000100:00100000:1.0:1767319701.486175:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319701.486210:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319701.486492:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940587776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 317us (720us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319701.486501:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570
00000100:00100000:2.0:1767319701.486592:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940587776:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319701.678741:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319701.938538:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319702.509105:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940587904:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319702.509185:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319702.509342:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940587904
00000100:00100000:1.0:1767319702.509351:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940587904
00000100:00100000:1.0:1767319702.509429:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571
00000100:00100000:1.0:1767319702.509439:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940587904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319702.509471:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319702.509520:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940587904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (335us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319702.509528:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571
00000100:00100000:1.0:1767319702.509576:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940587904:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319702.509858:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319702.597839:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319702.597980:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333440
00000100:00100000:3.0:1767319702.597989:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333440
00000100:00100000:3.0:1767319702.598051:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17279
00000100:00100000:3.0:1767319702.598059:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894333440:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319702.598079:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319702.598144:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894333440:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 84us (316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319702.598151:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17279
00000100:00100000:2.0:1767319702.598277:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319702.598412:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333568
00000100:00100000:0.0:1767319702.598418:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333568
00000100:00100000:0.0:1767319702.598477:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4650
00000100:00100000:0.0:1767319702.598485:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894333568:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319702.598536:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894333568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 51us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319702.598544:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4650
00000100:00080000:2.0:1767319702.598714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319702.598973:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894333696 offset 0 length 520: 4
00000100:00100000:2.0:1767319702.700898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319702.957665:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319703.724905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319703.984750:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319704.752081:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319705.005111:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319705.772931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319706.031271:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319706.093009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319706.093021:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319706.093023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319706.093027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319706.093032:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319706.093039:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767319706.093044:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319706.093051:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319706.093106:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940588032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319706.093123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319706.093126:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319706.093137:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319706.093141:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767319706.093143:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319706.093147:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319706.093168:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010380 x1853163940588160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319706.093232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319706.093236:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319706.093238:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319706.093242:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767319706.093245:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319706.093248:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319706.093260:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011c00 x1853163940588672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319706.093272:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:2.0:1767319706.093276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319706.093279:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319706.093281:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319706.093283:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767319706.093286:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319706.093289:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319706.093291:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940588800:0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.093297:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940588928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319706.093334:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940588288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319706.093357:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319706.093363:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319706.093420:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940588032:0@lo:38:kworker.0
00000100:00100000:3.0:1767319706.094034:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940588416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.100038:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588288
00000100:00100000:2.0:1767319706.100054:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588288
00000100:00100000:2.0:1767319706.100129:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019
00000100:00100000:2.0:1767319706.100140:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940588288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.100227:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940588288:12345-0@lo:400:kworker.0 Request processed in 89us (6861us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319706.100234:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019
00000100:00080000:2.0:1767319706.100256:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319706.100294:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940588288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.100332:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588800
00000100:00100000:2.0:1767319706.100337:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588800
00000100:00100000:1.0:1767319706.100338:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940588544:0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.100370:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4651
00000100:00100000:2.0:1767319706.100376:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940588800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319706.100377:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319706.100409:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588544
00000100:00100000:1.0:1767319706.100413:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588544
00000100:00100000:0.0:1767319706.101371:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319706.104299:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940588800:12345-0@lo:400:kworker.0 Request processed in 3911us (10930us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319706.104313:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4651
00000100:00100000:3.0:1767319706.104593:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319706.104688:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588416
00000100:00100000:3.0:1767319706.104698:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588416
00000100:00100000:3.0:1767319706.104750:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020
00000100:00100000:3.0:1767319706.104762:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940588416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319706.104848:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940588416:12345-0@lo:400:kworker.0 Request processed in 79us (245us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319706.104855:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020
00000100:00100000:3.0:1767319706.104899:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940588416:0@lo:400:kworker.0
00000100:00080000:3.0:1767319706.105026:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319706.105033:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319706.106813:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940588160:0@lo:38:kworker.0
00000100:00100000:0.0:1767319706.106940:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319706.106960:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940588672:0@lo:38:kworker.0
00000100:00100000:0.0:1767319706.106994:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319706.107071:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588032
00000100:00100000:2.0:1767319706.107079:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588032
00000100:00100000:2.0:1767319706.107125:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652
00000100:00100000:2.0:1767319706.107138:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940588544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.107202:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940588544:12345-0@lo:400:kworker.0 Request processed in 68us (6822us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319706.107209:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652
00000100:00100000:2.0:1767319706.107228:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17280
00000100:00100000:2.0:1767319706.107232:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940588032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319706.107252:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319706.107279:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940588032:12345-0@lo:38:kworker.0 Request processed in 46us (5911us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319706.107285:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17280
00000100:00100000:2.0:1767319706.107400:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588160
00000100:00100000:2.0:1767319706.107404:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588160
00000100:00100000:2.0:1767319706.107425:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154
00000100:00100000:2.0:1767319706.107429:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940588160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319706.107440:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319706.107464:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940588160:12345-0@lo:38:kworker.0 Request processed in 34us (525us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319706.107470:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154
00000100:00100000:2.0:1767319706.107526:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940588800:0@lo:400:kworker.0
00000100:00100000:2.0:1767319706.107539:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940588544:0@lo:400:kworker.0
00000100:00100000:0.0:1767319706.113022:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940588928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319706.113095:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319706.113150:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319706.113167:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319706.113171:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940588032:0@lo:38:kworker.0
00000100:00080000:0.0:1767319706.113184:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319706.113188:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319706.113191:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940588160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319706.113342:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588672
00000100:00100000:3.0:1767319706.113349:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588672
00000100:00100000:3.0:1767319706.113391:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940588928
00000100:00100000:3.0:1767319706.113394:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940588928
00000100:00100000:3.0:1767319706.113422:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17281
00000100:00100000:2.0:1767319706.113428:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17282
00000100:00100000:3.0:1767319706.113429:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940588672:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319706.113433:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940588928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319706.113449:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319706.113498:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940588928:12345-0@lo:38:kworker.0 Request processed in 63us (402us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319706.113508:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17282
00000100:00080000:1.0:1767319706.113510:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319706.113513:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319706.113516:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940588928:0@lo:38:kworker.0
00010000:00020000:3.0:1767319706.115360:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319706.115592:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940588672:12345-0@lo:38:kworker.0 Request processed in 2159us (8593us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319706.115602:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17281
00000100:00080000:1.0:1767319706.116009:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319706.116015:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319706.116019:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940588672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319706.605358:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940589056:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319706.605447:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319706.605731:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589056
00000100:00100000:0.0:1767319706.605741:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589056
00000100:00100000:0.0:1767319706.605837:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572
00000100:00100000:0.0:1767319706.605847:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940589056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319706.605883:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319706.605951:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940589056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (503us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319706.605960:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572
00000100:00100000:2.0:1767319706.606627:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940589056:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319706.799204:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319707.053018:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319707.629380:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319707.630694:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940589184:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319707.630790:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319707.641050:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589184
00000100:00100000:1.0:1767319707.641068:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589184
00000100:00100000:1.0:1767319707.641146:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1767319707.641156:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940589184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319707.641220:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319707.641308:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940589184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (10532us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319707.641315:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573
00000100:00100000:2.0:1767319707.642090:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940589184:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319707.723406:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319707.723468:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319707.723701:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333824
00000100:00100000:3.0:1767319707.723712:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333824
00000100:00100000:3.0:1767319707.723761:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894333952
00000100:00100000:3.0:1767319707.723765:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894333952
00000100:00100000:3.0:1767319707.723842:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4653
00000100:00100000:3.0:1767319707.723855:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894333952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319707.724030:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894333952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 179us (561us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319707.724220:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17283
00000100:00100000:1.0:1767319707.724229:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894333824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319707.724250:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319707.724285:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894333824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (889us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319707.724292:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17283
00000100:00080000:1.0:1767319707.724343:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319707.726888:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4653
00000100:00100000:3.0:1767319707.823349:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319708.077356:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319708.845176:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319709.101447:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319709.869210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319710.125237:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319710.189883:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319685/real 1767319685]  req@ffff93cf439b1880 x1853163940583808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319710.189917:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf439b1880 x1853163940583808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319710.189937:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319710.189971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319710.189975:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940583808:0@lo:250:kworker.0
00000100:00080000:3.0:1767319710.190840:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319710.190848:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319710.190851:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319710.190857:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4935
00000100:00080000:3.0:1767319710.190861:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319710.190868:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319710.190906:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940589312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319710.190936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319710.190939:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319710.190941:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319710.190953:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767319710.190956:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319710.190959:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319710.190975:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940589440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319710.190984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319710.190987:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319710.190989:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319710.190992:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767319710.191004:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319710.191008:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319710.191020:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940589568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319710.191090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319710.191093:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319710.191095:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319710.191098:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767319710.191100:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319710.191103:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319710.191113:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3b80 x1853163940590080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319710.191126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319710.191129:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319710.191130:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319710.191133:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767319710.191135:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319710.191138:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319710.191147:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940590336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319710.191378:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940589696:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191450:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319710.191517:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319710.191523:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940589824:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191545:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319710.191591:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940589952:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191618:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319710.191636:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319710.191642:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940590208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191661:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319710.191706:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589696
00000100:00100000:2.0:1767319710.191714:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589696
00000100:00100000:2.0:1767319710.191765:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589824
00000100:00100000:2.0:1767319710.191769:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589824
00000100:00100000:2.0:1767319710.191826:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021
00000100:00100000:2.0:1767319710.191835:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940589696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191885:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940589696:12345-0@lo:400:kworker.0 Request processed in 51us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319710.191893:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021
00000100:00100000:2.0:1767319710.191909:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022
00000100:00100000:2.0:1767319710.191915:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940589824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.191941:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940589824:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319710.191963:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022
00000100:00100000:2.0:1767319710.192020:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940589824:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.192029:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940589696:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.192067:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589952
00000100:00100000:2.0:1767319710.192071:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589952
00000100:00100000:2.0:1767319710.192097:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590208
00000100:00100000:2.0:1767319710.192100:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590208
00000100:00100000:2.0:1767319710.192116:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4654
00000100:00100000:2.0:1767319710.192122:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940589952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.192519:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940589952:12345-0@lo:400:kworker.0 Request processed in 396us (899us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319710.192527:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4654
00000100:00100000:2.0:1767319710.192541:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4655
00000100:00100000:2.0:1767319710.192558:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940590208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.192586:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940590208:12345-0@lo:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319710.192595:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4655
00000100:00100000:2.0:1767319710.192626:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940590208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319710.192636:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940589952:0@lo:400:kworker.0
00000100:00080000:1.0:1767319710.193336:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319710.193341:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319710.193344:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319710.193363:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940589312:0@lo:250:kworker.0
00000400:00000100:1.0:1767319710.193398:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940589312 offset 0 length 520: 4
00000100:00100000:1.0:1767319710.193422:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940589440:0@lo:38:kworker.0
00000100:00100000:1.0:1767319710.193447:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319710.193475:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940589568:0@lo:38:kworker.0
00000100:00100000:1.0:1767319710.193497:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319710.193524:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940590080:0@lo:38:kworker.0
00000100:00100000:1.0:1767319710.193542:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319710.193574:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940590336:0@lo:38:kworker.0
00000100:00100000:1.0:1767319710.193592:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319710.193622:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589440
00000100:00100000:1.0:1767319710.193627:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589440
00000100:00100000:1.0:1767319710.193648:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590080
00000100:00100000:1.0:1767319710.193651:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590080
00000100:00100000:1.0:1767319710.193662:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590336
00000100:00100000:1.0:1767319710.193664:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590336
00000100:00100000:1.0:1767319710.193678:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17284
00000100:00100000:1.0:1767319710.193683:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940589440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319710.193699:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319710.193729:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940589440:12345-0@lo:38:kworker.0 Request processed in 45us (282us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319710.193735:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17284
00000100:00100000:1.0:1767319710.193747:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17285
00000100:00100000:1.0:1767319710.193751:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940590080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319710.193759:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319710.193797:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940590080:12345-0@lo:38:kworker.0 Request processed in 44us (253us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319710.193803:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17285
00000100:00100000:1.0:1767319710.193812:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17286
00000100:00100000:1.0:1767319710.193815:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940590336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319710.193836:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319710.193858:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940590336:12345-0@lo:38:kworker.0 Request processed in 41us (266us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319710.193863:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17286
00000100:00080000:1.0:1767319710.193895:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319710.193900:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319710.193903:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940589440:0@lo:38:kworker.0
00000100:00080000:1.0:1767319710.193910:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319710.193913:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319710.193916:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940590080:0@lo:38:kworker.0
00000100:00080000:1.0:1767319710.193921:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319710.193924:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319710.193926:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940590336:0@lo:38:kworker.0
00000100:00100000:0.0:1767319710.194189:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940589568
00000100:00100000:0.0:1767319710.194193:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940589568
00000100:00100000:0.0:1767319710.194232:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155
00000100:00100000:0.0:1767319710.194237:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940589568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319710.194248:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319710.194280:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940589568:12345-0@lo:38:kworker.0 Request processed in 42us (782us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319710.194286:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155
00000100:00080000:0.0:1767319710.194307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319710.194311:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319710.194314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940589568:0@lo:38:kworker.0
00000100:00100000:2.0:1767319710.896057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319711.153146:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319711.727317:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940590464:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319711.727398:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319711.727684:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590464
00000100:00100000:1.0:1767319711.727694:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590464
00000100:00100000:1.0:1767319711.727756:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767319711.727765:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940590464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319711.727841:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319711.727897:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940590464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319711.727905:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574
00000100:00100000:2.0:1767319711.728070:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940590464:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319711.917058:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319712.173884:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319712.751737:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940590592:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319712.751844:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319712.752470:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590592
00000100:00100000:0.0:1767319712.752479:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590592
00000100:00100000:0.0:1767319712.752550:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575
00000100:00100000:0.0:1767319712.752561:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940590592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319712.752593:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319712.752645:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940590592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (801us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319712.752651:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575
00000100:00080000:1.0:1767319712.752744:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319712.752981:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940590592:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319712.838715:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319712.838879:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319712.847838:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334208
00000100:00100000:2.0:1767319712.847856:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334208
00000100:00100000:2.0:1767319712.847980:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334080
00000100:00100000:2.0:1767319712.847983:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334080
00000100:00100000:2.0:1767319712.848014:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4656
00000100:00100000:2.0:1767319712.848023:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894334208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319712.848124:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894334208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (9428us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319712.848132:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4656
00000100:00100000:2.0:1767319712.848152:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17287
00000100:00100000:2.0:1767319712.848156:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894334080:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:1.0:1767319712.848472:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767319712.848768:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319712.849157:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894334080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 997us (10275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319712.849173:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17287
00000100:00100000:2.0:1767319712.941392:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319713.197368:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319713.971828:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319714.221406:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319714.989886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319715.245031:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319715.308957:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319715.308970:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319715.308973:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319715.308978:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319715.308983:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319715.308992:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4960
00000100:00080000:3.0:1767319715.308997:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319715.309007:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319715.309067:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2a00 x1853163940590720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319715.309095:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319715.309098:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319715.309100:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319715.309104:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4960
00000100:00080000:3.0:1767319715.309107:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319715.309111:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319715.309127:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940590848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319715.309199:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319715.309202:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319715.309204:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319715.309208:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4960
00000100:00080000:3.0:1767319715.309210:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319715.309214:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319715.309227:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0380 x1853163940591360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319715.309244:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319715.309247:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319715.309249:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319715.309253:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4960
00000100:00080000:3.0:1767319715.309256:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319715.309259:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319715.309270:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0e00 x1853163940591616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319715.309325:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940591232:0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.309403:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319715.309470:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319715.309477:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940591488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.309506:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319715.309541:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591232
00000100:00100000:3.0:1767319715.309550:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591232
00000100:00100000:3.0:1767319715.309602:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591488
00000100:00100000:3.0:1767319715.309605:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591488
00000100:00100000:3.0:1767319715.309632:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4657
00000100:00100000:3.0:1767319715.309640:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940591232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.309692:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940591232:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319715.309701:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4657
00000100:00100000:1.0:1767319715.309715:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940590976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.309737:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658
00000100:00100000:3.0:1767319715.309746:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940591488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319715.309757:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319715.309816:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319715.309822:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940591104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319715.309877:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940590720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319715.309926:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590976
00000100:00100000:2.0:1767319715.309932:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590976
00000100:00100000:3.0:1767319715.309932:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940591488:12345-0@lo:400:kworker.0 Request processed in 185us (422us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319715.309941:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658
00000100:00100000:2.0:1767319715.309971:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023
00000100:00100000:2.0:1767319715.309981:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940590976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.309987:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940591488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319715.310000:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940591232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319715.310035:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940590976:12345-0@lo:400:kworker.0 Request processed in 56us (278us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319715.310043:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023
00000100:00080000:3.0:1767319715.310070:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319715.310076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319715.311292:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319715.311348:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940590976:0@lo:400:kworker.0
00000100:00100000:2.0:1767319715.311445:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591104
00000100:00100000:2.0:1767319715.311451:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591104
00000100:00100000:2.0:1767319715.311520:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024
00000100:00100000:2.0:1767319715.311528:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940591104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319715.311588:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940591104:12345-0@lo:400:kworker.0 Request processed in 60us (300us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319715.311594:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024
00000100:00100000:1.0:1767319715.311696:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940591104:0@lo:400:kworker.0
00000100:00080000:3.0:1767319715.311769:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319715.317114:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319715.317273:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940590848:0@lo:38:kworker.0
00000100:00100000:0.0:1767319715.317314:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319715.317346:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940591360:0@lo:38:kworker.0
00000100:00100000:0.0:1767319715.317371:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319715.317436:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590848
00000100:00100000:1.0:1767319715.317446:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590848
00000100:00100000:1.0:1767319715.317505:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156
00000100:00100000:1.0:1767319715.317514:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940590848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319715.317543:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319715.317590:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940590848:12345-0@lo:38:kworker.0 Request processed in 77us (275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319715.317598:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156
00000100:00100000:0.0:1767319715.322738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940591616:0@lo:38:kworker.0
00000100:00100000:0.0:1767319715.322821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319715.328716:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940590720
00000100:00100000:3.0:1767319715.328735:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940590720
00000100:00100000:3.0:1767319715.328819:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591360
00000100:00100000:3.0:1767319715.328823:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591360
00000100:00100000:3.0:1767319715.328854:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17288
00000100:00100000:3.0:1767319715.328863:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940590720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319715.328886:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319715.328984:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940590720:12345-0@lo:38:kworker.0 Request processed in 120us (11880us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319715.328990:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17288
00000100:00100000:3.0:1767319715.329009:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17289
00000100:00100000:3.0:1767319715.329290:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940591360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319715.329302:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319715.329332:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940591360:12345-0@lo:38:kworker.0 Request processed in 317us (11960us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319715.329338:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17289
00000100:00080000:0.0:1767319715.330953:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319715.330964:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319715.330969:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940590720:0@lo:38:kworker.0
00000100:00080000:0.0:1767319715.330985:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319715.330989:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319715.330991:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940590848:0@lo:38:kworker.0
00000100:00080000:0.0:1767319715.331001:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319715.331005:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319715.331008:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940591360:0@lo:38:kworker.0
00000100:00100000:3.0:1767319715.331275:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591616
00000100:00100000:3.0:1767319715.331283:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591616
00000100:00100000:3.0:1767319715.331337:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17290
00000100:00100000:3.0:1767319715.331345:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940591616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319715.331366:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319715.331438:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940591616:12345-0@lo:38:kworker.0 Request processed in 92us (8616us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319715.331445:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17290
00000100:00080000:0.0:1767319715.332292:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319715.332298:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319715.332302:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940591616:0@lo:38:kworker.0
00000100:00100000:3.0:1767319716.014168:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319716.269014:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319716.845155:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940591744:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319716.845256:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319716.845534:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591744
00000100:00100000:1.0:1767319716.845544:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591744
00000100:00100000:1.0:1767319716.848619:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576
00000100:00100000:1.0:1767319716.848660:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940591744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319716.848719:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319716.848867:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940591744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 231us (3610us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319716.848966:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940591744:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319716.852229:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576
00000100:00100000:3.0:1767319717.037180:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319717.293322:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319717.869141:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940591872:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319717.869220:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319717.869509:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940591872
00000100:00100000:1.0:1767319717.869518:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940591872
00000100:00100000:1.0:1767319717.869589:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577
00000100:00100000:1.0:1767319717.869598:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940591872:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319717.869629:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319717.869685:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940591872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (464us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319717.869692:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577
00000100:00100000:2.0:1767319717.869806:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940591872:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319717.869919:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319717.961006:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319717.961148:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334464
00000100:00100000:1.0:1767319717.961158:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334464
00000100:00100000:1.0:1767319717.961243:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4659
00000100:00100000:1.0:1767319717.961254:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894334464:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319717.961336:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894334464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (338us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319717.961355:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4659
00000100:00080000:3.0:1767319717.961427:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319717.965669:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319717.965833:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334336
00000100:00100000:3.0:1767319717.965843:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334336
00000100:00100000:3.0:1767319717.966525:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17291
00000100:00100000:3.0:1767319717.966536:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894334336:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319717.966565:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319717.966647:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894334336:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 110us (988us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319717.966656:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17291
00000100:00100000:3.0:1767319718.060927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319718.318608:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319719.085072:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319719.341097:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319720.108894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319720.365164:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319720.429042:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319720.429054:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319720.429057:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319720.429061:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319720.429066:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319720.429074:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4965
00000100:00080000:3.0:1767319720.429079:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319720.429086:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319720.429140:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0380 x1853163940592000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319720.429167:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319720.429171:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319720.429173:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319720.429177:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4965
00000100:00080000:3.0:1767319720.429180:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319720.429185:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319720.429201:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940592128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319720.429285:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319720.429288:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319720.429290:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319720.429294:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4965
00000100:00080000:3.0:1767319720.429297:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319720.429301:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319720.429312:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940592640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319720.429327:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319720.429331:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319720.429333:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319720.429336:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4965
00000100:00080000:3.0:1767319720.429338:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319720.429341:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319720.429356:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1880 x1853163940592896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319720.429505:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940592384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.429586:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319720.429654:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319720.429660:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940592256:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.429685:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319720.429711:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940592512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.429737:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319720.429754:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319720.429758:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940592768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.429801:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319720.429835:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592384
00000100:00100000:2.0:1767319720.429843:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592384
00000100:00100000:2.0:1767319720.429918:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592256
00000100:00100000:2.0:1767319720.429921:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592256
00000100:00100000:2.0:1767319720.429943:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025
00000100:00100000:2.0:1767319720.429951:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940592384:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.430001:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940592384:12345-0@lo:400:kworker.0 Request processed in 50us (415us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319720.430007:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025
00000100:00100000:2.0:1767319720.430022:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026
00000100:00100000:2.0:1767319720.430029:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940592256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.430058:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940592256:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319720.430064:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026
00000100:00080000:2.0:1767319720.430080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319720.430084:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319720.430194:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940592256:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.430203:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940592384:0@lo:400:kworker.0
00000100:00100000:3.0:1767319720.430467:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592512
00000100:00100000:3.0:1767319720.430472:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592512
00000100:00100000:3.0:1767319720.430518:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592768
00000100:00100000:3.0:1767319720.430522:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592768
00000100:00100000:3.0:1767319720.430622:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4660
00000100:00100000:3.0:1767319720.430628:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940592512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319720.430667:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940592512:12345-0@lo:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319720.430673:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4660
00000100:00100000:3.0:1767319720.430686:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4661
00000100:00100000:3.0:1767319720.430692:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940592768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319720.430719:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940592768:12345-0@lo:400:kworker.0 Request processed in 27us (917us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319720.430724:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4661
00000100:00100000:1.0:1767319720.430908:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940592000:0@lo:38:kworker.0
00000100:00100000:1.0:1767319720.430944:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319720.430973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940592128:0@lo:38:kworker.0
00000100:00100000:1.0:1767319720.430998:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319720.431017:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940592640:0@lo:38:kworker.0
00000100:00100000:1.0:1767319720.431035:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319720.431049:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940592896:0@lo:38:kworker.0
00000100:00100000:1.0:1767319720.431067:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319720.431096:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592128
00000100:00100000:1.0:1767319720.431101:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592128
00000100:00100000:1.0:1767319720.431122:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157
00000100:00100000:1.0:1767319720.431127:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940592128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319720.431160:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319720.431193:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940592128:12345-0@lo:38:kworker.0 Request processed in 64us (193us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319720.431200:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157
00000100:00100000:1.0:1767319720.431221:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592000
00000100:00100000:1.0:1767319720.431225:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592000
00000100:00100000:1.0:1767319720.431243:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592640
00000100:00100000:1.0:1767319720.431245:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592640
00000100:00100000:1.0:1767319720.431253:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940592896
00000100:00100000:1.0:1767319720.431255:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940592896
00000100:00100000:1.0:1767319720.431264:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17292
00000100:00100000:1.0:1767319720.431268:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319720.431278:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319720.431299:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592000:12345-0@lo:38:kworker.0 Request processed in 30us (356us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319720.431306:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17292
00000100:00100000:1.0:1767319720.431315:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17293
00000100:00100000:1.0:1767319720.431319:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319720.431327:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319720.431344:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592640:12345-0@lo:38:kworker.0 Request processed in 24us (308us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319720.431349:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17293
00000100:00100000:1.0:1767319720.431359:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17294
00000100:00100000:1.0:1767319720.431362:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319720.431371:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319720.431388:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940592896:12345-0@lo:38:kworker.0 Request processed in 24us (320us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319720.431393:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17294
00000100:00080000:1.0:1767319720.431424:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319720.431430:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319720.431434:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940592000:0@lo:38:kworker.0
00000100:00080000:1.0:1767319720.431442:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319720.431445:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319720.431448:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940592128:0@lo:38:kworker.0
00000100:00080000:1.0:1767319720.431455:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319720.431458:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319720.431461:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940592640:0@lo:38:kworker.0
00000100:00080000:1.0:1767319720.431467:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319720.431470:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319720.431473:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940592896:0@lo:38:kworker.0
00000100:00080000:2.0:1767319720.432441:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319720.432484:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940592768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319720.432501:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940592512:0@lo:400:kworker.0
00000100:00100000:3.0:1767319721.133095:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319721.389413:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319721.971561:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940593024:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319721.971652:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319721.972705:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593024
00000100:00100000:2.0:1767319721.972718:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593024
00000100:00100000:2.0:1767319721.972812:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578
00000100:00100000:2.0:1767319721.972822:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940593024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319721.972891:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319721.977295:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940593024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4463us (5632us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319721.977312:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578
00000100:00100000:0.0:1767319721.977963:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940593024:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319722.156921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319722.413805:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319722.989156:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319722.989190:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940593152:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319722.989265:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319722.989400:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593152
00000100:00100000:2.0:1767319722.989408:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593152
00000100:00100000:2.0:1767319722.989472:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579
00000100:00100000:2.0:1767319722.989481:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940593152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319722.989513:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319722.989556:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940593152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319722.989563:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579
00000100:00080000:1.0:1767319722.990021:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319722.990066:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940593152:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319723.080716:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319723.080766:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319723.081054:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334592
00000100:00100000:3.0:1767319723.081062:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334592
00000100:00100000:3.0:1767319723.081188:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334720
00000100:00100000:3.0:1767319723.081192:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334720
00000100:00080000:1.0:1767319723.081329:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319723.081381:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4662
00000100:00100000:2.0:1767319723.081390:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894334720:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319723.081461:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894334720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (695us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319723.081466:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4662
00000100:00100000:2.0:1767319723.081481:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17295
00000100:00100000:2.0:1767319723.081484:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894334592:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319723.081503:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319723.081521:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894334592:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 35us (817us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319723.081525:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17295
00000100:00100000:3.0:1767319723.180935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319723.446996:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319724.205042:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319724.465394:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319725.229891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319725.485011:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319725.549021:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319725.549030:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319725.549034:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319725.549037:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319725.549043:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319725.549051:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4970
00000100:00080000:0.0:1767319725.549056:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319725.549063:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319725.549103:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3fb80 x1853163940593280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319725.549127:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319725.549130:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319725.549132:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319725.549135:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4970
00000100:00080000:0.0:1767319725.549137:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319725.549140:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319725.549155:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0bb80 x1853163940593408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319725.549222:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319725.549226:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319725.549227:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319725.549232:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4970
00000100:00080000:0.0:1767319725.549234:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319725.549238:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319725.549249:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09880 x1853163940593920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319725.549264:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319725.549267:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319725.549269:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319725.549272:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4970
00000100:00080000:0.0:1767319725.549274:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319725.549278:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319725.549289:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09c00 x1853163940594176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319725.549317:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940594048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319725.549395:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319725.549459:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319725.549465:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940593792:0@lo:400:kworker.0
00000100:00100000:3.0:1767319725.549650:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940593536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319725.549684:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319725.549712:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319725.549718:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940593664:0@lo:400:kworker.0
00000100:00100000:3.0:1767319725.549751:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319725.549811:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593536
00000100:00100000:3.0:1767319725.549819:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593536
00000100:00100000:3.0:1767319725.549865:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593664
00000100:00100000:3.0:1767319725.549869:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593664
00000100:00100000:3.0:1767319725.549890:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027
00000100:00100000:3.0:1767319725.549899:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940593536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319725.549950:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940593536:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319725.549960:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027
00000100:00100000:3.0:1767319725.549979:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028
00000100:00100000:3.0:1767319725.549985:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940593664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319725.550014:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940593664:12345-0@lo:400:kworker.0 Request processed in 29us (262us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319725.550020:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028
00000100:00100000:3.0:1767319725.550064:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940593664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319725.550068:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940593280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319725.550078:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940593536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319725.550107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319725.550144:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940593408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319725.550160:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594048
00000100:00100000:3.0:1767319725.550166:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594048
00000100:00100000:2.0:1767319725.550178:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319725.550197:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940593920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319725.550199:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593280
00000100:00100000:3.0:1767319725.550204:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593280
00000100:00100000:3.0:1767319725.550221:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4663
00000100:00100000:3.0:1767319725.550230:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940594048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319725.550237:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319725.550258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940594176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319725.550274:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940594048:12345-0@lo:400:kworker.0 Request processed in 45us (877us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319725.550282:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4663
00000100:00100000:2.0:1767319725.550287:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319725.550296:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593920
00000100:00100000:3.0:1767319725.550301:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593920
00000100:00100000:3.0:1767319725.550315:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594176
00000100:00100000:3.0:1767319725.550318:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594176
00000100:00100000:3.0:1767319725.550332:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17296
00000100:00100000:2.0:1767319725.550342:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17297
00000100:00100000:3.0:1767319725.550342:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940593280:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319725.550352:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940593920:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319725.550423:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319725.550451:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940594048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319725.550473:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593792
00000100:00100000:0.0:1767319725.550477:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593792
00010000:00020000:3.0:1767319725.550843:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319725.550889:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940593280:12345-0@lo:38:kworker.0 Request processed in 549us (781us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319725.550898:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17296
00000100:00100000:3.0:1767319725.550913:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17298
00000100:00100000:3.0:1767319725.550917:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940594176:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319725.550980:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664
00000100:00100000:0.0:1767319725.550986:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940593792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319725.551029:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940593792:12345-0@lo:400:kworker.0 Request processed in 43us (606us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319725.551036:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664
00000100:00100000:1.0:1767319725.551046:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940593408
00000100:00100000:1.0:1767319725.551053:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940593408
00000100:00100000:0.0:1767319725.551072:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940593792:0@lo:400:kworker.0
00000100:00100000:1.0:1767319725.551083:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158
00000100:00100000:1.0:1767319725.551090:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940593408:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767319725.551106:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319725.551111:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319725.551114:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319725.551170:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319725.551176:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319725.551179:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940593280:0@lo:38:kworker.0
00010000:00020000:2.0:1767319725.554276:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319725.554389:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940593920:12345-0@lo:38:kworker.0 Request processed in 4033us (4148us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319725.554402:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17297
00000100:00080000:0.0:1767319725.554618:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319725.554624:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319725.554628:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940593920:0@lo:38:kworker.0
00010000:00020000:3.0:1767319725.563475:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319725.563585:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940594176:12345-0@lo:38:kworker.0 Request processed in 12664us (13297us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319725.563598:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17298
00000100:00080000:0.0:1767319725.564431:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319725.564440:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319725.564445:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940594176:0@lo:38:kworker.0
00010000:00020000:1.0:1767319725.566847:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319725.566961:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940593408:12345-0@lo:38:kworker.0 Request processed in 15867us (16781us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319725.566974:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158
00000100:00080000:0.0:1767319725.567107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319725.567113:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319725.567117:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940593408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319726.252955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319726.509129:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319727.085502:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319727.085530:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940594304:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319727.085606:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319727.085768:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594304
00000100:00100000:1.0:1767319727.085807:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594304
00000100:00100000:1.0:1767319727.085876:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580
00000100:00100000:1.0:1767319727.085885:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940594304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319727.085920:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319727.085966:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940594304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (360us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319727.085973:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580
00000100:00080000:2.0:1767319727.086373:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319727.086417:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940594304:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319727.174334:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767319727.174370:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894334848 offset 0 length 520: 4
00000100:00100000:2.0:1767319727.174396:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319727.174484:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335104
00000100:00100000:3.0:1767319727.174495:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335104
00000100:00100000:3.0:1767319727.174567:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894334976
00000100:00100000:3.0:1767319727.174571:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894334976
00000100:00100000:3.0:1767319727.174590:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4665
00000100:00100000:3.0:1767319727.174600:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894335104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319727.174674:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894335104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (349us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319727.174681:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4665
00000100:00100000:3.0:1767319727.174701:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17299
00000100:00100000:3.0:1767319727.174706:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894334976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319727.174742:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319727.174767:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894334976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (371us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319727.174814:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17299
00000100:00080000:2.0:1767319727.175366:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319727.277001:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319727.535237:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319728.109326:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940594432:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319728.109401:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319728.109568:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594432
00000100:00100000:0.0:1767319728.109577:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594432
00000100:00100000:0.0:1767319728.109648:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581
00000100:00100000:0.0:1767319728.109659:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940594432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319728.109699:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319728.109754:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940594432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (352us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319728.109761:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581
00000100:00100000:0.0:1767319728.109852:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940594432:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319728.110219:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319728.303817:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319728.558695:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319729.326301:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319729.581133:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319730.351062:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319730.605349:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319730.672312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319730.672323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319730.672326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319730.672331:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319730.672335:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319730.672345:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767319730.672350:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319730.672358:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319730.672407:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940594560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319730.672444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319730.672449:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319730.672451:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319730.672455:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767319730.672457:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319730.672461:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319730.672474:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940594688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319730.672531:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319730.672534:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319730.672536:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319730.672540:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767319730.672543:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319730.672547:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319730.672563:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940595200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319730.672579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319730.672582:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319730.672584:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319730.672587:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767319730.672590:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319730.672593:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319730.672603:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8700 x1853163940595456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319730.672640:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940594816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319730.672718:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319730.672844:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319730.672851:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940594944:0@lo:400:kworker.0
00000100:00100000:2.0:1767319730.672875:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319730.672914:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940595072:0@lo:400:kworker.0
00000100:00100000:3.0:1767319730.673067:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594816
00000100:00100000:3.0:1767319730.673075:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594816
00000100:00100000:3.0:1767319730.673124:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594944
00000100:00100000:3.0:1767319730.673128:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594944
00000100:00100000:3.0:1767319730.673149:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029
00000100:00100000:3.0:1767319730.673159:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940594816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319730.673259:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030
00000100:00100000:0.0:1767319730.673269:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940594944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319730.673338:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940594560:0@lo:38:kworker.0
00000100:00100000:3.0:1767319730.679096:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940594816:12345-0@lo:400:kworker.0 Request processed in 5488us (5927us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319730.679114:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029
00000100:00100000:3.0:1767319730.679210:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940594816:0@lo:400:kworker.0
00000100:00080000:3.0:1767319730.679420:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319730.679426:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319730.679448:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940595328:0@lo:400:kworker.0
00000100:00100000:3.0:1767319730.679501:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319730.679554:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595328
00000100:00100000:3.0:1767319730.679561:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595328
00000100:00100000:3.0:1767319730.679617:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4666
00000100:00100000:3.0:1767319730.679627:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940595328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319730.680400:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940595328:12345-0@lo:400:kworker.0 Request processed in 773us (896us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319730.680408:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4666
00000100:00080000:3.0:1767319730.680433:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319730.680462:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940595328:0@lo:400:kworker.0
00000100:00100000:0.0:1767319730.683244:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940594944:12345-0@lo:400:kworker.0 Request processed in 9957us (10348us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319730.683260:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030
00000100:00100000:3.0:1767319730.683553:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940594944:0@lo:400:kworker.0
00000100:00100000:1.0:1767319730.688552:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319730.688673:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940594688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319730.688721:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319730.688754:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940595200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319730.688803:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319730.688866:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594688
00000100:00100000:0.0:1767319730.688873:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594688
00000100:00100000:0.0:1767319730.688916:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159
00000100:00100000:0.0:1767319730.688931:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940594688:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319730.688956:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319730.689001:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940594688:12345-0@lo:38:kworker.0 Request processed in 79us (280us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319730.689008:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159
00000100:00100000:1.0:1767319730.702347:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940595456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319730.702415:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319730.708468:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940594560
00000100:00100000:3.0:1767319730.708485:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940594560
00000100:00100000:3.0:1767319730.708540:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595200
00000100:00100000:3.0:1767319730.708543:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595200
00000100:00100000:3.0:1767319730.708571:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17300
00000100:00100000:3.0:1767319730.708580:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940594560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319730.708605:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319730.708701:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940594560:12345-0@lo:38:kworker.0 Request processed in 121us (20156us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319730.708708:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17300
00000100:00100000:3.0:1767319730.708726:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17301
00000100:00100000:3.0:1767319730.708730:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940595200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319730.709199:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319730.709240:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940595200:12345-0@lo:38:kworker.0 Request processed in 508us (20436us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319730.709246:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17301
00000100:00080000:1.0:1767319730.709457:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319730.709463:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319730.709510:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940594560:0@lo:38:kworker.0
00000100:00080000:1.0:1767319730.709524:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319730.709527:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319730.709530:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940594688:0@lo:38:kworker.0
00000100:00080000:1.0:1767319730.709540:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319730.709543:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319730.709545:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940595200:0@lo:38:kworker.0
00000100:00100000:0.0:1767319730.710539:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319730.712399:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595456
00000100:00100000:3.0:1767319730.712412:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595456
00000100:00100000:3.0:1767319730.712448:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595072
00000100:00100000:3.0:1767319730.712452:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595072
00000100:00100000:3.0:1767319730.712501:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4667
00000100:00100000:3.0:1767319730.712510:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940595072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319730.712596:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940595072:12345-0@lo:400:kworker.0 Request processed in 87us (2061us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319730.712604:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4667
00000100:00100000:3.0:1767319730.712621:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17302
00000100:00100000:3.0:1767319730.712628:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940595456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319730.713041:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319730.713079:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940595456:12345-0@lo:38:kworker.0 Request processed in 451us (10663us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319730.713085:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17302
00000100:00080000:3.0:1767319730.713103:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319730.713209:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940595072:0@lo:400:kworker.0
00000100:00080000:1.0:1767319730.714847:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319730.714856:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319730.714861:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940595456:0@lo:38:kworker.0
00000100:00100000:2.0:1767319731.375674:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319731.633118:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319732.205839:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940595584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319732.205914:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319732.206333:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595584
00000100:00100000:1.0:1767319732.206342:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595584
00000100:00100000:1.0:1767319732.206414:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582
00000100:00100000:1.0:1767319732.206423:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940595584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319732.206653:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319732.206803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319732.207237:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940595584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 814us (1322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319732.207247:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582
00000100:00100000:2.0:1767319732.219662:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940595584:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319732.304386:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319732.304438:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319732.304517:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335232
00000100:00100000:0.0:1767319732.304527:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335232
00000100:00100000:0.0:1767319732.304570:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335360
00000100:00100000:0.0:1767319732.304573:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335360
00000100:00100000:0.0:1767319732.304611:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4668
00000100:00100000:0.0:1767319732.304618:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894335360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319732.304685:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894335360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 67us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319732.304690:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4668
00000100:00100000:0.0:1767319732.304705:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17303
00000100:00100000:0.0:1767319732.304708:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894335232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319732.304728:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319732.304767:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894335232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 55us (391us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319732.304801:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319732.304804:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17303
00000100:00100000:2.0:1767319732.400032:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319732.654071:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319733.229112:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319733.229139:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940595712:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319733.229212:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319733.229431:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595712
00000100:00100000:1.0:1767319733.229441:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595712
00000100:00100000:1.0:1767319733.229515:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583
00000100:00100000:1.0:1767319733.229526:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940595712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319733.229560:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319733.229618:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940595712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (405us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319733.229635:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583
00000100:00100000:2.0:1767319733.229685:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940595712:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319733.230012:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319733.426410:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319733.678765:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319734.446757:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319734.701301:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319735.468930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319735.725339:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319735.789017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319735.789027:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319735.789029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319735.789034:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319735.789038:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319735.789046:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767319735.789051:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319735.789058:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319735.789098:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9880 x1853163940595840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319735.789125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319735.789128:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319735.789130:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319735.789133:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767319735.789136:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319735.789139:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319735.789153:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eada680 x1853163940595968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319735.789225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319735.789228:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319735.789230:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319735.789234:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767319735.789236:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319735.789240:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319735.789253:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8700 x1853163940596480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319735.789268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319735.789270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319735.789272:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319735.789275:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767319735.789277:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319735.789281:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319735.789289:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8a80 x1853163940596736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319735.789317:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940596352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.789384:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319735.789454:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319735.789469:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940596608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.789493:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319735.789528:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596352
00000100:00100000:2.0:1767319735.789535:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596352
00000100:00100000:2.0:1767319735.789583:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596608
00000100:00100000:2.0:1767319735.789586:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596608
00000100:00100000:2.0:1767319735.789611:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4669
00000100:00100000:2.0:1767319735.789620:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940596352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.789673:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940596352:12345-0@lo:400:kworker.0 Request processed in 54us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319735.789680:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4669
00000100:00100000:2.0:1767319735.789879:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4670
00000100:00100000:2.0:1767319735.789887:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940596608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.789918:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940596608:12345-0@lo:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319735.789923:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4670
00000100:00100000:2.0:1767319735.789957:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940596608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.789968:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940596352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319735.790493:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940596096:0@lo:400:kworker.0
00000100:00100000:0.0:1767319735.790533:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319735.790579:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319735.790586:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940596224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319735.790607:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319735.790929:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596096
00000100:00100000:2.0:1767319735.790935:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596096
00000100:00100000:2.0:1767319735.790991:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596224
00000100:00100000:2.0:1767319735.790995:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596224
00000100:00100000:2.0:1767319735.791018:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031
00000100:00100000:2.0:1767319735.791026:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940596096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.791070:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940596096:12345-0@lo:400:kworker.0 Request processed in 45us (536us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319735.791077:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031
00000100:00100000:2.0:1767319735.791090:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032
00000100:00100000:2.0:1767319735.791097:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940596224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319735.791124:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940596224:12345-0@lo:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319735.791131:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032
00000100:00100000:0.0:1767319735.791340:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940596224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319735.791351:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940596096:0@lo:400:kworker.0
00000100:00080000:3.0:1767319735.791606:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319735.791611:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319735.791614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319735.792261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940595840:0@lo:38:kworker.0
00000100:00100000:1.0:1767319735.792311:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319735.792343:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940595968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319735.792367:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319735.792393:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940596480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319735.792414:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319735.792432:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940596736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319735.792452:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319735.792487:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595840
00000100:00100000:0.0:1767319735.792492:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596480
00000100:00100000:1.0:1767319735.792493:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595840
00000100:00100000:0.0:1767319735.792499:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596480
00000100:00100000:3.0:1767319735.792557:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940595968
00000100:00100000:3.0:1767319735.792561:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940595968
00000100:00100000:3.0:1767319735.792584:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160
00000100:00100000:3.0:1767319735.792590:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940595968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319735.792608:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319735.792648:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940595968:12345-0@lo:38:kworker.0 Request processed in 57us (279us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319735.792655:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160
00000100:00080000:3.0:1767319735.792693:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319735.792698:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319735.792701:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940595968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319735.792768:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596736
00000100:00100000:1.0:1767319735.792789:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596736
00000100:00100000:0.0:1767319735.795963:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17304
00000100:00100000:0.0:1767319735.795990:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940595840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319735.796017:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319735.796108:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940595840:12345-0@lo:38:kworker.0 Request processed in 128us (3795us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319735.796116:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17304
00000100:00100000:0.0:1767319735.796138:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17305
00000100:00100000:0.0:1767319735.796143:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940596480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319735.796153:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319735.796179:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940596480:12345-0@lo:38:kworker.0 Request processed in 35us (3765us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319735.796185:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17305
00000100:00100000:0.0:1767319735.796198:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17306
00000100:00100000:0.0:1767319735.796202:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940596736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319735.796210:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319735.796233:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940596736:12345-0@lo:38:kworker.0 Request processed in 29us (3780us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319735.796238:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17306
00000100:00080000:0.0:1767319735.796346:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319735.796351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319735.796355:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940595840:0@lo:38:kworker.0
00000100:00080000:0.0:1767319735.796367:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319735.796370:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319735.796373:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940596480:0@lo:38:kworker.0
00000100:00080000:0.0:1767319735.796382:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319735.796386:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319735.796389:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940596736:0@lo:38:kworker.0
00000100:00100000:2.0:1767319736.493263:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319736.749041:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319736.813156:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319710/real 1767319710]  req@ffff93cf514a0a80 x1853163940589312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319735 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319736.813189:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf514a0a80 x1853163940589312/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319735 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319736.813208:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319736.813227:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319736.813230:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940589312:0@lo:250:kworker.0
00000100:00080000:2.0:1767319736.813584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319736.813590:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319736.813594:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319736.813599:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4960
00000100:00080000:2.0:1767319736.813604:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319736.813609:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319736.813643:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940596864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319736.813672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319736.813676:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319736.813677:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319736.813681:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767319736.813683:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319736.813686:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319736.813727:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399e680 x1853163940596992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319736.813736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319736.813739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319736.813741:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319736.813745:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767319736.813747:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319736.813750:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319736.813764:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399f480 x1853163940597120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319736.813842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319736.813846:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319736.813849:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319736.813852:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767319736.813855:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319736.813859:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319736.813873:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940597632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319736.813874:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940597376:0@lo:400:kworker.0
00000100:00080000:2.0:1767319736.813898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319736.813901:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319736.813903:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319736.813907:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767319736.813909:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319736.813912:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319736.813923:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399c700 x1853163940597888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319736.813947:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940597504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319736.813954:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319736.813990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319736.814028:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319736.814042:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940597248:0@lo:400:kworker.0
00000100:00100000:3.0:1767319736.814066:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319736.814069:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940596864:0@lo:250:kworker.0
00000400:00000100:0.0:1767319736.814100:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940596864 offset 0 length 520: 4
00000100:00100000:3.0:1767319736.814101:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597376
00000100:00100000:3.0:1767319736.814110:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597376
00000100:00100000:0.0:1767319736.814125:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940596992:0@lo:38:kworker.0
00000100:00100000:0.0:1767319736.814151:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319736.814161:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597248
00000100:00100000:3.0:1767319736.814166:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597248
00000100:00100000:0.0:1767319736.814174:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940597120:0@lo:38:kworker.0
00000100:00100000:3.0:1767319736.814195:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033
00000100:00100000:0.0:1767319736.814203:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319736.814208:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940597376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814227:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940597632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319736.814250:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319736.814272:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940597888:0@lo:38:kworker.0
00000100:00100000:3.0:1767319736.814286:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940597376:12345-0@lo:400:kworker.0 Request processed in 81us (332us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319736.814297:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033
00000100:00100000:0.0:1767319736.814301:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319736.814322:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034
00000100:00100000:3.0:1767319736.814332:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940597248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814341:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597504
00000100:00100000:0.0:1767319736.814346:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597504
00000100:00100000:3.0:1767319736.814365:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940597248:12345-0@lo:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319736.814372:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034
00000100:00100000:0.0:1767319736.814379:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940596992
00000100:00100000:0.0:1767319736.814383:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940596992
00000100:00100000:0.0:1767319736.814402:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597632
00000100:00100000:3.0:1767319736.814405:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597120
00000100:00100000:0.0:1767319736.814406:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597632
00000100:00100000:3.0:1767319736.814412:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597120
00000100:00100000:0.0:1767319736.814420:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597888
00000100:00100000:0.0:1767319736.814424:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597888
00000100:00100000:3.0:1767319736.814438:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161
00000100:00100000:3.0:1767319736.814444:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940597120:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319736.814455:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4671
00010000:00020000:3.0:1767319736.814465:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319736.814466:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940597504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319736.814509:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940597120:12345-0@lo:38:kworker.0 Request processed in 62us (305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319736.814517:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940597504:12345-0@lo:400:kworker.0 Request processed in 52us (523us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319736.814521:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161
00000100:00100000:0.0:1767319736.814529:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4671
00000100:00100000:0.0:1767319736.814548:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17307
00000100:00100000:0.0:1767319736.814553:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940596992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319736.814565:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319736.814588:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940597248:0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814591:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940596992:12345-0@lo:38:kworker.0 Request processed in 36us (438us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319736.814602:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17307
00000100:00100000:3.0:1767319736.814611:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940597376:0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814619:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17308
00000100:00100000:0.0:1767319736.814624:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940597632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319736.814634:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319736.814645:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17309
00000100:00100000:0.0:1767319736.814658:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940597632:12345-0@lo:38:kworker.0 Request processed in 32us (405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319736.814665:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17308
00000100:00080000:0.0:1767319736.814694:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319736.814710:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319736.814714:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940596992:0@lo:38:kworker.0
00000100:00080000:0.0:1767319736.814725:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319736.814728:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319736.814730:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940597120:0@lo:38:kworker.0
00000100:00080000:0.0:1767319736.814737:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319736.814740:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319736.814743:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940597632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319736.814801:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940597760:0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814825:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319736.814852:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940597760
00000100:00100000:0.0:1767319736.814856:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940597760
00000100:00100000:0.0:1767319736.814879:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4672
00000100:00100000:0.0:1767319736.814885:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940597760:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319736.814917:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940597760:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319736.814926:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4672
00000100:00100000:0.0:1767319736.814951:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940597760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319736.815848:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940597888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319736.815873:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319736.815923:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940597888:12345-0@lo:38:kworker.0 Request processed in 1270us (1625us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319736.815929:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17309
00000100:00080000:0.0:1767319736.817834:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319736.817845:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319736.817851:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940597888:0@lo:38:kworker.0
00000100:00100000:2.0:1767319736.834028:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940597504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319737.327015:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940598016:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319737.327103:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319737.327258:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598016
00000100:00100000:2.0:1767319737.327269:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598016
00000100:00100000:2.0:1767319737.327363:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584
00000100:00100000:2.0:1767319737.327374:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940598016:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319737.327419:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319737.327475:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940598016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319737.327483:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584
00000100:00100000:2.0:1767319737.327537:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940598016:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319737.330262:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319737.414909:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319737.414965:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319737.415058:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335488
00000100:00100000:3.0:1767319737.415062:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335616
00000100:00100000:3.0:1767319737.415071:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335616
00000100:00100000:1.0:1767319737.415081:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335488
00000100:00100000:1.0:1767319737.415142:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4673
00000100:00100000:1.0:1767319737.415151:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894335616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:0.0:1767319737.415175:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319737.415270:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17310
00000100:00100000:3.0:1767319737.415279:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894335488:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767319737.415309:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894335616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 156us (340us total) trans 0 rc 0/0
00010000:00020000:3.0:1767319737.415309:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319737.415322:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4673
00000100:00100000:3.0:1767319737.415348:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894335488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 67us (449us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319737.415357:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17310
00000100:00100000:2.0:1767319737.518878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319737.775023:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319738.354316:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319738.354345:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940598144:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319738.354430:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319738.354568:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598144
00000100:00100000:0.0:1767319738.354579:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598144
00000100:00100000:0.0:1767319738.354670:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585
00000100:00100000:0.0:1767319738.354680:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940598144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319738.354727:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319738.354799:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940598144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (367us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319738.354807:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585
00000100:00080000:1.0:1767319738.354870:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319738.354913:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940598144:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319738.541143:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319738.803391:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319739.566738:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319739.821312:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319740.588937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319740.848539:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319741.613348:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319741.870585:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319741.933268:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319741.933283:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319741.933479:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319741.933484:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319741.933488:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319741.933497:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4986
00000100:00080000:3.0:1767319741.933503:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319741.933511:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319741.933560:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940598272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319741.933589:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319741.933592:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319741.933594:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319741.933598:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4986
00000100:00080000:3.0:1767319741.933601:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319741.933604:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319741.933629:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213480 x1853163940598400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319741.933708:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319741.933800:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940598272:0@lo:38:kworker.0
00000100:00100000:0.0:1767319741.933883:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319741.933939:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940598400:0@lo:38:kworker.0
00000100:00100000:0.0:1767319741.933968:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319741.934982:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319741.935000:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940598656:0@lo:400:kworker.0
00000100:00100000:2.0:1767319741.935053:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319741.935130:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598272
00000100:00100000:2.0:1767319741.935140:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598272
00000100:00100000:2.0:1767319741.935189:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17311
00000100:00100000:2.0:1767319741.935198:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940598272:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319741.935223:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319741.935270:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940598272:12345-0@lo:38:kworker.0 Request processed in 72us (1386us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319741.935277:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17311
00000100:00080000:2.0:1767319741.935336:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319741.935342:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319741.935345:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940598272:0@lo:38:kworker.0
00000100:00100000:2.0:1767319741.935395:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598400
00000100:00100000:2.0:1767319741.935398:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598400
00000100:00100000:2.0:1767319741.935420:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162
00000100:00100000:2.0:1767319741.935425:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940598400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319741.935436:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319741.935467:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940598400:12345-0@lo:38:kworker.0 Request processed in 41us (1498us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319741.935473:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162
00000100:00080000:2.0:1767319741.935497:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319741.935500:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319741.935503:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940598400:0@lo:38:kworker.0
00000100:00100000:0.0:1767319741.935943:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598656
00000100:00100000:0.0:1767319741.935949:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598656
00000100:00100000:0.0:1767319741.936013:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035
00000100:00100000:0.0:1767319741.936020:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940598656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319741.936070:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940598656:12345-0@lo:400:kworker.0 Request processed in 51us (1017us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319741.936077:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035
00000100:00100000:0.0:1767319741.936114:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940598656:0@lo:400:kworker.0
00000100:00080000:2.0:1767319741.941013:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319741.946602:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940598528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319741.946714:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319741.951378:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598528
00000100:00100000:0.0:1767319741.951397:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598528
00000100:00100000:0.0:1767319741.951497:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036
00000100:00100000:0.0:1767319741.951509:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940598528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319741.951617:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940598528:12345-0@lo:400:kworker.0 Request processed in 112us (4903us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319741.951624:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036
00000100:00080000:2.0:1767319741.951803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319741.951939:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319741.951944:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319741.951948:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319741.951953:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4986
00000100:00080000:3.0:1767319741.951957:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319741.951962:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319741.951983:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213100 x1853163940598912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319741.952006:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319741.952009:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319741.952011:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319741.952015:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4986
00000100:00080000:3.0:1767319741.952018:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319741.952021:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319741.952030:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212d80 x1853163940599168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319741.952061:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940599040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319741.952112:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319741.952142:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319741.952148:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940598784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319741.952168:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319741.952246:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599040
00000100:00100000:2.0:1767319741.952252:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599040
00000100:00100000:2.0:1767319741.952306:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598784
00000100:00100000:2.0:1767319741.952310:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598784
00000100:00100000:2.0:1767319741.952329:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4674
00000100:00100000:2.0:1767319741.952335:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940599040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319741.952376:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940599040:12345-0@lo:400:kworker.0 Request processed in 41us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319741.952383:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4674
00000100:00100000:2.0:1767319741.952396:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4675
00000100:00100000:2.0:1767319741.952402:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940598784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319741.952429:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940598784:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319741.952439:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4675
00000100:00100000:2.0:1767319741.952479:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940598784:0@lo:400:kworker.0
00000100:00100000:2.0:1767319741.952490:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940599040:0@lo:400:kworker.0
00000100:00100000:2.0:1767319741.952519:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940598912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319741.952544:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319741.952560:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940599168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319741.952579:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319741.952603:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940598912
00000100:00100000:2.0:1767319741.952607:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940598912
00000100:00100000:2.0:1767319741.952622:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599168
00000100:00100000:2.0:1767319741.952625:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599168
00000100:00100000:2.0:1767319741.952638:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17312
00000100:00100000:2.0:1767319741.952643:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940598912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319741.952677:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319741.952712:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940598912:12345-0@lo:38:kworker.0 Request processed in 68us (166us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319741.952719:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17312
00000100:00100000:2.0:1767319741.952731:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17313
00000100:00100000:2.0:1767319741.952735:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940599168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319741.952744:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319741.952767:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940599168:12345-0@lo:38:kworker.0 Request processed in 30us (187us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319741.952804:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17313
00000100:00080000:2.0:1767319741.952832:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319741.952837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319741.952840:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940598912:0@lo:38:kworker.0
00000100:00080000:2.0:1767319741.952847:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319741.952850:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319741.952852:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940599168:0@lo:38:kworker.0
00000100:00100000:1.0:1767319741.953361:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940598528:0@lo:400:kworker.0
00000100:00080000:3.0:1767319741.954601:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319742.445182:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940599296:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319742.445256:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319742.445458:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599296
00000100:00100000:1.0:1767319742.445467:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599296
00000100:00100000:1.0:1767319742.445520:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586
00000100:00100000:1.0:1767319742.445529:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940599296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319742.445560:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319742.445610:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940599296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319742.445617:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586
00000100:00100000:3.0:1767319742.446406:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940599296:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319742.534210:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319742.534570:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335872
00000100:00100000:0.0:1767319742.534580:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335872
00000100:00100000:0.0:1767319742.534680:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4676
00000100:00100000:0.0:1767319742.534691:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894335872:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319742.534824:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894335872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 134us (623us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319742.534832:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4676
00000100:00080000:3.0:1767319742.535166:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319742.540160:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319742.540389:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894335744
00000100:00100000:2.0:1767319742.540401:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894335744
00000100:00100000:2.0:1767319742.540462:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17314
00000100:00100000:2.0:1767319742.540470:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894335744:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319742.540492:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319742.540560:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894335744:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 89us (410us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319742.540567:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17314
00000100:00100000:2.0:1767319742.636916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319742.893112:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319743.470547:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940599424:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319743.470630:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319743.470897:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599424
00000100:00100000:1.0:1767319743.470906:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599424
00000100:00100000:1.0:1767319743.470963:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587
00000100:00100000:1.0:1767319743.470971:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940599424:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319743.471004:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767319743.471084:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319743.476172:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940599424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5190us (5530us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319743.476188:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587
00000100:00100000:2.0:1767319743.476407:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940599424:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319743.660901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319743.920056:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319744.685162:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319744.943077:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319745.709296:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319745.965309:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319746.733161:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319746.989116:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319747.054053:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.054064:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319747.054079:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.054083:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.054087:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.054095:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4991
00000100:00080000:0.0:1767319747.054099:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.054109:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319747.054150:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38000 x1853163940599552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319747.054178:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.054181:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.054183:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.054186:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4991
00000100:00080000:0.0:1767319747.054188:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.054192:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319747.054203:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3b100 x1853163940599680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319747.054251:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940599552:0@lo:38:kworker.0
00000100:00080000:0.0:1767319747.054283:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.054286:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.054287:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.054290:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4991
00000100:00080000:0.0:1767319747.054293:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.054296:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319747.054305:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940600192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319747.054319:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319747.054319:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319747.054322:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.054323:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.054327:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4991
00000100:00080000:0.0:1767319747.054329:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.054332:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319747.054340:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940600448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319747.054362:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940600064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.054373:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940599680:0@lo:38:kworker.0
00000100:00100000:0.0:1767319747.054389:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319747.054396:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.054412:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319747.054413:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940600192:0@lo:38:kworker.0
00000100:00100000:0.0:1767319747.054417:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940600320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.054432:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.054446:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599552
00000100:00100000:2.0:1767319747.054447:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940600448:0@lo:38:kworker.0
00000100:00100000:0.0:1767319747.054454:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599552
00000100:00100000:2.0:1767319747.054464:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.054482:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600064
00000100:00100000:0.0:1767319747.054485:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600064
00000100:00100000:2.0:1767319747.054488:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599680
00000100:00100000:2.0:1767319747.054491:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599680
00000100:00100000:2.0:1767319747.054510:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163
00000100:00100000:0.0:1767319747.054515:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600192
00000100:00100000:0.0:1767319747.054529:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600192
00000100:00100000:0.0:1767319747.054538:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600448
00000100:00100000:0.0:1767319747.054541:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600448
00000100:00100000:0.0:1767319747.054551:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4677
00000100:00100000:0.0:1767319747.054558:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940600064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.054601:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940600064:12345-0@lo:400:kworker.0 Request processed in 45us (212us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319747.054620:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4677
00000100:00100000:0.0:1767319747.054639:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17315
00000100:00100000:1.0:1767319747.054640:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940599808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.054643:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940599552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319747.054662:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319747.054672:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319747.054697:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319747.054703:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940599936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319747.054734:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319747.054766:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599808
00000100:00100000:1.0:1767319747.054769:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599808
00000100:00100000:1.0:1767319747.054832:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940599936
00000100:00100000:1.0:1767319747.054836:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940599936
00000100:00100000:1.0:1767319747.054854:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037
00000100:00100000:1.0:1767319747.054861:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940599808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319747.054897:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940599808:12345-0@lo:400:kworker.0 Request processed in 36us (223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319747.054902:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037
00000100:00100000:1.0:1767319747.054914:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038
00000100:00100000:1.0:1767319747.054919:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940599936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319747.054945:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940599936:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319747.054951:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038
00000100:00100000:1.0:1767319747.054987:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940599936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319747.054997:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940599808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.055002:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940599552:12345-0@lo:38:kworker.0 Request processed in 45us (370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319747.055009:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17315
00000100:00100000:0.0:1767319747.055020:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17316
00000100:00100000:0.0:1767319747.055024:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940600192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319747.055034:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319747.055045:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17317
00000100:00100000:1.0:1767319747.055049:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940600448:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319747.055057:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940600192:12345-0@lo:38:kworker.0 Request processed in 32us (625us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767319747.055059:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319747.055063:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17316
00000100:00100000:1.0:1767319747.055080:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940600448:12345-0@lo:38:kworker.0 Request processed in 29us (614us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319747.055090:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17317
00000100:00080000:0.0:1767319747.055148:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319747.055154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319747.055157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940600192:0@lo:38:kworker.0
00000100:00080000:0.0:1767319747.055165:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319747.055168:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319747.055171:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940600448:0@lo:38:kworker.0
00000100:00080000:0.0:1767319747.055178:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319747.055181:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:3.0:1767319747.055181:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319747.055183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940599552:0@lo:38:kworker.0
00000100:00080000:3.0:1767319747.055185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319747.055188:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319747.055198:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.055208:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600320
00000100:00100000:0.0:1767319747.055211:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600320
00000100:00100000:3.0:1767319747.055222:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940600064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.055238:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4678
00000100:00100000:0.0:1767319747.055243:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940600320:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319747.055252:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319747.055275:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940600320:12345-0@lo:400:kworker.0 Request processed in 32us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319747.055281:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4678
00000100:00100000:2.0:1767319747.055636:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940599680:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319747.055649:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319747.055685:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940599680:12345-0@lo:38:kworker.0 Request processed in 51us (1288us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319747.055692:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163
00000100:00080000:1.0:1767319747.055897:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319747.055902:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319747.055905:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940599680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319747.058695:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940600320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.565095:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940600576:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319747.565163:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.565310:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600576
00000100:00100000:0.0:1767319747.565319:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600576
00000100:00100000:0.0:1767319747.565379:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588
00000100:00100000:0.0:1767319747.565388:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940600576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319747.565418:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319747.565813:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940600576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 425us (648us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319747.565821:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588
00000100:00100000:2.0:1767319747.565903:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940600576:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319747.655947:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319747.655994:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319747.666100:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336128
00000100:00100000:3.0:1767319747.666116:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336128
00000100:00100000:3.0:1767319747.666205:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336000
00000100:00100000:3.0:1767319747.666210:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336000
00000100:00100000:3.0:1767319747.666238:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4679
00000100:00100000:3.0:1767319747.666249:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894336128:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319747.666324:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894336128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (10399us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319747.666332:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4679
00000100:00100000:3.0:1767319747.666350:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17318
00000100:00100000:3.0:1767319747.666354:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894336000:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319747.666373:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319747.666394:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894336000:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (10400us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319747.666400:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17318
00000100:00080000:2.0:1767319747.666711:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319747.756908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319748.013051:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319748.591634:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940600704:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319748.591699:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319748.591832:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600704
00000100:00100000:0.0:1767319748.591841:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600704
00000100:00100000:0.0:1767319748.591893:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589
00000100:00100000:0.0:1767319748.591904:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940600704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319748.591928:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319748.591968:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940600704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (269us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319748.591973:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589
00000100:00100000:2.0:1767319748.592043:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940600704:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319748.780910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319749.037561:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319749.804901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319750.062616:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319750.829049:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319751.092629:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319751.852896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319752.109865:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319752.172927:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319752.172939:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319752.172942:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319752.172946:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319752.172951:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319752.172960:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4997
00000100:00080000:0.0:1767319752.172965:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319752.172973:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319752.173018:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940600832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319752.173039:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319752.173043:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319752.173045:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319752.173049:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4997
00000100:00080000:0.0:1767319752.173052:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319752.173055:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319752.173068:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940600960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319752.173136:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319752.173140:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319752.173142:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319752.173145:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4997
00000100:00080000:0.0:1767319752.173147:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319752.173152:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319752.173165:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940601472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319752.173181:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319752.173196:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319752.173198:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319752.173202:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4997
00000100:00080000:0.0:1767319752.173204:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319752.173208:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319752.173220:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af800 x1853163940601728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319752.173323:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173404:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319752.173472:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319752.173479:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601088:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173501:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319752.173526:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940601344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173550:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319752.173583:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319752.173588:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940601600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173610:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319752.173645:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601344
00000100:00100000:2.0:1767319752.173652:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601344
00000100:00100000:2.0:1767319752.173714:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601600
00000100:00100000:2.0:1767319752.173717:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601600
00000100:00100000:2.0:1767319752.173739:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4680
00000100:00100000:2.0:1767319752.173747:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940601344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173827:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940601344:12345-0@lo:400:kworker.0 Request processed in 80us (275us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319752.173835:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4680
00000100:00100000:2.0:1767319752.173851:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4681
00000100:00100000:2.0:1767319752.173858:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940601600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173883:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940601600:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319752.173890:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4681
00000100:00080000:2.0:1767319752.173909:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319752.173940:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940601600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.173951:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940601344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319752.175520:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601216
00000100:00100000:0.0:1767319752.175532:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601216
00000100:00100000:0.0:1767319752.175608:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601088
00000100:00100000:0.0:1767319752.175611:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601088
00000100:00100000:0.0:1767319752.175633:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039
00000100:00100000:0.0:1767319752.175640:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319752.175725:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601216:12345-0@lo:400:kworker.0 Request processed in 85us (2321us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319752.175732:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039
00000100:00100000:0.0:1767319752.175748:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040
00000100:00100000:0.0:1767319752.175754:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319752.175804:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601088:12345-0@lo:400:kworker.0 Request processed in 51us (2303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319752.175810:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040
00000100:00100000:0.0:1767319752.175851:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319752.175862:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601216:0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.176568:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940600832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.176622:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.176650:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940600960:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.176673:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319752.176803:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600832
00000100:00100000:3.0:1767319752.176809:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600832
00000100:00100000:3.0:1767319752.176839:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17319
00000100:00100000:3.0:1767319752.176844:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940600832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319752.176866:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319752.176902:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940600832:12345-0@lo:38:kworker.0 Request processed in 56us (279us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319752.176908:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17319
00000100:00100000:1.0:1767319752.177839:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940601472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.177879:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.177901:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940601728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.177922:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319752.177958:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319752.177963:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319752.177967:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940600832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.177999:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601472
00000100:00100000:1.0:1767319752.178003:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601472
00000100:00100000:1.0:1767319752.178027:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601728
00000100:00100000:1.0:1767319752.178029:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601728
00000100:00100000:1.0:1767319752.178046:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17320
00000100:00100000:1.0:1767319752.178051:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940601472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319752.178066:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319752.178100:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940601472:12345-0@lo:38:kworker.0 Request processed in 48us (221us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319752.178107:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17320
00000100:00100000:1.0:1767319752.178121:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17321
00000100:00100000:1.0:1767319752.178125:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940601728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319752.178134:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319752.178154:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940601728:12345-0@lo:38:kworker.0 Request processed in 28us (232us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319752.178159:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17321
00000100:00080000:1.0:1767319752.178184:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319752.178187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319752.178190:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940601472:0@lo:38:kworker.0
00000100:00080000:1.0:1767319752.178196:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319752.178199:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319752.178201:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940601728:0@lo:38:kworker.0
00000100:00080000:2.0:1767319752.178282:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319752.178288:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319752.178497:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940600960
00000100:00100000:3.0:1767319752.178503:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940600960
00000100:00100000:3.0:1767319752.178533:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164
00000100:00100000:3.0:1767319752.178538:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940600960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319752.178548:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319752.178600:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940600960:12345-0@lo:38:kworker.0 Request processed in 60us (1925us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319752.178610:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164
00000100:00080000:1.0:1767319752.180858:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319752.180870:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319752.180875:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940600960:0@lo:38:kworker.0
00000100:00100000:0.0:1767319752.687128:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319752.687158:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601856:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319752.687227:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.687353:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601856
00000100:00100000:1.0:1767319752.687362:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601856
00000100:00100000:1.0:1767319752.687418:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590
00000100:00100000:1.0:1767319752.687427:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319752.687467:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319752.687514:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319752.687521:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590
00000100:00100000:2.0:1767319752.687679:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601856:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319752.773943:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319752.773986:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319752.774008:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894336512 offset 0 length 520: 4
00000100:00100000:2.0:1767319752.774100:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336256
00000100:00100000:2.0:1767319752.774110:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336256
00000100:00100000:2.0:1767319752.774165:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336384
00000100:00100000:2.0:1767319752.774168:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336384
00000100:00100000:2.0:1767319752.774206:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4682
00000100:00100000:2.0:1767319752.774225:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894336384:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319752.774288:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894336384:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319752.774296:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4682
00000100:00100000:2.0:1767319752.774311:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17322
00000100:00100000:2.0:1767319752.774315:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894336256:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319752.774333:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319752.774351:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894336256:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 34us (419us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319752.774357:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17322
00000100:00080000:2.0:1767319752.774453:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319752.876896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319753.133106:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319753.712515:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319753.712612:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319753.712793:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940601984
00000100:00100000:0.0:1767319753.712803:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940601984
00000100:00100000:0.0:1767319753.712859:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591
00000100:00100000:0.0:1767319753.712869:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319753.712901:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319753.712956:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940601984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (343us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319753.712963:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591
00000100:00100000:2.0:1767319753.713053:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940601984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319753.903079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319754.157166:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319754.924886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319755.181001:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319755.948972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319756.207087:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319756.973062:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319757.229112:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319757.293058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.293070:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319757.293073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.293077:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.293081:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.293089:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5002
00000100:00080000:2.0:1767319757.293094:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.293102:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319757.293153:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eadaa00 x1853163940602112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319757.293178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.293182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.293184:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.293187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5002
00000100:00080000:2.0:1767319757.293189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.293193:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319757.293206:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940602240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319757.293276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.293280:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.293282:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.293285:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5002
00000100:00080000:2.0:1767319757.293288:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.293292:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319757.293303:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940602752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319757.293317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.293320:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.293322:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.293325:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5002
00000100:00080000:2.0:1767319757.293327:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.293331:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319757.293341:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2a00 x1853163940603008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319757.293405:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940602496:0@lo:400:kworker.0
00000100:00100000:2.0:1767319757.293492:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319757.293564:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319757.293571:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940602368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319757.293595:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319757.293620:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940602880:0@lo:400:kworker.0
00000100:00100000:2.0:1767319757.293650:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319757.293669:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319757.293674:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940602624:0@lo:400:kworker.0
00000100:00100000:2.0:1767319757.293693:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319757.293965:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602880
00000100:00100000:0.0:1767319757.293974:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602880
00000100:00100000:0.0:1767319757.294046:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602624
00000100:00100000:0.0:1767319757.294050:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602624
00000100:00100000:0.0:1767319757.294070:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4683
00000100:00100000:0.0:1767319757.294079:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940602880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.294137:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940602880:12345-0@lo:400:kworker.0 Request processed in 58us (485us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.294143:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4683
00000100:00100000:0.0:1767319757.294159:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4684
00000100:00100000:0.0:1767319757.294165:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940602624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.294193:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940602624:12345-0@lo:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.294200:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4684
00000100:00100000:0.0:1767319757.294248:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940602624:0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.294260:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940602880:0@lo:400:kworker.0
00000100:00080000:2.0:1767319757.294334:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319757.294429:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940602112:0@lo:38:kworker.0
00000100:00100000:1.0:1767319757.294475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319757.294502:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940602240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319757.294538:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319757.294566:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940602752:0@lo:38:kworker.0
00000100:00100000:1.0:1767319757.294586:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319757.294602:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940603008:0@lo:38:kworker.0
00000100:00100000:1.0:1767319757.294623:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319757.294651:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602112
00000100:00100000:1.0:1767319757.294656:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602112
00000100:00100000:1.0:1767319757.294675:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602752
00000100:00100000:1.0:1767319757.294677:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602752
00000100:00100000:1.0:1767319757.294691:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603008
00000100:00100000:1.0:1767319757.294693:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603008
00000100:00100000:1.0:1767319757.294704:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17323
00000100:00100000:1.0:1767319757.294709:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940602112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319757.294728:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319757.294763:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940602112:12345-0@lo:38:kworker.0 Request processed in 52us (287us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319757.294769:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17323
00000100:00100000:1.0:1767319757.294799:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17324
00000100:00100000:1.0:1767319757.294803:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940602752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319757.294812:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319757.294839:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940602752:12345-0@lo:38:kworker.0 Request processed in 33us (251us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319757.294848:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17324
00000100:00100000:2.0:1767319757.294959:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17325
00000100:00100000:2.0:1767319757.294964:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940603008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319757.294974:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319757.295002:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940603008:12345-0@lo:38:kworker.0 Request processed in 36us (378us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319757.295008:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17325
00000100:00080000:1.0:1767319757.295180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319757.295186:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319757.295190:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940602112:0@lo:38:kworker.0
00000100:00080000:1.0:1767319757.295199:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319757.295202:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319757.295205:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940602752:0@lo:38:kworker.0
00000100:00080000:1.0:1767319757.295212:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319757.295215:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319757.295218:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940603008:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.295462:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602496
00000100:00100000:3.0:1767319757.295468:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602496
00000100:00100000:3.0:1767319757.295523:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602368
00000100:00100000:3.0:1767319757.295528:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602368
00000100:00100000:3.0:1767319757.295551:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041
00000100:00100000:3.0:1767319757.295560:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940602496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319757.295610:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940602496:12345-0@lo:400:kworker.0 Request processed in 52us (2117us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319757.295616:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041
00000100:00100000:3.0:1767319757.295631:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042
00000100:00100000:3.0:1767319757.295637:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940602368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319757.295664:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940602368:12345-0@lo:400:kworker.0 Request processed in 27us (2068us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319757.295670:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042
00000100:00100000:3.0:1767319757.295730:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940602368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319757.295742:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940602496:0@lo:400:kworker.0
00000100:00080000:2.0:1767319757.295817:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319757.295821:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319757.296382:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940602240
00000100:00100000:0.0:1767319757.296388:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940602240
00000100:00100000:0.0:1767319757.296426:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165
00000100:00100000:0.0:1767319757.296431:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940602240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319757.296447:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319757.296524:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940602240:12345-0@lo:38:kworker.0 Request processed in 82us (1975us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319757.296530:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165
00000100:00080000:2.0:1767319757.296610:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319757.296615:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319757.296618:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940602240:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.805260:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940603136:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319757.805344:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319757.805920:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603136
00000100:00100000:0.0:1767319757.805933:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603136
00000100:00100000:0.0:1767319757.805999:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592
00000100:00100000:0.0:1767319757.806012:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940603136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319757.806056:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319757.806140:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940603136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (795us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.806147:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592
00000100:00100000:3.0:1767319757.806194:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940603136:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319757.901012:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319757.901098:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319757.901196:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336640
00000100:00100000:3.0:1767319757.901208:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336640
00000100:00100000:3.0:1767319757.901258:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336768
00000100:00100000:3.0:1767319757.901262:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336768
00000100:00100000:3.0:1767319757.901306:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4685
00000100:00100000:3.0:1767319757.901317:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894336768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319757.901395:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894336768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319757.901449:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4685
00000100:00100000:3.0:1767319757.901472:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17326
00000100:00100000:3.0:1767319757.901477:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894336640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319757.901498:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319757.901541:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894336640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 62us (540us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319757.901547:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17326
00000100:00080000:2.0:1767319757.901615:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319757.996904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319758.252940:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319758.829114:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319758.829138:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940603264:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319758.829222:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319758.829466:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603264
00000100:00100000:0.0:1767319758.829476:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603264
00000100:00100000:0.0:1767319758.829538:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593
00000100:00100000:0.0:1767319758.829547:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940603264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319758.829577:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319758.829633:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940603264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (410us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319758.829640:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593
00000100:00100000:3.0:1767319758.830004:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940603264:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319759.021101:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319759.277238:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319760.045515:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319760.302916:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319761.069575:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319761.332578:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319761.388918:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319736/real 1767319736]  req@ffff93cf4399dc00 x1853163940596864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319761.388958:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4399dc00 x1853163940596864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319761.388978:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319761.389001:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319761.389005:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940596864:0@lo:250:kworker.0
00000100:00080000:0.0:1767319761.391538:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319761.391551:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319761.391554:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319761.391562:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 4986
00000100:00080000:0.0:1767319761.391567:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319761.391575:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319761.391618:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940603392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319761.391658:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319761.391662:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319761.391664:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319761.391667:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5007
00000100:00080000:0.0:1767319761.391670:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319761.391674:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319761.391689:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af800 x1853163940603520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319761.391698:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319761.391700:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319761.391702:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319761.391705:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5007
00000100:00080000:0.0:1767319761.391707:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319761.391709:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319761.391722:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940603648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319761.391761:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940603776:0@lo:400:kworker.0
00000100:00080000:0.0:1767319761.391820:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319761.391823:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319761.391825:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319761.391828:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5007
00000100:00080000:0.0:1767319761.391831:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319761.391836:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319761.391845:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940604160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319761.391853:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319761.391860:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319761.391863:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319761.391865:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319761.391868:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5007
00000100:00080000:0.0:1767319761.391870:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319761.391873:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319761.391882:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d500 x1853163940604416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319761.391908:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940604288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.391918:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319761.391922:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940603904:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.391939:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319761.391940:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319761.391962:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319761.391966:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940604032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.391973:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603776
00000100:00100000:3.0:1767319761.391980:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603776
00000100:00100000:0.0:1767319761.391985:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319761.392006:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604288
00000100:00100000:0.0:1767319761.392009:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604288
00000100:00100000:3.0:1767319761.392032:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603904
00000100:00100000:3.0:1767319761.392035:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603904
00000100:00100000:3.0:1767319761.392056:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043
00000100:00100000:3.0:1767319761.392063:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940603776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.392121:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940603776:12345-0@lo:400:kworker.0 Request processed in 58us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319761.392128:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043
00000100:00100000:2.0:1767319761.392139:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604032
00000100:00100000:2.0:1767319761.392143:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604032
00000100:00100000:3.0:1767319761.392146:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044
00000100:00100000:3.0:1767319761.392151:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940603904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319761.392173:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4686
00000100:00100000:3.0:1767319761.392178:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940603904:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319761.392179:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940604032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.392184:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044
00000100:00100000:2.0:1767319761.392213:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940604032:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319761.392218:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4686
00000100:00100000:3.0:1767319761.392229:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940603904:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.392238:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940603776:0@lo:400:kworker.0
00000100:00080000:2.0:1767319761.392245:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319761.392249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319761.392251:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319761.392271:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940604032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.392272:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940603392:0@lo:250:kworker.0
00000400:00000100:3.0:1767319761.392292:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940603392 offset 0 length 520: 4
00000100:00100000:3.0:1767319761.392309:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940603520:0@lo:38:kworker.0
00000100:00100000:3.0:1767319761.392329:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319761.392355:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940603648:0@lo:38:kworker.0
00000100:00100000:3.0:1767319761.392375:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319761.392392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940604160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319761.392410:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319761.392422:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940604416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319761.392455:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319761.392491:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603648
00000100:00100000:3.0:1767319761.392496:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603648
00000100:00100000:3.0:1767319761.392515:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166
00000100:00100000:3.0:1767319761.392520:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940603648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319761.392537:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319761.392556:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940603520
00000100:00100000:0.0:1767319761.392560:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940603520
00000100:00100000:3.0:1767319761.392569:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940603648:12345-0@lo:38:kworker.0 Request processed in 48us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319761.392572:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604160
00000100:00100000:0.0:1767319761.392574:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604160
00000100:00100000:3.0:1767319761.392576:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166
00000100:00100000:0.0:1767319761.392581:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604416
00000100:00100000:0.0:1767319761.392582:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604416
00000100:00100000:0.0:1767319761.392592:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4687
00000100:00100000:0.0:1767319761.392597:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940604288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319761.392732:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940604288:12345-0@lo:400:kworker.0 Request processed in 135us (791us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319761.392802:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940604288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319761.401657:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17327
00000100:00100000:3.0:1767319761.401674:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940603520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319761.401702:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319761.401808:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940603520:12345-0@lo:38:kworker.0 Request processed in 137us (9476us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319761.401817:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17327
00000100:00100000:3.0:1767319761.401856:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17328
00000100:00100000:3.0:1767319761.401862:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940604160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319761.401871:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319761.401898:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940604160:12345-0@lo:38:kworker.0 Request processed in 35us (9486us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319761.401904:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17328
00000100:00100000:3.0:1767319761.401917:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17329
00000100:00100000:3.0:1767319761.401922:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940604416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319761.401944:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319761.401970:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940604416:12345-0@lo:38:kworker.0 Request processed in 46us (9515us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319761.401979:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17329
00000100:00080000:3.0:1767319761.402033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319761.402038:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319761.402043:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940603520:0@lo:38:kworker.0
00000100:00080000:3.0:1767319761.402054:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319761.402057:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319761.402059:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940603648:0@lo:38:kworker.0
00000100:00080000:3.0:1767319761.402068:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319761.402071:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319761.402073:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940604160:0@lo:38:kworker.0
00000100:00080000:3.0:1767319761.402081:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319761.402083:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319761.402086:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940604416:0@lo:38:kworker.0
00000100:00080000:3.0:1767319761.402162:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319761.409212:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4687
00000100:00100000:2.0:1767319762.092903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319762.349217:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319762.927853:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940604544:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319762.927921:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319762.927962:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604544
00000100:00100000:0.0:1767319762.927972:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604544
00000100:00100000:0.0:1767319762.928024:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594
00000100:00100000:0.0:1767319762.928034:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940604544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319762.928065:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319762.928126:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940604544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (205us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319762.928134:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594
00000100:00100000:0.0:1767319762.928183:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940604544:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319763.015134:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319763.015239:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337024
00000100:00100000:2.0:1767319763.015251:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337024
00000100:00100000:2.0:1767319763.015328:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4688
00000100:00100000:2.0:1767319763.015337:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319763.015429:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (309us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319763.015438:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4688
00000100:00080000:3.0:1767319763.015546:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319763.015929:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319763.016048:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894336896
00000100:00100000:0.0:1767319763.016055:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894336896
00000100:00100000:0.0:1767319763.016089:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17330
00000100:00100000:0.0:1767319763.016094:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894336896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319763.016120:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319763.016161:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894336896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 65us (234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319763.016168:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17330
00000100:00100000:2.0:1767319763.116918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319763.373450:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319763.949484:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319763.949512:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940604672:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319763.949593:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319763.949836:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604672
00000100:00100000:0.0:1767319763.949849:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604672
00000100:00100000:0.0:1767319763.949931:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595
00000100:00100000:0.0:1767319763.949941:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940604672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319763.949975:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319763.950024:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940604672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (430us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319763.950031:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595
00000100:00080000:3.0:1767319763.950257:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319763.950298:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940604672:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319764.140902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319764.397036:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319765.164890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319765.421298:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319766.188908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319766.445005:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319766.508997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319766.509006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319766.509008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319766.509012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319766.509015:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319766.509020:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5011
00000100:00080000:3.0:1767319766.509024:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319766.509030:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319766.509065:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af480 x1853163940604800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319766.509087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319766.509090:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319766.509091:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319766.509093:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5011
00000100:00080000:3.0:1767319766.509095:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319766.509097:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319766.509109:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940604928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319766.509152:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605056:0@lo:400:kworker.0
00000100:00100000:1.0:1767319766.509216:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319766.509283:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605056
00000100:00100000:2.0:1767319766.509293:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605056
00000100:00100000:0.0:1767319766.509351:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940604800:0@lo:38:kworker.0
00000100:00100000:2.0:1767319766.509360:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045
00000100:00100000:2.0:1767319766.509371:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319766.509389:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319766.509412:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940604928:0@lo:38:kworker.0
00000100:00100000:1.0:1767319766.509457:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319766.509463:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319766.509490:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319766.509514:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604928
00000100:00100000:0.0:1767319766.509517:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604928
00000100:00100000:0.0:1767319766.509533:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167
00000100:00100000:0.0:1767319766.509537:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940604928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319766.509553:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319766.509576:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940604928:12345-0@lo:38:kworker.0 Request processed in 38us (86us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319766.509580:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167
00000100:00080000:0.0:1767319766.509608:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319766.509611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319766.509613:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940604928:0@lo:38:kworker.0
00000100:00080000:0.0:1767319766.509646:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319766.509659:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940604800
00000100:00100000:0.0:1767319766.509661:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940604800
00000100:00100000:0.0:1767319766.509675:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17331
00000100:00100000:0.0:1767319766.509678:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940604800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319766.509685:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319766.509939:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605056:12345-0@lo:400:kworker.0 Request processed in 570us (721us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319766.509947:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045
00000100:00080000:3.0:1767319766.512587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319766.512596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319766.512600:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319766.512610:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5011
00000100:00080000:3.0:1767319766.512615:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319766.512621:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319766.512644:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170000 x1853163940605440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319766.512671:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319766.512674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319766.512675:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319766.512677:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5011
00000100:00080000:3.0:1767319766.512679:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319766.512683:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319766.512690:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47172680 x1853163940605696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319766.512694:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940605312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319766.512721:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940605568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319766.512824:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940604800:12345-0@lo:38:kworker.0 Request processed in 3142us (3433us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319766.512835:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17331
00000100:00100000:0.0:1767319766.512878:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940605440:0@lo:38:kworker.0
00000100:00100000:0.0:1767319766.512896:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319766.512910:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940605696:0@lo:38:kworker.0
00000100:00100000:0.0:1767319766.512922:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319766.512947:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319766.512950:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319766.512953:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940604800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319766.512978:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605440
00000100:00100000:0.0:1767319766.512982:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605440
00000100:00100000:0.0:1767319766.512999:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605696
00000100:00100000:0.0:1767319766.513001:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605696
00000100:00100000:0.0:1767319766.513009:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17332
00000100:00100000:0.0:1767319766.513013:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940605440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319766.513027:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319766.513063:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319766.513065:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940605440:12345-0@lo:38:kworker.0 Request processed in 49us (166us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319766.513071:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17332
00000100:00100000:0.0:1767319766.513079:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605312
00000100:00100000:0.0:1767319766.513081:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605312
00000100:00100000:2.0:1767319766.513105:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17333
00000100:00100000:2.0:1767319766.513110:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940605696:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319766.513118:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689
00010000:00020000:2.0:1767319766.513121:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319766.513125:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940605312:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319766.513146:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940605696:12345-0@lo:38:kworker.0 Request processed in 34us (221us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319766.513151:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17333
00000100:00100000:0.0:1767319766.513164:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940605312:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319766.513170:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689
00000100:00100000:2.0:1767319766.513181:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940605312:0@lo:400:kworker.0
00000100:00080000:0.0:1767319766.513190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319766.513215:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319766.513220:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319766.513225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940605440:0@lo:38:kworker.0
00000100:00080000:0.0:1767319766.513235:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319766.513238:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319766.513242:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940605696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319766.513327:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319766.513372:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605056:0@lo:400:kworker.0
00000100:00100000:2.0:1767319766.513531:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605184
00000100:00100000:2.0:1767319766.513535:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605184
00000100:00100000:2.0:1767319766.513585:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046
00000100:00100000:2.0:1767319766.513593:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319766.514063:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605184:12345-0@lo:400:kworker.0 Request processed in 471us (735us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319766.514072:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046
00000100:00100000:1.0:1767319766.516322:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605184:0@lo:400:kworker.0
00000100:00080000:0.0:1767319766.516438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319766.516543:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319766.516664:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605568
00000100:00100000:2.0:1767319766.516672:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605568
00000100:00100000:2.0:1767319766.516739:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4690
00000100:00100000:2.0:1767319766.516759:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940605568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319766.516840:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940605568:12345-0@lo:400:kworker.0 Request processed in 93us (297us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319766.516847:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4690
00000100:00080000:0.0:1767319766.516900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319766.517001:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940605568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319767.213238:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319767.469046:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319768.045764:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605824:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319768.045891:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319768.046009:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605824
00000100:00100000:0.0:1767319768.046018:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605824
00000100:00100000:0.0:1767319768.046084:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596
00000100:00100000:0.0:1767319768.046093:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319768.046123:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319768.046509:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319768.047148:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1054us (1254us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319768.047157:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596
00000100:00100000:2.0:1767319768.047236:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605824:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319768.139896:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319768.140218:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337280
00000100:00100000:2.0:1767319768.140230:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337280
00000100:00100000:2.0:1767319768.140328:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4691
00000100:00100000:2.0:1767319768.140339:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319768.140689:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 351us (802us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319768.140698:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4691
00000100:00080000:3.0:1767319768.141752:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319768.145169:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319768.145821:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337152
00000100:00100000:2.0:1767319768.145833:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337152
00000100:00100000:2.0:1767319768.145944:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17334
00000100:00100000:2.0:1767319768.145954:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894337152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319768.145982:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319768.146054:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894337152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 99us (896us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319768.146061:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17334
00000100:00100000:2.0:1767319768.237004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319768.495409:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319769.069627:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319769.069653:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319769.069737:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319769.070003:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940605952
00000100:00100000:0.0:1767319769.070011:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940605952
00000100:00100000:0.0:1767319769.070082:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597
00000100:00100000:0.0:1767319769.070091:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319769.070122:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319769.070179:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940605952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (441us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319769.070186:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597
00000100:00080000:3.0:1767319769.070305:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319769.070385:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940605952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319769.261084:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319769.517117:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319770.284933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319770.543797:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319771.308903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319771.565035:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319771.629013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319771.629024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319771.629027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319771.629031:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319771.629035:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319771.629043:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767319771.629048:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319771.629055:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319771.629304:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2300 x1853163940606080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319771.629323:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319771.629326:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319771.629329:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319771.629332:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767319771.629335:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319771.629338:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319771.629356:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0000 x1853163940606208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319771.629453:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940606336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319771.629520:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319771.629592:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606336
00000100:00100000:1.0:1767319771.629602:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606336
00000100:00100000:0.0:1767319771.629645:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940606080:0@lo:38:kworker.0
00000100:00100000:1.0:1767319771.629669:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047
00000100:00100000:1.0:1767319771.629679:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940606336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319771.629685:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.629710:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940606208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319771.630580:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.630626:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606208
00000100:00100000:0.0:1767319771.630631:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606208
00000100:00100000:0.0:1767319771.630657:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168
00000100:00100000:0.0:1767319771.630663:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940606208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319771.630683:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319771.630723:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940606208:12345-0@lo:38:kworker.0 Request processed in 58us (981us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319771.630729:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168
00000100:00080000:0.0:1767319771.630765:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319771.630770:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319771.630789:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940606208:0@lo:38:kworker.0
00000100:00080000:0.0:1767319771.630824:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319771.630848:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606080
00000100:00100000:0.0:1767319771.630852:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606080
00000100:00100000:0.0:1767319771.630873:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17335
00000100:00100000:0.0:1767319771.630878:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940606080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319771.630888:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319771.630916:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940606080:12345-0@lo:38:kworker.0 Request processed in 37us (1234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319771.630922:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17335
00000100:00080000:0.0:1767319771.630951:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319771.630955:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319771.630958:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940606080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319771.630984:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940606464:0@lo:400:kworker.0
00000100:00100000:0.0:1767319771.631010:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.631043:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606464
00000100:00100000:0.0:1767319771.631047:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606464
00000100:00100000:0.0:1767319771.631078:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048
00000100:00100000:0.0:1767319771.631084:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940606464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319771.631120:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940606464:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319771.631126:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048
00000100:00080000:0.0:1767319771.631141:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319771.631159:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940606464:0@lo:400:kworker.0
00000100:00080000:2.0:1767319771.632040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319771.632045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319771.632048:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319771.632054:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767319771.632058:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319771.632064:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940606336:12345-0@lo:400:kworker.0 Request processed in 2383us (2539us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319771.632065:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319771.632078:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047
00000100:00100000:2.0:1767319771.632088:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3b80 x1853163940606720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319771.632115:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319771.632119:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319771.632121:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319771.632124:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767319771.632127:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319771.632129:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940606848:0@lo:400:kworker.0
00000100:00080000:2.0:1767319771.632134:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319771.632148:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2300 x1853163940606976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319771.632234:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940606592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319771.632267:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.632315:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940606720:0@lo:38:kworker.0
00000100:00100000:0.0:1767319771.632335:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.632349:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940606976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319771.632366:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.632407:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606592
00000100:00100000:0.0:1767319771.632412:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606592
00000100:00100000:1.0:1767319771.632428:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319771.632451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4692
00000100:00100000:0.0:1767319771.632460:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940606592:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319771.632470:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319771.632490:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606720
00000100:00100000:1.0:1767319771.632495:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606720
00000100:00100000:0.0:1767319771.632500:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940606592:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319771.632507:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4692
00000100:00100000:1.0:1767319771.632518:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606976
00000100:00100000:1.0:1767319771.632522:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606976
00000100:00100000:0.0:1767319771.632525:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940606848
00000100:00100000:0.0:1767319771.632530:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940606848
00000100:00100000:1.0:1767319771.632687:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17336
00000100:00100000:1.0:1767319771.632697:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940606720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319771.632715:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319771.632729:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940606336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319771.632756:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940606720:12345-0@lo:38:kworker.0 Request processed in 59us (418us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319771.633029:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4693
00000100:00100000:0.0:1767319771.633038:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940606848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319771.633077:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940606848:12345-0@lo:400:kworker.0 Request processed in 42us (651us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319771.633087:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4693
00000100:00100000:0.0:1767319771.633104:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17337
00000100:00100000:0.0:1767319771.633109:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940606976:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319771.633119:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319771.633142:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940606976:12345-0@lo:38:kworker.0 Request processed in 31us (775us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319771.633148:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17337
00000100:00100000:0.0:1767319771.633175:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940606592:0@lo:400:kworker.0
00000100:00080000:0.0:1767319771.633198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319771.633212:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319771.633216:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319771.633219:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940606720:0@lo:38:kworker.0
00000100:00080000:0.0:1767319771.633227:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319771.633230:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319771.633233:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940606976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319771.633417:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940606848:0@lo:400:kworker.0
00000100:00100000:1.0:1767319771.633919:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17336
00000100:00100000:2.0:1767319772.332963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319772.590397:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319773.166950:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319773.166975:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940607104:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319773.167045:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319773.167301:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607104
00000100:00100000:2.0:1767319773.167311:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607104
00000100:00100000:2.0:1767319773.167391:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598
00000100:00100000:2.0:1767319773.167400:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940607104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319773.167432:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319773.167582:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940607104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319773.167591:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598
00000100:00100000:1.0:1767319773.167707:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940607104:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319773.168277:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319773.255850:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319773.258964:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319773.259524:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337536
00000100:00100000:1.0:1767319773.259536:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337536
00000100:00100000:1.0:1767319773.259623:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337408
00000100:00100000:1.0:1767319773.259627:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337408
00000100:00100000:1.0:1767319773.259656:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4694
00000100:00100000:1.0:1767319773.259668:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894337536:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319773.259700:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17338
00000100:00100000:3.0:1767319773.259706:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894337408:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319773.259727:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319773.259751:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894337536:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (3907us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319773.259758:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894337408:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (798us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319773.259770:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17338
00000100:00100000:1.0:1767319773.259800:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4694
00000100:00080000:0.0:1767319773.259988:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319773.356915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319773.613016:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319774.189118:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319774.189140:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940607232:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319774.189202:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319774.189546:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607232
00000100:00100000:0.0:1767319774.189555:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607232
00000100:00080000:2.0:1767319774.189612:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319774.189630:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599
00000100:00100000:0.0:1767319774.189639:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940607232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319774.189670:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319774.189727:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940607232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (523us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319774.189735:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599
00000100:00100000:2.0:1767319774.189770:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940607232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319774.380906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319774.637797:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319775.405139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319775.662578:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319776.429318:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319776.685119:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319776.749076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319776.749088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319776.749091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319776.749095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319776.749100:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319776.749108:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5021
00000100:00080000:2.0:1767319776.749113:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319776.749120:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319776.749160:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0000 x1853163940607360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319776.749186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319776.749190:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319776.749192:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319776.749196:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5021
00000100:00080000:2.0:1767319776.749199:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319776.749202:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319776.749217:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940607488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319776.749292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319776.749296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319776.749297:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319776.749301:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5021
00000100:00080000:2.0:1767319776.749303:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319776.749308:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319776.749319:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2a00 x1853163940608000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319776.749344:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319776.749348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319776.749350:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319776.749353:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5021
00000100:00080000:2.0:1767319776.749355:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319776.749359:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319776.749372:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940608256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319776.749409:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940607872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319776.749479:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319776.749540:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319776.749546:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940608128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319776.749570:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319776.750135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940607360:0@lo:38:kworker.0
00000100:00100000:0.0:1767319776.750170:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319776.750205:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940607488:0@lo:38:kworker.0
00000100:00100000:0.0:1767319776.750232:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319776.750271:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940608000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319776.750294:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319776.750317:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940608256:0@lo:38:kworker.0
00000100:00100000:0.0:1767319776.750347:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319776.750397:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607488
00000100:00100000:0.0:1767319776.750404:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607488
00000100:00100000:0.0:1767319776.750442:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169
00000100:00100000:0.0:1767319776.750450:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940607488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319776.750472:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319776.750514:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940607488:12345-0@lo:38:kworker.0 Request processed in 62us (281us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319776.750520:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169
00000100:00100000:0.0:1767319776.750543:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607872
00000100:00100000:0.0:1767319776.750547:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607872
00000100:00100000:0.0:1767319776.750585:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608128
00000100:00100000:0.0:1767319776.750589:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608128
00000100:00100000:0.0:1767319776.750603:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607360
00000100:00100000:0.0:1767319776.750605:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607360
00000100:00100000:0.0:1767319776.750613:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608000
00000100:00100000:0.0:1767319776.750615:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608000
00000100:00100000:0.0:1767319776.750623:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608256
00000100:00100000:0.0:1767319776.750625:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608256
00000100:00100000:0.0:1767319776.750636:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695
00000100:00100000:0.0:1767319776.750643:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940607872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319776.750689:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940607872:12345-0@lo:400:kworker.0 Request processed in 47us (1210us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319776.750695:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695
00000100:00100000:0.0:1767319776.750708:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4696
00000100:00100000:0.0:1767319776.750714:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940608128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319776.750740:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940608128:12345-0@lo:400:kworker.0 Request processed in 27us (1169us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319776.750746:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4696
00000100:00100000:0.0:1767319776.750758:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339
00000100:00100000:0.0:1767319776.750761:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940607360:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319776.751131:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940607616:0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.751166:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319776.751196:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319776.751202:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940607744:0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.751224:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319776.751270:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340
00000100:00100000:3.0:1767319776.751275:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940608000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319776.751287:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319776.751315:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940608000:12345-0@lo:38:kworker.0 Request processed in 38us (1019us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319776.751320:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340
00000100:00100000:3.0:1767319776.751346:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17341
00000100:00100000:3.0:1767319776.751350:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940608256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319776.751359:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319776.751383:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940608256:12345-0@lo:38:kworker.0 Request processed in 32us (1036us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319776.751389:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17341
00000100:00100000:3.0:1767319776.751408:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607616
00000100:00100000:3.0:1767319776.751412:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607616
00000100:00100000:3.0:1767319776.751441:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940607744
00000100:00100000:3.0:1767319776.751445:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940607744
00000100:00100000:3.0:1767319776.751465:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049
00000100:00100000:3.0:1767319776.751473:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940607616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.751507:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940607616:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319776.751514:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049
00000100:00100000:3.0:1767319776.751527:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050
00000100:00100000:3.0:1767319776.751533:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940607744:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.751561:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940607744:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319776.751566:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050
00000100:00100000:3.0:1767319776.751607:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940607744:0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.751617:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940607616:0@lo:400:kworker.0
00000100:00080000:3.0:1767319776.751665:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319776.751669:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319776.751671:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319776.751696:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319776.751701:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319776.751704:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940607488:0@lo:38:kworker.0
00000100:00080000:3.0:1767319776.751712:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319776.751715:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319776.751718:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940608000:0@lo:38:kworker.0
00000100:00080000:3.0:1767319776.751726:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319776.751730:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319776.751733:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940608256:0@lo:38:kworker.0
00010000:00020000:0.0:1767319776.751983:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319776.752020:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940607360:12345-0@lo:38:kworker.0 Request processed in 1256us (1849us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319776.752027:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339
00000100:00080000:0.0:1767319776.752059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319776.752063:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319776.752067:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940607360:0@lo:38:kworker.0
00000100:00100000:3.0:1767319776.752116:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940608128:0@lo:400:kworker.0
00000100:00100000:3.0:1767319776.752132:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940607872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319777.359711:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767319777.359765:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894337664 offset 0 length 520: 4
00000100:00100000:3.0:1767319777.359843:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319777.359968:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337920
00000100:00100000:1.0:1767319777.359979:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337920
00000100:00100000:1.0:1767319777.360046:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894337792
00000100:00100000:1.0:1767319777.360049:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894337792
00000100:00100000:1.0:1767319777.360070:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4697
00000100:00100000:1.0:1767319777.360080:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319777.360170:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894337920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319777.360178:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4697
00000100:00100000:1.0:1767319777.360212:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17342
00000100:00100000:1.0:1767319777.360216:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894337792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319777.360237:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319777.360265:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894337792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (421us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319777.360271:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17342
00000100:00080000:3.0:1767319777.361004:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319777.452946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319777.709894:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319778.285146:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940608384:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319778.285231:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319778.285402:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608384
00000100:00100000:2.0:1767319778.285410:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608384
00000100:00100000:2.0:1767319778.285486:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600
00000100:00100000:2.0:1767319778.285497:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940608384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319778.285530:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319778.285575:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940608384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (355us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319778.285581:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600
00000100:00100000:2.0:1767319778.285617:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940608384:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319778.285679:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319778.476915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319778.733001:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319779.309134:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940608512:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319779.309221:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319779.309393:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608512
00000100:00100000:0.0:1767319779.309404:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608512
00000100:00100000:0.0:1767319779.309487:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601
00000100:00100000:0.0:1767319779.309497:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940608512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319779.309530:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319779.309578:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940608512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319779.309586:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601
00000100:00100000:1.0:1767319779.309723:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940608512:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319779.309803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319779.500977:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319779.758923:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319780.525429:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319780.782354:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319781.548895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319781.806090:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319781.868931:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319781.868945:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319781.868948:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319781.868952:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319781.868957:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319781.868976:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5026
00000100:00080000:3.0:1767319781.868981:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319781.868991:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319781.869034:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940608640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319781.869069:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319781.869073:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319781.869075:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319781.869079:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5026
00000100:00080000:3.0:1767319781.869082:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319781.869085:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319781.869102:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940608768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319781.869165:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319781.869168:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319781.869170:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319781.869173:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5026
00000100:00080000:3.0:1767319781.869176:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319781.869180:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319781.869191:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940609280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319781.869206:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319781.869209:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319781.869211:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319781.869214:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5026
00000100:00080000:3.0:1767319781.869216:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319781.869219:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319781.869230:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3b80 x1853163940609536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319781.869426:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940608640:0@lo:38:kworker.0
00000100:00100000:0.0:1767319781.869508:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319781.869569:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940608768:0@lo:38:kworker.0
00000100:00100000:0.0:1767319781.869595:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319781.869612:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940609280:0@lo:38:kworker.0
00000100:00100000:0.0:1767319781.869632:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319781.869653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940609536:0@lo:38:kworker.0
00000100:00100000:0.0:1767319781.869671:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319781.869707:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608640
00000100:00100000:0.0:1767319781.869715:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608640
00000100:00100000:0.0:1767319781.869744:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609280
00000100:00100000:0.0:1767319781.869748:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609280
00000100:00100000:0.0:1767319781.869760:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609536
00000100:00100000:0.0:1767319781.869763:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609536
00000100:00100000:0.0:1767319781.869804:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17343
00000100:00100000:0.0:1767319781.869810:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940608640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319781.869830:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319781.869870:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940608640:12345-0@lo:38:kworker.0 Request processed in 58us (361us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319781.869878:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17343
00000100:00100000:0.0:1767319781.869895:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17344
00000100:00100000:0.0:1767319781.869899:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940609280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319781.869908:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319781.869930:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940609280:12345-0@lo:38:kworker.0 Request processed in 30us (298us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319781.869936:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17344
00000100:00100000:0.0:1767319781.869947:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17345
00000100:00100000:0.0:1767319781.869951:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940609536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319781.869959:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319781.869994:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940609536:12345-0@lo:38:kworker.0 Request processed in 41us (322us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319781.870000:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17345
00000100:00080000:0.0:1767319781.870036:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319781.870041:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319781.870045:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940608640:0@lo:38:kworker.0
00000100:00080000:0.0:1767319781.870056:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319781.870060:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319781.870062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940609280:0@lo:38:kworker.0
00000100:00080000:0.0:1767319781.870070:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319781.870073:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319781.870076:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940609536:0@lo:38:kworker.0
00000100:00100000:3.0:1767319781.870456:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608768
00000100:00100000:3.0:1767319781.870461:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608768
00000100:00100000:3.0:1767319781.870489:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170
00000100:00100000:3.0:1767319781.870495:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940608768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319781.870506:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319781.870542:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940608768:12345-0@lo:38:kworker.0 Request processed in 45us (945us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319781.870548:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170
00000100:00080000:0.0:1767319781.870681:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319781.870685:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319781.870688:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940608768:0@lo:38:kworker.0
00000100:00100000:2.0:1767319781.871142:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940608896:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871185:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319781.871231:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319781.871238:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940609024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871258:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319781.871310:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940609152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871332:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319781.871348:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319781.871353:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940609408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871384:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319781.871407:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609152
00000100:00100000:2.0:1767319781.871411:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609152
00000100:00100000:2.0:1767319781.871589:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609408
00000100:00100000:2.0:1767319781.871593:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609408
00000100:00100000:2.0:1767319781.871616:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698
00000100:00100000:2.0:1767319781.871622:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940609152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871662:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940609152:12345-0@lo:400:kworker.0 Request processed in 40us (328us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319781.871668:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698
00000100:00100000:2.0:1767319781.871680:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4699
00000100:00100000:2.0:1767319781.871684:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940609408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871703:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940609408:12345-0@lo:400:kworker.0 Request processed in 19us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319781.871708:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4699
00000100:00080000:2.0:1767319781.871720:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319781.871747:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940609408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.871755:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940609152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319781.871930:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940608896
00000100:00100000:3.0:1767319781.871934:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940608896
00000100:00100000:3.0:1767319781.871978:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609024
00000100:00100000:3.0:1767319781.871981:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609024
00000100:00100000:3.0:1767319781.871999:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051
00000100:00100000:3.0:1767319781.872007:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940608896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319781.872041:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940608896:12345-0@lo:400:kworker.0 Request processed in 37us (856us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319781.872047:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051
00000100:00100000:3.0:1767319781.872073:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052
00000100:00100000:3.0:1767319781.872080:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940609024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319781.872106:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940609024:12345-0@lo:400:kworker.0 Request processed in 27us (846us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319781.872111:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052
00000100:00080000:2.0:1767319781.872912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319781.872918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319781.872946:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940609024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319781.872956:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940608896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319782.476264:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319782.476332:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338048
00000100:00100000:1.0:1767319782.476344:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338048
00000100:00100000:3.0:1767319782.476345:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319782.476462:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338176
00000100:00100000:1.0:1767319782.476466:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338176
00000100:00100000:0.0:1767319782.480437:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4700
00000100:00100000:0.0:1767319782.480463:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894338176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319782.480559:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894338176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 108us (4214us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319782.480568:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4700
00000100:00100000:0.0:1767319782.480598:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17346
00000100:00100000:0.0:1767319782.480603:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894338048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319782.480626:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319782.480653:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894338048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (4409us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319782.480660:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17346
00000100:00080000:3.0:1767319782.481477:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319782.573164:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319782.829814:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319783.405896:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319783.405922:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940609664:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319783.405997:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319783.406389:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609664
00000100:00100000:1.0:1767319783.406398:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609664
00000100:00100000:1.0:1767319783.407512:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602
00000100:00100000:1.0:1767319783.407526:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940609664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319783.407578:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319783.407683:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940609664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (1684us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319783.407690:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602
00000100:00100000:2.0:1767319783.409887:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940609664:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319783.412573:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319783.596951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319783.854764:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319784.433004:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940609792:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319784.433085:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319784.433186:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940609792
00000100:00100000:2.0:1767319784.433194:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940609792
00000100:00080000:1.0:1767319784.433537:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319784.435662:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603
00000100:00100000:1.0:1767319784.435681:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940609792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319784.435718:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319784.436116:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940609792:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319784.436469:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940609792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 794us (3391us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319784.436478:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603
00000100:00100000:2.0:1767319784.620905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319784.877040:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319785.644919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319785.901186:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319786.668903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319786.930064:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319786.989347:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319761/real 1767319761]  req@ffff93cf519ad500 x1853163940603392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319786 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319786.989381:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf519ad500 x1853163940603392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319786 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319786.989398:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319786.989420:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319786.989423:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940603392:0@lo:250:kworker.0
00000100:00080000:3.0:1767319786.990512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319786.990522:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319786.990526:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319786.990533:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5011
00000100:00080000:3.0:1767319786.990537:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319786.990543:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319786.990585:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2300 x1853163940609920/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319786.990612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319786.990616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319786.990618:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319786.990621:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5031
00000100:00080000:3.0:1767319786.990623:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319786.990626:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319786.990642:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3b80 x1853163940610048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319786.990651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319786.990654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319786.990656:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319786.990659:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5031
00000100:00080000:3.0:1767319786.990662:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319786.990665:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319786.990677:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940610176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319786.990748:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319786.990751:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319786.990754:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319786.990757:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5031
00000100:00080000:3.0:1767319786.990760:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319786.990764:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319786.990790:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7480 x1853163940610688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319786.990807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319786.990810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319786.990812:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319786.990816:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5031
00000100:00080000:3.0:1767319786.990818:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319786.990821:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319786.990829:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940610944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319786.990861:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940610560:0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.990934:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319786.991000:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319786.991006:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940610816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.991027:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991117:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940610304:0@lo:400:kworker.0
00000100:00100000:0.0:1767319786.991150:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991185:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319786.991191:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940610432:0@lo:400:kworker.0
00000100:00100000:0.0:1767319786.991213:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991259:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610560
00000100:00100000:0.0:1767319786.991266:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610560
00000100:00100000:2.0:1767319786.991284:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940609920:0@lo:250:kworker.0
00000400:00000100:2.0:1767319786.991313:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940609920 offset 0 length 520: 4
00000100:00100000:0.0:1767319786.991321:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610816
00000100:00100000:0.0:1767319786.991326:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610816
00000100:00100000:2.0:1767319786.991339:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940610048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319786.991362:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4701
00000100:00100000:2.0:1767319786.991369:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991377:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940610560:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319786.991389:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940610176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319786.991407:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319786.991422:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940610688:0@lo:38:kworker.0
00000100:00100000:2.0:1767319786.991447:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991448:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940610560:12345-0@lo:400:kworker.0 Request processed in 71us (509us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319786.991458:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4701
00000100:00100000:2.0:1767319786.991461:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940610944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319786.991475:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319786.991481:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610048
00000100:00100000:0.0:1767319786.991486:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610048
00000100:00100000:2.0:1767319786.991501:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610688
00000100:00100000:0.0:1767319786.991503:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610944
00000100:00100000:2.0:1767319786.991507:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610688
00000100:00100000:0.0:1767319786.991508:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610944
00000100:00100000:0.0:1767319786.991526:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4702
00000100:00100000:0.0:1767319786.991533:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940610816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319786.991536:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17347
00000100:00100000:2.0:1767319786.991545:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940610048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319786.991566:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319786.991569:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940610816:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319786.991577:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4702
00000100:00100000:0.0:1767319786.991591:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17348
00000100:00100000:0.0:1767319786.991597:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940610944:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319786.991608:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940610048:12345-0@lo:38:kworker.0 Request processed in 61us (240us total) trans 0 rc -19/-19
00010000:00020000:0.0:1767319786.991610:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319786.991620:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17347
00000100:00100000:2.0:1767319786.991637:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17349
00000100:00100000:2.0:1767319786.991641:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940610688:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319786.991647:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940610944:12345-0@lo:38:kworker.0 Request processed in 48us (169us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767319786.991652:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319786.991662:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17348
00000100:00100000:2.0:1767319786.991684:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940610688:12345-0@lo:38:kworker.0 Request processed in 40us (238us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319786.991690:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17349
00000100:00100000:2.0:1767319786.991714:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610176
00000100:00100000:2.0:1767319786.991717:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610176
00000100:00100000:2.0:1767319786.991735:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171
00000100:00100000:2.0:1767319786.991739:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940610176:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319786.991746:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319786.991765:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940610176:12345-0@lo:38:kworker.0 Request processed in 26us (358us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319786.991769:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171
00000100:00080000:2.0:1767319786.993529:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319786.993539:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319786.993542:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940610048:0@lo:38:kworker.0
00000100:00080000:2.0:1767319786.993550:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319786.993553:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319786.993555:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940610176:0@lo:38:kworker.0
00000100:00080000:2.0:1767319786.993561:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319786.993563:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319786.993565:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940610688:0@lo:38:kworker.0
00000100:00080000:2.0:1767319786.993571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319786.993573:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319786.993575:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940610944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319786.994328:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610304
00000100:00100000:3.0:1767319786.994338:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610304
00000100:00100000:3.0:1767319786.994400:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940610432
00000100:00100000:3.0:1767319786.994404:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940610432
00000100:00100000:3.0:1767319786.994445:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053
00000100:00100000:3.0:1767319786.994456:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940610304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.994553:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940610304:12345-0@lo:400:kworker.0 Request processed in 101us (3402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319786.994562:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053
00000100:00100000:3.0:1767319786.994579:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054
00000100:00100000:3.0:1767319786.994585:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940610432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.994615:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940610432:12345-0@lo:400:kworker.0 Request processed in 30us (3400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319786.994620:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054
00000100:00100000:3.0:1767319786.994668:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940610432:0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.994680:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940610304:0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.994714:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940610816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319786.994734:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940610560:0@lo:400:kworker.0
00000100:00080000:1.0:1767319786.996397:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319786.996406:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319786.996409:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319787.593701:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319787.593870:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338432
00000100:00100000:2.0:1767319787.593881:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338432
00000100:00080000:1.0:1767319787.593982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319787.593982:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4703
00000100:00100000:2.0:1767319787.593996:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894338432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319787.594076:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894338432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319787.594084:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4703
00000100:00100000:0.0:1767319787.597523:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319787.597989:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338304
00000100:00100000:2.0:1767319787.597999:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338304
00000100:00100000:2.0:1767319787.598998:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17350
00000100:00100000:2.0:1767319787.599009:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894338304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319787.599033:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319787.603731:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894338304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4707us (6202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319787.603748:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17350
00000100:00100000:2.0:1767319787.694642:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319787.949422:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319788.525127:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319788.525155:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940611072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319788.525245:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319788.525574:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611072
00000100:00100000:1.0:1767319788.525585:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611072
00000100:00100000:1.0:1767319788.525681:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604
00000100:00100000:1.0:1767319788.525691:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940611072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319788.525727:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319788.526017:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940611072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 327us (771us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319788.526028:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604
00000100:00100000:0.0:1767319788.526114:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940611072:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319788.526603:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319788.717077:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319788.974459:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319789.549096:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319789.549122:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940611200:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319789.549191:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319789.549630:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611200
00000100:00100000:1.0:1767319789.549639:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611200
00000100:00100000:1.0:1767319789.549711:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605
00000100:00100000:1.0:1767319789.549721:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940611200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319789.549752:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319789.549819:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940611200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (627us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319789.549826:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605
00000100:00080000:3.0:1767319789.550054:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319789.550093:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940611200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319789.740904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319789.997019:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319790.765345:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319791.022650:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319791.788902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319792.045018:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319792.108921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319792.108933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319792.108936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319792.108940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319792.108944:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319792.108953:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5037
00000100:00080000:3.0:1767319792.108959:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319792.108966:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319792.109021:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940611328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319792.109048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319792.109051:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319792.109053:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319792.109056:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5037
00000100:00080000:3.0:1767319792.109059:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319792.109062:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319792.109077:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5500 x1853163940611456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319792.109160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319792.109164:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319792.109165:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319792.109169:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5037
00000100:00080000:3.0:1767319792.109172:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319792.109176:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319792.109188:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ea680 x1853163940611968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319792.109236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319792.109239:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319792.109241:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319792.109244:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5037
00000100:00080000:3.0:1767319792.109247:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319792.109251:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319792.109260:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9f80 x1853163940612224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319792.109290:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940611712:0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109368:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319792.109437:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319792.109443:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940611584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109467:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319792.109492:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940611840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109517:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319792.109533:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319792.109537:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940612096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109570:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319792.109602:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611712
00000100:00100000:3.0:1767319792.109609:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611712
00000100:00100000:3.0:1767319792.109657:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611584
00000100:00100000:3.0:1767319792.109660:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611584
00000100:00100000:3.0:1767319792.109681:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055
00000100:00100000:3.0:1767319792.109690:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940611712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109741:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940611712:12345-0@lo:400:kworker.0 Request processed in 53us (372us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319792.109749:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055
00000100:00100000:3.0:1767319792.109767:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056
00000100:00100000:3.0:1767319792.109801:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940611584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109828:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940611584:12345-0@lo:400:kworker.0 Request processed in 56us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319792.109833:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056
00000100:00080000:3.0:1767319792.109851:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319792.109855:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319792.109888:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940611584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319792.109898:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940611712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319792.110587:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611840
00000100:00100000:1.0:1767319792.110593:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611840
00000100:00100000:1.0:1767319792.110657:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612096
00000100:00100000:1.0:1767319792.110660:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612096
00000100:00100000:1.0:1767319792.110682:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4704
00000100:00100000:1.0:1767319792.110690:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940611840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319792.110746:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940611840:12345-0@lo:400:kworker.0 Request processed in 57us (1227us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319792.110752:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4704
00000100:00100000:1.0:1767319792.110766:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4705
00000100:00100000:1.0:1767319792.110806:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940612096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319792.110837:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940612096:12345-0@lo:400:kworker.0 Request processed in 65us (1266us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319792.110843:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4705
00000100:00100000:1.0:1767319792.110879:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940612096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319792.110892:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940611840:0@lo:400:kworker.0
00000100:00080000:3.0:1767319792.111521:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319792.112702:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940611328:0@lo:38:kworker.0
00000100:00100000:2.0:1767319792.112804:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319792.112849:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940611456:0@lo:38:kworker.0
00000100:00100000:2.0:1767319792.112876:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319792.112897:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940611968:0@lo:38:kworker.0
00000100:00100000:2.0:1767319792.112920:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319792.112941:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940612224:0@lo:38:kworker.0
00000100:00100000:2.0:1767319792.112964:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319792.113007:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611328
00000100:00100000:2.0:1767319792.113013:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611328
00000100:00100000:2.0:1767319792.113043:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611968
00000100:00100000:2.0:1767319792.113046:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611968
00000100:00100000:2.0:1767319792.113060:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612224
00000100:00100000:2.0:1767319792.113063:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612224
00000100:00100000:2.0:1767319792.113073:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17351
00000100:00100000:2.0:1767319792.113079:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940611328:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319792.113101:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319792.113213:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940611328:12345-0@lo:38:kworker.0 Request processed in 132us (437us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319792.113224:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17351
00000100:00100000:2.0:1767319792.113240:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17352
00000100:00100000:2.0:1767319792.113244:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940611968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319792.113253:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319792.113277:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940611968:12345-0@lo:38:kworker.0 Request processed in 31us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319792.113284:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17352
00000100:00100000:2.0:1767319792.113295:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17353
00000100:00100000:2.0:1767319792.113299:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940612224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319792.113308:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319792.113329:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940612224:12345-0@lo:38:kworker.0 Request processed in 29us (365us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319792.113335:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17353
00000100:00080000:2.0:1767319792.113383:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319792.113390:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319792.113393:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940611328:0@lo:38:kworker.0
00000100:00080000:2.0:1767319792.113404:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319792.113407:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319792.113410:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940611968:0@lo:38:kworker.0
00000100:00080000:2.0:1767319792.113417:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319792.113420:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319792.113423:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940612224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319792.113803:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940611456
00000100:00100000:1.0:1767319792.113810:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940611456
00000100:00100000:1.0:1767319792.113841:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172
00000100:00100000:1.0:1767319792.113847:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940611456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319792.113859:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319792.113896:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940611456:12345-0@lo:38:kworker.0 Request processed in 48us (1020us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319792.113901:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172
00000100:00080000:3.0:1767319792.119267:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319792.119283:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319792.119288:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940611456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319792.710515:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319792.711010:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319792.711220:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338560
00000100:00100000:2.0:1767319792.711230:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338560
00000100:00100000:2.0:1767319792.711410:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338688
00000100:00100000:2.0:1767319792.711414:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338688
00000100:00100000:2.0:1767319792.711460:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4706
00000100:00100000:2.0:1767319792.711470:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894338688:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319792.711551:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894338688:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (542us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319792.711558:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4706
00000100:00100000:2.0:1767319792.711910:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17354
00000100:00100000:2.0:1767319792.711916:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894338560:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319792.711935:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319792.711963:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894338560:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (1458us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319792.711970:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17354
00000100:00080000:3.0:1767319792.712913:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319792.813008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319793.073561:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319793.646028:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319793.648942:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940612352:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319793.649545:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319793.649796:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612352
00000100:00100000:0.0:1767319793.649807:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612352
00000100:00100000:0.0:1767319793.649863:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606
00000100:00100000:0.0:1767319793.649874:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940612352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319793.649920:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319793.649998:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940612352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (456us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319793.650007:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606
00000100:00100000:2.0:1767319793.650274:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940612352:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319793.837863:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319794.093494:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319794.669262:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940612480:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319794.669356:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319794.669566:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612480
00000100:00100000:1.0:1767319794.669575:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612480
00000100:00100000:1.0:1767319794.669653:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607
00000100:00100000:1.0:1767319794.669673:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940612480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319794.669702:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319794.669748:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940612480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319794.669754:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607
00000100:00080000:3.0:1767319794.670217:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319794.670257:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940612480:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319794.860912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319795.117023:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319795.884896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319796.141203:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319796.908906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319797.165634:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319797.229030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319797.229040:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319797.229042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319797.229045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319797.229049:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319797.229055:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5042
00000100:00080000:0.0:1767319797.229059:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319797.229065:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319797.229100:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6680 x1853163940612608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319797.229125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319797.229128:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319797.229129:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319797.229131:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5042
00000100:00080000:0.0:1767319797.229133:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319797.229135:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319797.229145:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5880 x1853163940612736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319797.229181:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940612608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319797.229225:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940612864:0@lo:400:kworker.0
00000100:00100000:3.0:1767319797.229248:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319797.229271:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319797.229320:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940612736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319797.229357:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319797.229425:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612608
00000100:00100000:2.0:1767319797.229433:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612608
00000100:00100000:2.0:1767319797.229489:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17355
00000100:00100000:2.0:1767319797.229498:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940612608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319797.229521:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319797.229670:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612864
00000100:00100000:1.0:1767319797.229675:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612864
00000100:00100000:1.0:1767319797.229731:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057
00000100:00100000:1.0:1767319797.229739:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940612864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319797.229804:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940612864:12345-0@lo:400:kworker.0 Request processed in 65us (533us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319797.229811:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057
00000100:00080000:3.0:1767319797.231490:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319797.231518:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612736
00000100:00100000:3.0:1767319797.231529:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612736
00000100:00100000:3.0:1767319797.231566:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173
00000100:00100000:3.0:1767319797.231572:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940612736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319797.231593:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319797.231755:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940612864:0@lo:400:kworker.0
00000100:00080000:0.0:1767319797.233031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319797.233031:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767319797.233038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319797.233042:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319797.233049:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5042
00000100:00100000:1.0:1767319797.233049:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940612992:0@lo:400:kworker.0
00000100:00080000:0.0:1767319797.233055:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319797.233062:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319797.233086:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d6d80 x1853163940613248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319797.233105:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319797.233174:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940612992
00000100:00100000:1.0:1767319797.233180:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940612992
00000100:00100000:3.0:1767319797.233216:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940612736:12345-0@lo:38:kworker.0 Request processed in 1639us (3853us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319797.233227:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173
00000100:00100000:1.0:1767319797.233231:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058
00000100:00100000:1.0:1767319797.233242:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940612992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319797.233279:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940613248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319797.233291:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940612992:12345-0@lo:400:kworker.0 Request processed in 51us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319797.233299:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058
00000100:00100000:3.0:1767319797.233316:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319797.233323:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319797.233358:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940612992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319797.233377:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940613120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319797.233395:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319797.233429:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613248
00000100:00100000:1.0:1767319797.233433:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613248
00000100:00100000:1.0:1767319797.233451:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613120
00000100:00100000:1.0:1767319797.233454:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613120
00000100:00100000:1.0:1767319797.233478:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4707
00000100:00100000:1.0:1767319797.233484:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940613120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319797.233510:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940613120:12345-0@lo:400:kworker.0 Request processed in 28us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319797.233515:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4707
00000100:00100000:1.0:1767319797.233523:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17356
00000100:00100000:1.0:1767319797.233526:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940613248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319797.233538:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319797.233552:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940613248:12345-0@lo:38:kworker.0 Request processed in 26us (238us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319797.233556:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17356
00000100:00100000:1.0:1767319797.233571:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940613120:0@lo:400:kworker.0
00000100:00080000:1.0:1767319797.233580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319797.233967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319797.233972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319797.233975:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319797.233980:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5042
00000100:00080000:0.0:1767319797.233984:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319797.233985:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940613376:0@lo:400:kworker.0
00000100:00080000:0.0:1767319797.233990:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319797.234006:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7800 x1853163940613504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319797.234020:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319797.234052:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613376
00000100:00100000:0.0:1767319797.234057:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613376
00000100:00080000:1.0:1767319797.234101:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319797.234103:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4708
00000100:00100000:0.0:1767319797.234111:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940613376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319797.234166:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940613376:12345-0@lo:400:kworker.0 Request processed in 56us (148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319797.234172:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4708
00000100:00100000:1.0:1767319797.234220:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940613376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319797.234220:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940612608:12345-0@lo:38:kworker.0 Request processed in 4720us (4969us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319797.234232:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17355
00000100:00080000:3.0:1767319797.236365:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319797.236377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319797.236382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940612608:0@lo:38:kworker.0
00000100:00080000:3.0:1767319797.236393:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319797.236397:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319797.236399:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940612736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319797.236436:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940613504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319797.237054:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319797.237179:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319797.237184:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319797.237188:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940613248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319797.243731:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613504
00000100:00100000:2.0:1767319797.243749:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613504
00000100:00100000:2.0:1767319797.243820:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17357
00000100:00100000:2.0:1767319797.247642:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940613504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319797.247679:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319797.247909:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940613504:12345-0@lo:38:kworker.0 Request processed in 283us (10855us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319797.247919:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17357
00000100:00080000:3.0:1767319797.251195:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319797.251210:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319797.251215:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940613504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319797.831193:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319797.831239:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319797.834693:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338944
00000100:00100000:1.0:1767319797.834713:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338944
00000100:00080000:3.0:1767319797.834799:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319797.834813:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894338816
00000100:00100000:1.0:1767319797.834816:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894338816
00000100:00100000:1.0:1767319797.834840:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4709
00000100:00100000:1.0:1767319797.834849:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894338944:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319797.834872:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17358
00000100:00100000:3.0:1767319797.834880:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894338816:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319797.834904:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319797.834930:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894338944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (3755us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319797.834937:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4709
00000100:00100000:3.0:1767319797.834943:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894338816:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (3700us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319797.834953:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17358
00000100:00100000:2.0:1767319797.932939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319798.188969:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319798.765045:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940613632:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319798.765117:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319798.765411:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613632
00000100:00100000:2.0:1767319798.765421:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613632
00000100:00100000:2.0:1767319798.765474:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767319798.765485:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940613632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319798.765519:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319798.765573:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940613632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (456us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319798.765579:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608
00000100:00100000:3.0:1767319798.765818:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940613632:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319798.956958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319799.213035:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319799.791440:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940613760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319799.791512:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319799.791658:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613760
00000100:00100000:0.0:1767319799.791666:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613760
00000100:00100000:0.0:1767319799.791747:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609
00000100:00100000:0.0:1767319799.791757:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940613760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319799.791825:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319799.791908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319799.792560:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940613760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 802us (1045us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319799.792570:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767319799.792726:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940613760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319799.981372:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319800.237342:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319801.004906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319801.261042:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319801.928522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319801.928627:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339328
00000100:00100000:0.0:1767319801.928644:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339328
00000100:00100000:0.0:1767319801.928843:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4710
00000100:00100000:0.0:1767319801.928858:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894339328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319801.928957:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894339328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (455us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319801.928966:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4710
00000100:00080000:1.0:1767319801.929744:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767319801.932637:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894339072 offset 0 length 520: 4
00000100:00100000:1.0:1767319801.932687:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319801.933035:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339200
00000100:00100000:2.0:1767319801.933046:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339200
00000100:00100000:2.0:1767319801.933351:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17359
00000100:00100000:2.0:1767319801.933361:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894339200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319801.933387:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319801.933461:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894339200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 100us (773us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319801.933468:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17359
00000100:00100000:2.0:1767319802.030322:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319802.285548:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319802.350475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319802.350488:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319802.350491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319802.350495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319802.350499:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319802.350507:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5047
00000100:00080000:0.0:1767319802.350511:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319802.350518:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319802.350562:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4000 x1853163940613888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319802.350579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319802.350582:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319802.350584:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319802.350588:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5047
00000100:00080000:0.0:1767319802.350590:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319802.350593:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319802.350607:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7800 x1853163940614016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319802.350675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319802.350679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319802.350681:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319802.350684:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5047
00000100:00080000:0.0:1767319802.350687:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319802.350691:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319802.350705:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940614528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319802.350722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319802.350726:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319802.350727:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319802.350731:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5047
00000100:00080000:0.0:1767319802.350733:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319802.350736:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319802.350746:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171500 x1853163940614784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319802.350855:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940613888:0@lo:38:kworker.0
00000100:00100000:3.0:1767319802.350926:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.350992:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940614016:0@lo:38:kworker.0
00000100:00100000:3.0:1767319802.351016:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.351037:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940614528:0@lo:38:kworker.0
00000100:00100000:3.0:1767319802.351057:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.351077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940614784:0@lo:38:kworker.0
00000100:00100000:3.0:1767319802.351116:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.351145:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940614656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319802.351171:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.351200:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319802.351206:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940614400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319802.351225:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319802.351262:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614016
00000100:00100000:3.0:1767319802.351271:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614016
00000100:00100000:3.0:1767319802.351302:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174
00000100:00100000:3.0:1767319802.351309:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940614016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319802.351329:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319802.351372:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940614016:12345-0@lo:38:kworker.0 Request processed in 62us (354us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319802.351380:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174
00000100:00100000:3.0:1767319802.351406:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940613888
00000100:00100000:3.0:1767319802.351411:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940613888
00000100:00100000:3.0:1767319802.351428:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614528
00000100:00100000:3.0:1767319802.351430:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614528
00000100:00100000:3.0:1767319802.351437:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614784
00000100:00100000:3.0:1767319802.351439:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614784
00000100:00100000:3.0:1767319802.351447:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614656
00000100:00100000:3.0:1767319802.351449:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614656
00000100:00100000:3.0:1767319802.351478:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614400
00000100:00100000:3.0:1767319802.351480:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614400
00000100:00100000:3.0:1767319802.351497:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4711
00000100:00100000:3.0:1767319802.351502:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940614656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319802.351545:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940614656:12345-0@lo:400:kworker.0 Request processed in 43us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319802.351551:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4711
00000100:00100000:3.0:1767319802.351564:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4712
00000100:00100000:3.0:1767319802.351570:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940614400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319802.351595:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940614400:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319802.351600:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4712
00000100:00100000:3.0:1767319802.351611:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17360
00000100:00100000:3.0:1767319802.351615:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940613888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319802.351625:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319802.351647:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940613888:12345-0@lo:38:kworker.0 Request processed in 30us (721us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319802.351653:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17360
00000100:00100000:3.0:1767319802.351664:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17361
00000100:00100000:3.0:1767319802.351667:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940614528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319802.351676:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319802.351695:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940614528:12345-0@lo:38:kworker.0 Request processed in 26us (636us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319802.351700:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17361
00000100:00100000:3.0:1767319802.351709:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17362
00000100:00100000:3.0:1767319802.351712:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940614784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319802.351720:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319802.351739:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940614784:12345-0@lo:38:kworker.0 Request processed in 26us (624us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319802.351745:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17362
00000100:00100000:3.0:1767319802.351811:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940614400:0@lo:400:kworker.0
00000100:00100000:3.0:1767319802.351823:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940614656:0@lo:400:kworker.0
00000100:00080000:3.0:1767319802.351852:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319802.351857:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319802.351860:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940613888:0@lo:38:kworker.0
00000100:00080000:3.0:1767319802.351869:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319802.351872:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319802.351875:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940614016:0@lo:38:kworker.0
00000100:00080000:3.0:1767319802.351882:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319802.351885:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319802.351887:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940614528:0@lo:38:kworker.0
00000100:00080000:3.0:1767319802.351894:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319802.351897:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319802.351899:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940614784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319802.352204:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319802.352243:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319802.352290:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319802.352298:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614144:0@lo:400:kworker.0
00000100:00100000:2.0:1767319802.352318:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319802.352885:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614272
00000100:00100000:1.0:1767319802.352891:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614272
00000100:00100000:1.0:1767319802.352943:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614144
00000100:00100000:1.0:1767319802.352946:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614144
00000100:00100000:1.0:1767319802.352971:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059
00000100:00100000:1.0:1767319802.352980:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319802.353033:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614272:12345-0@lo:400:kworker.0 Request processed in 54us (789us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319802.353041:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059
00000100:00100000:1.0:1767319802.353056:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060
00000100:00100000:1.0:1767319802.353062:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319802.353099:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614144:12345-0@lo:400:kworker.0 Request processed in 38us (780us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319802.353112:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060
00000100:00080000:1.0:1767319802.353137:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319802.353141:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319802.353143:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319802.353824:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614144:0@lo:400:kworker.0
00000100:00100000:2.0:1767319802.353836:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319803.052895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319803.311358:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319803.885026:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319803.885050:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614912:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319803.885136:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319803.885161:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940614912
00000100:00100000:0.0:1767319803.885170:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940614912
00000100:00100000:0.0:1767319803.885248:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610
00000100:00100000:0.0:1767319803.885259:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319803.885291:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319803.885338:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940614912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (201us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319803.885345:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610
00000100:00100000:2.0:1767319803.885382:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940614912:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319804.076901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319804.337475:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319804.910216:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940615040:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319804.910289:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319804.910486:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615040
00000100:00100000:3.0:1767319804.910495:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615040
00000100:00100000:3.0:1767319804.910557:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611
00000100:00100000:3.0:1767319804.910568:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940615040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319804.910599:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319804.910650:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940615040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (360us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319804.910658:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611
00000100:00080000:1.0:1767319804.910736:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319804.910903:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940615040:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319805.100933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319805.358056:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319806.125238:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319806.385768:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319807.047406:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319807.047432:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319807.047500:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339584
00000100:00100000:2.0:1767319807.047511:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339584
00000100:00100000:2.0:1767319807.047587:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339456
00000100:00100000:2.0:1767319807.047591:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339456
00000100:00100000:2.0:1767319807.047610:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4713
00000100:00100000:2.0:1767319807.047620:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894339584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319807.047692:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894339584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319807.047701:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4713
00000100:00100000:2.0:1767319807.047721:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17363
00000100:00100000:2.0:1767319807.047725:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894339456:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319807.047746:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319807.047821:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894339456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (339us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319807.047829:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17363
00000100:00080000:1.0:1767319807.047898:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319807.151105:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319807.405844:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319807.469244:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319807.469254:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319807.469257:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319807.469261:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319807.469264:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319807.469272:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5052
00000100:00080000:3.0:1767319807.469277:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319807.469284:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319807.469325:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38700 x1853163940615168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319807.469355:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319807.469359:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319807.469361:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319807.469364:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5052
00000100:00080000:3.0:1767319807.469367:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319807.469370:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319807.469386:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc3a300 x1853163940615296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319807.469457:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940615424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319807.469538:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319807.469631:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615424
00000100:00100000:2.0:1767319807.469639:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615424
00000100:00100000:2.0:1767319807.469708:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061
00000100:00100000:2.0:1767319807.469718:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940615424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319807.469847:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940615168:0@lo:38:kworker.0
00000100:00100000:0.0:1767319807.469884:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319807.469904:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940615296:0@lo:38:kworker.0
00000100:00100000:0.0:1767319807.469925:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319807.469955:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615168
00000100:00100000:0.0:1767319807.469959:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615168
00000100:00100000:0.0:1767319807.469984:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17364
00000100:00100000:0.0:1767319807.469989:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940615168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319807.470007:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319807.470040:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940615168:12345-0@lo:38:kworker.0 Request processed in 49us (155us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319807.470046:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17364
00000100:00080000:0.0:1767319807.470125:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319807.470130:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319807.470133:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940615168:0@lo:38:kworker.0
00000100:00080000:0.0:1767319807.470180:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319807.470200:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615296
00000100:00100000:0.0:1767319807.470204:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615296
00000100:00100000:0.0:1767319807.470222:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175
00000100:00100000:0.0:1767319807.470226:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940615296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319807.470235:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319807.470264:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940615296:12345-0@lo:38:kworker.0 Request processed in 35us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319807.470270:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175
00000100:00080000:0.0:1767319807.470292:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319807.470296:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319807.470298:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940615296:0@lo:38:kworker.0
00000100:00100000:0.0:1767319807.470322:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940615552:0@lo:400:kworker.0
00000100:00100000:0.0:1767319807.470348:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319807.470380:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615552
00000100:00100000:0.0:1767319807.470384:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615552
00000100:00100000:0.0:1767319807.470416:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062
00000100:00100000:0.0:1767319807.470422:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940615552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319807.470455:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940615552:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319807.470460:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062
00000100:00100000:0.0:1767319807.470486:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940615552:0@lo:400:kworker.0
00000100:00080000:0.0:1767319807.470500:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319807.471110:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940615424:12345-0@lo:400:kworker.0 Request processed in 1392us (1570us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319807.471118:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061
00000100:00100000:1.0:1767319807.471240:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940615424:0@lo:400:kworker.0
00000100:00080000:3.0:1767319807.471635:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319807.471639:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319807.471642:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319807.471647:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5052
00000100:00080000:3.0:1767319807.471650:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319807.471655:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319807.471670:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940615808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319807.471752:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319807.471755:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319807.471757:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319807.471760:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5052
00000100:00080000:3.0:1767319807.471763:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319807.471767:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319807.471791:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4e00 x1853163940616064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319807.472093:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940615680:0@lo:400:kworker.0
00000100:00100000:0.0:1767319807.472135:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319807.472244:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940615936:0@lo:400:kworker.0
00000100:00100000:3.0:1767319807.472306:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940615808:0@lo:38:kworker.0
00000100:00100000:1.0:1767319807.472463:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615680
00000100:00100000:1.0:1767319807.472470:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615680
00000100:00080000:0.0:1767319807.473123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319807.473159:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4714
00000100:00100000:0.0:1767319807.473170:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940615680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319807.473234:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940615680:12345-0@lo:400:kworker.0 Request processed in 68us (1098us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319807.473256:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4714
00000100:00100000:0.0:1767319807.473301:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940615680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319807.473509:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319807.473541:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940616064:0@lo:38:kworker.0
00000100:00100000:3.0:1767319807.473568:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319807.473916:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615808
00000100:00100000:1.0:1767319807.473923:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615808
00000100:00100000:1.0:1767319807.473945:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616064
00000100:00100000:1.0:1767319807.473948:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616064
00000100:00100000:3.0:1767319807.473960:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17365
00000100:00100000:1.0:1767319807.473976:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17366
00000100:00100000:3.0:1767319807.473977:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940615808:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319807.473980:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940616064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319807.473996:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767319807.473997:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319807.474030:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940616064:12345-0@lo:38:kworker.0 Request processed in 49us (461us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319807.474030:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940615808:12345-0@lo:38:kworker.0 Request processed in 52us (520us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319807.474037:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17365
00000100:00100000:1.0:1767319807.474039:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17366
00000100:00080000:3.0:1767319807.474084:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319807.474089:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319807.474093:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940615808:0@lo:38:kworker.0
00000100:00080000:3.0:1767319807.474102:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319807.474104:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319807.474106:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940616064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319807.474251:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319807.474295:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940615936
00000100:00100000:2.0:1767319807.474299:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940615936
00000100:00100000:2.0:1767319807.474352:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4715
00000100:00100000:2.0:1767319807.474360:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940615936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319807.474404:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940615936:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319807.474411:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4715
00000100:00100000:1.0:1767319807.474431:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940615936:0@lo:400:kworker.0
00000100:00080000:3.0:1767319807.474639:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319808.172892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319808.430992:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319809.005679:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319809.005714:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940616192:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319809.005818:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319809.006076:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616192
00000100:00100000:1.0:1767319809.006086:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616192
00000100:00100000:1.0:1767319809.006165:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612
00000100:00100000:1.0:1767319809.006175:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940616192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319809.006210:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319809.006263:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940616192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (444us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319809.006270:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612
00000100:00100000:1.0:1767319809.006321:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940616192:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319809.006389:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319809.196996:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319809.454233:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319810.029106:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940616320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319810.029179:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319810.029247:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616320
00000100:00100000:0.0:1767319810.029256:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616320
00000100:00100000:0.0:1767319810.029320:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613
00000100:00100000:0.0:1767319810.029330:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940616320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319810.029374:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319810.029438:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940616320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319810.029445:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613
00000100:00100000:1.0:1767319810.029501:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940616320:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319810.030533:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319810.222144:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319810.477128:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319811.244898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319811.501041:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319811.566596:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319786/real 1767319786]  req@ffff93cf43dc2300 x1853163940609920/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319811 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319811.566629:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf43dc2300 x1853163940609920/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319811 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319811.566650:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319811.566675:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319811.566679:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940609920:0@lo:250:kworker.0
00000100:00080000:3.0:1767319811.566745:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319811.566752:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319811.566755:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319811.566760:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5037
00000100:00080000:3.0:1767319811.566765:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319811.566785:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319811.566821:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4e00 x1853163940616448/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319811.566848:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319811.566851:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319811.566853:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319811.566856:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5057
00000100:00080000:3.0:1767319811.566858:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319811.566862:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319811.566878:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7100 x1853163940616576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319811.566886:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319811.566888:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319811.566890:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319811.566893:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5057
00000100:00080000:3.0:1767319811.566895:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319811.566899:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319811.566909:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d7800 x1853163940616704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319811.566979:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319811.566983:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319811.566984:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319811.566988:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5057
00000100:00080000:3.0:1767319811.566990:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319811.566995:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319811.567009:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978000 x1853163940617216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319811.567034:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319811.567037:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319811.567039:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319811.567042:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5057
00000100:00080000:3.0:1767319811.567044:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319811.567047:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319811.567058:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797b800 x1853163940617472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319811.567084:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940617088:0@lo:400:kworker.0
00000100:00100000:3.0:1767319811.567146:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319811.567204:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319811.567209:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940617344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319811.567232:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319811.567310:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940616960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.567351:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319811.567382:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319811.567388:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940616832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.567410:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319811.567439:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617088
00000100:00100000:2.0:1767319811.567446:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617088
00000100:00100000:2.0:1767319811.567496:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617344
00000100:00100000:2.0:1767319811.567500:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617344
00000100:00100000:2.0:1767319811.567526:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716
00000100:00100000:2.0:1767319811.567534:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940617088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.567585:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940617088:12345-0@lo:400:kworker.0 Request processed in 51us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319811.567593:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716
00000100:00100000:2.0:1767319811.567609:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4717
00000100:00100000:2.0:1767319811.567615:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940617344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.567643:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940617344:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319811.567649:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4717
00000100:00080000:2.0:1767319811.567665:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319811.567695:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940617344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.567706:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940617088:0@lo:400:kworker.0
00000100:00100000:3.0:1767319811.567859:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616960
00000100:00100000:3.0:1767319811.567864:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616960
00000100:00100000:3.0:1767319811.567938:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616832
00000100:00100000:3.0:1767319811.567942:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616832
00000100:00100000:1.0:1767319811.570153:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940616448:0@lo:250:kworker.0
00000400:00000100:1.0:1767319811.570208:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940616448 offset 0 length 520: 4
00000100:00100000:1.0:1767319811.570244:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940616576:0@lo:38:kworker.0
00000100:00100000:1.0:1767319811.570277:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319811.570298:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940616704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319811.570321:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319811.570339:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940617216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319811.570361:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319811.570377:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940617472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319811.570395:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319811.570431:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616576
00000100:00100000:1.0:1767319811.570437:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616576
00000100:00100000:1.0:1767319811.570464:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617216
00000100:00100000:1.0:1767319811.570467:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617216
00000100:00100000:1.0:1767319811.570480:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617472
00000100:00100000:1.0:1767319811.570482:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617472
00000100:00100000:1.0:1767319811.570500:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17367
00000100:00100000:1.0:1767319811.570506:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940616576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319811.570526:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319811.570564:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940616576:12345-0@lo:38:kworker.0 Request processed in 56us (286us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319811.570570:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17367
00000100:00100000:1.0:1767319811.570586:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17368
00000100:00100000:1.0:1767319811.570589:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940617216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319811.570600:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319811.570621:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940617216:12345-0@lo:38:kworker.0 Request processed in 31us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319811.570627:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17368
00000100:00100000:1.0:1767319811.570638:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17369
00000100:00100000:1.0:1767319811.570641:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940617472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319811.570650:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319811.570671:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940617472:12345-0@lo:38:kworker.0 Request processed in 28us (275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319811.570677:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17369
00000100:00080000:1.0:1767319811.570714:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319811.570719:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319811.570722:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940616576:0@lo:38:kworker.0
00000100:00080000:1.0:1767319811.570732:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319811.570735:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319811.570737:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940617216:0@lo:38:kworker.0
00000100:00080000:1.0:1767319811.570743:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319811.570746:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319811.570748:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940617472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319811.570811:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940616704
00000100:00100000:1.0:1767319811.570815:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940616704
00000100:00100000:1.0:1767319811.570834:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176
00000100:00100000:1.0:1767319811.570838:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940616704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319811.570848:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319811.570876:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940616704:12345-0@lo:38:kworker.0 Request processed in 37us (555us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319811.570882:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176
00000100:00080000:1.0:1767319811.570903:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319811.570906:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319811.570909:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940616704:0@lo:38:kworker.0
00000100:00080000:1.0:1767319811.570952:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319811.573283:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063
00000100:00100000:2.0:1767319811.573306:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940616960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.574526:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940616960:12345-0@lo:400:kworker.0 Request processed in 1226us (7169us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319811.574537:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063
00000100:00100000:2.0:1767319811.574565:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064
00000100:00100000:2.0:1767319811.574573:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940616832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319811.574607:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940616832:12345-0@lo:400:kworker.0 Request processed in 36us (7196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319811.574612:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064
00000100:00100000:1.0:1767319811.574865:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940616832:0@lo:400:kworker.0
00000100:00100000:1.0:1767319811.574878:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940616960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319812.171051:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319812.171101:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319812.176928:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339840
00000100:00100000:2.0:1767319812.176945:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339840
00000100:00100000:2.0:1767319812.177046:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339712
00000100:00100000:2.0:1767319812.177051:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339712
00000100:00100000:2.0:1767319812.177085:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4718
00000100:00100000:2.0:1767319812.177096:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894339840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319812.177186:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894339840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (6145us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319812.177194:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4718
00000100:00100000:2.0:1767319812.177214:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17370
00000100:00100000:2.0:1767319812.177219:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894339712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319812.177240:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319812.177266:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894339712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (6164us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319812.177272:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17370
00000100:00080000:0.0:1767319812.177490:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319812.268965:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319812.525058:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319813.292981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319813.549378:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319814.130579:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319814.130606:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940617600:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319814.130680:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319814.131945:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617600
00000100:00100000:0.0:1767319814.131957:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617600
00000100:00100000:0.0:1767319814.132058:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614
00000100:00100000:0.0:1767319814.132068:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940617600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319814.132102:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319814.132170:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940617600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1489us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319814.132178:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614
00000100:00080000:1.0:1767319814.132366:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319814.133261:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940617600:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319814.316935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319814.580136:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319815.149190:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940617728:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319815.149254:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319815.149975:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617728
00000100:00100000:2.0:1767319815.149993:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617728
00000100:00100000:2.0:1767319815.150104:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615
00000100:00100000:2.0:1767319815.150115:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940617728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319815.150161:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319815.150220:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940617728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (965us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319815.150227:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615
00000100:00100000:3.0:1767319815.150525:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940617728:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319815.150745:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319815.340903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319815.602407:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319816.364923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319816.627132:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319816.687066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319816.687077:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319816.687080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319816.687084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319816.687089:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319816.687097:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5061
00000100:00080000:0.0:1767319816.687102:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319816.687108:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319816.687147:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a03800 x1853163940617856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319816.687174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319816.687178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319816.687180:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319816.687183:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5061
00000100:00080000:0.0:1767319816.687186:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319816.687189:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319816.687200:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a01c00 x1853163940617984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319816.687444:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940618112:0@lo:400:kworker.0
00000100:00100000:2.0:1767319816.687507:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319816.687563:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940618240:0@lo:400:kworker.0
00000100:00100000:1.0:1767319816.688053:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940617856:0@lo:38:kworker.0
00000100:00100000:1.0:1767319816.688096:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319816.688154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940617984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319816.688178:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319816.688216:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617984
00000100:00100000:1.0:1767319816.688225:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617984
00000100:00100000:1.0:1767319816.688264:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177
00000100:00100000:1.0:1767319816.688285:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940617984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319816.688319:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319816.688364:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940617984:12345-0@lo:38:kworker.0 Request processed in 91us (183us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319816.688371:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177
00000100:00100000:1.0:1767319816.688398:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940617856
00000100:00100000:1.0:1767319816.688402:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940617856
00000100:00100000:1.0:1767319816.688421:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371
00000100:00100000:1.0:1767319816.688426:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940617856:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319816.688435:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319816.688459:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940617856:12345-0@lo:38:kworker.0 Request processed in 32us (363us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319816.688465:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371
00000100:00080000:1.0:1767319816.688498:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319816.688503:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319816.688506:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940617856:0@lo:38:kworker.0
00000100:00080000:1.0:1767319816.688514:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319816.688517:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319816.688520:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940617984:0@lo:38:kworker.0
00000100:00100000:2.0:1767319816.698187:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940618368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319816.698249:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319816.699260:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618368
00000100:00100000:3.0:1767319816.699285:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618368
00000100:00100000:3.0:1767319816.699376:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719
00000100:00100000:3.0:1767319816.699390:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940618368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319816.699471:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940618368:12345-0@lo:400:kworker.0 Request processed in 86us (1219us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319816.699479:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719
00000100:00080000:3.0:1767319816.699503:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319816.699520:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319816.701592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319816.701601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319816.701605:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319816.701612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5061
00000100:00080000:0.0:1767319816.701617:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319816.701623:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319816.701645:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618112
00000100:00100000:0.0:1767319816.701654:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618112
00000100:00100000:0.0:1767319816.701705:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618240
00000100:00100000:0.0:1767319816.701708:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618240
00000100:00100000:0.0:1767319816.701726:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065
00000100:00100000:0.0:1767319816.701733:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940618112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319816.702102:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940618112:12345-0@lo:400:kworker.0 Request processed in 365us (14591us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319816.702110:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065
00000100:00100000:0.0:1767319816.702127:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066
00000100:00100000:0.0:1767319816.702135:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940618240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319816.702178:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940618240:12345-0@lo:400:kworker.0 Request processed in 44us (2657us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319816.702184:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066
00000100:00100000:0.0:1767319816.702245:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940618240:0@lo:400:kworker.0
00000100:00100000:2.0:1767319816.702572:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940618112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319816.702853:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940618496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319816.702995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319816.702999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319816.703004:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319816.703009:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5061
00000100:00080000:0.0:1767319816.703012:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319816.703016:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319816.703029:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc3a300 x1853163940618752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319816.704461:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940618624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319816.704532:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319816.704640:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319816.704674:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940618368:0@lo:400:kworker.0
00000100:00100000:1.0:1767319816.704996:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618624
00000100:00100000:1.0:1767319816.705004:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618624
00000100:00100000:1.0:1767319816.705066:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4720
00000100:00100000:1.0:1767319816.705075:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940618624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319816.705131:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940618624:12345-0@lo:400:kworker.0 Request processed in 57us (599us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319816.705137:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4720
00000100:00100000:1.0:1767319816.705171:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940618624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319816.705192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940618496:0@lo:38:kworker.0
00000100:00100000:1.0:1767319816.705219:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319816.705237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940618752:0@lo:38:kworker.0
00000100:00100000:1.0:1767319816.705258:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319816.705286:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618496
00000100:00100000:1.0:1767319816.705290:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618496
00000100:00100000:1.0:1767319816.705306:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618752
00000100:00100000:1.0:1767319816.705491:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618752
00000100:00100000:1.0:1767319816.705517:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17372
00000100:00100000:1.0:1767319816.705522:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940618496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319816.705541:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319816.705578:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940618496:12345-0@lo:38:kworker.0 Request processed in 54us (358us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319816.705583:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17372
00000100:00100000:1.0:1767319816.705594:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373
00000100:00100000:1.0:1767319816.705598:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940618752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319816.705606:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319816.705629:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940618752:12345-0@lo:38:kworker.0 Request processed in 29us (369us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319816.705634:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373
00000100:00080000:1.0:1767319816.705674:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319816.705679:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319816.705682:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940618496:0@lo:38:kworker.0
00000100:00080000:1.0:1767319816.705689:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319816.705692:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319816.705695:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940618752:0@lo:38:kworker.0
00000100:00080000:3.0:1767319816.708585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319817.289748:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319817.289863:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319817.291238:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340096
00000100:00100000:3.0:1767319817.291260:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340096
00000100:00100000:3.0:1767319817.291331:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894339968
00000100:00100000:3.0:1767319817.291335:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894339968
00000100:00080000:0.0:1767319817.291349:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319817.291366:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4721
00000100:00100000:3.0:1767319817.291377:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894340096:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319817.291458:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894340096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (1720us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319817.291465:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4721
00000100:00100000:3.0:1767319817.291486:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17374
00000100:00100000:3.0:1767319817.291491:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894339968:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319817.291511:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319817.291535:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894339968:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (1671us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319817.291541:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17374
00000100:00100000:2.0:1767319817.395059:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319817.645016:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319818.413195:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319818.669008:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319819.246577:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319819.249378:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940618880:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319819.249466:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319819.249664:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940618880
00000100:00100000:3.0:1767319819.249674:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940618880
00000100:00100000:3.0:1767319819.249739:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616
00000100:00100000:3.0:1767319819.249749:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940618880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319819.249797:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319819.249845:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940618880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (379us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319819.249852:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616
00000100:00080000:0.0:1767319819.249939:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319819.250281:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940618880:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319819.437001:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319819.693007:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319820.270207:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940619008:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319820.270277:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319820.270385:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619008
00000100:00100000:2.0:1767319820.270393:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619008
00000100:00100000:2.0:1767319820.270445:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617
00000100:00100000:2.0:1767319820.270454:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940619008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319820.270487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319820.270529:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940619008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (251us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319820.270538:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617
00000100:00100000:0.0:1767319820.271045:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940619008:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319820.271082:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319820.461760:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319820.717107:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319821.486658:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319821.741273:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319821.805251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319821.805263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319821.805268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319821.805272:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319821.805277:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319821.805286:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767319821.805291:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319821.805298:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319821.805367:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978000 x1853163940619136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319821.805395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319821.805399:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319821.805401:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319821.805405:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767319821.805408:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319821.805411:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319821.805422:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47978e00 x1853163940619264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319821.805480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319821.805483:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319821.805485:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319821.805488:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767319821.805491:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319821.805495:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319821.805508:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940619648:0@lo:400:kworker.0
00000100:00100000:3.0:1767319821.805565:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319821.805613:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940619392:0@lo:400:kworker.0
00000100:00100000:1.0:1767319821.805785:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940619520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319821.805855:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940619136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319821.808668:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319821.808807:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ea00 x1853163940619776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319821.808831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319821.808833:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319821.808836:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319821.808840:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5066
00000100:00080000:0.0:1767319821.808843:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319821.808847:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319821.808855:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940619904:0@lo:400:kworker.0
00000100:00100000:0.0:1767319821.808885:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319821.808921:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7e680 x1853163940620032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319821.808969:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619648
00000100:00100000:0.0:1767319821.808977:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619648
00000100:00100000:0.0:1767319821.809018:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619904
00000100:00100000:0.0:1767319821.809020:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619904
00000100:00100000:0.0:1767319821.809038:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722
00000100:00100000:0.0:1767319821.809043:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940619648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319821.809634:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940619648:12345-0@lo:400:kworker.0 Request processed in 589us (4068us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319821.809639:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722
00000100:00100000:0.0:1767319821.809653:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723
00000100:00100000:0.0:1767319821.809657:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940619904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319821.809678:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940619904:12345-0@lo:400:kworker.0 Request processed in 21us (793us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319821.809681:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723
00000100:00100000:0.0:1767319821.809707:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940619904:0@lo:400:kworker.0
00000100:00080000:0.0:1767319821.809732:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319821.809751:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619392
00000100:00100000:0.0:1767319821.809754:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619392
00000100:00100000:0.0:1767319821.809789:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067
00000100:00100000:0.0:1767319821.809794:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940619392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319821.809818:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940619392:12345-0@lo:400:kworker.0 Request processed in 25us (1158us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319821.809821:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067
00000100:00080000:0.0:1767319821.809830:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319821.809840:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940619392:0@lo:400:kworker.0
00000100:00100000:3.0:1767319821.811235:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940619648:0@lo:400:kworker.0
00000100:00100000:2.0:1767319821.811491:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319821.811500:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319821.811526:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940619264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319821.811563:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319821.811593:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940619776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319821.811616:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619520
00000100:00100000:2.0:1767319821.811621:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319821.811623:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619520
00000100:00100000:2.0:1767319821.811651:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619136
00000100:00100000:2.0:1767319821.811656:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619136
00000100:00100000:0.0:1767319821.811659:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068
00000100:00100000:0.0:1767319821.811667:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940619520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319821.811685:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619776
00000100:00100000:2.0:1767319821.811689:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619776
00000100:00100000:0.0:1767319821.811704:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940619520:12345-0@lo:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319821.811712:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375
00000100:00100000:0.0:1767319821.811716:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068
00000100:00100000:2.0:1767319821.811722:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940619136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319821.811742:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319821.811747:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17376
00000100:00100000:0.0:1767319821.811751:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940619776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319821.811760:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319821.811795:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940619136:12345-0@lo:38:kworker.0 Request processed in 72us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319821.811802:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940619776:12345-0@lo:38:kworker.0 Request processed in 48us (181us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319821.811805:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375
00000100:00100000:0.0:1767319821.811812:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17376
00000100:00080000:3.0:1767319821.811827:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319821.811834:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319821.811840:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940619776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319821.811848:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940620032:0@lo:38:kworker.0
00000100:00100000:3.0:1767319821.811872:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319821.811900:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319821.811904:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319821.811908:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940619136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319821.812644:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620032
00000100:00100000:0.0:1767319821.812649:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620032
00000100:00100000:0.0:1767319821.812680:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17377
00000100:00100000:0.0:1767319821.812684:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940620032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319821.812696:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319821.812799:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940620032:12345-0@lo:38:kworker.0 Request processed in 114us (926us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319821.812804:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17377
00000100:00080000:3.0:1767319821.815065:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319821.815075:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319821.815080:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940620032:0@lo:38:kworker.0
00000100:00100000:1.0:1767319821.816295:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940619264
00000100:00100000:1.0:1767319821.816318:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940619264
00000100:00100000:1.0:1767319821.816384:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178
00000100:00100000:1.0:1767319821.816393:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940619264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319821.816416:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319821.816494:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940619264:12345-0@lo:38:kworker.0 Request processed in 100us (4930us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319821.816500:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178
00000100:00100000:1.0:1767319821.816542:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940619520:0@lo:400:kworker.0
00000100:00080000:3.0:1767319821.816629:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319821.816633:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319821.816636:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940619264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319822.407046:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319822.407119:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319822.407581:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340352
00000100:00100000:0.0:1767319822.407591:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340352
00000100:00100000:0.0:1767319822.407713:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340224
00000100:00100000:0.0:1767319822.407718:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340224
00000100:00100000:0.0:1767319822.407743:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4724
00000100:00100000:0.0:1767319822.407753:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340352:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319822.407757:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17378
00000100:00100000:2.0:1767319822.407767:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894340224:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319822.407826:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319822.407872:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894340224:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 100us (747us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319822.407880:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17378
00000100:00100000:0.0:1767319822.407883:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 117us (832us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319822.407894:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4724
00000100:00080000:1.0:1767319822.408414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319822.509448:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319822.765086:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319823.533014:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319823.789010:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319824.364996:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940620160:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319824.365059:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319824.365220:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620160
00000100:00100000:2.0:1767319824.365228:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620160
00000100:00100000:2.0:1767319824.365290:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618
00000100:00100000:2.0:1767319824.365296:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940620160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319824.365319:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319824.365424:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319824.366173:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940620160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 875us (1110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319824.366182:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618
00000100:00100000:0.0:1767319824.366343:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940620160:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319824.556988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319824.815123:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319825.396261:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940620288:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319825.396333:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319825.396554:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620288
00000100:00100000:3.0:1767319825.396563:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620288
00000100:00100000:3.0:1767319825.396635:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619
00000100:00100000:3.0:1767319825.396646:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940620288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319825.396674:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319825.396743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319825.398037:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940620288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1388us (1698us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319825.398048:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619
00000100:00100000:1.0:1767319825.398214:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940620288:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319825.580904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319825.837264:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319826.605861:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319826.863230:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319826.930201:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319826.930214:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319826.930217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319826.930221:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319826.930226:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319826.930233:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5071
00000100:00080000:2.0:1767319826.930239:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319826.930246:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319826.930290:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5c00 x1853163940620416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319826.930324:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319826.930327:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319826.930329:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319826.930333:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5071
00000100:00080000:2.0:1767319826.930348:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319826.930352:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319826.930370:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cc380 x1853163940620544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319826.930402:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940620416:0@lo:38:kworker.0
00000100:00080000:2.0:1767319826.930455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319826.930459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319826.930461:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319826.930465:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5071
00000100:00080000:2.0:1767319826.930468:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319826.930473:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319826.930480:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319826.930487:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f480 x1853163940621056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319826.930509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319826.930512:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319826.930514:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319826.930518:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5071
00000100:00080000:2.0:1767319826.930520:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319826.930524:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319826.930540:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d070a09180 x1853163940621312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319826.930550:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940620544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319826.930577:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319826.930604:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940621056:0@lo:38:kworker.0
00000100:00100000:3.0:1767319826.930620:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319826.930640:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940621312:0@lo:38:kworker.0
00000100:00100000:3.0:1767319826.930656:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319826.930824:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620416
00000100:00100000:2.0:1767319826.930832:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620416
00000100:00100000:2.0:1767319826.930864:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621056
00000100:00100000:2.0:1767319826.930868:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621056
00000100:00100000:2.0:1767319826.930910:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621312
00000100:00100000:2.0:1767319826.930913:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621312
00000100:00100000:2.0:1767319826.930932:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17379
00000100:00100000:2.0:1767319826.930939:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940620416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319826.930964:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319826.931013:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940620416:12345-0@lo:38:kworker.0 Request processed in 73us (533us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319826.931020:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17379
00000100:00100000:2.0:1767319826.931037:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17380
00000100:00100000:2.0:1767319826.931041:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940621056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319826.931050:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319826.931075:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940621056:12345-0@lo:38:kworker.0 Request processed in 33us (454us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319826.931081:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17380
00000100:00100000:2.0:1767319826.931092:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17381
00000100:00100000:2.0:1767319826.931095:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940621312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319826.931103:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319826.931121:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940621312:12345-0@lo:38:kworker.0 Request processed in 24us (465us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319826.931126:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17381
00000100:00080000:2.0:1767319826.931177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319826.931182:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319826.931186:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940621056:0@lo:38:kworker.0
00000100:00080000:2.0:1767319826.931196:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319826.931199:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319826.931201:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940621312:0@lo:38:kworker.0
00000100:00080000:2.0:1767319826.931209:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319826.931212:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319826.931215:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940620416:0@lo:38:kworker.0
00000100:00100000:0.0:1767319826.931356:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940620928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.931389:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319826.931410:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319826.931416:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940621184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.931434:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319826.931457:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620928
00000100:00100000:0.0:1767319826.931461:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620928
00000100:00100000:0.0:1767319826.931499:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621184
00000100:00100000:0.0:1767319826.931502:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621184
00000100:00100000:0.0:1767319826.931522:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725
00000100:00100000:0.0:1767319826.931528:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940620928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.931573:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940620928:12345-0@lo:400:kworker.0 Request processed in 44us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319826.931579:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725
00000100:00100000:0.0:1767319826.931902:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4726
00000100:00100000:0.0:1767319826.931912:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940621184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.931950:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940621184:12345-0@lo:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319826.931957:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4726
00000100:00080000:0.0:1767319826.931978:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319826.932004:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940621184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.932014:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940620928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.932038:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940620672:0@lo:400:kworker.0
00000100:00100000:3.0:1767319826.932066:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620544
00000100:00100000:0.0:1767319826.932070:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319826.932074:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620544
00000100:00100000:3.0:1767319826.932108:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179
00000100:00100000:0.0:1767319826.932115:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319826.932115:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940620544:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319826.932127:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940620800:0@lo:400:kworker.0
00010000:00020000:3.0:1767319826.932134:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319826.932153:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319826.932184:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940620544:12345-0@lo:38:kworker.0 Request processed in 68us (1605us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319826.932193:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179
00000100:00100000:0.0:1767319826.932194:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620672
00000100:00100000:0.0:1767319826.932200:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620672
00000100:00080000:3.0:1767319826.932231:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319826.932237:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319826.932238:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940620800
00000100:00100000:3.0:1767319826.932243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940620544:0@lo:38:kworker.0
00000100:00100000:0.0:1767319826.932245:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940620800
00000100:00100000:0.0:1767319826.932272:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069
00000100:00100000:0.0:1767319826.932279:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940620672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319826.932295:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070
00000100:00100000:3.0:1767319826.932308:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940620800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.932325:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940620672:12345-0@lo:400:kworker.0 Request processed in 44us (255us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319826.932332:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069
00000100:00100000:3.0:1767319826.932348:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940620800:12345-0@lo:400:kworker.0 Request processed in 45us (196us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319826.932356:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070
00000100:00080000:0.0:1767319826.932552:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319826.932572:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940620800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319826.932594:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940620672:0@lo:400:kworker.0
00000400:00000100:0.0:1767319827.529268:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894340480 offset 0 length 520: 4
00000100:00100000:0.0:1767319827.529317:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319827.529355:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319827.529684:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340736
00000100:00100000:1.0:1767319827.529695:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340736
00000100:00100000:1.0:1767319827.529808:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340608
00000100:00100000:1.0:1767319827.529812:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340608
00000100:00100000:1.0:1767319827.529834:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4727
00000100:00100000:1.0:1767319827.529844:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319827.529931:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (613us total) trans 0 rc 0/0
00000100:00080000:0.0:1767319827.530116:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319827.530183:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17382
00000100:00100000:2.0:1767319827.530190:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894340608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319827.530217:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319827.530248:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894340608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (891us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319827.530259:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17382
00000100:00100000:1.0:1767319827.530636:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4727
00000100:00100000:2.0:1767319827.628948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319827.885251:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319828.652931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319828.909049:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319829.487066:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940621440:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319829.487156:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319829.490439:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621440
00000100:00100000:3.0:1767319829.490456:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621440
00000100:00100000:3.0:1767319829.490543:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620
00000100:00100000:3.0:1767319829.490556:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940621440:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319829.490800:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767319829.490893:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319829.500277:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940621440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9714us (13110us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319829.500294:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1767319829.500521:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940621440:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319829.678138:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319829.933738:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319830.520709:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319830.520735:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940621568:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319830.520839:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319830.520995:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621568
00000100:00100000:3.0:1767319830.521004:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621568
00000100:00100000:3.0:1767319830.521074:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621
00000100:00100000:3.0:1767319830.521085:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940621568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319830.521114:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319830.521159:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940621568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319830.521165:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621
00000100:00080000:0.0:1767319830.521795:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319830.521837:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940621568:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319830.701124:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319830.957013:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319831.724942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319831.982673:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319832.045368:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319832.045380:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319832.045383:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319832.045386:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319832.045391:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319832.045397:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5076
00000100:00080000:3.0:1767319832.045401:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319832.045408:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319832.045446:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae680 x1853163940621696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319832.045471:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319832.045474:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319832.045476:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319832.045479:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5076
00000100:00080000:3.0:1767319832.045481:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319832.045484:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319832.045496:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaed80 x1853163940621824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319832.045569:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319832.045573:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319832.045588:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319832.045593:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5076
00000100:00080000:3.0:1767319832.045595:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319832.045600:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319832.045610:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf100 x1853163940622336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319832.045627:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319832.045630:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319832.045632:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319832.045635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5076
00000100:00080000:3.0:1767319832.045637:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319832.045641:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319832.045651:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac000 x1853163940622592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319832.046042:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940622464:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046108:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319832.046188:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319832.046207:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940622208:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046231:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319832.046256:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940622080:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046281:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319832.046309:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622080
00000100:00100000:1.0:1767319832.046315:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622080
00000100:00100000:1.0:1767319832.046367:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071
00000100:00100000:1.0:1767319832.046376:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940622080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046417:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940622080:12345-0@lo:400:kworker.0 Request processed in 42us (134us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319832.046424:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071
00000100:00100000:1.0:1767319832.046470:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940622080:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046485:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319832.046490:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940621952:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046512:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319832.046530:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621952
00000100:00100000:1.0:1767319832.046534:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621952
00000100:00100000:1.0:1767319832.046557:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072
00000100:00100000:1.0:1767319832.046563:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940621952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.046732:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940621952:12345-0@lo:400:kworker.0 Request processed in 168us (217us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319832.046739:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072
00000100:00100000:1.0:1767319832.046765:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940621952:0@lo:400:kworker.0
00000100:00080000:0.0:1767319832.046985:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319832.046991:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319832.047239:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940621696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319832.047275:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319832.047302:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940621824:0@lo:38:kworker.0
00000100:00100000:2.0:1767319832.047325:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319832.047341:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940622336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319832.047361:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319832.047378:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940622592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319832.047398:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319832.047427:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622464
00000100:00100000:2.0:1767319832.047431:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622464
00000100:00100000:2.0:1767319832.047463:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622208
00000100:00100000:2.0:1767319832.047466:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622208
00000100:00100000:2.0:1767319832.047480:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621696
00000100:00100000:2.0:1767319832.047483:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621696
00000100:00100000:2.0:1767319832.047490:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622336
00000100:00100000:2.0:1767319832.047492:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622336
00000100:00100000:2.0:1767319832.047499:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622592
00000100:00100000:2.0:1767319832.047501:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622592
00000100:00100000:2.0:1767319832.047521:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728
00000100:00100000:2.0:1767319832.047528:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940622464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319832.047567:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940622464:12345-0@lo:400:kworker.0 Request processed in 39us (1459us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319832.047573:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728
00000100:00100000:0.0:1767319832.048121:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4729
00000100:00100000:0.0:1767319832.048132:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940622208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319832.048172:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940622208:12345-0@lo:400:kworker.0 Request processed in 43us (1940us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319832.048178:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4729
00000100:00100000:0.0:1767319832.048207:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383
00000100:00100000:0.0:1767319832.048211:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940621696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319832.048230:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319832.048264:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940621696:12345-0@lo:38:kworker.0 Request processed in 51us (988us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319832.048269:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383
00000100:00100000:0.0:1767319832.048281:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384
00000100:00100000:0.0:1767319832.048285:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940622336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319832.048294:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319832.048316:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940622336:12345-0@lo:38:kworker.0 Request processed in 29us (954us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319832.048321:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384
00000100:00100000:0.0:1767319832.048330:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17385
00000100:00100000:0.0:1767319832.048334:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940622592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319832.048343:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319832.048363:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940622592:12345-0@lo:38:kworker.0 Request processed in 28us (965us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319832.048369:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17385
00000100:00080000:0.0:1767319832.048390:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319832.048414:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319832.048418:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319832.048422:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940621696:0@lo:38:kworker.0
00000100:00080000:0.0:1767319832.048432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319832.048435:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319832.048438:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940622336:0@lo:38:kworker.0
00000100:00080000:0.0:1767319832.048445:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319832.048448:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319832.048451:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940622592:0@lo:38:kworker.0
00000100:00100000:1.0:1767319832.048937:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940621824
00000100:00100000:1.0:1767319832.048944:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940621824
00000100:00100000:1.0:1767319832.048977:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180
00000100:00100000:1.0:1767319832.048982:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940621824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319832.048993:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319832.049038:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940621824:12345-0@lo:38:kworker.0 Request processed in 54us (1711us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319832.049044:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180
00000100:00100000:1.0:1767319832.049093:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940622208:0@lo:400:kworker.0
00000100:00100000:1.0:1767319832.049104:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940622464:0@lo:400:kworker.0
00000100:00080000:0.0:1767319832.049396:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319832.049401:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319832.049404:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940621824:0@lo:38:kworker.0
00000100:00100000:2.0:1767319832.646046:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319832.646284:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340992
00000100:00100000:3.0:1767319832.646297:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340992
00000100:00100000:3.0:1767319832.646440:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4730
00000100:00100000:3.0:1767319832.646454:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319832.646542:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894340992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (506us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319832.646550:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4730
00000100:00080000:0.0:1767319832.646621:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319832.659213:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319832.659370:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894340864
00000100:00100000:3.0:1767319832.659381:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894340864
00000100:00100000:3.0:1767319832.659445:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17386
00000100:00100000:3.0:1767319832.659454:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894340864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319832.659482:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319832.659558:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894340864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 103us (354us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319832.659566:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17386
00000100:00100000:2.0:1767319832.749323:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319833.005069:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319833.773189:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319834.029413:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319834.606285:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940622720:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319834.606357:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319834.606524:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622720
00000100:00100000:1.0:1767319834.606533:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622720
00000100:00100000:1.0:1767319834.606599:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622
00000100:00100000:1.0:1767319834.606608:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940622720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319834.606636:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319834.606680:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940622720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (323us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319834.606688:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622
00000100:00100000:1.0:1767319834.606730:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940622720:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319834.607016:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319834.797371:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319835.053293:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319835.629247:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940622848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319835.629323:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319835.631979:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940622848
00000100:00100000:3.0:1767319835.631995:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940622848
00000100:00100000:3.0:1767319835.632414:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623
00000100:00100000:3.0:1767319835.632427:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940622848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319835.632460:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319835.632555:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940622848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (3232us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319835.632563:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623
00000100:00100000:2.0:1767319835.632638:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940622848:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319835.632716:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319835.820921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319836.081575:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319836.141037:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319811/real 1767319811]  req@ffff93cf426d4e00 x1853163940616448/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319836 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319836.141082:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf426d4e00 x1853163940616448/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319836 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319836.141103:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319836.141128:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319836.141132:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940616448:0@lo:250:kworker.0
00000100:00080000:3.0:1767319836.141528:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319836.141534:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319836.141537:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319836.141542:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5061
00000100:00080000:3.0:1767319836.141547:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319836.141553:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319836.141588:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaed80 x1853163940622976/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319836.141615:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319836.141619:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319836.141620:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319836.141624:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5082
00000100:00080000:3.0:1767319836.141627:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319836.141630:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319836.141645:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeace00 x1853163940623104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319836.141654:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319836.141658:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319836.141660:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319836.141663:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5082
00000100:00080000:3.0:1767319836.141665:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319836.141668:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319836.141680:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead500 x1853163940623232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319836.141747:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319836.141750:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319836.141752:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319836.141755:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5082
00000100:00080000:3.0:1767319836.141757:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319836.141760:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319836.141806:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae300 x1853163940623744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319836.141823:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319836.141826:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319836.141828:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319836.141831:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5082
00000100:00080000:3.0:1767319836.141834:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319836.141838:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319836.141849:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45408380 x1853163940624000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319836.141874:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940623616:0@lo:400:kworker.0
00000100:00100000:3.0:1767319836.141939:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319836.142054:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940623360:0@lo:400:kworker.0
00000100:00100000:0.0:1767319836.142088:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319836.142149:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319836.142155:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940623488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319836.142188:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319836.142224:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623360
00000100:00100000:0.0:1767319836.142232:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623360
00000100:00100000:0.0:1767319836.142279:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623488
00000100:00100000:0.0:1767319836.142283:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623488
00000100:00100000:0.0:1767319836.142307:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073
00000100:00100000:0.0:1767319836.142315:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940623360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319836.142375:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940623360:12345-0@lo:400:kworker.0 Request processed in 59us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319836.142382:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073
00000100:00100000:0.0:1767319836.142398:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074
00000100:00100000:0.0:1767319836.142404:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940623488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319836.142433:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940623488:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319836.142438:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074
00000100:00080000:0.0:1767319836.142453:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319836.142479:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940623488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319836.142487:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940623360:0@lo:400:kworker.0
00000100:00100000:3.0:1767319836.142882:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319836.142889:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940623872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319836.142915:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319836.143030:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623616
00000100:00100000:1.0:1767319836.143034:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623616
00000100:00100000:1.0:1767319836.143062:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623872
00000100:00100000:1.0:1767319836.143064:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623872
00000100:00100000:1.0:1767319836.143077:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4731
00000100:00100000:1.0:1767319836.143081:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940623616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319836.143108:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940623616:12345-0@lo:400:kworker.0 Request processed in 27us (1169us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319836.143112:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4731
00000100:00100000:1.0:1767319836.143120:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4732
00000100:00100000:1.0:1767319836.143123:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940623872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319836.143138:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940623872:12345-0@lo:400:kworker.0 Request processed in 14us (223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319836.143143:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4732
00000100:00080000:1.0:1767319836.143173:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319836.143264:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940623872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319836.143271:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940623616:0@lo:400:kworker.0
00000100:00100000:2.0:1767319836.145696:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940622976:0@lo:250:kworker.0
00000400:00000100:2.0:1767319836.145765:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940622976 offset 0 length 520: 4
00000100:00100000:2.0:1767319836.145856:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940623104:0@lo:38:kworker.0
00000100:00100000:2.0:1767319836.145891:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319836.145925:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940623232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319836.145951:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319836.145976:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940623744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319836.145996:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319836.146012:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623232
00000100:00100000:3.0:1767319836.146020:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623232
00000100:00100000:2.0:1767319836.146027:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940624000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319836.146055:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181
00000100:00100000:2.0:1767319836.146056:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319836.146062:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940623232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319836.146081:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319836.146112:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623744
00000100:00100000:2.0:1767319836.146117:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623744
00000100:00100000:3.0:1767319836.146121:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940623232:12345-0@lo:38:kworker.0 Request processed in 57us (168us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319836.146126:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181
00000100:00100000:2.0:1767319836.146146:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624000
00000100:00100000:2.0:1767319836.146151:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624000
00000100:00100000:0.0:1767319836.146239:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940623104
00000100:00100000:0.0:1767319836.146242:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940623104
00000100:00100000:0.0:1767319836.146263:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17387
00000100:00100000:0.0:1767319836.146267:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940623744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319836.146274:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319836.146297:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940623744:12345-0@lo:38:kworker.0 Request processed in 30us (301us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319836.146301:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17387
00000100:00100000:0.0:1767319836.146309:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17388
00000100:00100000:0.0:1767319836.146311:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940624000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319836.146316:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319836.146328:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940624000:12345-0@lo:38:kworker.0 Request processed in 15us (276us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319836.146331:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17388
00000100:00100000:0.0:1767319836.146336:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17389
00000100:00100000:0.0:1767319836.146338:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940623104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319836.146343:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319836.146368:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940623104:12345-0@lo:38:kworker.0 Request processed in 28us (478us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319836.146372:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17389
00000100:00080000:3.0:1767319836.148938:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319836.148952:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319836.148958:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940623104:0@lo:38:kworker.0
00000100:00080000:3.0:1767319836.148972:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319836.148975:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319836.148978:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940623232:0@lo:38:kworker.0
00000100:00080000:3.0:1767319836.148989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319836.148992:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319836.148995:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940623744:0@lo:38:kworker.0
00000100:00080000:3.0:1767319836.149005:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319836.149008:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319836.149011:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940624000:0@lo:38:kworker.0
00000100:00100000:2.0:1767319836.844960:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319837.101669:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319837.773340:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319837.773402:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319837.773504:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341120
00000100:00100000:2.0:1767319837.773514:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341120
00000100:00100000:2.0:1767319837.773563:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341248
00000100:00100000:2.0:1767319837.773567:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341248
00000100:00100000:2.0:1767319837.773629:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4733
00000100:00100000:2.0:1767319837.773642:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894341248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319837.773722:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894341248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (318us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319837.773730:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4733
00000100:00100000:2.0:1767319837.773749:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17390
00000100:00100000:2.0:1767319837.773754:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894341120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319837.773810:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319837.773837:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894341120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 82us (507us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319837.773844:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17390
00000100:00080000:0.0:1767319837.774177:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319837.873330:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319838.127378:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319838.892936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319839.149470:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319839.726890:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319839.726917:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940624128:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319839.727004:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319839.727511:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624128
00000100:00100000:1.0:1767319839.727520:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624128
00000100:00100000:1.0:1767319839.727595:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624
00000100:00100000:1.0:1767319839.727604:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940624128:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319839.727637:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319839.727693:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940624128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (703us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319839.727700:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624
00000100:00100000:2.0:1767319839.727881:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940624128:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319839.728002:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319839.916921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319840.173272:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319840.749065:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319840.749099:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940624256:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319840.749188:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319840.749563:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624256
00000100:00100000:1.0:1767319840.749575:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624256
00000100:00100000:1.0:1767319840.749674:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625
00000100:00100000:1.0:1767319840.749684:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940624256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319840.749718:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319840.749862:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940624256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (671us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319840.749869:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625
00000100:00080000:2.0:1767319840.750224:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319840.750616:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940624256:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319840.941147:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319841.203016:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319841.262330:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319841.262341:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319841.262344:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319841.262348:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319841.262353:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319841.262360:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5086
00000100:00080000:2.0:1767319841.262365:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319841.262372:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319841.262413:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879f480 x1853163940624384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319841.262487:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940624384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.262555:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319841.262681:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624384
00000100:00100000:0.0:1767319841.262691:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624384
00000100:00100000:0.0:1767319841.262737:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17391
00000100:00100000:0.0:1767319841.262744:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940624384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319841.262801:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319841.263141:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319841.263145:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319841.263147:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319841.263152:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5086
00000100:00080000:2.0:1767319841.263164:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319841.263168:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319841.263188:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adf800 x1853163940624512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319841.271104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940624512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.271209:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319841.271470:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940624384:12345-0@lo:38:kworker.0 Request processed in 8723us (8912us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319841.271482:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17391
00000100:00100000:1.0:1767319841.271607:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624512
00000100:00100000:1.0:1767319841.271616:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624512
00000100:00100000:1.0:1767319841.274841:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182
00000100:00100000:1.0:1767319841.274857:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940624512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319841.274883:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319841.274976:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940624512:12345-0@lo:38:kworker.0 Request processed in 120us (3768us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319841.274984:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182
00000100:00080000:2.0:1767319841.275490:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319841.275495:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319841.275499:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319841.275504:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5086
00000100:00080000:2.0:1767319841.275508:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319841.275514:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319841.275534:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc380 x1853163940625024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319841.275551:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319841.275555:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319841.275556:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319841.275559:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5086
00000100:00080000:2.0:1767319841.275561:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319841.275565:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319841.275575:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940625280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319841.275610:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940624768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319841.275654:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319841.275694:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319841.275700:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940624640:0@lo:400:kworker.0
00000100:00100000:2.0:1767319841.275723:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319841.275763:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624768
00000100:00100000:2.0:1767319841.275770:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624768
00000100:00080000:3.0:1767319841.276567:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319841.276575:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319841.276579:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940624384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.276634:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940625024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.276675:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319841.276700:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940625280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.276720:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319841.276756:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319841.276761:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319841.276764:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940624512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.276833:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940625152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.276861:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319841.276881:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319841.276886:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940624896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.276905:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319841.276937:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624640
00000100:00100000:3.0:1767319841.276942:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624640
00000100:00100000:2.0:1767319841.277367:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075
00000100:00100000:2.0:1767319841.277378:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940624768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319841.277431:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940624768:12345-0@lo:400:kworker.0 Request processed in 55us (1776us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319841.277441:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075
00000100:00100000:3.0:1767319841.277486:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076
00000100:00100000:3.0:1767319841.277495:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940624640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.277526:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940624640:12345-0@lo:400:kworker.0 Request processed in 34us (1802us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319841.277532:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076
00000100:00080000:3.0:1767319841.277563:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319841.277575:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625024
00000100:00100000:3.0:1767319841.277579:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625024
00000100:00100000:3.0:1767319841.277611:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625280
00000100:00100000:3.0:1767319841.277614:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625280
00000100:00100000:3.0:1767319841.277626:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625152
00000100:00100000:3.0:1767319841.277628:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625152
00000100:00100000:3.0:1767319841.277647:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940624896
00000100:00100000:3.0:1767319841.277650:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940624896
00000100:00100000:3.0:1767319841.277664:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734
00000100:00100000:3.0:1767319841.277670:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940625152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.277704:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940625152:12345-0@lo:400:kworker.0 Request processed in 34us (841us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319841.277710:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734
00000100:00100000:3.0:1767319841.277721:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4735
00000100:00100000:3.0:1767319841.277728:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940624896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.277767:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940624896:12345-0@lo:400:kworker.0 Request processed in 40us (860us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319841.277795:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4735
00000100:00100000:3.0:1767319841.277985:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17392
00000100:00100000:3.0:1767319841.277989:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940625024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319841.278009:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319841.278046:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940625024:12345-0@lo:38:kworker.0 Request processed in 54us (1369us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319841.278051:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17392
00000100:00100000:3.0:1767319841.278064:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17393
00000100:00100000:3.0:1767319841.278068:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940625280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319841.278077:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319841.278104:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940625280:12345-0@lo:38:kworker.0 Request processed in 34us (1382us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319841.278110:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17393
00000100:00100000:3.0:1767319841.278147:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940624896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.281339:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940625152:0@lo:400:kworker.0
00000100:00080000:3.0:1767319841.281396:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319841.281432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319841.281437:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319841.281441:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940625024:0@lo:38:kworker.0
00000100:00080000:3.0:1767319841.281451:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319841.281454:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319841.281457:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940625280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319841.281530:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940624640:0@lo:400:kworker.0
00000100:00100000:3.0:1767319841.281543:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940624768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319841.966542:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319842.221362:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319842.887044:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319842.887099:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319842.887196:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341504
00000100:00100000:3.0:1767319842.887209:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341504
00000100:00100000:3.0:1767319842.887282:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341376
00000100:00100000:3.0:1767319842.887286:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341376
00000100:00100000:3.0:1767319842.887315:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4736
00000100:00100000:3.0:1767319842.887328:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894341504:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319842.887399:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894341504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319842.887406:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4736
00000100:00100000:3.0:1767319842.887443:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17394
00000100:00100000:3.0:1767319842.887447:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894341376:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319842.887468:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319842.887492:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894341376:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (392us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319842.887497:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17394
00000100:00080000:0.0:1767319842.887859:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319842.988957:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319843.246677:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319844.013164:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319844.268993:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319844.845046:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319844.845151:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940625408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319844.845217:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319844.845494:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625408
00000100:00100000:3.0:1767319844.845502:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625408
00000100:00100000:3.0:1767319844.845584:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626
00000100:00100000:3.0:1767319844.845594:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940625408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319844.845633:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319844.845692:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940625408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319844.845700:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626
00000100:00100000:2.0:1767319844.845820:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940625408:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319844.846029:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319845.036982:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319845.293357:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319845.869669:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319845.869700:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940625536:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319845.869807:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319845.870007:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625536
00000100:00100000:1.0:1767319845.870015:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625536
00000100:00100000:1.0:1767319845.870090:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627
00000100:00100000:1.0:1767319845.870098:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940625536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319845.870131:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319845.870180:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940625536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (372us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319845.870359:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627
00000100:00080000:0.0:1767319845.871526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319845.871583:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940625536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319846.062303:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319846.317003:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319846.382452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319846.382464:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319846.382466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319846.382470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319846.382474:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319846.382482:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5091
00000100:00080000:3.0:1767319846.382489:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319846.382495:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319846.382535:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add880 x1853163940625664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319846.382565:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319846.382568:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319846.382571:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319846.382574:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5091
00000100:00080000:3.0:1767319846.382577:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319846.382580:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319846.382593:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add180 x1853163940625792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319846.382656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319846.382659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319846.382661:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319846.382664:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5091
00000100:00080000:3.0:1767319846.382667:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319846.382671:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319846.382683:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940626304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319846.382711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319846.382715:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319846.382717:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319846.382720:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5091
00000100:00080000:3.0:1767319846.382723:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319846.382726:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319846.382740:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abe680 x1853163940626560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319846.382798:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626048:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.382867:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319846.382930:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319846.382936:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940625920:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.382959:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319846.382986:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940626432:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383013:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319846.383032:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319846.383037:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940626176:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383057:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319846.383084:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626048
00000100:00100000:3.0:1767319846.383091:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626048
00000100:00100000:3.0:1767319846.383146:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625920
00000100:00100000:3.0:1767319846.383150:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625920
00000100:00100000:3.0:1767319846.383180:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077
00000100:00100000:3.0:1767319846.383189:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383236:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626048:12345-0@lo:400:kworker.0 Request processed in 49us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319846.383244:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077
00000100:00100000:3.0:1767319846.383261:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078
00000100:00100000:3.0:1767319846.383267:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940625920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383294:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940625920:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319846.383300:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078
00000100:00100000:3.0:1767319846.383322:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626432
00000100:00100000:3.0:1767319846.383325:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626432
00000100:00100000:3.0:1767319846.383349:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626176
00000100:00100000:3.0:1767319846.383353:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626176
00000100:00100000:3.0:1767319846.383372:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737
00000100:00100000:3.0:1767319846.383378:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940626432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383409:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940626432:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319846.383414:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737
00000100:00100000:3.0:1767319846.383426:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4738
00000100:00100000:3.0:1767319846.383432:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940626176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383457:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940626176:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319846.383462:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4738
00000100:00100000:3.0:1767319846.383508:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940626176:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383538:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940626432:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383569:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940625920:0@lo:400:kworker.0
00000100:00100000:3.0:1767319846.383577:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319846.384261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940625664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319846.384302:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319846.384337:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940625792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319846.384367:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319846.384392:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940626304:0@lo:38:kworker.0
00000100:00100000:0.0:1767319846.384413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319846.384435:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940626560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319846.384455:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319846.384490:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625664
00000100:00100000:0.0:1767319846.384495:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625664
00000100:00100000:0.0:1767319846.384517:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626304
00000100:00100000:0.0:1767319846.384520:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626304
00000100:00100000:0.0:1767319846.384531:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626560
00000100:00100000:0.0:1767319846.384533:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626560
00000100:00100000:0.0:1767319846.384550:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17395
00000100:00100000:0.0:1767319846.384555:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940625664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319846.384574:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319846.384608:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940625664:12345-0@lo:38:kworker.0 Request processed in 51us (305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319846.384614:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17395
00000100:00100000:0.0:1767319846.384627:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17396
00000100:00100000:0.0:1767319846.384630:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940626304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319846.384639:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319846.384662:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940626304:12345-0@lo:38:kworker.0 Request processed in 30us (249us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319846.384668:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17396
00000100:00100000:0.0:1767319846.384678:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17397
00000100:00100000:0.0:1767319846.384681:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940626560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319846.384689:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319846.384723:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940626560:12345-0@lo:38:kworker.0 Request processed in 40us (267us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319846.384729:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17397
00000100:00080000:0.0:1767319846.384747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319846.384752:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319846.384817:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319846.384823:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319846.384826:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940625664:0@lo:38:kworker.0
00000100:00080000:0.0:1767319846.384834:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319846.384837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319846.384839:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940626304:0@lo:38:kworker.0
00000100:00080000:0.0:1767319846.384846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319846.384849:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319846.384852:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940626560:0@lo:38:kworker.0
00000100:00100000:1.0:1767319846.385057:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940625792
00000100:00100000:1.0:1767319846.385062:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940625792
00000100:00100000:1.0:1767319846.385090:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183
00000100:00100000:1.0:1767319846.385096:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940625792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319846.385115:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319846.385156:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940625792:12345-0@lo:38:kworker.0 Request processed in 60us (788us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319846.385162:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183
00000100:00080000:2.0:1767319846.385376:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319846.385381:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319846.385384:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940625792:0@lo:38:kworker.0
00000100:00100000:2.0:1767319847.084894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319847.341116:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319848.008164:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319848.008257:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341760
00000100:00100000:3.0:1767319848.008267:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341760
00000100:00100000:3.0:1767319848.008347:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4739
00000100:00100000:3.0:1767319848.008356:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894341760:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319848.008440:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894341760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319848.008448:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4739
00000100:00080000:0.0:1767319848.008600:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319848.011007:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319848.011209:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894341632
00000100:00100000:1.0:1767319848.011219:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894341632
00000100:00100000:1.0:1767319848.011267:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17398
00000100:00100000:1.0:1767319848.011276:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894341632:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319848.011301:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319848.011361:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894341632:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 85us (363us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319848.011368:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17398
00000100:00100000:2.0:1767319848.109337:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319848.365222:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319849.134303:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319849.389583:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319849.966631:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319849.973625:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626688:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319849.973757:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319849.978488:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626688
00000100:00100000:1.0:1767319849.978512:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626688
00000100:00100000:1.0:1767319849.978639:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628
00000100:00100000:1.0:1767319849.978652:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319849.978712:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319849.978865:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 215us (5107us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319849.978874:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628
00000100:00080000:0.0:1767319849.978987:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319849.979384:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319850.157018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319850.413064:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319850.989237:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626816:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319850.989336:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319850.989484:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626816
00000100:00100000:0.0:1767319850.989496:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626816
00000100:00100000:0.0:1767319850.989579:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629
00000100:00100000:0.0:1767319850.989590:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319850.989630:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319850.989747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319850.992417:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940626816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2815us (3067us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319850.992437:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629
00000100:00100000:2.0:1767319850.992570:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940626816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319851.182857:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319851.437036:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319851.501263:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319851.501277:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319851.501280:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319851.501285:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319851.501291:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319851.501301:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5096
00000100:00080000:2.0:1767319851.501308:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767319851.501316:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319851.501367:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88a80 x1853163940626944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319851.501397:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319851.501401:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319851.501403:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319851.501407:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5096
00000100:00080000:2.0:1767319851.501410:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767319851.501414:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319851.501431:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a680 x1853163940627072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319851.501486:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319851.501489:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319851.501490:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319851.501494:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5096
00000100:00080000:2.0:1767319851.501497:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767319851.501501:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319851.501511:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d89c00 x1853163940627456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319851.501536:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319851.501539:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319851.501541:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319851.501545:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5096
00000100:00080000:2.0:1767319851.501547:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319851.501551:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319851.501564:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92a00 x1853163940627712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319851.501586:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940627584:0@lo:400:kworker.0
00000100:00100000:1.0:1767319851.501596:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940627200:0@lo:400:kworker.0
00000100:00100000:3.0:1767319851.501670:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940627328:0@lo:400:kworker.0
00000100:00100000:0.0:1767319851.501732:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940626944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319851.508793:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319851.508959:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627200
00000100:00100000:1.0:1767319851.508972:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627200
00000100:00100000:1.0:1767319851.509057:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079
00000100:00100000:1.0:1767319851.509070:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940627200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319851.509827:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940627200:12345-0@lo:400:kworker.0 Request processed in 756us (1293us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319851.509839:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079
00000100:00080000:1.0:1767319851.509878:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319851.509936:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940627200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319851.513622:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319851.514063:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627584
00000100:00100000:1.0:1767319851.514076:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627584
00000100:00100000:1.0:1767319851.514188:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4740
00000100:00100000:1.0:1767319851.514202:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940627584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319851.514295:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940627584:12345-0@lo:400:kworker.0 Request processed in 97us (684us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319851.514304:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4740
00000100:00080000:2.0:1767319851.515833:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319851.515913:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940627584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319851.516169:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319851.516423:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627328
00000100:00100000:2.0:1767319851.516431:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627328
00000100:00080000:1.0:1767319851.516490:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319851.516508:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741
00000100:00100000:2.0:1767319851.516518:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940627328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319851.516594:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940627328:12345-0@lo:400:kworker.0 Request processed in 77us (425us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319851.516603:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741
00000100:00100000:1.0:1767319851.516753:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940627328:0@lo:400:kworker.0
00000100:00100000:0.0:1767319851.518314:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319851.518407:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940627072:0@lo:38:kworker.0
00000100:00100000:0.0:1767319851.518441:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319851.518466:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940627456:0@lo:38:kworker.0
00000100:00100000:0.0:1767319851.518490:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319851.518502:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627072
00000100:00100000:1.0:1767319851.518510:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627072
00000100:00100000:1.0:1767319851.518643:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184
00000100:00100000:1.0:1767319851.518652:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940627072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319851.518691:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319851.518743:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940627072:12345-0@lo:38:kworker.0 Request processed in 90us (299us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319851.518751:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184
00000100:00100000:0.0:1767319851.522746:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940627712:0@lo:38:kworker.0
00000100:00100000:0.0:1767319851.522857:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319851.526262:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940626944
00000100:00100000:3.0:1767319851.526283:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940626944
00000100:00100000:3.0:1767319851.526377:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627456
00000100:00100000:3.0:1767319851.526382:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627456
00000100:00100000:3.0:1767319851.526418:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17399
00000100:00100000:3.0:1767319851.526429:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940626944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319851.526463:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319851.526571:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940626944:12345-0@lo:38:kworker.0 Request processed in 141us (8263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319851.526579:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17399
00000100:00100000:3.0:1767319851.526602:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17400
00000100:00100000:3.0:1767319851.526606:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940627456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319851.526616:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319851.526643:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940627456:12345-0@lo:38:kworker.0 Request processed in 36us (8152us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319851.526650:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17400
00000100:00100000:2.0:1767319851.527339:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627712
00000100:00100000:2.0:1767319851.527346:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627712
00000100:00080000:0.0:1767319851.527426:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319851.527435:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319851.527440:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940626944:0@lo:38:kworker.0
00000100:00080000:0.0:1767319851.527452:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319851.527455:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319851.527458:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940627072:0@lo:38:kworker.0
00000100:00080000:0.0:1767319851.527466:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319851.527469:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319851.527471:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940627456:0@lo:38:kworker.0
00000100:00100000:2.0:1767319851.531315:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17401
00000100:00100000:2.0:1767319851.531335:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940627712:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319851.531370:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319851.531502:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940627712:12345-0@lo:38:kworker.0 Request processed in 168us (8644us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319851.531510:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17401
00000100:00080000:0.0:1767319851.531616:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319851.531624:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319851.531628:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940627712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319852.105930:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767319852.105984:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894341888 offset 0 length 520: 4
00000100:00100000:2.0:1767319852.106014:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319852.106129:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342144
00000100:00100000:3.0:1767319852.106143:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342144
00000100:00100000:3.0:1767319852.106240:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342016
00000100:00100000:3.0:1767319852.106244:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342016
00000100:00100000:3.0:1767319852.106271:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4742
00000100:00100000:3.0:1767319852.106282:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894342144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319852.106381:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894342144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319852.106389:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4742
00000100:00100000:3.0:1767319852.106411:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17402
00000100:00100000:3.0:1767319852.106416:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894342016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319852.106442:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319852.106471:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894342016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319852.106477:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17402
00000100:00080000:2.0:1767319852.106894:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319852.204952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319852.461926:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319853.229261:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319853.491154:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319854.252908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319854.509610:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319855.086071:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940627840:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319855.086336:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319855.087913:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627840
00000100:00100000:0.0:1767319855.087930:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627840
00000100:00100000:0.0:1767319855.088028:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630
00000100:00100000:0.0:1767319855.088041:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940627840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319855.088087:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319855.088209:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940627840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (1873us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319855.088218:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630
00000100:00100000:3.0:1767319855.088382:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940627840:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319855.088747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319855.279257:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319855.537445:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319856.110846:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940627968:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319856.110964:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319856.111917:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940627968
00000100:00100000:2.0:1767319856.111931:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940627968
00000100:00100000:2.0:1767319856.112036:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631
00000100:00100000:2.0:1767319856.112049:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940627968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319856.112094:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319856.112173:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940627968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (1208us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319856.112181:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631
00000100:00100000:2.0:1767319856.112253:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940627968:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319856.112336:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319856.303398:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319856.557082:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319856.621674:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319856.621700:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319856.621704:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319856.621709:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319856.621717:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319856.621727:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5101
00000100:00080000:0.0:1767319856.621736:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319856.621746:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319856.621837:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940628096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319856.621875:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319856.621880:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319856.621882:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319856.621887:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5101
00000100:00080000:0.0:1767319856.621890:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319856.621895:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319856.621912:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940628224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319856.621978:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319856.621982:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319856.621984:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319856.621988:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5101
00000100:00080000:0.0:1767319856.621991:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319856.621995:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319856.622007:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399d880 x1853163940628608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319856.622023:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319856.622027:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319856.622028:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319856.622033:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5101
00000100:00080000:0.0:1767319856.622036:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319856.622039:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319856.622055:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196300 x1853163940628864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319856.622253:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940628096:0@lo:38:kworker.0
00000100:00100000:1.0:1767319856.622357:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319856.622442:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940628224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319856.622471:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319856.622493:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940628608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319856.622514:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319856.622547:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940628864:0@lo:38:kworker.0
00000100:00100000:1.0:1767319856.622567:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319856.622624:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628224
00000100:00100000:1.0:1767319856.622634:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628224
00000100:00100000:1.0:1767319856.622681:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185
00000100:00100000:1.0:1767319856.622700:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940628224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319856.622728:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319856.622826:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940628224:12345-0@lo:38:kworker.0 Request processed in 135us (352us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319856.622837:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185
00000100:00080000:1.0:1767319856.622895:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319856.622901:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319856.622904:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940628224:0@lo:38:kworker.0
00000100:00100000:2.0:1767319856.623287:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319856.623302:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940628352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319856.623358:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319856.623556:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940628480:0@lo:400:kworker.0
00000100:00100000:3.0:1767319856.623594:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319856.623633:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319856.623640:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940628736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319856.623665:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319856.623709:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628096
00000100:00100000:3.0:1767319856.623714:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628096
00000100:00100000:3.0:1767319856.623743:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628608
00000100:00100000:3.0:1767319856.623747:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628608
00000100:00100000:3.0:1767319856.623756:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628864
00000100:00100000:3.0:1767319856.623759:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628864
00000100:00100000:3.0:1767319856.623767:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628480
00000100:00100000:3.0:1767319856.623770:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628480
00000100:00100000:3.0:1767319856.623832:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628736
00000100:00100000:3.0:1767319856.623836:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628736
00000100:00100000:3.0:1767319856.623859:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743
00000100:00100000:3.0:1767319856.623867:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940628480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319856.623920:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940628480:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319856.623927:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743
00000100:00100000:3.0:1767319856.623947:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4744
00000100:00100000:3.0:1767319856.623954:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940628736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319856.623983:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940628736:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319856.623989:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4744
00000100:00100000:3.0:1767319856.624001:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17403
00000100:00100000:3.0:1767319856.624004:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319856.624022:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319856.624053:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628096:12345-0@lo:38:kworker.0 Request processed in 47us (1697us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319856.624062:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17403
00000100:00100000:3.0:1767319856.624074:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17404
00000100:00100000:3.0:1767319856.624077:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319856.624086:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319856.624108:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628608:12345-0@lo:38:kworker.0 Request processed in 29us (1593us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319856.624114:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17404
00000100:00100000:3.0:1767319856.624124:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17405
00000100:00100000:3.0:1767319856.624128:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319856.624136:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319856.624157:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940628864:12345-0@lo:38:kworker.0 Request processed in 28us (1590us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319856.624163:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17405
00000100:00080000:3.0:1767319856.624185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319856.624212:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940628736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319856.624224:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940628480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319856.624736:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628352
00000100:00100000:1.0:1767319856.624744:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628352
00000100:00100000:1.0:1767319856.624820:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080
00000100:00100000:1.0:1767319856.624828:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940628352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319856.624887:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940628352:12345-0@lo:400:kworker.0 Request processed in 60us (1528us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319856.624894:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080
00000100:00080000:1.0:1767319856.624933:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319856.624938:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319856.624943:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940628096:0@lo:38:kworker.0
00000100:00080000:1.0:1767319856.624956:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319856.624959:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319856.624962:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940628608:0@lo:38:kworker.0
00000100:00080000:1.0:1767319856.624971:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319856.624975:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319856.624978:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940628864:0@lo:38:kworker.0
00000100:00100000:2.0:1767319856.625072:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940628352:0@lo:400:kworker.0
00000100:00100000:3.0:1767319857.222200:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319857.222258:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319857.222368:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342400
00000100:00100000:1.0:1767319857.222382:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342400
00000100:00100000:1.0:1767319857.222469:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342272
00000100:00100000:1.0:1767319857.222472:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342272
00000100:00100000:1.0:1767319857.222493:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4745
00000100:00100000:1.0:1767319857.222505:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894342400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319857.222596:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894342400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319857.222617:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4745
00000100:00100000:1.0:1767319857.222642:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17406
00000100:00100000:1.0:1767319857.222646:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894342272:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319857.222673:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319857.222703:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894342272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (445us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319857.222710:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17406
00000100:00080000:3.0:1767319857.223115:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319857.325768:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319857.581079:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319858.350431:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319858.606202:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319859.373262:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319859.631466:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319860.205651:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319860.205694:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940628992:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319860.205820:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319860.207438:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940628992
00000100:00100000:0.0:1767319860.207454:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940628992
00000100:00100000:0.0:1767319860.207573:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632
00000100:00100000:0.0:1767319860.207611:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940628992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319860.207655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319860.207825:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940628992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 216us (2004us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319860.207835:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632
00000100:00100000:1.0:1767319860.208239:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940628992:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319860.208540:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319860.401079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319860.653141:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319861.229908:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940629120:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319861.230020:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319861.230177:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629120
00000100:00100000:3.0:1767319861.230190:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629120
00000100:00100000:3.0:1767319861.230305:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633
00000100:00100000:3.0:1767319861.230321:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940629120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319861.230365:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319861.230628:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319861.231573:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940629120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1243us (1538us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319861.231587:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633
00000100:00100000:1.0:1767319861.231848:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940629120:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319861.420963:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319861.679486:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319861.741046:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319861.741063:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319861.741066:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319861.741071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319861.741076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319861.741086:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5106
00000100:00080000:2.0:1767319861.741092:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319861.741101:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319861.741167:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940629248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319861.741198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319861.741201:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319861.741203:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319861.741207:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5106
00000100:00080000:2.0:1767319861.741210:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319861.741215:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319861.741245:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940629376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319861.741305:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319861.741308:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319861.741310:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319861.741314:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5106
00000100:00080000:2.0:1767319861.741317:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319861.741322:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319861.741334:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012680 x1853163940629760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319861.741361:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319861.741365:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319861.741366:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319861.741371:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5106
00000100:00080000:2.0:1767319861.741373:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319861.741377:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319861.741390:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011c00 x1853163940630016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319861.741553:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940629888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319861.741666:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319861.741751:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629888
00000100:00100000:0.0:1767319861.741759:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629888
00000100:00080000:0.0:1767319861.741801:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319861.741852:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1767319861.741862:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940629888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319861.741913:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940629888:12345-0@lo:400:kworker.0 Request processed in 54us (248us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319861.741920:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1767319861.741971:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940629888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319861.742236:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940629504:0@lo:400:kworker.0
00000100:00100000:2.0:1767319861.742275:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319861.742317:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319861.742325:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940629632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319861.742348:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319861.742651:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319836/real 1767319836]  req@ffff93d07aeaed80 x1853163940622976/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319861 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319861.742669:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d07aeaed80 x1853163940622976/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319861 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319861.742681:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940629248:0@lo:38:kworker.0
00000100:00100000:1.0:1767319861.742707:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319861.742721:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940629376:0@lo:38:kworker.0
00000100:00100000:1.0:1767319861.742739:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319861.742752:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940629760:0@lo:38:kworker.0
00000100:00100000:1.0:1767319861.742767:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319861.742791:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940630016:0@lo:38:kworker.0
00000100:00100000:1.0:1767319861.742807:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319861.742819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319861.742827:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319861.742830:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940622976:0@lo:250:kworker.0
00000100:00100000:1.0:1767319861.742857:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629376
00000100:00100000:1.0:1767319861.742861:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629376
00000100:00100000:1.0:1767319861.742880:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186
00000100:00100000:1.0:1767319861.742884:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940629376:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319861.742904:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319861.742930:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940629376:12345-0@lo:38:kworker.0 Request processed in 45us (190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319861.742934:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186
00000100:00100000:1.0:1767319861.742951:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629632
00000100:00100000:1.0:1767319861.742953:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629632
00000100:00100000:1.0:1767319861.742983:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629248
00000100:00100000:1.0:1767319861.742985:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629248
00000100:00100000:1.0:1767319861.742993:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629760
00000100:00100000:1.0:1767319861.742994:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629760
00000100:00100000:1.0:1767319861.742999:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630016
00000100:00100000:1.0:1767319861.743000:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630016
00000100:00100000:1.0:1767319861.743006:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4747
00000100:00100000:1.0:1767319861.743010:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940629632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319861.743035:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940629632:12345-0@lo:400:kworker.0 Request processed in 25us (687us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319861.743040:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4747
00000100:00100000:1.0:1767319861.743047:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17407
00000100:00100000:1.0:1767319861.743051:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940629248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319861.743063:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319861.743083:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940629248:12345-0@lo:38:kworker.0 Request processed in 30us (374us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319861.743088:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17407
00000100:00100000:1.0:1767319861.743098:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17408
00000100:00100000:1.0:1767319861.743102:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940629760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319861.743111:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319861.743131:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940629760:12345-0@lo:38:kworker.0 Request processed in 27us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319861.743136:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17408
00000100:00100000:1.0:1767319861.743146:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17409
00000100:00100000:1.0:1767319861.743149:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940630016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319861.743158:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319861.743180:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940630016:12345-0@lo:38:kworker.0 Request processed in 29us (371us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319861.743186:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17409
00000100:00080000:1.0:1767319861.743210:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319861.743248:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319861.743251:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319861.743254:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940629248:0@lo:38:kworker.0
00000100:00080000:1.0:1767319861.743260:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319861.743262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319861.743264:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940629376:0@lo:38:kworker.0
00000100:00080000:1.0:1767319861.743271:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319861.743275:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319861.743277:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940629760:0@lo:38:kworker.0
00000100:00080000:1.0:1767319861.743284:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319861.743287:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319861.743289:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940630016:0@lo:38:kworker.0
00000100:00100000:1.0:1767319861.743326:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940629632:0@lo:400:kworker.0
00000100:00080000:3.0:1767319861.743499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319861.743504:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319861.743507:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319861.743511:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5086
00000100:00080000:3.0:1767319861.743514:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319861.743517:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319861.743541:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cca80 x1853163940630144/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319861.743586:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940630144:0@lo:250:kworker.0
00000400:00000100:3.0:1767319861.743615:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940630144 offset 0 length 520: 4
00000100:00100000:0.0:1767319861.743798:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940629504
00000100:00100000:0.0:1767319861.743803:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940629504
00000100:00100000:0.0:1767319861.743839:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081
00000100:00100000:0.0:1767319861.743844:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940629504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319861.743876:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940629504:12345-0@lo:400:kworker.0 Request processed in 33us (1602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319861.743881:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081
00000100:00100000:1.0:1767319861.744045:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940629504:0@lo:400:kworker.0
00000100:00100000:0.0:1767319862.344293:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319862.344512:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319862.345194:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342656
00000100:00100000:2.0:1767319862.345209:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342656
00000100:00100000:2.0:1767319862.345302:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342528
00000100:00100000:2.0:1767319862.345306:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342528
00000100:00100000:2.0:1767319862.345329:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4748
00000100:00100000:2.0:1767319862.345341:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894342656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319862.345481:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894342656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 142us (1205us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319862.345490:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4748
00000100:00100000:2.0:1767319862.345511:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17410
00000100:00100000:2.0:1767319862.345516:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894342528:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319862.345554:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319862.345587:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894342528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (1076us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319862.345594:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17410
00000100:00080000:0.0:1767319862.347911:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319862.444955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319862.701309:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319863.469360:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319863.729724:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319864.495726:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319864.750106:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319865.325302:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319865.325336:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940630272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319865.325429:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319865.325726:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630272
00000100:00100000:3.0:1767319865.325742:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630272
00000100:00100000:3.0:1767319865.326018:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634
00000100:00100000:3.0:1767319865.326032:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940630272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319865.326068:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319865.326169:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940630272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (739us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319865.326178:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634
00000100:00100000:2.0:1767319865.330064:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940630272:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319865.332020:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319865.520842:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319865.774220:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319866.349752:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940630400:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319866.349904:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319866.350538:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630400
00000100:00100000:0.0:1767319866.350550:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630400
00000100:00100000:0.0:1767319866.350652:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635
00000100:00100000:0.0:1767319866.350666:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940630400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319866.350717:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319866.350817:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940630400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (914us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319866.350823:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635
00000100:00080000:1.0:1767319866.350991:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319866.351027:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940630400:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319866.540885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319866.797479:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319866.861074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319866.861088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319866.861092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319866.861097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319866.861103:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319866.861113:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5111
00000100:00080000:0.0:1767319866.861120:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319866.861129:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319866.861185:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940630528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319866.861219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319866.861224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319866.861226:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319866.861229:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5111
00000100:00080000:0.0:1767319866.861233:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319866.861237:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319866.861255:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940630656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319866.861330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319866.861334:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319866.861336:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319866.861341:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5111
00000100:00080000:0.0:1767319866.861344:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319866.861351:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319866.861364:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219d880 x1853163940631040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319866.861373:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767319866.861386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319866.861391:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319866.861393:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319866.861398:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5111
00000100:00080000:0.0:1767319866.861401:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319866.861406:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319866.861419:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964000 x1853163940631296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319866.861453:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940630912:0@lo:400:kworker.0
00000100:00100000:2.0:1767319866.861504:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940630784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319866.861582:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319866.861653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940630528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319866.861996:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319866.862213:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630912
00000100:00100000:1.0:1767319866.862226:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630912
00000100:00080000:1.0:1767319866.862264:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319866.862341:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749
00000100:00100000:1.0:1767319866.862355:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940630912:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319866.862431:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940630912:12345-0@lo:400:kworker.0 Request processed in 81us (852us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319866.862440:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749
00000100:00100000:1.0:1767319866.862493:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940631168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319866.862545:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319866.862583:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631168
00000100:00100000:1.0:1767319866.862587:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631168
00000100:00080000:1.0:1767319866.862604:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319866.862624:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4750
00000100:00100000:1.0:1767319866.862630:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940631168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319866.862665:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940631168:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319866.862671:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4750
00000100:00100000:1.0:1767319866.862725:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940631168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319866.862815:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630784
00000100:00100000:1.0:1767319866.862820:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630784
00000100:00100000:1.0:1767319866.862863:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082
00000100:00100000:1.0:1767319866.862871:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940630784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319866.862914:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940630784:12345-0@lo:400:kworker.0 Request processed in 44us (920us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319866.862921:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082
00000100:00100000:2.0:1767319866.863007:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940630784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319866.863633:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319866.863677:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940630656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319866.863894:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319866.863930:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940631040:0@lo:38:kworker.0
00000100:00100000:3.0:1767319866.863956:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319866.863973:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940631296:0@lo:38:kworker.0
00000100:00100000:3.0:1767319866.863995:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319866.864037:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630528
00000100:00100000:3.0:1767319866.864042:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630528
00000100:00100000:3.0:1767319866.864069:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631040
00000100:00100000:3.0:1767319866.864072:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631040
00000100:00100000:3.0:1767319866.864086:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631296
00000100:00100000:3.0:1767319866.864089:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631296
00000100:00100000:3.0:1767319866.864107:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17411
00000100:00100000:3.0:1767319866.864112:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940630528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319866.864136:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319866.864178:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940630528:12345-0@lo:38:kworker.0 Request processed in 64us (548us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319866.864186:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17411
00000100:00100000:3.0:1767319866.864204:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17412
00000100:00100000:3.0:1767319866.864208:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940631040:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319866.864218:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319866.864240:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940631040:12345-0@lo:38:kworker.0 Request processed in 30us (283us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319866.864245:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17412
00000100:00100000:3.0:1767319866.864256:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17413
00000100:00100000:3.0:1767319866.864259:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940631296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319866.864268:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319866.864288:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940631296:12345-0@lo:38:kworker.0 Request processed in 28us (292us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319866.864295:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17413
00000100:00080000:3.0:1767319866.864337:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319866.864343:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319866.864348:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940630528:0@lo:38:kworker.0
00000100:00080000:3.0:1767319866.864357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319866.864361:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319866.864363:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940631040:0@lo:38:kworker.0
00000100:00080000:3.0:1767319866.864370:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319866.864373:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319866.864376:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940631296:0@lo:38:kworker.0
00000100:00100000:2.0:1767319866.864556:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940630656
00000100:00100000:2.0:1767319866.864562:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940630656
00000100:00100000:2.0:1767319866.864598:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187
00000100:00100000:2.0:1767319866.864604:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940630656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319866.864615:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319866.864658:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940630656:12345-0@lo:38:kworker.0 Request processed in 53us (764us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319866.864665:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187
00000100:00100000:0.0:1767319866.865211:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940630912:0@lo:400:kworker.0
00000100:00080000:3.0:1767319866.865299:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319866.865305:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319866.865308:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940630656:0@lo:38:kworker.0
00000100:00100000:1.0:1767319867.462937:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319867.464094:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319867.466460:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342912
00000100:00100000:1.0:1767319867.466476:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342912
00000100:00100000:1.0:1767319867.466569:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894342784
00000100:00100000:1.0:1767319867.466574:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894342784
00000100:00100000:1.0:1767319867.466615:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4751
00000100:00100000:1.0:1767319867.466625:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894342912:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319867.466715:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894342912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (3790us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319867.466723:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4751
00000100:00100000:1.0:1767319867.466742:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17414
00000100:00100000:1.0:1767319867.466747:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894342784:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319867.466768:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319867.466824:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894342784:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 74us (2735us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319867.466831:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17414
00000100:00080000:0.0:1767319867.467008:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319867.565126:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319867.821382:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319868.593807:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319868.845015:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319869.613052:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319869.871431:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319870.447939:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319870.447969:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940631424:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319870.448462:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319870.448658:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631424
00000100:00100000:0.0:1767319870.448667:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631424
00000100:00100000:0.0:1767319870.448739:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636
00000100:00100000:0.0:1767319870.448748:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940631424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319870.448808:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319870.448869:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940631424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (406us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319870.448876:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636
00000100:00100000:3.0:1767319870.449127:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940631424:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319870.451956:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319870.636873:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319870.892984:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319871.469007:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940631552:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319871.469085:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319871.469216:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631552
00000100:00100000:0.0:1767319871.469225:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631552
00000100:00100000:0.0:1767319871.469294:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637
00000100:00100000:0.0:1767319871.469304:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940631552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319871.469341:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767319871.469444:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319871.469955:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940631552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 651us (868us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319871.469964:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637
00000100:00100000:3.0:1767319871.470033:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940631552:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319871.663202:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319871.917029:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319871.981260:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319871.981273:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319871.981277:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319871.981282:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319871.981287:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319871.981296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767319871.981301:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319871.981309:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319871.981376:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012a00 x1853163940631680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319871.981414:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319871.981418:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319871.981420:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319871.981424:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767319871.981426:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319871.981430:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319871.981445:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940631808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319871.981527:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940631936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319871.981610:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319871.981714:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940631680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319871.981752:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319871.981789:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940631808:0@lo:38:kworker.0
00000100:00100000:3.0:1767319871.981829:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319871.981867:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631808
00000100:00100000:3.0:1767319871.981875:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631808
00000100:00100000:3.0:1767319871.981912:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188
00000100:00100000:3.0:1767319871.981919:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940631808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319871.981941:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319871.981982:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940631808:12345-0@lo:38:kworker.0 Request processed in 62us (151us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319871.981989:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188
00000100:00080000:3.0:1767319871.982035:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319871.982040:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319871.982043:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940631808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319871.982203:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631936
00000100:00100000:0.0:1767319871.982207:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631936
00000100:00100000:0.0:1767319871.982255:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083
00000100:00100000:0.0:1767319871.982263:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940631936:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319871.982442:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319871.982484:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319871.982520:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632064
00000100:00100000:3.0:1767319871.982524:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632064
00000100:00100000:3.0:1767319871.982553:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084
00000100:00100000:3.0:1767319871.982559:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632064:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319871.982593:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632064:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319871.982599:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084
00000100:00100000:3.0:1767319871.982632:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319871.985767:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940631936:12345-0@lo:400:kworker.0 Request processed in 3493us (4145us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319871.985797:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083
00000100:00100000:0.0:1767319871.985882:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940631680
00000100:00100000:0.0:1767319871.985891:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940631680
00000100:00100000:0.0:1767319871.985942:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17415
00000100:00100000:0.0:1767319871.985948:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940631680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319871.985970:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319871.986033:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940631680:12345-0@lo:38:kworker.0 Request processed in 84us (4281us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319871.986040:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17415
00000100:00080000:3.0:1767319871.988403:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319871.988415:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319871.988420:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940631680:0@lo:38:kworker.0
00000100:00100000:1.0:1767319871.990689:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940631936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319871.991744:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940632192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319871.992618:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319871.992711:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319871.992716:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319871.992720:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319871.992726:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767319871.992730:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319871.992737:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319871.992766:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012a00 x1853163940632320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319871.992874:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940632448:0@lo:400:kworker.0
00000100:00100000:0.0:1767319871.992910:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319871.992953:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632192
00000100:00100000:0.0:1767319871.992959:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632192
00000100:00100000:0.0:1767319871.992998:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632448
00000100:00100000:0.0:1767319871.993000:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632448
00000100:00100000:0.0:1767319871.993022:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752
00000100:00100000:0.0:1767319871.993028:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940632192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319871.993102:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753
00000100:00100000:3.0:1767319871.993111:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940632448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319871.993139:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940632448:12345-0@lo:400:kworker.0 Request processed in 32us (229us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319871.993144:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753
00000100:00100000:3.0:1767319871.993163:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940632320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319871.993179:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319871.993196:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632320
00000100:00100000:3.0:1767319871.993198:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632320
00000100:00100000:3.0:1767319871.993211:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17416
00000100:00100000:3.0:1767319871.993214:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940632320:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319871.993230:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319871.993250:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940632320:12345-0@lo:38:kworker.0 Request processed in 34us (69us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319871.993254:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17416
00000100:00080000:3.0:1767319871.993277:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319871.993280:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319871.993282:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940632320:0@lo:38:kworker.0
00000100:00100000:3.0:1767319871.993301:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940632448:0@lo:400:kworker.0
00000100:00080000:3.0:1767319871.993326:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319871.993697:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319871.993701:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319871.993704:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319871.993708:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767319871.993711:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319871.993715:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319871.993733:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013b80 x1853163940632576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319871.994219:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940632576:0@lo:38:kworker.0
00000100:00100000:3.0:1767319871.994258:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319871.994394:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632576
00000100:00100000:2.0:1767319871.994399:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632576
00000100:00100000:2.0:1767319871.994483:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17417
00000100:00100000:2.0:1767319871.994488:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940632576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319871.994504:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319871.994546:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940632576:12345-0@lo:38:kworker.0 Request processed in 56us (286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319871.994553:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17417
00000100:00080000:3.0:1767319871.994702:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319871.994706:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319871.994710:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940632576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319871.995009:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940632192:12345-0@lo:400:kworker.0 Request processed in 1979us (2392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319871.995016:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752
00000100:00100000:1.0:1767319871.995019:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940632192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319872.583891:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319872.583981:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319872.586453:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343168
00000100:00100000:2.0:1767319872.586483:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343168
00000100:00080000:3.0:1767319872.586709:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319872.586839:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343040
00000100:00100000:2.0:1767319872.586845:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343040
00000100:00100000:2.0:1767319872.586872:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4754
00000100:00100000:2.0:1767319872.586885:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894343168:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319872.587021:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894343168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 112us (3115us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319872.587031:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4754
00000100:00100000:2.0:1767319872.587052:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17418
00000100:00100000:2.0:1767319872.587057:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894343040:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319872.587088:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319872.587139:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894343040:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 63us (3140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319872.587147:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17418
00000100:00100000:3.0:1767319872.684947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319872.941131:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319873.709205:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319873.965084:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319874.737757:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319874.989591:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319875.566231:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319875.566270:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632704:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319875.566390:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319875.567584:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632704
00000100:00100000:2.0:1767319875.567611:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632704
00000100:00100000:2.0:1767319875.567727:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638
00000100:00100000:2.0:1767319875.567739:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319875.567849:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319875.568269:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319875.570721:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2967us (4313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319875.570742:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638
00000100:00100000:3.0:1767319875.571448:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632704:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319875.757118:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319876.013962:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319876.591638:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632832:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319876.591740:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319876.592480:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632832
00000100:00100000:2.0:1767319876.592493:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632832
00000100:00100000:2.0:1767319876.592587:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639
00000100:00100000:2.0:1767319876.592599:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319876.592655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319876.592727:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940632832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (987us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319876.592736:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639
00000100:00080000:0.0:1767319876.593123:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319876.593182:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940632832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319876.781927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319877.039003:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319877.101564:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319877.101584:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319877.101588:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319877.101594:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319877.101761:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319877.101790:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5122
00000100:00080000:0.0:1767319877.101797:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319877.101807:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319877.101874:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940632960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319877.101947:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940632960:0@lo:38:kworker.0
00000100:00100000:3.0:1767319877.102045:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319877.102229:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319877.102235:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319877.102237:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319877.102242:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5122
00000100:00080000:0.0:1767319877.102245:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319877.102250:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319877.102269:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964000 x1853163940633088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319877.102333:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940632960
00000100:00100000:1.0:1767319877.102345:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940632960
00000100:00100000:1.0:1767319877.102409:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419
00000100:00100000:1.0:1767319877.102431:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940632960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319877.102459:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319877.102866:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940633088:0@lo:38:kworker.0
00000100:00100000:3.0:1767319877.102907:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319877.102985:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633088
00000100:00100000:2.0:1767319877.102991:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633088
00000100:00100000:2.0:1767319877.103022:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189
00000100:00100000:2.0:1767319877.103028:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940633088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319877.103039:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319877.103077:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940633088:12345-0@lo:38:kworker.0 Request processed in 47us (168us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319877.103099:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189
00000100:00080000:0.0:1767319877.103402:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319877.103407:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319877.103411:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319877.103415:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5122
00000100:00080000:0.0:1767319877.103419:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319877.103434:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319877.103452:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b3480 x1853163940633600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319877.103472:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319877.103475:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319877.103478:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319877.103481:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5122
00000100:00080000:0.0:1767319877.103483:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319877.103487:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319877.103497:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf439b1500 x1853163940633856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319877.103531:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940633728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.103566:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319877.103592:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319877.103598:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940633472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.103634:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319877.103672:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633728
00000100:00100000:0.0:1767319877.103676:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633728
00000100:00100000:0.0:1767319877.103736:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633472
00000100:00100000:0.0:1767319877.103739:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633472
00000100:00100000:0.0:1767319877.103765:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4755
00000100:00100000:0.0:1767319877.103792:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940633728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.103849:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940633728:12345-0@lo:400:kworker.0 Request processed in 78us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319877.103864:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4755
00000100:00100000:0.0:1767319877.103881:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4756
00000100:00100000:0.0:1767319877.103887:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940633472:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.103915:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940633472:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319877.103921:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4756
00000100:00080000:0.0:1767319877.103940:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319877.103979:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940633472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.103989:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940633728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104027:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104057:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319877.104101:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319877.104107:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104131:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319877.104162:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633344
00000100:00100000:0.0:1767319877.104166:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633344
00000100:00100000:0.0:1767319877.104194:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633216
00000100:00100000:0.0:1767319877.104197:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633216
00000100:00100000:0.0:1767319877.104237:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085
00000100:00100000:0.0:1767319877.104245:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633344:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104282:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633344:12345-0@lo:400:kworker.0 Request processed in 38us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319877.104288:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085
00000100:00100000:0.0:1767319877.104300:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086
00000100:00100000:0.0:1767319877.104306:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104336:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633216:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319877.104341:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086
00000100:00080000:0.0:1767319877.104356:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319877.104372:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319877.104380:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633344:0@lo:400:kworker.0
00000100:00100000:1.0:1767319877.105145:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d046b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940632960:12345-0@lo:38:kworker.0 Request processed in 2721us (3095us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319877.105156:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419
00000100:00080000:3.0:1767319877.105951:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319877.105963:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319877.105968:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940632960:0@lo:38:kworker.0
00000100:00100000:3.0:1767319877.106012:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940633600:0@lo:38:kworker.0
00000100:00100000:3.0:1767319877.106168:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319877.106352:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940633856:0@lo:38:kworker.0
00000100:00100000:3.0:1767319877.106392:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319877.106753:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319877.106759:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319877.106763:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940633088:0@lo:38:kworker.0
00000100:00100000:1.0:1767319877.107452:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633600
00000100:00100000:1.0:1767319877.107463:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633600
00000100:00100000:1.0:1767319877.107523:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633856
00000100:00100000:1.0:1767319877.107527:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633856
00000100:00100000:1.0:1767319877.107550:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17420
00000100:00100000:1.0:1767319877.107558:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940633600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319877.107585:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319877.107711:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17421
00000100:00100000:3.0:1767319877.107717:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940633856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319877.107726:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319877.107811:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940633856:12345-0@lo:38:kworker.0 Request processed in 92us (1418us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319877.107819:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17421
00000100:00080000:3.0:1767319877.107954:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319877.107960:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319877.107964:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940633856:0@lo:38:kworker.0
00000100:00100000:1.0:1767319877.108149:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940633600:12345-0@lo:38:kworker.0 Request processed in 590us (1979us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319877.108156:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17420
00000100:00080000:3.0:1767319877.108455:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319877.108461:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319877.108464:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf439b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940633600:0@lo:38:kworker.0
00000100:00100000:1.0:1767319877.702437:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319877.702636:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343552
00000100:00100000:2.0:1767319877.702650:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343552
00000100:00100000:2.0:1767319877.702759:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4757
00000100:00100000:2.0:1767319877.702810:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894343552:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319877.702943:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894343552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 174us (534us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319877.702952:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4757
00000100:00080000:0.0:1767319877.703561:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319877.707209:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894343296 offset 0 length 520: 4
00000100:00100000:2.0:1767319877.707267:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319877.708842:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343424
00000100:00100000:1.0:1767319877.708876:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343424
00000100:00100000:1.0:1767319877.708960:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17422
00000100:00100000:1.0:1767319877.708982:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894343424:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319877.709014:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319877.709127:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894343424:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 146us (1858us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319877.709136:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17422
00000100:00100000:3.0:1767319877.804879:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319878.061234:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319878.829441:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319879.086066:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319879.852951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319880.109577:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319880.685180:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319880.685217:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633984:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319880.685336:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319880.685814:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940633984
00000100:00100000:1.0:1767319880.685839:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940633984
00000100:00100000:1.0:1767319880.685932:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640
00000100:00100000:1.0:1767319880.685942:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633984:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319880.685993:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319880.686058:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940633984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (722us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319880.686066:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640
00000100:00080000:0.0:1767319880.686833:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319880.692122:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940633984:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319880.876929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319881.138060:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319881.709390:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940634112:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319881.709501:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319881.709895:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634112
00000100:00100000:2.0:1767319881.709906:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634112
00000100:00100000:2.0:1767319881.709995:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641
00000100:00100000:2.0:1767319881.710008:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940634112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319881.710051:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319881.710248:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940634112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 242us (746us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319881.710258:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641
00000100:00080000:0.0:1767319881.710955:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319881.721142:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940634112:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319881.901006:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319882.157936:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319882.221075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319882.221084:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319882.221094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319882.221098:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319882.221103:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319882.221110:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5127
00000100:00080000:3.0:1767319882.221115:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319882.221121:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319882.221164:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409500 x1853163940634240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319882.221179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319882.221182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319882.221184:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319882.221187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5127
00000100:00080000:3.0:1767319882.221189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319882.221193:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319882.221204:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073408e00 x1853163940634368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319882.221260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319882.221263:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319882.221265:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319882.221268:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5127
00000100:00080000:3.0:1767319882.221270:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319882.221273:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319882.221282:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95180 x1853163940634880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319882.221296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319882.221299:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319882.221301:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319882.221304:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5127
00000100:00080000:3.0:1767319882.221306:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319882.221309:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319882.221317:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940635136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319882.221683:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940634240:0@lo:38:kworker.0
00000100:00100000:0.0:1767319882.221751:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319882.221831:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940634368:0@lo:38:kworker.0
00000100:00100000:0.0:1767319882.221854:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319882.221871:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940634880:0@lo:38:kworker.0
00000100:00100000:0.0:1767319882.221886:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319882.221902:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940635136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319882.221928:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319882.221959:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634368
00000100:00100000:0.0:1767319882.221965:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634368
00000100:00100000:0.0:1767319882.221994:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190
00000100:00100000:0.0:1767319882.222001:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940634368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319882.222021:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319882.222054:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940634368:12345-0@lo:38:kworker.0 Request processed in 52us (199us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319882.222060:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190
00000100:00100000:0.0:1767319882.222079:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634240
00000100:00100000:0.0:1767319882.222081:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634240
00000100:00100000:0.0:1767319882.222220:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634880
00000100:00100000:0.0:1767319882.222224:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634880
00000100:00100000:0.0:1767319882.222235:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635136
00000100:00100000:0.0:1767319882.222237:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635136
00000100:00100000:0.0:1767319882.222248:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17423
00000100:00100000:0.0:1767319882.222252:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940634240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319882.222262:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319882.222285:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940634240:12345-0@lo:38:kworker.0 Request processed in 32us (535us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319882.222291:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17423
00000100:00100000:0.0:1767319882.222300:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424
00000100:00100000:0.0:1767319882.222303:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940634880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319882.222311:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319882.222331:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940634880:12345-0@lo:38:kworker.0 Request processed in 26us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319882.222336:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424
00000100:00100000:0.0:1767319882.222345:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17425
00000100:00100000:0.0:1767319882.222348:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940635136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319882.222629:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319882.222659:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940635136:12345-0@lo:38:kworker.0 Request processed in 308us (729us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319882.222665:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17425
00000100:00080000:0.0:1767319882.222703:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319882.222708:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319882.222712:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940634240:0@lo:38:kworker.0
00000100:00080000:0.0:1767319882.222720:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319882.222723:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319882.222725:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940634368:0@lo:38:kworker.0
00000100:00080000:0.0:1767319882.222732:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319882.222734:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319882.222737:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940634880:0@lo:38:kworker.0
00000100:00080000:0.0:1767319882.222743:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319882.222746:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319882.222748:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940635136:0@lo:38:kworker.0
00000100:00100000:2.0:1767319882.222958:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940634496:0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.222990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319882.223019:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319882.223024:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940634624:0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223041:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319882.223067:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634496
00000100:00100000:2.0:1767319882.223070:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634496
00000100:00100000:1.0:1767319882.223212:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940634752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223233:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634624
00000100:00100000:2.0:1767319882.223240:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634624
00000100:00100000:2.0:1767319882.223264:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087
00000100:00100000:2.0:1767319882.223272:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940634496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319882.223294:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319882.223389:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940634752
00000100:00100000:3.0:1767319882.223396:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940634752
00000100:00100000:3.0:1767319882.223430:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758
00000100:00100000:3.0:1767319882.223441:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940634752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223760:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940634496:12345-0@lo:400:kworker.0 Request processed in 489us (767us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319882.223767:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087
00000100:00100000:2.0:1767319882.223802:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088
00000100:00100000:2.0:1767319882.223808:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940634624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223834:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940634624:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319882.223839:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088
00000100:00100000:2.0:1767319882.223868:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940634624:0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223876:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940634496:0@lo:400:kworker.0
00000100:00100000:2.0:1767319882.223901:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940635008:0@lo:400:kworker.0
00000100:00080000:0.0:1767319882.224032:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319882.224038:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319882.239503:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940634752:12345-0@lo:400:kworker.0 Request processed in 16053us (16198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319882.239523:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758
00000100:00100000:1.0:1767319882.239714:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940634752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319882.251439:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319882.252217:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635008
00000100:00100000:3.0:1767319882.252228:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635008
00000100:00100000:3.0:1767319882.252313:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4759
00000100:00100000:3.0:1767319882.252325:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940635008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319882.252429:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940635008:12345-0@lo:400:kworker.0 Request processed in 107us (999us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319882.252437:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4759
00000100:00100000:2.0:1767319882.252698:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940635008:0@lo:400:kworker.0
00000100:00080000:0.0:1767319882.252803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319882.822353:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319882.822460:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319882.822496:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343808
00000100:00100000:1.0:1767319882.822517:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343808
00000100:00100000:1.0:1767319882.822675:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343680
00000100:00100000:1.0:1767319882.822680:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343680
00000100:00100000:1.0:1767319882.822709:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4760
00000100:00100000:1.0:1767319882.822721:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894343808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319882.822886:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894343808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 165us (543us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319882.822895:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4760
00000100:00100000:1.0:1767319882.822918:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17426
00000100:00100000:1.0:1767319882.822923:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894343680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319882.822950:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319882.822977:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894343680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (518us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319882.822984:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17426
00000100:00080000:2.0:1767319882.824425:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319882.925115:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319883.181299:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319883.948984:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319884.205416:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319884.975694:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319885.229732:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319885.805110:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319885.805134:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940635264:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319885.805208:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319885.805375:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635264
00000100:00100000:3.0:1767319885.805384:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635264
00000100:00100000:3.0:1767319885.805472:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642
00000100:00100000:3.0:1767319885.805483:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940635264:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319885.805514:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319885.805560:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940635264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (351us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319885.805567:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642
00000100:00080000:0.0:1767319885.805830:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319885.805866:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940635264:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319885.997214:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319886.254275:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319886.318199:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319861/real 1767319861]  req@ffff93d0469cca80 x1853163940630144/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319886.318246:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0469cca80 x1853163940630144/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319886.318272:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319886.318298:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319886.318302:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940630144:0@lo:250:kworker.0
00000100:00080000:0.0:1767319886.320077:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319886.320086:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319886.320090:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319886.320097:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5111
00000100:00080000:0.0:1767319886.320101:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319886.320108:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319886.320141:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073408e00 x1853163940635392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319886.320170:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319886.320174:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319886.320176:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319886.320179:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5132
00000100:00080000:0.0:1767319886.320181:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319886.320184:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319886.320198:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409500 x1853163940635520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319886.320207:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319886.320211:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319886.320212:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319886.320216:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5132
00000100:00080000:0.0:1767319886.320218:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319886.320221:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319886.320253:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2300 x1853163940635648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319886.320306:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319886.320309:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319886.320311:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319886.320314:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5132
00000100:00080000:0.0:1767319886.320316:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319886.320320:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319886.320329:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0380 x1853163940636160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319886.320355:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319886.320358:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319886.320360:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319886.320363:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5132
00000100:00080000:0.0:1767319886.320366:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319886.320369:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319886.320379:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940636416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319886.320498:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940635776:0@lo:400:kworker.0
00000100:00100000:3.0:1767319886.320565:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319886.320636:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319886.320643:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940636288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319886.320667:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319886.320749:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940636032:0@lo:400:kworker.0
00000100:00100000:2.0:1767319886.320799:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319886.320817:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319886.320822:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940635904:0@lo:400:kworker.0
00000100:00100000:2.0:1767319886.320842:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319886.321119:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636288
00000100:00100000:3.0:1767319886.321128:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636288
00000100:00100000:3.0:1767319886.321188:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636032
00000100:00100000:3.0:1767319886.321192:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636032
00000100:00100000:3.0:1767319886.321213:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4761
00000100:00100000:3.0:1767319886.321222:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940636288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319886.321291:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940636288:12345-0@lo:400:kworker.0 Request processed in 70us (622us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319886.321298:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4761
00000100:00100000:3.0:1767319886.321315:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4762
00000100:00100000:3.0:1767319886.321321:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940636032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319886.321361:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940636032:12345-0@lo:400:kworker.0 Request processed in 40us (561us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319886.321368:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4762
00000100:00100000:3.0:1767319886.321412:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940636288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319886.321670:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940636032:0@lo:400:kworker.0
00000100:00080000:2.0:1767319886.321688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319886.321905:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940635392:0@lo:250:kworker.0
00000400:00000100:1.0:1767319886.321950:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940635392 offset 0 length 520: 4
00000100:00100000:1.0:1767319886.321974:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940635520:0@lo:38:kworker.0
00000100:00100000:1.0:1767319886.321996:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319886.322022:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940635648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319886.322046:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319886.322070:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940636160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319886.322091:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319886.322103:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940636416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319886.322122:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319886.322385:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635520
00000100:00100000:2.0:1767319886.322390:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635520
00000100:00100000:2.0:1767319886.322423:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636160
00000100:00100000:2.0:1767319886.322426:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636160
00000100:00100000:2.0:1767319886.322437:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636416
00000100:00100000:2.0:1767319886.322439:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636416
00000100:00100000:2.0:1767319886.322448:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427
00000100:00100000:2.0:1767319886.322453:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940635520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319886.322475:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319886.322515:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940635520:12345-0@lo:38:kworker.0 Request processed in 60us (517us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319886.322521:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427
00000100:00100000:2.0:1767319886.322534:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428
00000100:00100000:2.0:1767319886.322537:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940636160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319886.322546:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319886.322565:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940636160:12345-0@lo:38:kworker.0 Request processed in 26us (473us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319886.322570:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428
00000100:00100000:2.0:1767319886.322579:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17429
00000100:00100000:2.0:1767319886.322582:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940636416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319886.322594:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319886.322616:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940636416:12345-0@lo:38:kworker.0 Request processed in 32us (493us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319886.322621:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17429
00000100:00080000:2.0:1767319886.322646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319886.322651:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319886.322654:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940635520:0@lo:38:kworker.0
00000100:00080000:2.0:1767319886.322661:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319886.322665:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319886.322668:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940636160:0@lo:38:kworker.0
00000100:00080000:2.0:1767319886.322674:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319886.322677:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319886.322680:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940636416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319886.322917:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635648
00000100:00100000:3.0:1767319886.322922:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635648
00000100:00100000:3.0:1767319886.322957:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191
00000100:00100000:3.0:1767319886.322962:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940635648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319886.322980:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319886.323011:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940635648:12345-0@lo:38:kworker.0 Request processed in 48us (964us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319886.323018:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191
00000100:00080000:2.0:1767319886.323170:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319886.323174:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319886.323177:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940635648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319886.324969:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635776
00000100:00100000:0.0:1767319886.324981:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635776
00000100:00100000:0.0:1767319886.325050:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940635904
00000100:00100000:0.0:1767319886.325054:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940635904
00000100:00100000:0.0:1767319886.325097:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089
00000100:00100000:0.0:1767319886.325106:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940635776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319886.325195:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940635776:12345-0@lo:400:kworker.0 Request processed in 89us (4628us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319886.325203:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089
00000100:00100000:0.0:1767319886.325220:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090
00000100:00100000:0.0:1767319886.325225:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940635904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319886.325458:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940635904:12345-0@lo:400:kworker.0 Request processed in 232us (4614us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319886.325465:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090
00000100:00100000:0.0:1767319886.325546:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940635776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319886.325675:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940635904:0@lo:400:kworker.0
00000100:00080000:3.0:1767319886.326400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319886.830470:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940636544:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319886.830550:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319886.830683:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636544
00000100:00100000:1.0:1767319886.830691:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636544
00000100:00100000:1.0:1767319886.830754:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643
00000100:00100000:1.0:1767319886.830764:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940636544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319886.830835:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767319886.830880:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940636544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319886.830887:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643
00000100:00100000:0.0:1767319886.831045:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940636544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319887.020929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319887.287146:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319887.965935:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319887.965991:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319887.970112:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344064
00000100:00100000:0.0:1767319887.970142:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344064
00000100:00100000:0.0:1767319887.970695:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894343936
00000100:00100000:0.0:1767319887.970702:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894343936
00000100:00100000:0.0:1767319887.970728:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4763
00000100:00100000:0.0:1767319887.970740:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894344064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319887.970851:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894344064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 113us (4926us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319887.970859:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4763
00000100:00100000:0.0:1767319887.970879:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17430
00000100:00100000:0.0:1767319887.970883:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894343936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319887.970904:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319887.970931:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894343936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (4941us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319887.970938:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17430
00000100:00080000:3.0:1767319887.971574:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319888.044920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319888.304142:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319889.072804:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319889.328098:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319890.092977:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319890.349481:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319890.927505:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940636672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319890.927582:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319890.928726:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636672
00000100:00100000:0.0:1767319890.928737:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636672
00000100:00100000:0.0:1767319890.928849:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644
00000100:00100000:0.0:1767319890.928859:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940636672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319890.928896:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767319890.928979:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319890.931489:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940636672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2622us (3897us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319890.931503:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644
00000100:00100000:2.0:1767319890.931687:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940636672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319891.116995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319891.373003:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319891.438031:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319891.438043:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319891.438046:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319891.438050:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319891.438055:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319891.438064:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5136
00000100:00080000:2.0:1767319891.438069:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319891.438077:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319891.438183:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940636800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319891.438201:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319891.438204:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319891.438206:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319891.438209:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5136
00000100:00080000:2.0:1767319891.438211:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319891.438215:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319891.438230:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409500 x1853163940636928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319891.438314:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940637056:0@lo:400:kworker.0
00000100:00100000:3.0:1767319891.438385:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319891.438495:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637056
00000100:00100000:1.0:1767319891.438504:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637056
00000100:00100000:1.0:1767319891.438557:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091
00000100:00100000:1.0:1767319891.438567:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940637056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319891.438568:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940636800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319891.438606:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319891.438629:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940636928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319891.438652:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319891.438671:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319891.438675:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319891.438678:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319891.438681:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5136
00000100:00080000:2.0:1767319891.438684:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319891.438687:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636800
00000100:00080000:2.0:1767319891.438687:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319891.438691:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636800
00000100:00100000:2.0:1767319891.438701:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940637440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319891.438713:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431
00000100:00100000:0.0:1767319891.438718:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940636800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319891.438736:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319891.438765:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940636800:12345-0@lo:38:kworker.0 Request processed in 46us (158us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319891.438791:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431
00000100:00100000:0.0:1767319891.438813:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940637312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319891.438842:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319891.438861:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319891.438867:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940637184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319891.438869:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940637056:12345-0@lo:400:kworker.0 Request processed in 304us (484us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319891.438875:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091
00000100:00100000:0.0:1767319891.438887:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319891.438898:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637184
00000100:00100000:1.0:1767319891.438902:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637184
00000100:00100000:0.0:1767319891.438914:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637312
00000100:00100000:0.0:1767319891.438917:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637312
00000100:00100000:1.0:1767319891.438930:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092
00000100:00100000:1.0:1767319891.438936:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940637184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319891.438940:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4764
00000100:00100000:0.0:1767319891.438945:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940637312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319891.438968:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940637184:12345-0@lo:400:kworker.0 Request processed in 32us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319891.438970:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940637312:12345-0@lo:400:kworker.0 Request processed in 25us (129us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319891.438974:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092
00000100:00100000:0.0:1767319891.438976:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4764
00000100:00080000:2.0:1767319891.439025:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319891.439029:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319891.439031:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319891.439035:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5136
00000100:00080000:2.0:1767319891.439037:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319891.439041:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319891.439057:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223100 x1853163940637696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319891.439082:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940636928
00000100:00100000:2.0:1767319891.439086:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940636928
00000100:00100000:2.0:1767319891.439121:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192
00000100:00100000:2.0:1767319891.439126:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940636928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319891.439137:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319891.439164:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940636928:12345-0@lo:38:kworker.0 Request processed in 36us (511us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319891.439169:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192
00000100:00100000:2.0:1767319891.439196:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940637568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319891.439223:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319891.439248:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637568
00000100:00100000:2.0:1767319891.439251:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637568
00000100:00100000:3.0:1767319891.439416:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940637056:0@lo:400:kworker.0
00000100:00080000:3.0:1767319891.439440:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319891.439445:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319891.440771:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4765
00000100:00100000:0.0:1767319891.440784:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940637184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319891.440795:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940637568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319891.440798:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940637312:0@lo:400:kworker.0
00000100:00100000:2.0:1767319891.440857:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940637568:12345-0@lo:400:kworker.0 Request processed in 68us (1632us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319891.440865:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4765
00000100:00100000:3.0:1767319891.441013:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940637440:0@lo:38:kworker.0
00000100:00100000:3.0:1767319891.441050:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319891.442767:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940637696:0@lo:38:kworker.0
00000100:00100000:3.0:1767319891.442833:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319891.442867:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637440
00000100:00100000:1.0:1767319891.442876:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637440
00000100:00100000:1.0:1767319891.442998:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432
00000100:00100000:1.0:1767319891.443005:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940637440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319891.443026:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319891.443065:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940637440:12345-0@lo:38:kworker.0 Request processed in 60us (2015us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319891.443072:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432
00000100:00100000:1.0:1767319891.443325:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940637568:0@lo:400:kworker.0
00000100:00080000:3.0:1767319891.445286:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319891.445308:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319891.445313:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940636800:0@lo:38:kworker.0
00000100:00080000:3.0:1767319891.445326:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319891.445330:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319891.445333:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940636928:0@lo:38:kworker.0
00000100:00080000:3.0:1767319891.445365:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319891.445370:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319891.445372:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940637440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319891.445420:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637696
00000100:00100000:2.0:1767319891.445427:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637696
00000100:00100000:2.0:1767319891.445465:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433
00000100:00100000:2.0:1767319891.445472:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940637696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319891.445494:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319891.445668:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940637696:12345-0@lo:38:kworker.0 Request processed in 194us (2833us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319891.445676:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433
00000100:00080000:3.0:1767319891.445721:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319891.445725:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319891.445729:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940637696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319891.949211:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319891.949236:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940637824:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319891.949320:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319891.949441:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637824
00000100:00100000:0.0:1767319891.949448:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637824
00000100:00100000:0.0:1767319891.949497:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645
00000100:00100000:0.0:1767319891.949505:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940637824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319891.949534:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319891.949580:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940637824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319891.949587:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645
00000100:00100000:2.0:1767319891.949697:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940637824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319892.140892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319892.398729:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319893.070899:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319893.071017:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344192
00000100:00100000:2.0:1767319893.071028:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344192
00000100:00100000:2.0:1767319893.071085:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17434
00000100:00100000:2.0:1767319893.071094:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894344192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319893.071120:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319893.071222:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894344192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 126us (335us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319893.071230:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17434
00000100:00100000:3.0:1767319893.071732:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319893.071945:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344320
00000100:00100000:2.0:1767319893.071950:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344320
00000100:00100000:2.0:1767319893.072010:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4766
00000100:00100000:2.0:1767319893.072020:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894344320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319893.072073:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894344320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 56us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319893.072080:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4766
00000100:00080000:3.0:1767319893.073910:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319893.167591:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319893.442833:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319894.188919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319894.445617:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319895.213430:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319895.469061:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319896.046024:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940637952:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319896.046098:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319896.046234:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940637952
00000100:00100000:3.0:1767319896.046242:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940637952
00000100:00100000:3.0:1767319896.046337:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646
00000100:00100000:3.0:1767319896.046349:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940637952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319896.046379:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767319896.046461:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319896.046986:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940637952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 638us (886us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319896.046996:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646
00000100:00100000:2.0:1767319896.047126:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940637952:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319896.237148:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319896.494292:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319896.561264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319896.561276:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319896.561278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319896.561282:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319896.561286:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319896.561295:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5141
00000100:00080000:3.0:1767319896.561299:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319896.561307:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319896.561371:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409500 x1853163940638080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319896.561455:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940638080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319896.561543:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319896.561665:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638080
00000100:00100000:2.0:1767319896.561673:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638080
00000100:00100000:2.0:1767319896.561730:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435
00000100:00100000:2.0:1767319896.561737:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940638080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319896.561758:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319896.561856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319896.561860:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319896.561862:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319896.561866:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5141
00000100:00080000:3.0:1767319896.561869:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319896.561873:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319896.561891:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011500 x1853163940638208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319896.566199:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940638208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319896.566297:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319896.566464:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638208
00000100:00100000:1.0:1767319896.566474:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638208
00000100:00100000:1.0:1767319896.566521:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193
00000100:00100000:1.0:1767319896.566528:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940638208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319896.566553:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319896.566599:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940638208:12345-0@lo:38:kworker.0 Request processed in 70us (301us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319896.566619:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193
00000100:00100000:2.0:1767319896.573163:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940638080:12345-0@lo:38:kworker.0 Request processed in 11414us (11609us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319896.573178:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435
00000100:00100000:1.0:1767319896.573679:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940638336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319896.573749:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319896.573869:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638336
00000100:00100000:2.0:1767319896.573877:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638336
00000100:00100000:2.0:1767319896.573935:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093
00000100:00100000:2.0:1767319896.573946:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940638336:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319896.574059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319896.574064:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319896.574067:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319896.574072:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5141
00000100:00080000:3.0:1767319896.574076:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319896.574080:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319896.574114:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071213b80 x1853163940638592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319896.574134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319896.574137:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319896.574139:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319896.574142:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5141
00000100:00080000:3.0:1767319896.574144:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319896.574147:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319896.574159:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071212d80 x1853163940638848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319896.574187:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940638464:0@lo:400:kworker.0
00000100:00100000:3.0:1767319896.574216:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319896.574238:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319896.574263:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940638720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319896.574287:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319896.574381:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638464
00000100:00100000:3.0:1767319896.574386:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638464
00000100:00100000:3.0:1767319896.574414:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638720
00000100:00100000:3.0:1767319896.574416:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638720
00000100:00100000:3.0:1767319896.574438:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767
00000100:00100000:3.0:1767319896.574445:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940638464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319896.574493:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940638464:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319896.574500:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767
00000100:00100000:3.0:1767319896.574516:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4768
00000100:00100000:3.0:1767319896.574521:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940638720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319896.574546:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940638720:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319896.574551:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4768
00000100:00100000:3.0:1767319896.574587:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940638720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319896.574598:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940638464:0@lo:400:kworker.0
00000100:00080000:3.0:1767319896.574647:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319896.574653:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319896.575980:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319896.575988:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319896.575992:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940638080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319896.576104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940638592:0@lo:38:kworker.0
00000100:00100000:0.0:1767319896.576157:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319896.576180:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940638848:0@lo:38:kworker.0
00000100:00100000:0.0:1767319896.576202:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319896.576226:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319896.576231:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319896.576234:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940638208:0@lo:38:kworker.0
00000100:00100000:3.0:1767319896.576690:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638592
00000100:00100000:3.0:1767319896.576697:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638592
00000100:00100000:3.0:1767319896.576742:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638848
00000100:00100000:3.0:1767319896.576746:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638848
00000100:00100000:3.0:1767319896.576766:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436
00000100:00100000:3.0:1767319896.579286:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940638592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319896.579336:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319896.579444:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940638592:12345-0@lo:38:kworker.0 Request processed in 2669us (3285us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319896.579454:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436
00000100:00100000:3.0:1767319896.579501:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437
00000100:00100000:3.0:1767319896.579507:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940638848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319896.579518:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319896.579543:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940638848:12345-0@lo:38:kworker.0 Request processed in 35us (3340us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319896.579548:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437
00000100:00080000:0.0:1767319896.586824:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319896.586839:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319896.586844:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940638592:0@lo:38:kworker.0
00000100:00080000:0.0:1767319896.586859:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319896.586862:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319896.586865:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940638848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319896.587185:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940638336:12345-0@lo:400:kworker.0 Request processed in 13239us (13433us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319896.587198:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093
00000100:00100000:1.0:1767319896.591323:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940638336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319897.069612:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319897.069637:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940638976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319897.069707:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319897.070043:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940638976
00000100:00100000:3.0:1767319897.070051:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940638976
00000100:00100000:3.0:1767319897.070103:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647
00000100:00100000:3.0:1767319897.070112:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940638976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319897.070149:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319897.070203:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940638976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (496us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319897.070211:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647
00000100:00100000:1.0:1767319897.071507:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940638976:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319897.260929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319897.517086:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319898.185561:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319898.185614:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319898.186326:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344448
00000100:00100000:1.0:1767319898.186339:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344448
00000100:00100000:1.0:1767319898.188410:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344576
00000100:00100000:1.0:1767319898.188424:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344576
00000100:00080000:2.0:1767319898.188650:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319898.190692:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4769
00000100:00100000:3.0:1767319898.190720:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894344576:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319898.190837:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894344576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 131us (5222us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319898.190847:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4769
00000100:00100000:3.0:1767319898.190879:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17438
00000100:00100000:3.0:1767319898.190885:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894344448:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319898.190909:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319898.190938:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894344448:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 52us (5441us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319898.190945:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17438
00000100:00100000:2.0:1767319898.285033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319898.542241:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319899.308884:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319899.565439:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319900.334821:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319900.589619:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319901.165478:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940639104:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319901.165547:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.166126:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639104
00000100:00100000:2.0:1767319901.166135:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639104
00000100:00080000:0.0:1767319901.166366:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319901.173645:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648
00000100:00100000:2.0:1767319901.173672:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940639104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319901.173709:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319901.173807:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940639104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (8259us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319901.173815:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648
00000100:00100000:0.0:1767319901.174057:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940639104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319901.357313:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319901.615237:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319901.677155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319901.677166:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319901.677169:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319901.677173:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319901.677177:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319901.677185:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767319901.677189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319901.677221:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319901.677268:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940639232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319901.677290:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319901.677293:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319901.677295:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319901.677299:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767319901.677301:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319901.677305:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319901.677315:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d196300 x1853163940639360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319901.677381:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940639488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319901.677455:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319901.677566:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639488
00000100:00100000:1.0:1767319901.677575:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639488
00000100:00100000:1.0:1767319901.677638:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094
00000100:00100000:1.0:1767319901.677648:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940639488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319901.677735:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940639232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.677769:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.677803:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940639360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.677823:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.677865:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639232
00000100:00100000:2.0:1767319901.677869:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639232
00000100:00100000:2.0:1767319901.677892:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439
00000100:00100000:2.0:1767319901.677897:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940639232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319901.677915:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319901.677951:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940639232:12345-0@lo:38:kworker.0 Request processed in 53us (181us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319901.677958:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439
00000100:00080000:2.0:1767319901.677977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319901.678014:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319901.678019:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319901.678023:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940639232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.678071:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639360
00000100:00100000:2.0:1767319901.678075:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639360
00000100:00100000:2.0:1767319901.678096:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194
00000100:00100000:2.0:1767319901.678100:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940639360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319901.678109:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319901.678139:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940639360:12345-0@lo:38:kworker.0 Request processed in 37us (314us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319901.678145:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194
00000100:00080000:2.0:1767319901.678165:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319901.678169:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319901.678172:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940639360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.678534:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940639616:0@lo:400:kworker.0
00000100:00100000:2.0:1767319901.678563:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.678592:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639616
00000100:00100000:2.0:1767319901.678596:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639616
00000100:00100000:2.0:1767319901.678625:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770
00000100:00100000:2.0:1767319901.678631:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940639616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319901.678663:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940639616:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319901.678668:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770
00000100:00080000:2.0:1767319901.678682:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319901.678700:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940639616:0@lo:400:kworker.0
00000100:00100000:1.0:1767319901.683407:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940639488:12345-0@lo:400:kworker.0 Request processed in 5751us (5942us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319901.683422:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094
00000100:00080000:0.0:1767319901.683528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319901.683533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319901.683537:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319901.683542:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767319901.683545:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319901.683551:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319901.683591:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940639744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319901.683787:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940639872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319901.683844:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.683916:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940639744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.683946:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319901.683984:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639872
00000100:00100000:2.0:1767319901.683991:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639872
00000100:00080000:0.0:1767319901.684028:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319901.684032:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319901.684034:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319901.684038:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5146
00000100:00100000:2.0:1767319901.684039:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940639744
00000100:00080000:0.0:1767319901.684041:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767319901.684042:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940639744
00000100:00080000:0.0:1767319901.684044:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319901.684081:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760dc00 x1853163940640000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319901.684081:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4771
00000100:00100000:2.0:1767319901.684097:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940639872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319901.684113:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940640000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319901.684135:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319901.684216:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940639488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319901.684418:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640000
00000100:00100000:3.0:1767319901.684423:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640000
00000100:00100000:3.0:1767319901.684447:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440
00000100:00100000:3.0:1767319901.684452:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940639744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319901.684472:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319901.684579:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940639744:12345-0@lo:38:kworker.0 Request processed in 125us (631us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319901.684586:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440
00000100:00100000:3.0:1767319901.684601:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441
00000100:00100000:3.0:1767319901.684604:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940640000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319901.684614:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319901.684640:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940640000:12345-0@lo:38:kworker.0 Request processed in 34us (503us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319901.684645:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441
00000100:00080000:3.0:1767319901.684670:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319901.685361:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319901.685367:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319901.685371:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940640000:0@lo:38:kworker.0
00000100:00080000:0.0:1767319901.685382:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319901.685385:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319901.685388:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940639744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319901.689791:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940639872:12345-0@lo:400:kworker.0 Request processed in 5682us (5926us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319901.689795:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940639872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319901.689806:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4771
00000100:00100000:3.0:1767319902.198040:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319902.198065:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940640128:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319902.198132:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319902.198413:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640128
00000100:00100000:2.0:1767319902.198421:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640128
00000100:00100000:2.0:1767319902.198480:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649
00000100:00100000:2.0:1767319902.198487:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940640128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319902.198518:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319902.198571:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940640128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (437us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319902.198579:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649
00000100:00100000:1.0:1767319902.198742:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940640128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319902.284844:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767319902.284888:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894344704 offset 0 length 520: 4
00000100:00100000:2.0:1767319902.284910:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319902.286537:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344960
00000100:00100000:1.0:1767319902.286551:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344960
00000100:00100000:1.0:1767319902.286695:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894344832
00000100:00100000:1.0:1767319902.286700:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894344832
00000100:00100000:1.0:1767319902.286727:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4772
00000100:00100000:1.0:1767319902.286737:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894344960:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319902.286835:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894344960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (2001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319902.286843:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4772
00000100:00100000:1.0:1767319902.286864:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17442
00000100:00100000:1.0:1767319902.286868:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894344832:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319902.286888:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319902.286924:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894344832:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (2012us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319902.286928:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17442
00000100:00080000:3.0:1767319902.287320:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319902.380932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319902.644305:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319903.404914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319903.661018:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319904.429260:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319904.688022:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319905.452995:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319905.709970:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319906.285431:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940640256:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319906.285519:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319906.285597:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640256
00000100:00100000:3.0:1767319906.285605:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640256
00000100:00100000:3.0:1767319906.285664:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650
00000100:00100000:3.0:1767319906.285676:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940640256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319906.285709:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319906.285750:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940640256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (231us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319906.285757:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650
00000100:00080000:2.0:1767319906.286480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319906.286571:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940640256:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319906.477097:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319906.733370:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319906.797365:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319906.797376:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319906.797379:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319906.797383:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319906.797386:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319906.797395:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5151
00000100:00080000:2.0:1767319906.797399:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319906.797407:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319906.797451:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8a80 x1853163940640384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319906.797484:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319906.797488:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319906.797489:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319906.797493:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5151
00000100:00080000:2.0:1767319906.797496:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319906.797500:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319906.797518:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183bb80 x1853163940640512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319906.797584:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319906.797587:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319906.797589:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319906.797592:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5151
00000100:00080000:2.0:1767319906.797595:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319906.797599:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319906.797610:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940640896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319906.797626:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319906.797629:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319906.797631:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319906.797634:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5151
00000100:00080000:2.0:1767319906.797636:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319906.797639:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319906.797666:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839180 x1853163940641152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319906.797694:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319906.797709:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940640640:0@lo:400:kworker.0
00000100:00100000:2.0:1767319906.797817:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319906.798145:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940641024:0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798219:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319906.798248:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319906.798254:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940640768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798276:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319906.798308:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641024
00000100:00100000:1.0:1767319906.798327:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641024
00000100:00100000:1.0:1767319906.798383:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640768
00000100:00100000:1.0:1767319906.798386:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640768
00000100:00100000:1.0:1767319906.798412:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4773
00000100:00100000:1.0:1767319906.798421:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940641024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798474:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940641024:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319906.798482:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4773
00000100:00100000:1.0:1767319906.798499:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4774
00000100:00100000:1.0:1767319906.798505:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940640768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798531:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940640768:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319906.798537:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4774
00000100:00080000:1.0:1767319906.798554:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319906.798595:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940640768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798606:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940641024:0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798633:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640640
00000100:00100000:1.0:1767319906.798637:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640640
00000100:00100000:1.0:1767319906.798667:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095
00000100:00100000:1.0:1767319906.798674:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940640640:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319906.798706:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940640640:12345-0@lo:400:kworker.0 Request processed in 33us (889us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319906.798712:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095
00000100:00080000:1.0:1767319906.798726:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319906.798865:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940640384:0@lo:38:kworker.0
00000100:00100000:0.0:1767319906.798911:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319906.798937:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940640512:0@lo:38:kworker.0
00000100:00100000:0.0:1767319906.798961:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319906.798980:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940640896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319906.799000:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319906.799029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940641152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319906.799050:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319906.799080:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640512
00000100:00100000:0.0:1767319906.799084:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640512
00000100:00100000:0.0:1767319906.799103:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195
00000100:00100000:0.0:1767319906.799108:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940640512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319906.799126:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319906.799171:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940640512:12345-0@lo:38:kworker.0 Request processed in 62us (209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319906.799178:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195
00000100:00100000:0.0:1767319906.799196:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640384
00000100:00100000:0.0:1767319906.799199:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640384
00000100:00100000:0.0:1767319906.799216:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940640896
00000100:00100000:0.0:1767319906.799218:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940640896
00000100:00100000:0.0:1767319906.799234:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641152
00000100:00100000:0.0:1767319906.799238:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641152
00000100:00100000:3.0:1767319906.799252:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443
00000100:00100000:3.0:1767319906.799260:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940640384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319906.799271:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319906.799308:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940640384:12345-0@lo:38:kworker.0 Request processed in 49us (398us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319906.804690:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444
00000100:00100000:0.0:1767319906.804708:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940640896:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319906.804739:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319906.804847:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940640896:12345-0@lo:38:kworker.0 Request processed in 143us (5845us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319906.804856:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444
00000100:00100000:0.0:1767319906.804891:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445
00000100:00100000:0.0:1767319906.804988:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940641152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319906.804999:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319906.805119:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940641152:12345-0@lo:38:kworker.0 Request processed in 131us (6067us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319906.805127:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445
00000100:00080000:0.0:1767319906.805304:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319906.805310:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319906.805314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940640384:0@lo:38:kworker.0
00000100:00080000:0.0:1767319906.805450:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319906.805454:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319906.805459:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940640512:0@lo:38:kworker.0
00000100:00080000:0.0:1767319906.805467:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319906.805471:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319906.805474:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940640896:0@lo:38:kworker.0
00000100:00080000:0.0:1767319906.805482:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319906.805485:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319906.805489:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940641152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319906.805652:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940640640:0@lo:400:kworker.0
00000100:00100000:3.0:1767319906.811459:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443
00000100:00100000:0.0:1767319907.309095:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940641280:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319907.309227:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319907.309545:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641280
00000100:00100000:3.0:1767319907.309555:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641280
00000100:00100000:3.0:1767319907.309622:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651
00000100:00100000:3.0:1767319907.309632:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940641280:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319907.309676:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319907.309908:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940641280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 277us (682us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319907.309918:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651
00000100:00100000:0.0:1767319907.309991:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940641280:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319907.405983:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319907.406042:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319907.406277:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345216
00000100:00100000:3.0:1767319907.406288:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345216
00000100:00100000:0.0:1767319907.406308:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345088
00000100:00100000:0.0:1767319907.406316:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345088
00000100:00080000:1.0:1767319907.406406:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319907.406487:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4775
00000100:00100000:0.0:1767319907.406501:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319907.406591:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (621us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319907.406599:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4775
00000100:00100000:0.0:1767319907.406623:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17446
00000100:00100000:0.0:1767319907.406627:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894345088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319907.406648:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319907.406675:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894345088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (632us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319907.406681:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17446
00000100:00100000:2.0:1767319907.500901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319907.757292:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319908.525374:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319908.781222:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319909.548911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319909.805085:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319910.573501:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319910.830306:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319911.406444:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319911.406471:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940641408:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319911.406548:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319911.407009:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641408
00000100:00100000:3.0:1767319911.407019:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641408
00000100:00100000:3.0:1767319911.407080:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652
00000100:00100000:3.0:1767319911.407086:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940641408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319911.407300:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319911.407567:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940641408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 479us (1017us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319911.407575:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652
00000100:00080000:1.0:1767319911.407641:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319911.407696:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940641408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319911.597053:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319911.853668:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319911.917043:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319886/real 1767319886]  req@ffff93d073408e00 x1853163940635392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319911 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319911.917077:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d073408e00 x1853163940635392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319911 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319911.917096:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319911.917136:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319911.917140:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940635392:0@lo:250:kworker.0
00000100:00080000:3.0:1767319911.917456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319911.917462:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319911.917465:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319911.917470:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5136
00000100:00080000:3.0:1767319911.917474:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319911.917480:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319911.917645:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940641536/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319911.917671:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319911.917674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319911.917676:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319911.917680:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5156
00000100:00080000:3.0:1767319911.917682:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319911.917686:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319911.917701:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d194000 x1853163940641664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319911.917710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319911.917713:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319911.917715:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319911.917717:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5156
00000100:00100000:0.0:1767319911.917719:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940641536:0@lo:250:kworker.0
00000100:00080000:3.0:1767319911.917720:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319911.917723:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319911.917735:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940641792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:0.0:1767319911.917766:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940641536 offset 0 length 520: 4
00000100:00080000:3.0:1767319911.917801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319911.917805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319911.917806:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319911.917816:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940641920:0@lo:400:kworker.0
00000100:00080000:3.0:1767319911.918449:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5156
00000100:00080000:3.0:1767319911.918453:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319911.918457:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319911.918473:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8000 x1853163940642176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319911.919218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319911.919224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319911.919227:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319911.919233:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5156
00000100:00080000:3.0:1767319911.919237:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319911.919242:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319911.919261:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8380 x1853163940642432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319911.919311:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940642304:0@lo:400:kworker.0
00000100:00100000:3.0:1767319911.919358:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319911.919412:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642304
00000100:00100000:3.0:1767319911.919419:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642304
00000100:00100000:3.0:1767319911.919475:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4776
00000100:00100000:3.0:1767319911.919502:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940642304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319911.919559:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940642304:12345-0@lo:400:kworker.0 Request processed in 76us (200us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319911.919566:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4776
00000100:00080000:3.0:1767319911.919593:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319911.919622:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940642304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319911.920472:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940642048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319911.920537:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319911.921198:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642048
00000100:00100000:3.0:1767319911.921206:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642048
00000100:00080000:2.0:1767319911.921280:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319911.921295:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777
00000100:00100000:3.0:1767319911.921303:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940642048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319911.921363:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940642048:12345-0@lo:400:kworker.0 Request processed in 61us (826us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319911.921370:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777
00000100:00100000:2.0:1767319911.921395:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940642048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319911.921754:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319911.921871:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641920
00000100:00100000:2.0:1767319911.921876:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641920
00000100:00100000:2.0:1767319911.921917:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096
00000100:00100000:2.0:1767319911.921925:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940641920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319911.921968:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940641920:12345-0@lo:400:kworker.0 Request processed in 43us (3933us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319911.921974:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096
00000100:00080000:3.0:1767319911.922024:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319911.923098:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940641920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319911.924509:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940641664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319911.924585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319911.924699:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940641792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319911.924727:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319911.924757:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940642176:0@lo:38:kworker.0
00000100:00100000:0.0:1767319911.924797:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319911.924861:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641792
00000100:00100000:2.0:1767319911.924868:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641792
00000100:00100000:2.0:1767319911.924914:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196
00000100:00100000:2.0:1767319911.924922:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940641792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319911.924942:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319911.924979:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940641792:12345-0@lo:38:kworker.0 Request processed in 56us (251us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319911.924987:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196
00000100:00100000:0.0:1767319911.926152:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940642432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319911.926206:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319911.926618:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940641664
00000100:00100000:3.0:1767319911.926626:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940641664
00000100:00100000:3.0:1767319911.926658:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642176
00000100:00100000:3.0:1767319911.926662:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642176
00000100:00100000:3.0:1767319911.926681:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447
00000100:00100000:3.0:1767319911.926687:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940641664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319911.926710:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319911.926756:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940641664:12345-0@lo:38:kworker.0 Request processed in 68us (2171us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319911.926763:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447
00000100:00100000:3.0:1767319911.926795:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448
00000100:00100000:3.0:1767319911.926799:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940642176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319911.927538:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319911.927583:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940642176:12345-0@lo:38:kworker.0 Request processed in 781us (2784us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319911.927591:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448
00000100:00080000:0.0:1767319911.927714:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319911.927720:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319911.927724:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940641664:0@lo:38:kworker.0
00000100:00080000:0.0:1767319911.927753:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319911.927757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319911.927760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940641792:0@lo:38:kworker.0
00000100:00080000:0.0:1767319911.927767:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319911.927771:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319911.927790:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940642176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319911.928010:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642432
00000100:00100000:3.0:1767319911.928016:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642432
00000100:00100000:3.0:1767319911.928051:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17449
00000100:00100000:3.0:1767319911.928056:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940642432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319911.928068:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319911.928098:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940642432:12345-0@lo:38:kworker.0 Request processed in 41us (1892us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319911.928117:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17449
00000100:00080000:0.0:1767319911.928605:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319911.928610:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319911.928613:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940642432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319912.429053:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940642560:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319912.429156:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319912.429316:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642560
00000100:00100000:0.0:1767319912.429324:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642560
00000100:00100000:0.0:1767319912.429392:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653
00000100:00100000:0.0:1767319912.429401:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940642560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319912.429431:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319912.429739:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940642560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 338us (581us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319912.429747:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653
00000100:00100000:3.0:1767319912.429915:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940642560:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319912.522604:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319912.522731:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319912.522857:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345472
00000100:00100000:2.0:1767319912.522868:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345472
00000100:00100000:3.0:1767319912.522878:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345344
00000100:00100000:3.0:1767319912.522882:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345344
00000100:00080000:0.0:1767319912.522956:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319912.522967:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4778
00000100:00100000:3.0:1767319912.522978:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319912.523063:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319912.523072:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4778
00000100:00100000:3.0:1767319912.523090:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17450
00000100:00100000:3.0:1767319912.523095:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894345344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319912.523153:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319912.523188:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894345344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (458us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319912.523195:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17450
00000100:00100000:2.0:1767319912.626654:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319912.879760:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319913.647843:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319913.901820:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319914.668898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319914.925039:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319915.694442:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319915.949104:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319916.525717:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319916.525750:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940642688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319916.526620:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319916.527398:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642688
00000100:00100000:0.0:1767319916.527408:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642688
00000100:00100000:0.0:1767319916.527498:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654
00000100:00100000:0.0:1767319916.527507:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940642688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319916.527538:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319916.527592:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940642688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (975us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319916.527600:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654
00000100:00080000:3.0:1767319916.527911:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319916.528366:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940642688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319916.717167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319916.973203:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319917.037003:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319917.037013:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319917.037016:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319917.037021:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319917.037025:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319917.037040:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5161
00000100:00080000:3.0:1767319917.037045:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319917.037053:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319917.037111:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eadaa00 x1853163940642816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319917.037136:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319917.037140:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319917.037142:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319917.037145:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5161
00000100:00080000:3.0:1767319917.037147:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319917.037150:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319917.037162:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead9f80 x1853163940642944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319917.037250:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940643072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319917.037318:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319917.037428:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319917.037431:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319917.037433:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319917.037437:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5161
00000100:00080000:3.0:1767319917.037439:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319917.037443:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319917.037455:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8a80 x1853163940643456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319917.037512:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940642816:0@lo:38:kworker.0
00000100:00100000:0.0:1767319917.037556:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319917.037576:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940642944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319917.037598:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319917.037614:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940643456:0@lo:38:kworker.0
00000100:00100000:0.0:1767319917.037648:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319917.037683:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642944
00000100:00100000:0.0:1767319917.037690:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642944
00000100:00100000:0.0:1767319917.037720:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197
00000100:00100000:0.0:1767319917.037726:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940642944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319917.037747:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319917.038270:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940643200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319917.038301:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319917.038327:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319917.038332:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940643328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319917.038349:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319917.038368:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940643584:0@lo:400:kworker.0
00000100:00100000:2.0:1767319917.038387:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319917.038407:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643072
00000100:00100000:2.0:1767319917.038410:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643072
00000100:00100000:2.0:1767319917.038437:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643200
00000100:00100000:2.0:1767319917.038440:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643200
00000100:00100000:2.0:1767319917.038462:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097
00000100:00100000:2.0:1767319917.038468:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940643072:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319917.038984:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319917.038990:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319917.038992:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319917.038997:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5161
00000100:00080000:3.0:1767319917.039000:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319917.039004:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319917.039023:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9180 x1853163940643712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319917.039081:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940642816
00000100:00100000:3.0:1767319917.039084:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940642816
00000100:00100000:3.0:1767319917.039106:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643456
00000100:00100000:3.0:1767319917.039109:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643456
00000100:00100000:3.0:1767319917.039119:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643328
00000100:00100000:3.0:1767319917.039121:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643328
00000100:00100000:3.0:1767319917.039135:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643584
00000100:00100000:3.0:1767319917.039137:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643584
00000100:00100000:3.0:1767319917.039150:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4779
00000100:00100000:3.0:1767319917.039156:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940643328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039197:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940643328:12345-0@lo:400:kworker.0 Request processed in 41us (847us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319917.039204:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4779
00000100:00100000:3.0:1767319917.039219:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4780
00000100:00100000:3.0:1767319917.039224:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940643584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039247:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940643584:12345-0@lo:400:kworker.0 Request processed in 23us (859us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319917.039252:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4780
00000100:00100000:3.0:1767319917.039263:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451
00000100:00100000:3.0:1767319917.039266:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940642816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319917.039281:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319917.039303:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940642816:12345-0@lo:38:kworker.0 Request processed in 35us (1746us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319917.039308:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451
00000100:00100000:3.0:1767319917.039317:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452
00000100:00100000:3.0:1767319917.039321:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940643456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319917.039328:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319917.039344:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940643456:12345-0@lo:38:kworker.0 Request processed in 22us (1695us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319917.039349:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452
00000100:00080000:3.0:1767319917.039379:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319917.039382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319917.039412:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940643328:0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039439:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940643584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039466:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098
00000100:00100000:3.0:1767319917.039472:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940643200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039499:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940643200:12345-0@lo:400:kworker.0 Request processed in 28us (1197us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319917.039505:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098
00000100:00100000:3.0:1767319917.039542:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940643200:0@lo:400:kworker.0
00000100:00100000:3.0:1767319917.039576:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940643712:0@lo:38:kworker.0
00000100:00100000:3.0:1767319917.039599:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319917.039619:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319917.039623:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319917.039636:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940642816:0@lo:38:kworker.0
00000100:00080000:3.0:1767319917.039644:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319917.039647:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319917.039650:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940643456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319917.039670:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643712
00000100:00100000:3.0:1767319917.039673:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643712
00000100:00100000:3.0:1767319917.039688:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17453
00000100:00100000:3.0:1767319917.039692:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940643712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319917.039702:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319917.039728:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940643712:12345-0@lo:38:kworker.0 Request processed in 34us (128us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319917.039733:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17453
00000100:00080000:3.0:1767319917.039752:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319917.039756:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319917.039758:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940643712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319917.040273:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940643072:12345-0@lo:400:kworker.0 Request processed in 1802us (2952us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319917.040282:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097
00000100:00100000:1.0:1767319917.040333:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940643072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319917.073575:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940642944:12345-0@lo:38:kworker.0 Request processed in 35838us (35966us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319917.073591:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197
00000100:00080000:1.0:1767319917.073762:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319917.073769:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319917.073786:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940642944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319917.549093:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319917.553092:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940643840:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319917.553176:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319917.556304:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643840
00000100:00100000:2.0:1767319917.556320:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643840
00000100:00100000:2.0:1767319917.561454:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655
00000100:00100000:2.0:1767319917.561472:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940643840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319917.561511:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319917.561601:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940643840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (8424us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319917.561608:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655
00000100:00100000:3.0:1767319917.561710:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940643840:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319917.640198:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319917.640250:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319917.640323:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345600
00000100:00100000:3.0:1767319917.640333:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345600
00000100:00100000:0.0:1767319917.640351:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345728
00000100:00100000:0.0:1767319917.640358:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345728
00000100:00100000:3.0:1767319917.640378:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17454
00000100:00100000:3.0:1767319917.640387:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894345600:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319917.640411:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319917.640438:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4781
00000100:00100000:0.0:1767319917.640449:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345728:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319917.640475:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894345600:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 88us (290us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319917.640481:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17454
00000100:00100000:0.0:1767319917.640503:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894345728:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 54us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319917.640511:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4781
00000100:00080000:1.0:1767319917.640616:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319917.742411:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319917.997247:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319918.764918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319919.021024:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319919.789256:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319920.045884:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319920.813012:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319921.069027:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319921.646379:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940643968:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319921.646531:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319921.646842:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940643968
00000100:00100000:2.0:1767319921.646850:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940643968
00000100:00100000:2.0:1767319921.646931:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656
00000100:00100000:2.0:1767319921.646941:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940643968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319921.646974:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319921.647059:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940643968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (527us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319921.647066:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656
00000100:00080000:1.0:1767319921.647760:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319921.648313:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940643968:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319921.836945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319922.095034:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319922.163376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319922.163388:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319922.163391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319922.163396:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319922.163401:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319922.163411:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5167
00000100:00080000:1.0:1767319922.163416:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319922.163423:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319922.163468:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940644096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319922.163506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319922.163510:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319922.163511:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319922.163515:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5167
00000100:00080000:1.0:1767319922.163518:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319922.163521:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319922.163533:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a300 x1853163940644224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319922.163607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319922.163611:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319922.163612:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319922.163615:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5167
00000100:00080000:1.0:1767319922.163618:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319922.163621:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319922.163631:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879d880 x1853163940644736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319922.163645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319922.163648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319922.163650:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319922.163653:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5167
00000100:00080000:1.0:1767319922.163655:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319922.163659:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319922.163668:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879d500 x1853163940644992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319922.163701:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940644608:0@lo:400:kworker.0
00000100:00100000:1.0:1767319922.163806:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319922.163880:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319922.163886:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940644480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319922.163913:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319922.164558:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940644864:0@lo:400:kworker.0
00000100:00100000:0.0:1767319922.164598:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319922.164643:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319922.164649:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940644352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319922.164673:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.164967:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644480
00000100:00100000:3.0:1767319922.164975:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644480
00000100:00100000:3.0:1767319922.165050:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644352
00000100:00100000:3.0:1767319922.165054:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644352
00000100:00100000:3.0:1767319922.165078:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099
00000100:00100000:3.0:1767319922.165085:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940644480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319922.165159:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940644480:12345-0@lo:400:kworker.0 Request processed in 73us (1243us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319922.165166:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099
00000100:00100000:3.0:1767319922.165187:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100
00000100:00100000:3.0:1767319922.165193:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940644352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319922.165222:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940644352:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319922.165228:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100
00000100:00100000:3.0:1767319922.165274:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940644480:0@lo:400:kworker.0
00000100:00100000:3.0:1767319922.165303:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940644096:0@lo:38:kworker.0
00000100:00100000:3.0:1767319922.165327:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.165344:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940644224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319922.165367:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.165382:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940644736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319922.165402:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.165418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940644992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319922.165439:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.165469:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644608
00000100:00100000:3.0:1767319922.165472:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644608
00000100:00100000:3.0:1767319922.165497:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644864
00000100:00100000:3.0:1767319922.165500:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644864
00000100:00100000:3.0:1767319922.165512:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644096
00000100:00100000:3.0:1767319922.165514:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644096
00000100:00100000:3.0:1767319922.165522:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644736
00000100:00100000:3.0:1767319922.165524:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644736
00000100:00100000:3.0:1767319922.165531:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644992
00000100:00100000:3.0:1767319922.165534:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644992
00000100:00100000:3.0:1767319922.165544:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4782
00000100:00100000:3.0:1767319922.165551:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940644608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319922.165586:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940644608:12345-0@lo:400:kworker.0 Request processed in 36us (1814us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319922.165591:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4782
00000100:00100000:3.0:1767319922.165602:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4783
00000100:00100000:3.0:1767319922.165608:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940644864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319922.165738:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940644864:12345-0@lo:400:kworker.0 Request processed in 130us (1139us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319922.165745:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4783
00000100:00100000:3.0:1767319922.165765:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17455
00000100:00100000:3.0:1767319922.165769:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319922.165816:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319922.165848:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644096:12345-0@lo:38:kworker.0 Request processed in 78us (520us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319922.165854:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17455
00000100:00100000:3.0:1767319922.165865:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17456
00000100:00100000:3.0:1767319922.165868:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319922.165877:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319922.165897:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644736:12345-0@lo:38:kworker.0 Request processed in 27us (494us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319922.165903:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17456
00000100:00100000:3.0:1767319922.165912:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17457
00000100:00100000:3.0:1767319922.165916:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319922.165924:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319922.165945:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940644992:12345-0@lo:38:kworker.0 Request processed in 28us (505us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319922.165950:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17457
00000100:00100000:3.0:1767319922.165983:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940644608:0@lo:400:kworker.0
00000100:00080000:3.0:1767319922.166007:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319922.166021:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319922.166024:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940644096:0@lo:38:kworker.0
00000100:00080000:3.0:1767319922.166033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319922.166035:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319922.166038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940644736:0@lo:38:kworker.0
00000100:00080000:3.0:1767319922.166044:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319922.166047:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319922.166051:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940644992:0@lo:38:kworker.0
00000100:00080000:0.0:1767319922.167850:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319922.167861:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319922.167884:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940644224
00000100:00100000:0.0:1767319922.167895:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940644224
00000100:00100000:0.0:1767319922.167952:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198
00000100:00100000:0.0:1767319922.167959:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940644224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319922.167983:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319922.168083:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940644224:12345-0@lo:38:kworker.0 Request processed in 123us (2713us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319922.168090:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198
00000100:00100000:0.0:1767319922.168154:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940644352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319922.168167:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940644864:0@lo:400:kworker.0
00000100:00080000:3.0:1767319922.168882:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319922.168891:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319922.168894:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940644224:0@lo:38:kworker.0
00000100:00100000:0.0:1767319922.669734:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319922.669759:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940645120:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319922.669857:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319922.670015:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645120
00000100:00100000:3.0:1767319922.670024:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645120
00000100:00100000:3.0:1767319922.670083:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657
00000100:00100000:3.0:1767319922.670093:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940645120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319922.670135:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319922.670192:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940645120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319922.670199:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657
00000100:00100000:0.0:1767319922.670556:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940645120:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319922.767539:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319922.767582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319922.767812:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345856
00000100:00100000:1.0:1767319922.767822:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345856
00000100:00100000:1.0:1767319922.767867:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894345984
00000100:00100000:1.0:1767319922.767870:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894345984
00000100:00100000:1.0:1767319922.767922:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4784
00000100:00100000:1.0:1767319922.767931:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894345984:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319922.768027:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894345984:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (443us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319922.768035:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4784
00000100:00100000:1.0:1767319922.768054:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17458
00000100:00100000:1.0:1767319922.768059:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894345856:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319922.768079:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319922.768106:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894345856:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (578us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319922.768111:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17458
00000100:00080000:0.0:1767319922.768312:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319922.861292:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319923.117058:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319923.884964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319924.140989:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319924.909489:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319925.165049:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319925.934625:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319926.189064:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319926.765084:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319926.765109:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940645248:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319926.765332:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319926.765568:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645248
00000100:00100000:2.0:1767319926.765577:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645248
00000100:00100000:2.0:1767319926.765657:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658
00000100:00100000:2.0:1767319926.765667:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940645248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319926.765697:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319926.765752:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940645248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (419us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319926.765760:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658
00000100:00080000:1.0:1767319926.765884:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319926.765922:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940645248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319926.956899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319927.213038:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319927.276943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319927.276954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319927.276957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319927.276961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319927.276974:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319927.276982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5172
00000100:00080000:1.0:1767319927.276987:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319927.276995:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319927.277042:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b800 x1853163940645376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319927.277067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319927.277070:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319927.277072:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319927.277075:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5172
00000100:00080000:1.0:1767319927.277078:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319927.277082:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319927.277097:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaed80 x1853163940645504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319927.277180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319927.277183:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319927.277185:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319927.277189:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5172
00000100:00080000:1.0:1767319927.277191:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319927.277195:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319927.277206:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d4700 x1853163940646016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319927.277235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319927.277238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319927.277239:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319927.277243:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5172
00000100:00080000:1.0:1767319927.277247:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767319927.277251:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319927.277261:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf426d5c00 x1853163940646272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319927.277307:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940645888:0@lo:400:kworker.0
00000100:00100000:1.0:1767319927.277382:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319927.277443:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319927.277450:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940645760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319927.277474:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.277816:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940645376:0@lo:38:kworker.0
00000100:00100000:0.0:1767319927.277849:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.277867:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940645504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319927.277889:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.277904:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940646016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319927.277923:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.277936:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940646272:0@lo:38:kworker.0
00000100:00100000:0.0:1767319927.277982:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.278013:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940646144:0@lo:400:kworker.0
00000100:00100000:0.0:1767319927.278036:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.278052:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319927.278056:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940645632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319927.278076:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319927.278377:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645760
00000100:00100000:3.0:1767319927.278385:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645760
00000100:00100000:3.0:1767319927.278458:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645632
00000100:00100000:3.0:1767319927.278462:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645632
00000100:00100000:3.0:1767319927.278499:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101
00000100:00100000:3.0:1767319927.278509:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940645760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319927.278569:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940645760:12345-0@lo:400:kworker.0 Request processed in 62us (1093us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319927.278576:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101
00000100:00100000:3.0:1767319927.278595:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102
00000100:00100000:3.0:1767319927.278601:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940645632:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319927.278632:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940645632:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319927.278638:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102
00000100:00100000:3.0:1767319927.278658:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645888
00000100:00100000:3.0:1767319927.278661:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645888
00000100:00100000:3.0:1767319927.278687:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645376
00000100:00100000:3.0:1767319927.278690:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645376
00000100:00100000:3.0:1767319927.278698:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646016
00000100:00100000:3.0:1767319927.278701:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646016
00000100:00100000:3.0:1767319927.278708:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646272
00000100:00100000:3.0:1767319927.278710:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646272
00000100:00100000:3.0:1767319927.278730:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646144
00000100:00100000:3.0:1767319927.278733:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646144
00000100:00100000:3.0:1767319927.278747:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4785
00000100:00100000:3.0:1767319927.278753:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940645888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319927.278815:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940645888:12345-0@lo:400:kworker.0 Request processed in 62us (1433us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319927.278821:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4785
00000100:00100000:3.0:1767319927.278833:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4786
00000100:00100000:3.0:1767319927.278839:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940646144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319927.278865:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940646144:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319927.278871:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4786
00000100:00100000:3.0:1767319927.278881:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17459
00000100:00100000:3.0:1767319927.278885:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940645376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319927.278903:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319927.278931:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940645376:12345-0@lo:38:kworker.0 Request processed in 43us (1081us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319927.278936:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17459
00000100:00100000:3.0:1767319927.278946:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17460
00000100:00100000:3.0:1767319927.278949:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940646016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319927.278958:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319927.278991:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940646016:12345-0@lo:38:kworker.0 Request processed in 39us (1066us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319927.278995:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17460
00000100:00100000:3.0:1767319927.279005:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17461
00000100:00100000:3.0:1767319927.279009:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940646272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319927.279017:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319927.279037:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940646272:12345-0@lo:38:kworker.0 Request processed in 27us (1055us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319927.279042:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17461
00000100:00100000:3.0:1767319927.279088:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940645760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319927.279098:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940645888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319927.279583:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940645504
00000100:00100000:2.0:1767319927.279589:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940645504
00000100:00100000:2.0:1767319927.279611:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199
00000100:00100000:2.0:1767319927.279617:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940645504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319927.279628:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319927.279663:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940645504:12345-0@lo:38:kworker.0 Request processed in 45us (1772us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319927.279669:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199
00000100:00080000:0.0:1767319927.279810:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319927.279815:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319927.279844:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940645632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319927.279856:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940646144:0@lo:400:kworker.0
00000100:00080000:0.0:1767319927.279884:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319927.279889:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319927.279892:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940645376:0@lo:38:kworker.0
00000100:00080000:0.0:1767319927.279901:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319927.279905:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319927.279907:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940645504:0@lo:38:kworker.0
00000100:00080000:0.0:1767319927.279915:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319927.279917:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319927.279920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940646016:0@lo:38:kworker.0
00000100:00080000:0.0:1767319927.279927:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319927.279931:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319927.279933:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940646272:0@lo:38:kworker.0
00000100:00100000:0.0:1767319927.789208:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319927.789231:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940646400:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319927.789297:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319927.789496:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646400
00000100:00100000:2.0:1767319927.789505:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646400
00000100:00100000:2.0:1767319927.789556:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659
00000100:00100000:2.0:1767319927.789566:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940646400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319927.789596:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319927.789638:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940646400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (340us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319927.789645:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659
00000100:00100000:0.0:1767319927.789739:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940646400:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319927.878250:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319927.878377:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346368
00000100:00100000:2.0:1767319927.878388:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346368
00000100:00100000:2.0:1767319927.878524:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4787
00000100:00100000:2.0:1767319927.878535:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894346368:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319927.878609:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894346368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (368us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319927.878616:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4787
00000400:00000100:3.0:1767319927.878766:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894346112 offset 0 length 520: 4
00000100:00100000:3.0:1767319927.878891:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319927.879162:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346240
00000100:00100000:1.0:1767319927.879167:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346240
00000100:00100000:1.0:1767319927.879202:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17462
00000100:00100000:1.0:1767319927.879208:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894346240:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319927.879229:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319927.879278:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894346240:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 68us (386us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319927.879285:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17462
00000100:00080000:0.0:1767319927.879752:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319927.981368:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319928.237618:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319929.006973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319929.264603:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319930.029120:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319930.285060:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319931.052901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319931.309072:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319931.885432:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940646528:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319931.885503:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319931.886930:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646528
00000100:00100000:2.0:1767319931.886943:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646528
00000100:00100000:2.0:1767319931.887040:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660
00000100:00100000:2.0:1767319931.887050:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940646528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319931.887084:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319931.887172:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940646528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (1668us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319931.887179:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660
00000100:00080000:0.0:1767319931.890360:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319931.890541:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d070a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940646528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319932.078618:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319932.340241:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319932.396910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319932.396929:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319932.396933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319932.396937:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319932.396942:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319932.396949:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5177
00000100:00080000:1.0:1767319932.396954:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319932.396961:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319932.397024:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8700 x1853163940646656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319932.397055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319932.397058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319932.397060:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319932.397063:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5177
00000100:00080000:1.0:1767319932.397066:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319932.397070:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319932.397085:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9500 x1853163940646784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319932.397174:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940646912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319932.397245:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319932.397348:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940646656:0@lo:38:kworker.0
00000100:00100000:0.0:1767319932.397383:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319932.397402:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940646784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319932.397424:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319932.397455:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646784
00000100:00100000:0.0:1767319932.397462:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646784
00000100:00100000:0.0:1767319932.397494:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200
00000100:00100000:0.0:1767319932.397501:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940646784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319932.397522:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319932.397559:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940646784:12345-0@lo:38:kworker.0 Request processed in 57us (133us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319932.397566:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200
00000100:00080000:0.0:1767319932.397615:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319932.397619:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319932.397623:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940646784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319932.398419:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646912
00000100:00100000:2.0:1767319932.398426:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646912
00000100:00100000:0.0:1767319932.398437:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940646656
00000100:00100000:0.0:1767319932.398443:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940646656
00000100:00100000:2.0:1767319932.398473:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103
00000100:00100000:0.0:1767319932.398478:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17463
00000100:00100000:2.0:1767319932.398484:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940646912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.398486:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940646656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319932.398504:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319932.398547:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940646656:12345-0@lo:38:kworker.0 Request processed in 61us (1163us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319932.398553:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17463
00000100:00080000:0.0:1767319932.398584:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319932.398611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319932.398616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319932.398619:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319932.398643:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319932.401167:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940646656:0@lo:38:kworker.0
00000100:00100000:0.0:1767319932.401219:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940647040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.401278:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319932.401455:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319932.401464:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940647168:0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.401488:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319932.401514:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647168
00000100:00100000:0.0:1767319932.401520:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647168
00000100:00100000:0.0:1767319932.401566:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4788
00000100:00100000:0.0:1767319932.401573:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940647168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.401622:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940647168:12345-0@lo:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319932.401628:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4788
00000100:00080000:0.0:1767319932.401648:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319932.401672:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940647168:0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.401731:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647040
00000100:00100000:0.0:1767319932.401734:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647040
00000100:00100000:0.0:1767319932.401758:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104
00000100:00100000:0.0:1767319932.401763:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940647040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.401817:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940647040:12345-0@lo:400:kworker.0 Request processed in 53us (539us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319932.401823:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104
00000100:00080000:0.0:1767319932.401835:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319932.401847:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940647040:0@lo:400:kworker.0
00000100:00080000:1.0:1767319932.403676:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5177
00000100:00080000:1.0:1767319932.403683:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319932.403689:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319932.403727:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ebb80 x1853163940647296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319932.403808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319932.403813:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319932.403816:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319932.403821:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5177
00000100:00080000:1.0:1767319932.403824:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:1.0:1767319932.403827:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319932.403839:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9880 x1853163940647552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319932.403875:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940647424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319932.403938:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319932.403986:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647424
00000100:00100000:1.0:1767319932.403992:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647424
00000100:00100000:1.0:1767319932.404040:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4789
00000100:00100000:1.0:1767319932.404048:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940647424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319932.404093:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940647424:12345-0@lo:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319932.404101:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4789
00000100:00100000:0.0:1767319932.404135:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940647296:0@lo:38:kworker.0
00000100:00100000:1.0:1767319932.404144:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940647424:0@lo:400:kworker.0
00000100:00100000:0.0:1767319932.404170:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319932.404172:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319932.404188:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647296
00000100:00100000:0.0:1767319932.404193:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940647552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319932.404193:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647296
00000100:00100000:1.0:1767319932.404220:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17464
00000100:00100000:0.0:1767319932.404224:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319932.404229:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940647296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319932.404250:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319932.404258:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647552
00000100:00100000:0.0:1767319932.404263:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647552
00000100:00100000:0.0:1767319932.404291:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17465
00000100:00100000:1.0:1767319932.404293:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940647296:12345-0@lo:38:kworker.0 Request processed in 63us (124us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319932.404300:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940647552:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319932.404306:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17464
00010000:00020000:0.0:1767319932.404315:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319932.404354:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319932.404359:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319932.404362:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940647296:0@lo:38:kworker.0
00000100:00100000:0.0:1767319932.404955:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940647552:12345-0@lo:38:kworker.0 Request processed in 655us (734us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319932.404961:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17465
00000100:00080000:1.0:1767319932.405735:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319932.405741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319932.405745:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940647552:0@lo:38:kworker.0
00000100:00100000:2.0:1767319932.407897:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940646912:12345-0@lo:400:kworker.0 Request processed in 9408us (10643us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319932.407910:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103
00000100:00100000:3.0:1767319932.410068:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940646912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319932.909265:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940647680:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319932.909340:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319932.909570:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647680
00000100:00100000:2.0:1767319932.909578:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647680
00000100:00100000:2.0:1767319932.909622:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661
00000100:00100000:2.0:1767319932.909631:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940647680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319932.909660:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319932.909732:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d070a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940647680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (392us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319932.909740:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661
00000100:00100000:3.0:1767319932.910530:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940647680:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319933.006349:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319933.006399:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319933.006674:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346624
00000100:00100000:2.0:1767319933.006685:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346624
00000100:00100000:2.0:1767319933.006762:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346496
00000100:00100000:2.0:1767319933.006766:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346496
00000100:00100000:2.0:1767319933.006843:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4790
00000100:00100000:2.0:1767319933.006853:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894346624:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319933.006946:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894346624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (607us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319933.006954:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4790
00000100:00100000:2.0:1767319933.006973:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17466
00000100:00100000:2.0:1767319933.006978:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894346496:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319933.006998:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319933.007023:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07879d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894346496:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (623us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319933.007029:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17466
00000100:00080000:3.0:1767319933.008521:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319933.101034:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319933.360160:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319934.124985:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319934.382227:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319935.149017:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319935.405345:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319936.173269:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319936.429292:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319936.496001:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319911/real 1767319911]  req@ffff93d06d195f80 x1853163940641536/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319936 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319936.496036:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d195f80 x1853163940641536/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319936 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319936.496055:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319936.496080:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319936.496084:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940641536:0@lo:250:kworker.0
00000100:00080000:3.0:1767319936.497691:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319936.497701:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319936.497705:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319936.497713:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5161
00000100:00080000:3.0:1767319936.497717:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319936.497724:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319936.497759:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07879d880 x1853163940647808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319936.497816:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319936.497821:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319936.497823:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319936.497826:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767319936.497829:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319936.497832:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319936.497862:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8a300 x1853163940647936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319936.497872:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319936.497875:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319936.497877:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319936.497889:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767319936.497891:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319936.497894:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319936.497908:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d8aa00 x1853163940648064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319936.497986:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319936.497989:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319936.497991:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319936.497995:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767319936.497997:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319936.498001:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319936.498013:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38a80 x1853163940648576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319936.498027:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319936.498031:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319936.498033:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319936.498037:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767319936.498042:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767319936.498046:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319936.498056:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3b100 x1853163940648832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319936.498068:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940648320:0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498088:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940648448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319936.498181:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940648192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498281:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319936.498338:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319936.498344:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940648704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498365:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319936.498400:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648448
00000100:00100000:3.0:1767319936.498408:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648448
00000100:00100000:3.0:1767319936.498457:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648704
00000100:00100000:3.0:1767319936.498460:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648704
00000100:00100000:3.0:1767319936.498490:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4791
00000100:00100000:3.0:1767319936.498499:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940648448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498548:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940648448:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319936.498556:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4791
00000100:00100000:3.0:1767319936.498574:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4792
00000100:00100000:3.0:1767319936.498581:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940648704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498608:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940648704:12345-0@lo:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319936.498614:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4792
00000100:00080000:3.0:1767319936.498636:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319936.498671:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940648704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.498681:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940648448:0@lo:400:kworker.0
00000100:00100000:0.0:1767319936.501565:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940647808:0@lo:250:kworker.0
00000400:00000100:0.0:1767319936.501634:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940647808 offset 0 length 520: 4
00000100:00100000:0.0:1767319936.501672:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940647936:0@lo:38:kworker.0
00000100:00100000:0.0:1767319936.501701:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319936.501732:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940648064:0@lo:38:kworker.0
00000100:00100000:0.0:1767319936.501754:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319936.501801:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940648576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319936.501821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319936.501834:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940648832:0@lo:38:kworker.0
00000100:00100000:0.0:1767319936.501862:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319936.501912:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648064
00000100:00100000:0.0:1767319936.501920:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648064
00000100:00100000:0.0:1767319936.501971:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201
00000100:00100000:0.0:1767319936.501978:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940648064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319936.502004:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319936.502047:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940648064:12345-0@lo:38:kworker.0 Request processed in 68us (291us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319936.502055:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201
00000100:00080000:0.0:1767319936.502095:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319936.502099:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319936.502103:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940648064:0@lo:38:kworker.0
00000100:00100000:3.0:1767319936.502306:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940647936
00000100:00100000:3.0:1767319936.502312:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940647936
00000100:00100000:3.0:1767319936.502345:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648576
00000100:00100000:3.0:1767319936.502347:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648576
00000100:00100000:3.0:1767319936.502361:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648832
00000100:00100000:3.0:1767319936.502364:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648832
00000100:00100000:3.0:1767319936.502379:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467
00000100:00100000:3.0:1767319936.502384:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940647936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319936.502395:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319936.502431:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940647936:12345-0@lo:38:kworker.0 Request processed in 46us (729us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319936.502440:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467
00000100:00100000:3.0:1767319936.502456:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17468
00000100:00100000:3.0:1767319936.502460:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940648576:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319936.502468:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17469
00010000:00020000:3.0:1767319936.502469:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319936.502473:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940648832:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319936.502481:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319936.502492:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940648576:12345-0@lo:38:kworker.0 Request processed in 31us (670us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319936.502497:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17468
00000100:00100000:0.0:1767319936.502570:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940648832:12345-0@lo:38:kworker.0 Request processed in 31us (642us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319936.502577:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17469
00000100:00080000:0.0:1767319936.502607:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319936.502611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319936.502614:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940647936:0@lo:38:kworker.0
00000100:00080000:0.0:1767319936.502623:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319936.502625:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319936.502628:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940648576:0@lo:38:kworker.0
00000100:00080000:0.0:1767319936.502635:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319936.502638:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319936.502641:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940648832:0@lo:38:kworker.0
00000100:00100000:2.0:1767319936.505370:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319936.505468:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648320
00000100:00100000:3.0:1767319936.505481:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648320
00000100:00100000:3.0:1767319936.505562:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105
00000100:00100000:3.0:1767319936.505574:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940648320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319936.505646:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940648320:12345-0@lo:400:kworker.0 Request processed in 75us (284us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319936.505654:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105
00000100:00080000:2.0:1767319936.505804:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319936.505844:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940648320:0@lo:400:kworker.0
00000100:00100000:1.0:1767319936.507025:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319936.507130:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648192
00000100:00100000:0.0:1767319936.507138:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648192
00000100:00100000:0.0:1767319936.507223:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106
00000100:00100000:0.0:1767319936.507233:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940648192:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319936.507516:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319936.507577:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940648192:12345-0@lo:400:kworker.0 Request processed in 345us (556us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319936.507586:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106
00000100:00100000:1.0:1767319936.507667:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940648192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319937.012494:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940648960:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319937.012564:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319937.013100:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940648960
00000100:00100000:0.0:1767319937.013110:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940648960
00000100:00100000:0.0:1767319937.013191:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662
00000100:00100000:0.0:1767319937.013202:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940648960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319937.013253:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319937.013332:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940648960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (766us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319937.013340:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662
00000100:00100000:1.0:1767319937.013610:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940648960:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319937.201106:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319937.457383:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319938.029147:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319938.029168:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940649088:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319938.029237:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319938.029382:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649088
00000100:00100000:3.0:1767319938.029391:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649088
00000100:00100000:3.0:1767319938.029461:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663
00000100:00100000:3.0:1767319938.029477:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940649088:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319938.029721:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767319938.029930:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319938.029994:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940649088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 525us (756us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319938.030003:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663
00000100:00100000:1.0:1767319938.030091:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940649088:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319938.120320:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319938.120419:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319938.121986:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346752
00000100:00100000:2.0:1767319938.122000:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346752
00000100:00100000:2.0:1767319938.122050:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894346880
00000100:00100000:2.0:1767319938.122054:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894346880
00000100:00100000:3.0:1767319938.122096:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17470
00000100:00080000:0.0:1767319938.122139:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319938.122177:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894346752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319938.122204:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319938.122279:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894346752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 173us (1969us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319938.122579:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4793
00000100:00100000:2.0:1767319938.122597:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894346880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319938.122652:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894346880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 66us (2233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319938.122660:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4793
00000100:00100000:3.0:1767319938.126433:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17470
00000100:00100000:2.0:1767319938.221830:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319938.477112:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319939.245100:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319939.502289:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319940.268898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319940.525046:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319941.292929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319941.549055:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319941.613440:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319941.613452:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319941.613455:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319941.613459:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319941.613463:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319941.613472:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5186
00000100:00080000:3.0:1767319941.613477:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319941.613483:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319941.613523:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dce00 x1853163940649216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319941.613552:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319941.613556:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319941.613558:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319941.613561:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5186
00000100:00080000:3.0:1767319941.613564:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319941.613567:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319941.613583:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dc380 x1853163940649344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319941.613655:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319941.613795:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940649216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319941.613871:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319941.613931:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940649344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319941.613955:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319941.613990:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649344
00000100:00100000:0.0:1767319941.613998:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649344
00000100:00100000:0.0:1767319941.614027:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202
00000100:00100000:0.0:1767319941.614035:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940649344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319941.614054:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319941.614090:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940649344:12345-0@lo:38:kworker.0 Request processed in 55us (134us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319941.614097:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202
00000100:00080000:0.0:1767319941.614135:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319941.614139:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319941.614156:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940649344:0@lo:38:kworker.0
00000100:00100000:1.0:1767319941.614298:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649216
00000100:00100000:1.0:1767319941.614302:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649216
00000100:00100000:1.0:1767319941.614343:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17471
00000100:00100000:1.0:1767319941.614349:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940649216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319941.614359:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319941.614388:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940649216:12345-0@lo:38:kworker.0 Request processed in 39us (517us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319941.614393:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17471
00000100:00080000:0.0:1767319941.620271:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319941.620283:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319941.620287:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940649216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319941.620509:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940649600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.620590:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319941.620639:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940649472:0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.620682:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319941.620747:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649600
00000100:00100000:2.0:1767319941.620753:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649600
00000100:00100000:2.0:1767319941.620816:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649472
00000100:00100000:2.0:1767319941.620820:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649472
00000100:00100000:2.0:1767319941.620855:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107
00000100:00100000:2.0:1767319941.620864:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940649600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.620914:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940649600:12345-0@lo:400:kworker.0 Request processed in 50us (323us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319941.620922:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107
00000100:00100000:2.0:1767319941.620944:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108
00000100:00100000:2.0:1767319941.620949:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940649472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.620978:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940649472:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319941.620984:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108
00000100:00080000:1.0:1767319941.620995:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319941.621002:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319941.621018:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940649600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319941.621061:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940649472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319941.622040:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940649728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319941.622088:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319941.622183:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649728
00000100:00100000:1.0:1767319941.622189:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649728
00000100:00080000:3.0:1767319941.622219:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319941.622238:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4794
00000100:00100000:1.0:1767319941.622246:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940649728:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319941.622262:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319941.622265:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319941.622269:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5186
00000100:00080000:3.0:1767319941.622272:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319941.622276:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00080000:2.0:1767319941.622332:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319941.622437:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712dc700 x1853163940649856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319941.622571:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940649984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.622593:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319941.622623:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649984
00000100:00100000:2.0:1767319941.622625:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649984
00000100:00100000:2.0:1767319941.622655:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4795
00000100:00100000:2.0:1767319941.622661:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940649984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.622694:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940649984:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319941.622701:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4795
00000100:00080000:2.0:1767319941.622728:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319941.622751:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940649984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319941.622766:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940649856:0@lo:38:kworker.0
00000100:00100000:2.0:1767319941.622797:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319941.622820:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940649856
00000100:00100000:2.0:1767319941.622823:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940649856
00000100:00100000:2.0:1767319941.622853:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17472
00000100:00100000:2.0:1767319941.622857:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940649856:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319941.622875:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319941.622901:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940649856:12345-0@lo:38:kworker.0 Request processed in 43us (103us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319941.622905:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17472
00000100:00080000:2.0:1767319941.622925:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319941.622929:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319941.622931:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940649856:0@lo:38:kworker.0
00000100:00100000:1.0:1767319941.627382:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940649728:12345-0@lo:400:kworker.0 Request processed in 5126us (5282us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319941.627397:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4794
00000100:00100000:0.0:1767319941.631986:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940649728:0@lo:400:kworker.0
00000100:00080000:3.0:1767319941.634073:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319941.634082:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319941.634086:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319941.634093:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5186
00000100:00080000:3.0:1767319941.634098:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319941.634104:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319941.634143:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df800 x1853163940650112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319941.634240:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940650112:0@lo:38:kworker.0
00000100:00100000:2.0:1767319941.634318:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319941.635219:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650112
00000100:00100000:1.0:1767319941.635228:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650112
00000100:00100000:1.0:1767319941.635279:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17473
00000100:00100000:1.0:1767319941.635286:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940650112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319941.635306:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319941.643456:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940650112:12345-0@lo:38:kworker.0 Request processed in 8159us (9127us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319941.643472:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17473
00000100:00080000:2.0:1767319941.649018:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319941.649031:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319941.649036:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940650112:0@lo:38:kworker.0
00000100:00100000:2.0:1767319942.129264:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940650240:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319942.129337:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319942.129428:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650240
00000100:00100000:3.0:1767319942.129438:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650240
00000100:00100000:3.0:1767319942.129498:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664
00000100:00100000:3.0:1767319942.129509:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940650240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319942.129540:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319942.129602:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940650240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319942.129609:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664
00000100:00100000:2.0:1767319942.129747:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940650240:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319942.316999:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319942.573134:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319943.151966:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940650368:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319943.152039:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319943.152231:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650368
00000100:00100000:0.0:1767319943.152240:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650368
00000100:00100000:0.0:1767319943.152307:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665
00000100:00100000:0.0:1767319943.152317:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940650368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319943.152350:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767319943.152415:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319943.153605:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940650368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1284us (1560us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319943.153616:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665
00000100:00100000:1.0:1767319943.153838:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940650368:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319943.240968:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319943.241054:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319943.241299:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347136
00000100:00100000:2.0:1767319943.241310:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347136
00000100:00100000:2.0:1767319943.241385:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347008
00000100:00100000:2.0:1767319943.241388:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347008
00000100:00100000:2.0:1767319943.241413:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4796
00000100:00100000:2.0:1767319943.241423:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894347136:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319943.241510:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894347136:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 86us (550us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319943.241518:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4796
00000100:00100000:2.0:1767319943.241537:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17474
00000100:00100000:2.0:1767319943.241542:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894347008:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319943.241561:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319943.242046:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894347008:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 500us (989us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319943.242053:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17474
00000100:00080000:3.0:1767319943.242361:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319943.340930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319943.597294:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319944.365477:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319944.621066:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319945.389057:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319945.645020:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319946.412902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319946.669056:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319946.736700:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319946.736710:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319946.736713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319946.736717:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319946.736721:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319946.736728:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5191
00000100:00080000:1.0:1767319946.736732:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319946.736739:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319946.736839:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8a80 x1853163940650496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319946.736867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319946.736871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319946.736874:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319946.736877:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5191
00000100:00080000:1.0:1767319946.736880:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319946.736884:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319946.736901:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ead80 x1853163940650624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319946.736965:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940650752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319946.737033:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319946.737170:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940650880:0@lo:400:kworker.0
00000100:00100000:2.0:1767319946.737206:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319946.737255:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650752
00000100:00100000:2.0:1767319946.737262:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650752
00000100:00100000:2.0:1767319946.737310:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650880
00000100:00100000:2.0:1767319946.737313:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650880
00000100:00100000:2.0:1767319946.737338:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109
00000100:00100000:2.0:1767319946.737346:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940650752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319946.737888:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110
00000100:00100000:3.0:1767319946.737902:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940650880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319946.737947:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940650880:12345-0@lo:400:kworker.0 Request processed in 50us (739us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319946.737954:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110
00000100:00080000:3.0:1767319946.737997:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319946.738001:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319946.738015:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940650496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319946.738044:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319946.738065:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940650624:0@lo:38:kworker.0
00000100:00100000:3.0:1767319946.738090:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319946.738154:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940650880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319946.738185:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650624
00000100:00100000:3.0:1767319946.738188:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650624
00000100:00100000:3.0:1767319946.738209:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203
00000100:00100000:3.0:1767319946.738214:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940650624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319946.738233:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319946.738269:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940650624:12345-0@lo:38:kworker.0 Request processed in 53us (177us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319946.738276:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203
00000100:00080000:3.0:1767319946.738302:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319946.738307:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319946.738310:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940650624:0@lo:38:kworker.0
00000100:00100000:3.0:1767319946.738346:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940650496
00000100:00100000:3.0:1767319946.738350:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940650496
00000100:00100000:3.0:1767319946.738372:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17475
00000100:00100000:3.0:1767319946.738376:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940650496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319946.738385:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319946.738414:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940650496:12345-0@lo:38:kworker.0 Request processed in 37us (369us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319946.738420:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17475
00000100:00080000:3.0:1767319946.738442:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319946.738446:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319946.738449:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940650496:0@lo:38:kworker.0
00000100:00080000:1.0:1767319946.742595:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319946.742603:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319946.742606:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319946.742615:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5191
00000100:00080000:1.0:1767319946.742620:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319946.742627:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319946.742649:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea680 x1853163940651136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319946.742676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319946.742679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319946.742681:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319946.742685:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5191
00000100:00080000:1.0:1767319946.742687:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319946.742691:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319946.742712:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eaa00 x1853163940651392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319946.742752:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940651264:0@lo:400:kworker.0
00000100:00100000:1.0:1767319946.742861:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319946.742898:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319946.742904:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940651008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319946.742927:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319946.742960:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651264
00000100:00100000:1.0:1767319946.742967:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651264
00000100:00100000:1.0:1767319946.743027:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651008
00000100:00100000:1.0:1767319946.743031:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651008
00000100:00100000:1.0:1767319946.743054:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4797
00000100:00100000:1.0:1767319946.743063:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b831850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940651264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319946.743111:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b831850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940651264:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319946.743118:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4797
00000100:00100000:1.0:1767319946.744146:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4798
00000100:00100000:1.0:1767319946.744157:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940651008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319946.744206:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940651008:12345-0@lo:400:kworker.0 Request processed in 50us (1277us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319946.744212:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4798
00000100:00100000:1.0:1767319946.744261:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940651008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319946.744273:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940651264:0@lo:400:kworker.0
00000100:00080000:1.0:1767319946.744298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319946.744314:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940651136:0@lo:38:kworker.0
00000100:00100000:1.0:1767319946.744345:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319946.744369:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940651392:0@lo:38:kworker.0
00000100:00100000:1.0:1767319946.744388:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319946.744418:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651136
00000100:00100000:1.0:1767319946.744423:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651136
00000100:00100000:1.0:1767319946.744443:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651392
00000100:00100000:1.0:1767319946.744446:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651392
00000100:00100000:1.0:1767319946.744456:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17476
00000100:00100000:1.0:1767319946.744461:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940651136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319946.744481:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319946.744514:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940651136:12345-0@lo:38:kworker.0 Request processed in 51us (169us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319946.744520:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17476
00000100:00100000:1.0:1767319946.744534:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17477
00000100:00100000:1.0:1767319946.744537:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940651392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319946.744546:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319946.744566:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940651392:12345-0@lo:38:kworker.0 Request processed in 27us (178us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319946.744572:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17477
00000100:00080000:1.0:1767319946.744596:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319946.744601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319946.744604:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940651136:0@lo:38:kworker.0
00000100:00080000:1.0:1767319946.744611:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319946.744614:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319946.744617:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940651392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319946.745415:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940650752:12345-0@lo:400:kworker.0 Request processed in 8065us (8378us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319946.745425:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109
00000100:00100000:0.0:1767319946.745582:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940650752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319947.245182:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319947.245211:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940651520:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319947.245284:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319947.245441:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651520
00000100:00100000:1.0:1767319947.245449:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651520
00000100:00100000:1.0:1767319947.245505:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666
00000100:00100000:1.0:1767319947.245514:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940651520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319947.245545:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319947.245597:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940651520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319947.245606:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666
00000100:00100000:2.0:1767319947.245726:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940651520:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319947.436906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319947.697286:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319948.269583:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319948.274067:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940651648:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319948.274352:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319948.283580:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651648
00000100:00100000:3.0:1767319948.283595:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651648
00000100:00100000:3.0:1767319948.284160:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667
00000100:00100000:3.0:1767319948.284171:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940651648:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319948.284211:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319948.284293:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940651648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (9941us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319948.284301:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667
00000100:00100000:0.0:1767319948.285989:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940651648:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319948.287566:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319948.359905:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319948.359950:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319948.360054:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347392
00000100:00100000:1.0:1767319948.360065:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347392
00000100:00100000:1.0:1767319948.360152:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347264
00000100:00100000:1.0:1767319948.360155:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347264
00000100:00100000:1.0:1767319948.360190:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4799
00000100:00100000:1.0:1767319948.360200:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894347392:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767319948.360331:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319948.360368:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17478
00000100:00100000:2.0:1767319948.360374:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894347264:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319948.360398:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319948.360989:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894347264:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 611us (1034us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319948.361083:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17478
00000100:00100000:1.0:1767319948.363730:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894347392:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3520us (3825us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319948.363745:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4799
00000100:00100000:2.0:1767319948.461002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319948.717039:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319949.486516:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319949.742517:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319950.508908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319950.764941:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319951.536046:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319951.789643:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319951.854466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319951.854481:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319951.854484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319951.854488:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319951.854494:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319951.854514:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767319951.854520:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319951.854530:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319951.854586:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712de300 x1853163940651776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319951.854608:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319951.854611:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319951.854613:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319951.854616:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767319951.854618:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319951.854621:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319951.854633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddc00 x1853163940651904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319951.854716:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319951.854851:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940651776:0@lo:38:kworker.0
00000100:00100000:2.0:1767319951.854932:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319951.854994:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940651904:0@lo:38:kworker.0
00000100:00100000:0.0:1767319951.854998:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651776
00000100:00100000:0.0:1767319951.855008:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651776
00000100:00100000:2.0:1767319951.855023:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319951.855053:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17479
00000100:00100000:0.0:1767319951.855064:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940651776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319951.855085:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319951.855094:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940651904
00000100:00100000:2.0:1767319951.855099:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940651904
00000100:00100000:2.0:1767319951.855124:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204
00000100:00100000:2.0:1767319951.855130:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940651904:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319951.855139:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940651776:12345-0@lo:38:kworker.0 Request processed in 74us (206us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767319951.855144:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319951.855149:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17479
00000100:00100000:2.0:1767319951.855177:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940651904:12345-0@lo:38:kworker.0 Request processed in 45us (154us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319951.855184:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204
00000100:00080000:0.0:1767319951.855196:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319951.855202:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319951.855207:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940651776:0@lo:38:kworker.0
00000100:00080000:0.0:1767319951.855219:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319951.855222:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319951.855225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940651904:0@lo:38:kworker.0
00000100:00100000:1.0:1767319951.855845:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319951.855883:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319951.855923:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319951.855942:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319951.856015:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652160
00000100:00100000:0.0:1767319951.856019:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652160
00000100:00100000:0.0:1767319951.856069:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652032
00000100:00100000:0.0:1767319951.856072:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652032
00000100:00100000:0.0:1767319951.856093:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111
00000100:00100000:0.0:1767319951.856101:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319951.856144:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652160:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319951.856150:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111
00000100:00100000:0.0:1767319951.856163:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112
00000100:00100000:0.0:1767319951.856169:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319951.856195:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652032:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319951.856200:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112
00000100:00080000:1.0:1767319951.856447:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319951.856451:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319951.856479:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319951.856488:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652032:0@lo:400:kworker.0
00000100:00100000:2.0:1767319951.857004:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:3.0:1767319951.857056:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319951.857061:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319951.857064:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319951.857069:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767319951.857072:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319951.857077:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319951.857097:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712ddf80 x1853163940652416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319951.857159:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940652416:0@lo:38:kworker.0
00000100:00100000:0.0:1767319951.857196:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319951.863166:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652416
00000100:00100000:1.0:1767319951.863182:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652416
00000100:00100000:1.0:1767319951.863259:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17480
00000100:00100000:1.0:1767319951.863268:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940652416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319951.863293:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319951.863377:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940652416:12345-0@lo:38:kworker.0 Request processed in 109us (6180us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319951.863384:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17480
00000100:00080000:1.0:1767319951.863428:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319951.863433:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319951.863436:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940652416:0@lo:38:kworker.0
00000100:00100000:2.0:1767319951.869878:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940652544:0@lo:400:kworker.0
00000100:00100000:2.0:1767319951.869970:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319951.870022:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940652288:0@lo:400:kworker.0
00000100:00100000:2.0:1767319951.870045:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319951.870171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319951.870177:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319951.870181:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319951.870187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767319951.870192:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319951.870202:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319951.870238:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0712df800 x1853163940652672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319951.870306:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940652672:0@lo:38:kworker.0
00000100:00100000:3.0:1767319951.870335:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319951.882847:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652544
00000100:00100000:0.0:1767319951.882863:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652544
00000100:00080000:3.0:1767319951.883610:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319951.883860:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652288
00000100:00100000:1.0:1767319951.883868:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652288
00000100:00080000:3.0:1767319951.883941:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319951.885378:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652672
00000100:00100000:2.0:1767319951.885388:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652672
00000100:00100000:2.0:1767319951.885431:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4800
00000100:00100000:2.0:1767319951.885444:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940652544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319951.885557:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940652544:12345-0@lo:400:kworker.0 Request processed in 118us (15586us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319951.885565:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4800
00000100:00100000:2.0:1767319951.885585:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4801
00000100:00100000:2.0:1767319951.885592:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940652288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319951.885621:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940652288:12345-0@lo:400:kworker.0 Request processed in 30us (15575us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319951.885626:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4801
00000100:00100000:2.0:1767319951.885640:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17481
00000100:00100000:2.0:1767319951.885644:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940652672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319951.885668:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319951.885704:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940652672:12345-0@lo:38:kworker.0 Request processed in 59us (15369us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319951.885710:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17481
00000100:00100000:3.0:1767319951.885767:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940652544:0@lo:400:kworker.0
00000100:00080000:2.0:1767319951.891756:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319951.891786:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319951.891793:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940652672:0@lo:38:kworker.0
00000100:00100000:3.0:1767319951.895788:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940652288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319952.365353:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319952.374210:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652800:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319952.374306:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319952.375034:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652800
00000100:00100000:0.0:1767319952.375044:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652800
00000100:00100000:0.0:1767319952.375106:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668
00000100:00100000:0.0:1767319952.375116:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319952.375150:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319952.375217:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940652800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (910us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319952.375225:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668
00000100:00100000:1.0:1767319952.375376:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940652800:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319952.556903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319952.815724:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319953.389116:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319953.394542:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940652928:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319953.394632:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319953.395507:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940652928
00000100:00100000:3.0:1767319953.395518:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940652928
00000100:00100000:3.0:1767319953.395597:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669
00000100:00080000:1.0:1767319953.395706:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319953.395741:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940652928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319953.395801:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319953.395878:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940652928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 272us (1245us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319953.395886:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669
00000100:00100000:1.0:1767319953.395970:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940652928:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319953.479960:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319953.480098:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347648
00000100:00100000:1.0:1767319953.480113:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347648
00000100:00100000:1.0:1767319953.480196:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4802
00000100:00100000:1.0:1767319953.480215:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894347648:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767319953.480242:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319953.480326:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894347648:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 120us (378us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319953.480338:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4802
00000100:00100000:0.0:1767319953.489070:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767319953.489116:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894347776 offset 0 length 520: 4
00000100:00100000:1.0:1767319953.491109:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347520
00000100:00100000:1.0:1767319953.491136:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347520
00000100:00100000:1.0:1767319953.491206:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17482
00000100:00100000:1.0:1767319953.491214:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894347520:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319953.491238:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319953.491334:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894347520:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 118us (2281us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319953.491343:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17482
00000100:00100000:2.0:1767319953.581241:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319953.837293:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319954.604940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319954.861214:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319955.628960:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319955.885393:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319956.654299:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319956.917163:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319956.973043:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319956.973052:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319956.973055:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319956.973059:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319956.973063:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319956.973070:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767319956.973075:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319956.973081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319956.973118:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073410000 x1853163940653056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319956.973149:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319956.973153:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319956.973154:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319956.973158:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767319956.973160:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319956.973164:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319956.973176:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411180 x1853163940653184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319956.973240:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319956.973243:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319956.973246:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319956.973249:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767319956.973251:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319956.973255:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319956.973264:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412680 x1853163940653696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319956.973276:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319956.973278:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319956.973280:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319956.973283:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767319956.973285:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319956.973288:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319956.973295:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412300 x1853163940653952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319956.973372:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940653056:0@lo:38:kworker.0
00000100:00100000:3.0:1767319956.973454:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319956.973517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940653184:0@lo:38:kworker.0
00000100:00100000:3.0:1767319956.973543:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319956.973558:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940653696:0@lo:38:kworker.0
00000100:00100000:3.0:1767319956.973576:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319956.973600:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940653952:0@lo:38:kworker.0
00000100:00100000:3.0:1767319956.973619:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319956.973661:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653056
00000100:00100000:3.0:1767319956.973669:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653056
00000100:00100000:3.0:1767319956.973737:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653696
00000100:00100000:3.0:1767319956.973741:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653696
00000100:00100000:3.0:1767319956.973754:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653952
00000100:00100000:3.0:1767319956.973757:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653952
00000100:00100000:3.0:1767319956.973805:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17483
00000100:00100000:3.0:1767319956.973812:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653056:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319956.973833:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319956.973874:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653056:12345-0@lo:38:kworker.0 Request processed in 62us (420us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319956.973881:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17483
00000100:00100000:3.0:1767319956.973899:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17484
00000100:00100000:3.0:1767319956.973903:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653696:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319956.973912:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319956.973933:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653696:12345-0@lo:38:kworker.0 Request processed in 29us (356us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319956.973938:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17484
00000100:00100000:3.0:1767319956.973948:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17485
00000100:00100000:3.0:1767319956.973951:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319956.973959:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319956.973978:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940653952:12345-0@lo:38:kworker.0 Request processed in 25us (358us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319956.973983:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17485
00000100:00080000:3.0:1767319956.974018:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319956.974023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319956.974026:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940653056:0@lo:38:kworker.0
00000100:00080000:3.0:1767319956.974033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319956.974036:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319956.974038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940653696:0@lo:38:kworker.0
00000100:00080000:3.0:1767319956.974044:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319956.974047:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319956.974049:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940653952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319956.974252:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653184
00000100:00100000:2.0:1767319956.974258:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653184
00000100:00100000:2.0:1767319956.974280:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205
00000100:00100000:2.0:1767319956.974285:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940653184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319956.974295:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319956.974332:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940653184:12345-0@lo:38:kworker.0 Request processed in 45us (788us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319956.974338:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205
00000100:00080000:2.0:1767319956.974364:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319956.974368:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319956.974371:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940653184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319956.974461:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940653440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974499:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319956.974537:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319956.974544:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940653312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974566:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319956.974603:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653440
00000100:00100000:1.0:1767319956.974608:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653440
00000100:00100000:1.0:1767319956.974654:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653312
00000100:00100000:1.0:1767319956.974657:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653312
00000100:00100000:1.0:1767319956.974680:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113
00000100:00100000:1.0:1767319956.974686:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940653440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974738:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940653440:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319956.974745:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113
00000100:00100000:1.0:1767319956.974759:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114
00000100:00100000:1.0:1767319956.974766:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940653312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974837:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940653312:12345-0@lo:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319956.974843:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114
00000100:00080000:1.0:1767319956.974862:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319956.974867:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319956.974886:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940653824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974914:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319956.974933:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319956.974939:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940653568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.974958:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319956.974982:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653824
00000100:00100000:1.0:1767319956.974985:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653824
00000100:00100000:1.0:1767319956.975013:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940653568
00000100:00100000:1.0:1767319956.975016:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940653568
00000100:00100000:1.0:1767319956.975032:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4803
00000100:00100000:1.0:1767319956.975038:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940653824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.975073:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940653824:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319956.975078:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4803
00000100:00100000:1.0:1767319956.975089:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4804
00000100:00100000:1.0:1767319956.975095:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940653568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.975122:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940653568:12345-0@lo:400:kworker.0 Request processed in 27us (162us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319956.975128:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4804
00000100:00080000:1.0:1767319956.975143:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319956.975164:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940653568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.975175:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940653824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.975199:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940653312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319956.975209:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940653440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319957.485078:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940654080:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319957.485149:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319957.485282:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654080
00000100:00100000:2.0:1767319957.485290:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654080
00000100:00100000:2.0:1767319957.485331:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670
00000100:00100000:2.0:1767319957.485337:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940654080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319957.485363:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319957.485406:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940654080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (256us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319957.485413:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670
00000100:00100000:0.0:1767319957.485532:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940654080:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319957.677215:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319957.935392:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319958.511962:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319958.511985:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940654208:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319958.512057:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319958.512213:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654208
00000100:00100000:3.0:1767319958.512222:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654208
00000100:00100000:3.0:1767319958.512299:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767319958.512311:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940654208:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319958.512333:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767319958.512345:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319958.512404:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940654208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319958.512411:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671
00000100:00100000:2.0:1767319958.512452:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940654208:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319958.597903:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319958.600298:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348032
00000100:00100000:1.0:1767319958.600316:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348032
00000100:00100000:1.0:1767319958.600420:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4805
00000100:00100000:1.0:1767319958.600431:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894348032:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319958.600529:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894348032:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (2637us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319958.600536:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4805
00000100:00100000:0.0:1767319958.600945:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:2.0:1767319958.601585:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319958.601819:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894347904
00000100:00100000:3.0:1767319958.601828:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894347904
00000100:00100000:3.0:1767319958.601870:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17486
00000100:00100000:3.0:1767319958.601876:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894347904:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319958.601899:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319958.601955:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894347904:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 78us (1011us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319958.601963:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17486
00000100:00100000:3.0:1767319958.701035:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319958.957023:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319959.725949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319959.981174:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319960.749001:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319961.005122:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319961.071028:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319936/real 1767319936]  req@ffff93d07879d880 x1853163940647808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319961.071134:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d07879d880 x1853163940647808/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319961.071159:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319961.071187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319961.071191:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07879d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940647808:0@lo:250:kworker.0
00000100:00080000:1.0:1767319961.071279:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319961.071285:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319961.071289:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319961.071295:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5186
00000100:00080000:1.0:1767319961.071300:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319961.071308:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319961.071350:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940654336/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319961.071378:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319961.071382:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319961.071385:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319961.071389:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5207
00000100:00080000:1.0:1767319961.071391:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319961.071395:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319961.071415:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8700 x1853163940654464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319961.071429:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319961.071432:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319961.071433:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319961.071436:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5207
00000100:00080000:1.0:1767319961.071438:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319961.071442:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319961.071453:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9500 x1853163940654592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319961.071553:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319961.071557:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319961.071559:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319961.071562:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5207
00000100:00080000:1.0:1767319961.071564:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319961.071580:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319961.071593:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2680 x1853163940655104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319961.071608:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319961.071611:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319961.071613:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319961.071616:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5207
00000100:00080000:1.0:1767319961.071619:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319961.071622:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319961.071631:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1880 x1853163940655360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319961.071671:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940654976:0@lo:400:kworker.0
00000100:00100000:1.0:1767319961.071745:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319961.071830:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319961.071837:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940655232:0@lo:400:kworker.0
00000100:00100000:1.0:1767319961.071879:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319961.071930:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654976
00000100:00100000:1.0:1767319961.071939:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654976
00000100:00100000:1.0:1767319961.072017:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655232
00000100:00100000:1.0:1767319961.072021:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655232
00000100:00100000:1.0:1767319961.072047:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4806
00000100:00100000:1.0:1767319961.072056:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940654976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319961.072110:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940654976:12345-0@lo:400:kworker.0 Request processed in 54us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319961.072119:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4806
00000100:00100000:1.0:1767319961.072137:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4807
00000100:00100000:1.0:1767319961.072144:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940655232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319961.072171:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940655232:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319961.072176:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4807
00000100:00080000:1.0:1767319961.072194:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319961.072229:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940655232:0@lo:400:kworker.0
00000100:00100000:1.0:1767319961.072240:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940654976:0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072335:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940654848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072378:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319961.072433:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319961.072439:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940654720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072473:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319961.072501:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654848
00000100:00100000:0.0:1767319961.072505:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654848
00000100:00100000:0.0:1767319961.072559:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654720
00000100:00100000:0.0:1767319961.072563:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654720
00000100:00100000:0.0:1767319961.072581:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115
00000100:00100000:0.0:1767319961.072588:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940654848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072622:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940654848:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319961.072628:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115
00000100:00100000:0.0:1767319961.072640:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116
00000100:00100000:0.0:1767319961.072646:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940654720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072687:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940654720:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319961.072693:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116
00000100:00080000:0.0:1767319961.072710:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319961.072713:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319961.072751:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940654720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319961.072761:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940654848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319961.073180:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940654336:0@lo:250:kworker.0
00000400:00000100:3.0:1767319961.073212:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940654336 offset 0 length 520: 4
00000100:00100000:3.0:1767319961.073231:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940654464:0@lo:38:kworker.0
00000100:00100000:3.0:1767319961.073253:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319961.073279:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940654592:0@lo:38:kworker.0
00000100:00100000:3.0:1767319961.073321:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319961.073351:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940655104:0@lo:38:kworker.0
00000100:00100000:3.0:1767319961.073372:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319961.073390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940655360:0@lo:38:kworker.0
00000100:00100000:3.0:1767319961.073410:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319961.073446:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654464
00000100:00100000:3.0:1767319961.073451:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654464
00000100:00100000:3.0:1767319961.073476:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655104
00000100:00100000:3.0:1767319961.073480:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655104
00000100:00100000:3.0:1767319961.073492:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655360
00000100:00100000:3.0:1767319961.073494:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655360
00000100:00100000:3.0:1767319961.073505:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17487
00000100:00100000:3.0:1767319961.073510:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940654464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319961.073530:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319961.073565:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940654464:12345-0@lo:38:kworker.0 Request processed in 54us (311us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319961.073571:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17487
00000100:00100000:3.0:1767319961.073587:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17488
00000100:00100000:3.0:1767319961.073591:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940655104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319961.073600:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319961.073621:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940655104:12345-0@lo:38:kworker.0 Request processed in 29us (248us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319961.073626:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17488
00000100:00100000:3.0:1767319961.073637:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17489
00000100:00100000:3.0:1767319961.073641:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940655360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319961.073648:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319961.073685:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940655360:12345-0@lo:38:kworker.0 Request processed in 42us (273us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319961.073691:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17489
00000100:00080000:3.0:1767319961.073724:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319961.073728:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319961.073732:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940654464:0@lo:38:kworker.0
00000100:00080000:3.0:1767319961.073741:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319961.073744:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319961.073747:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940655104:0@lo:38:kworker.0
00000100:00080000:3.0:1767319961.073754:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319961.073758:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319961.073760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940655360:0@lo:38:kworker.0
00000100:00100000:1.0:1767319961.074695:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940654592
00000100:00100000:1.0:1767319961.074705:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940654592
00000100:00100000:1.0:1767319961.074760:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206
00000100:00100000:1.0:1767319961.074766:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940654592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319961.074806:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319961.074883:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940654592:12345-0@lo:38:kworker.0 Request processed in 116us (1562us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319961.074889:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206
00000100:00080000:3.0:1767319961.081842:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319961.081855:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319961.081859:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940654592:0@lo:38:kworker.0
00000100:00100000:3.0:1767319961.772900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319962.029132:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319962.611076:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319962.611104:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940655488:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319962.611188:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319962.611391:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655488
00000100:00100000:1.0:1767319962.611399:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655488
00000100:00100000:1.0:1767319962.611458:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672
00000100:00100000:1.0:1767319962.611467:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940655488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319962.611557:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319962.611611:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940655488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (422us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319962.611619:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672
00000100:00100000:0.0:1767319962.612192:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940655488:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319962.797157:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319963.053020:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319963.635917:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319963.635943:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940655616:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319963.636014:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319963.636156:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655616
00000100:00100000:0.0:1767319963.636165:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655616
00000100:00100000:0.0:1767319963.636233:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767319963.636242:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940655616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319963.636271:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319963.636319:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940655616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (304us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319963.636325:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767319963.636375:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940655616:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319963.639026:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319963.725502:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319963.725547:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319963.726137:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348160
00000100:00100000:2.0:1767319963.726151:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348160
00000100:00100000:2.0:1767319963.726206:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348288
00000100:00100000:2.0:1767319963.726210:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348288
00000100:00100000:2.0:1767319963.726309:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4808
00000100:00100000:2.0:1767319963.726320:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894348288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767319963.726406:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894348288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (857us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319963.726414:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4808
00000100:00100000:2.0:1767319963.726431:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17490
00000100:00100000:2.0:1767319963.726435:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894348160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767319963.726469:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319963.726498:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894348160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 60us (1008us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319963.726506:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17490
00000100:00080000:0.0:1767319963.728300:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319963.820896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319964.077022:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319964.848354:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319965.101272:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319965.868905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319966.126458:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319966.188895:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319966.188906:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319966.188909:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319966.188914:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319966.188918:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319966.188925:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5211
00000100:00080000:1.0:1767319966.188930:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319966.188938:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319966.188992:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb2d80 x1853163940655744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319966.189021:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319966.189024:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319966.189026:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319966.189030:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5211
00000100:00080000:1.0:1767319966.189033:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319966.189036:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319966.189099:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940655744:0@lo:38:kworker.0
00000100:00100000:3.0:1767319966.189182:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319966.189290:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1f80 x1853163940655872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319966.189358:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319966.189362:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319966.189364:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319966.189367:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5211
00000100:00080000:1.0:1767319966.189370:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319966.189374:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319966.189386:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb100 x1853163940656384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319966.189387:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940656000:0@lo:400:kworker.0
00000100:00080000:1.0:1767319966.189400:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319966.189403:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319966.189405:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319966.189408:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5211
00000100:00080000:1.0:1767319966.189410:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319966.189414:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319966.189421:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319966.189423:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb800 x1853163940656640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319966.189444:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940656128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319966.189471:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319966.189530:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655744
00000100:00100000:0.0:1767319966.189538:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655744
00000100:00100000:3.0:1767319966.189638:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940656512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319966.189654:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656000
00000100:00100000:2.0:1767319966.189658:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656000
00000100:00100000:2.0:1767319966.189707:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656128
00000100:00100000:2.0:1767319966.189710:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656128
00000100:00100000:2.0:1767319966.189731:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117
00000100:00100000:2.0:1767319966.189740:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940656000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319966.189820:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17491
00000100:00100000:0.0:1767319966.189827:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940655744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319966.189845:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319966.190149:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940656256:0@lo:400:kworker.0
00000100:00100000:3.0:1767319966.197956:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319966.198049:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656512
00000100:00100000:3.0:1767319966.198058:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656512
00000100:00100000:3.0:1767319966.198114:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4809
00000100:00100000:3.0:1767319966.198126:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940656512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319966.198190:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940656512:12345-0@lo:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319966.198198:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4809
00000100:00100000:3.0:1767319966.198233:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940655872:0@lo:38:kworker.0
00000100:00100000:3.0:1767319966.198269:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319966.198287:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940656384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319966.198306:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319966.198319:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940656640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319966.198337:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319966.198377:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940655872
00000100:00100000:3.0:1767319966.198381:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940655872
00000100:00100000:3.0:1767319966.198405:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207
00000100:00100000:3.0:1767319966.198410:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940655872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319966.198430:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319966.198462:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940655872:12345-0@lo:38:kworker.0 Request processed in 51us (192us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319966.198468:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207
00000100:00100000:3.0:1767319966.198486:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656384
00000100:00100000:3.0:1767319966.198490:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656384
00000100:00100000:3.0:1767319966.198505:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656640
00000100:00100000:3.0:1767319966.198508:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656640
00000100:00100000:3.0:1767319966.198520:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17492
00000100:00100000:3.0:1767319966.198524:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940656384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319966.198534:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319966.198558:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940656384:12345-0@lo:38:kworker.0 Request processed in 32us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319966.198563:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17492
00000100:00100000:3.0:1767319966.198574:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17493
00000100:00100000:3.0:1767319966.198578:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940656640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319966.198586:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319966.198620:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940656640:12345-0@lo:38:kworker.0 Request processed in 29us (271us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319966.198626:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17493
00000100:00100000:3.0:1767319966.198706:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940656512:0@lo:400:kworker.0
00000100:00080000:3.0:1767319966.198733:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319966.198738:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319966.198741:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940655872:0@lo:38:kworker.0
00000100:00080000:3.0:1767319966.198748:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319966.198751:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319966.198754:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940656384:0@lo:38:kworker.0
00000100:00080000:3.0:1767319966.198760:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319966.198764:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319966.198766:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940656640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319966.198829:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118
00000100:00100000:3.0:1767319966.198839:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940656128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319966.198876:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940656128:12345-0@lo:400:kworker.0 Request processed in 40us (9404us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319966.198882:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118
00000100:00080000:3.0:1767319966.198900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319966.198905:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319966.198907:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319966.199066:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940656128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319966.203438:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940656000:12345-0@lo:400:kworker.0 Request processed in 13689us (14006us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319966.203454:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117
00000100:00100000:3.0:1767319966.204132:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940656000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319966.204552:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940655744:12345-0@lo:38:kworker.0 Request processed in 14721us (15367us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319966.204562:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17491
00000100:00080000:3.0:1767319966.204654:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319966.204660:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319966.204663:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940655744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319966.206333:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319966.206562:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656256
00000100:00100000:0.0:1767319966.206571:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656256
00000100:00100000:0.0:1767319966.206711:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4810
00000100:00100000:0.0:1767319966.206721:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940656256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319966.206809:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940656256:12345-0@lo:400:kworker.0 Request processed in 90us (481us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319966.206816:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4810
00000100:00100000:1.0:1767319966.206948:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940656256:0@lo:400:kworker.0
00000100:00080000:3.0:1767319966.207088:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319966.892917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319967.152397:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319967.725379:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940656768:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319967.725534:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319967.725727:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656768
00000100:00100000:0.0:1767319967.725738:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656768
00000100:00100000:0.0:1767319967.725846:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674
00000100:00100000:0.0:1767319967.725862:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940656768:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319967.725914:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319967.725992:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940656768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319967.726004:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674
00000100:00100000:3.0:1767319967.726178:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940656768:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319967.917414:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319968.173699:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319968.749271:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940656896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319968.749362:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319968.749530:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940656896
00000100:00100000:3.0:1767319968.749540:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940656896
00000100:00100000:3.0:1767319968.749619:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675
00000100:00100000:3.0:1767319968.749631:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940656896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319968.749660:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319968.749701:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940656896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (340us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319968.749708:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675
00000100:00080000:2.0:1767319968.749768:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319968.749836:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940656896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319968.838756:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319968.838880:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319968.839058:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348544
00000100:00100000:1.0:1767319968.839071:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348544
00000100:00100000:1.0:1767319968.839165:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348416
00000100:00100000:1.0:1767319968.839169:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348416
00000100:00100000:1.0:1767319968.839194:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4811
00000100:00100000:1.0:1767319968.839205:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894348544:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319968.839295:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894348544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (554us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319968.839305:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4811
00000100:00100000:1.0:1767319968.839327:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17494
00000100:00100000:1.0:1767319968.839332:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894348416:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319968.839362:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319968.839393:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894348416:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 59us (514us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319968.839400:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17494
00000100:00080000:3.0:1767319968.839747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319968.943746:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319969.200447:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319969.967760:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319970.221420:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319970.988930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319971.245351:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319971.310699:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319971.310712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319971.310715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319971.310719:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319971.310724:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319971.310734:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5216
00000100:00080000:1.0:1767319971.310739:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319971.310747:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319971.310817:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737fb480 x1853163940657024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319971.310850:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319971.310854:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319971.310856:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319971.310908:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5216
00000100:00080000:1.0:1767319971.310911:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319971.310914:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319971.310929:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737f9500 x1853163940657152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319971.311003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319971.311006:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319971.311008:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319971.311011:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5216
00000100:00080000:1.0:1767319971.311014:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319971.311018:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319971.311027:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0737faa00 x1853163940657664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319971.311056:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319971.311059:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319971.311060:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319971.311063:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5216
00000100:00080000:1.0:1767319971.311066:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319971.311069:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767319971.311080:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760fb80 x1853163940657920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319971.311090:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940657280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319971.311131:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940657536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319971.311161:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319971.311172:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319971.311245:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940657408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311277:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319971.311303:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940657792:0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311325:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319971.311354:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657536
00000100:00100000:2.0:1767319971.311362:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657536
00000100:00100000:2.0:1767319971.311419:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657792
00000100:00100000:2.0:1767319971.311423:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657792
00000100:00100000:2.0:1767319971.311451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4812
00000100:00100000:2.0:1767319971.311459:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940657536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311517:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940657536:12345-0@lo:400:kworker.0 Request processed in 58us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319971.311525:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4812
00000100:00100000:2.0:1767319971.311541:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4813
00000100:00100000:2.0:1767319971.311547:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940657792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311588:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940657792:12345-0@lo:400:kworker.0 Request processed in 41us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319971.311594:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4813
00000100:00080000:2.0:1767319971.311611:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319971.311638:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657280
00000100:00100000:2.0:1767319971.311642:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657280
00000100:00100000:2.0:1767319971.311668:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657408
00000100:00100000:2.0:1767319971.311670:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657408
00000100:00100000:2.0:1767319971.311687:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119
00000100:00100000:2.0:1767319971.311691:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940657280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311721:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940657280:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319971.311727:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119
00000100:00100000:2.0:1767319971.311738:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120
00000100:00100000:2.0:1767319971.311743:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940657408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319971.311793:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940657408:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319971.311802:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120
00000100:00080000:2.0:1767319971.311815:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319971.311818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319971.311949:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940657536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319971.312261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940657024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319971.312297:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319971.312373:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657024
00000100:00100000:1.0:1767319971.312378:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657024
00000100:00100000:1.0:1767319971.312413:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17495
00000100:00100000:1.0:1767319971.312418:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940657024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319971.312436:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319971.312488:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940657024:12345-0@lo:38:kworker.0 Request processed in 69us (191us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319971.312494:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17495
00000100:00100000:1.0:1767319971.313081:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940657792:0@lo:400:kworker.0
00000100:00080000:3.0:1767319971.313427:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319971.313433:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319971.313437:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940657024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319971.313444:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940657152:0@lo:38:kworker.0
00000100:00100000:3.0:1767319971.313495:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319971.313525:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940657664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319971.313545:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319971.313579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940657920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319971.313603:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319971.313642:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657664
00000100:00100000:3.0:1767319971.313646:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657664
00000100:00100000:3.0:1767319971.313671:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657920
00000100:00100000:3.0:1767319971.313674:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657920
00000100:00100000:3.0:1767319971.313690:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17496
00000100:00100000:3.0:1767319971.313694:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940657664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319971.313710:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319971.313744:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940657664:12345-0@lo:38:kworker.0 Request processed in 48us (198us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319971.313750:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17496
00000100:00100000:3.0:1767319971.313765:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17497
00000100:00100000:3.0:1767319971.313768:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940657920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319971.313805:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319971.313830:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940657920:12345-0@lo:38:kworker.0 Request processed in 59us (226us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319971.313835:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17497
00000100:00080000:3.0:1767319971.313867:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319971.313871:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319971.313874:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940657664:0@lo:38:kworker.0
00000100:00080000:3.0:1767319971.313881:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319971.313885:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319971.313888:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940657920:0@lo:38:kworker.0
00000100:00100000:1.0:1767319971.313982:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940657152
00000100:00100000:1.0:1767319971.313986:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940657152
00000100:00100000:1.0:1767319971.314014:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208
00000100:00100000:1.0:1767319971.314019:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940657152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319971.314030:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319971.314078:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940657152:12345-0@lo:38:kworker.0 Request processed in 57us (582us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319971.314084:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208
00000100:00080000:1.0:1767319971.314107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319971.314111:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319971.314123:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940657152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319971.314621:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940657408:0@lo:400:kworker.0
00000100:00100000:0.0:1767319971.315195:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940657280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319972.013673:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319972.269291:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319972.845031:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940658048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319972.845360:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319972.845605:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658048
00000100:00100000:1.0:1767319972.845613:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658048
00000100:00100000:1.0:1767319972.845667:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676
00000100:00100000:1.0:1767319972.845676:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940658048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319972.845720:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319972.845802:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940658048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (415us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319972.845810:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676
00000100:00100000:0.0:1767319972.846079:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940658048:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319973.037698:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319973.293980:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319973.870029:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319973.870053:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940658176:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319973.870122:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319973.870494:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658176
00000100:00100000:3.0:1767319973.870503:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658176
00000100:00100000:3.0:1767319973.870593:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677
00000100:00100000:3.0:1767319973.870604:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940658176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319973.870632:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319973.870672:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940658176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (550us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319973.870678:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677
00000100:00100000:0.0:1767319973.870897:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940658176:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319973.871010:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319973.964301:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319973.964401:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319973.964630:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348672
00000100:00100000:3.0:1767319973.964641:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348672
00000100:00100000:3.0:1767319973.964690:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894348800
00000100:00100000:3.0:1767319973.964694:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894348800
00000100:00100000:3.0:1767319973.964747:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4814
00000100:00100000:3.0:1767319973.964760:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894348800:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319973.964908:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894348800:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 151us (506us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319973.964917:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4814
00000100:00100000:3.0:1767319973.964939:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17498
00000100:00100000:3.0:1767319973.964944:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894348672:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319973.964964:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319973.964991:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894348672:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (701us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319973.965002:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17498
00000100:00080000:2.0:1767319973.965329:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319974.060893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319974.321311:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319975.085145:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319975.341077:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319976.110583:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319976.365312:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319976.429335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319976.429347:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319976.429350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319976.429355:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319976.429360:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319976.429369:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5221
00000100:00080000:3.0:1767319976.429375:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319976.429383:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319976.429444:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38380 x1853163940658304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319976.429477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319976.429481:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319976.429482:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319976.429486:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5221
00000100:00080000:3.0:1767319976.429489:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319976.429493:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319976.429509:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38000 x1853163940658432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319976.429602:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319976.429606:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319976.429609:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319976.429612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5221
00000100:00080000:3.0:1767319976.429614:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319976.429619:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319976.429629:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3bb80 x1853163940658944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319976.429667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319976.429671:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319976.429672:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319976.429676:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5221
00000100:00080000:3.0:1767319976.429679:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319976.429682:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319976.429727:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3ad80 x1853163940659200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319976.430152:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940658304:0@lo:38:kworker.0
00000100:00100000:1.0:1767319976.430275:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319976.430381:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940658432:0@lo:38:kworker.0
00000100:00100000:1.0:1767319976.430424:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319976.430442:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940658944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319976.430462:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319976.430486:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940659200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319976.430504:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319976.430554:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658304
00000100:00100000:1.0:1767319976.430563:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658304
00000100:00100000:1.0:1767319976.430617:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658944
00000100:00100000:1.0:1767319976.430620:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658944
00000100:00100000:1.0:1767319976.430632:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659200
00000100:00100000:1.0:1767319976.430634:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659200
00000100:00100000:1.0:1767319976.430649:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17499
00000100:00100000:1.0:1767319976.430655:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940658304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319976.430687:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319976.430751:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940658304:12345-0@lo:38:kworker.0 Request processed in 94us (475us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319976.430757:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17499
00000100:00100000:1.0:1767319976.430799:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17500
00000100:00100000:1.0:1767319976.430803:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940658944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319976.430812:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319976.430836:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940658944:12345-0@lo:38:kworker.0 Request processed in 32us (373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319976.430844:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17500
00000100:00100000:1.0:1767319976.430854:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17501
00000100:00100000:1.0:1767319976.430858:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940659200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319976.430866:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319976.430892:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940659200:12345-0@lo:38:kworker.0 Request processed in 32us (386us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319976.430900:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17501
00000100:00080000:1.0:1767319976.430958:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319976.430963:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319976.430967:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940658304:0@lo:38:kworker.0
00000100:00080000:1.0:1767319976.430975:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319976.430979:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319976.430981:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940658944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319976.431324:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940658688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431383:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319976.431433:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319976.431441:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940658560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431465:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319976.431495:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940659072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431533:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319976.431586:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319976.431595:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940658816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431623:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319976.431645:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659072
00000100:00100000:2.0:1767319976.431650:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659072
00000100:00100000:2.0:1767319976.431718:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658816
00000100:00100000:2.0:1767319976.431722:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658816
00000100:00100000:2.0:1767319976.431740:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4815
00000100:00100000:2.0:1767319976.431747:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940659072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431838:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940659072:12345-0@lo:400:kworker.0 Request processed in 91us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319976.431847:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4815
00000100:00100000:2.0:1767319976.431860:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4816
00000100:00100000:2.0:1767319976.431866:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940658816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.431890:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940658816:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319976.431895:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4816
00000100:00080000:2.0:1767319976.432430:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319976.432470:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940658816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319976.432481:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940659072:0@lo:400:kworker.0
00000100:00080000:1.0:1767319976.433239:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319976.433245:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319976.433249:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940659200:0@lo:38:kworker.0
00000100:00100000:3.0:1767319976.433482:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658432
00000100:00100000:3.0:1767319976.433490:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658432
00000100:00100000:3.0:1767319976.433551:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209
00000100:00100000:3.0:1767319976.433559:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940658432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319976.433595:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319976.433694:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940658432:12345-0@lo:38:kworker.0 Request processed in 133us (3268us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319976.433700:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209
00000100:00100000:3.0:1767319976.434352:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658688
00000100:00100000:3.0:1767319976.434360:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658688
00000100:00100000:3.0:1767319976.434419:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940658560
00000100:00100000:3.0:1767319976.434423:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940658560
00000100:00100000:3.0:1767319976.434450:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121
00000100:00100000:3.0:1767319976.434460:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940658688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319976.434533:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940658688:12345-0@lo:400:kworker.0 Request processed in 76us (3149us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319976.434539:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121
00000100:00100000:3.0:1767319976.434552:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122
00000100:00100000:3.0:1767319976.434558:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940658560:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319976.434690:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319976.434696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319976.434819:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940658688:0@lo:400:kworker.0
00000100:00080000:2.0:1767319976.435392:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319976.435409:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319976.435413:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940658432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319976.436481:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940658560:12345-0@lo:400:kworker.0 Request processed in 1918us (5009us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319976.436492:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122
00000100:00100000:0.0:1767319976.437246:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940658560:0@lo:400:kworker.0
00000100:00100000:3.0:1767319977.132923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319977.392025:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319977.966103:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940659328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319977.966190:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319977.966343:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659328
00000100:00100000:2.0:1767319977.966352:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659328
00000100:00100000:3.0:1767319977.966442:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678
00000100:00100000:3.0:1767319977.966455:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940659328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319977.966512:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767319977.974207:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940659328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7538us (7799us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319977.974223:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678
00000100:00100000:0.0:1767319977.989836:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940659328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319978.057389:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319978.057650:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349184
00000100:00100000:3.0:1767319978.057661:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349184
00000100:00100000:3.0:1767319978.057847:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4817
00000100:00100000:3.0:1767319978.057861:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894349184:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767319978.057957:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894349184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (577us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319978.057966:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4817
00000100:00080000:0.0:1767319978.058646:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767319978.063261:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894348928 offset 0 length 520: 4
00000100:00100000:3.0:1767319978.063311:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319978.064924:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349056
00000100:00100000:1.0:1767319978.064938:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349056
00000100:00100000:1.0:1767319978.065038:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17502
00000100:00100000:1.0:1767319978.065046:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894349056:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319978.065071:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319978.065163:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894349056:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 116us (1851us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319978.065171:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17502
00000100:00100000:3.0:1767319978.156887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319978.414036:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319978.989194:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940659456:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319978.989271:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319978.990301:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659456
00000100:00100000:3.0:1767319978.990310:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659456
00000100:00100000:3.0:1767319978.990382:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679
00000100:00100000:3.0:1767319978.990398:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940659456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319978.990467:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767319978.990552:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940659456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (1280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319978.990559:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679
00000100:00100000:0.0:1767319978.990668:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940659456:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319978.991198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319979.182079:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319979.440813:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319980.205705:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319980.461016:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319981.228907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319981.485056:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319981.549111:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319981.549124:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319981.549127:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319981.549140:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319981.549145:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319981.549154:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5226
00000100:00080000:3.0:1767319981.549159:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319981.549166:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319981.549209:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38000 x1853163940659584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319981.549237:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319981.549240:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319981.549242:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319981.549245:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5226
00000100:00080000:3.0:1767319981.549287:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319981.549290:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319981.549304:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3b100 x1853163940659712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319981.549364:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319981.549368:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319981.549370:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319981.549373:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5226
00000100:00080000:3.0:1767319981.549375:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319981.549379:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319981.549387:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38e00 x1853163940660224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319981.549400:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319981.549403:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319981.549405:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319981.549408:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5226
00000100:00080000:3.0:1767319981.549410:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319981.549413:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319981.549422:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b800 x1853163940660480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319981.549448:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940660096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319981.549546:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319981.549725:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940659584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319981.549792:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940660352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319981.550056:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940659968:0@lo:400:kworker.0
00000100:00100000:2.0:1767319981.550091:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319981.550130:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940659840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319981.550172:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319981.550257:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659968
00000100:00100000:0.0:1767319981.550265:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659968
00000100:00100000:1.0:1767319981.550292:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659840
00000100:00100000:1.0:1767319981.550299:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659840
00000100:00100000:3.0:1767319981.550387:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660096
00000100:00100000:3.0:1767319981.550391:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660096
00000100:00100000:0.0:1767319981.550399:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123
00000100:00100000:0.0:1767319981.550415:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940659968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319981.550486:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940659968:12345-0@lo:400:kworker.0 Request processed in 78us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319981.550496:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123
00000100:00100000:0.0:1767319981.550536:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319981.550570:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660352
00000100:00100000:0.0:1767319981.550574:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660352
00000100:00100000:1.0:1767319981.553791:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124
00000100:00100000:1.0:1767319981.553808:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940659840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319981.553895:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940659840:12345-0@lo:400:kworker.0 Request processed in 93us (3722us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319981.553902:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124
00000100:00100000:1.0:1767319981.553966:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940659840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319981.553999:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319981.554032:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940659712:0@lo:38:kworker.0
00000100:00100000:1.0:1767319981.554059:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319981.554087:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940660224:0@lo:38:kworker.0
00000100:00100000:1.0:1767319981.554109:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319981.554126:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940660480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319981.554155:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319981.554186:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659712
00000100:00100000:1.0:1767319981.554193:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659712
00000100:00100000:1.0:1767319981.554216:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210
00000100:00100000:1.0:1767319981.554220:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940659712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319981.554241:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319981.554272:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940659712:12345-0@lo:38:kworker.0 Request processed in 50us (211us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319981.554278:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210
00000100:00100000:1.0:1767319981.554295:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940659584
00000100:00100000:1.0:1767319981.554299:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940659584
00000100:00100000:1.0:1767319981.554322:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660224
00000100:00100000:1.0:1767319981.554325:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660224
00000100:00100000:1.0:1767319981.554332:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660480
00000100:00100000:1.0:1767319981.554334:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660480
00000100:00100000:1.0:1767319981.554341:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17503
00000100:00100000:1.0:1767319981.554346:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940659584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319981.554355:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319981.554380:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940659584:12345-0@lo:38:kworker.0 Request processed in 33us (380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319981.554386:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17503
00000100:00100000:1.0:1767319981.554397:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17504
00000100:00100000:1.0:1767319981.554400:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940660224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319981.554408:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319981.554428:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940660224:12345-0@lo:38:kworker.0 Request processed in 27us (319us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319981.554434:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17504
00000100:00100000:1.0:1767319981.554444:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17505
00000100:00100000:1.0:1767319981.554447:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940660480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319981.554475:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319981.554499:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940660480:12345-0@lo:38:kworker.0 Request processed in 50us (343us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319981.554504:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17505
00000100:00080000:1.0:1767319981.554537:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319981.554543:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319981.554547:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940659584:0@lo:38:kworker.0
00000100:00080000:1.0:1767319981.554569:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319981.554573:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319981.554577:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940659712:0@lo:38:kworker.0
00000100:00080000:1.0:1767319981.554585:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319981.554588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319981.554591:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940660224:0@lo:38:kworker.0
00000100:00080000:1.0:1767319981.554598:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319981.554601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319981.554604:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940660480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319981.554682:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940659968:0@lo:400:kworker.0
00000100:00080000:2.0:1767319981.559388:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319981.559405:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319981.559409:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319981.561360:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4818
00000100:00100000:3.0:1767319981.561379:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940660096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319981.561501:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940660096:12345-0@lo:400:kworker.0 Request processed in 129us (11953us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319981.561508:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4818
00000100:00100000:0.0:1767319981.561523:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4819
00000100:00100000:0.0:1767319981.561535:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940660352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319981.561580:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940660352:12345-0@lo:400:kworker.0 Request processed in 49us (11042us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319981.561587:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4819
00000100:00100000:0.0:1767319981.561630:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940660352:0@lo:400:kworker.0
00000100:00100000:3.0:1767319981.565384:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940660096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319982.252919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319982.509082:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319983.088958:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940660608:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319983.089034:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319983.092684:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660608
00000100:00100000:1.0:1767319983.092701:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660608
00000100:00100000:1.0:1767319983.092908:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680
00000100:00100000:1.0:1767319983.092918:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940660608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319983.092955:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767319983.093047:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940660608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (4012us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319983.093055:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680
00000100:00100000:0.0:1767319983.096276:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940660608:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319983.096633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319983.175339:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319983.175435:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349440
00000100:00100000:1.0:1767319983.175446:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349440
00000100:00100000:1.0:1767319983.175547:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4820
00000100:00100000:1.0:1767319983.175558:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894349440:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319983.175650:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894349440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319983.175658:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4820
00000100:00080000:2.0:1767319983.175763:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319983.176200:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319983.176261:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349312
00000100:00100000:3.0:1767319983.176265:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349312
00000100:00100000:3.0:1767319983.176292:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17506
00000100:00100000:3.0:1767319983.176298:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894349312:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319983.176317:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319983.176355:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894349312:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (156us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319983.176362:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17506
00000100:00100000:3.0:1767319983.276910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319983.533316:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319984.109136:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940660736:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319984.109210:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319984.109340:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660736
00000100:00100000:3.0:1767319984.109349:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660736
00000100:00100000:3.0:1767319984.109421:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681
00000100:00100000:3.0:1767319984.109482:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940660736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319984.109512:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767319984.109583:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319984.110110:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940660736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 663us (898us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319984.110120:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681
00000100:00100000:1.0:1767319984.110242:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940660736:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319984.300919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319984.557079:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319985.325765:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319985.581050:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319986.348962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319986.605290:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319986.668988:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319961/real 1767319961]  req@ffff93d06d3e9180 x1853163940654336/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319986 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319986.669028:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d3e9180 x1853163940654336/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319986 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319986.669047:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319986.669067:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319986.669071:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940654336:0@lo:250:kworker.0
00000100:00080000:0.0:1767319986.669293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319986.669298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319986.669301:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319986.669306:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5211
00000100:00080000:0.0:1767319986.669310:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319986.669315:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319986.669494:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d195f80 x1853163940660864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319986.669518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319986.669521:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319986.669523:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319986.669526:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5231
00000100:00080000:0.0:1767319986.669528:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319986.669532:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319986.669566:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519a8e00 x1853163940660992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319986.669575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319986.669579:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319986.669580:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319986.669584:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5231
00000100:00080000:0.0:1767319986.669586:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319986.669589:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319986.669602:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940661120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319986.669659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319986.669663:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319986.669665:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319986.669669:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5231
00000100:00080000:0.0:1767319986.669671:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319986.669675:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319986.669701:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059500 x1853163940661632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319986.669718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319986.669721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319986.669723:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319986.669725:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5231
00000100:00080000:0.0:1767319986.669728:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319986.669732:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767319986.669753:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47058700 x1853163940661888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319986.669967:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940661504:0@lo:400:kworker.0
00000100:00100000:2.0:1767319986.670034:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319986.670098:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319986.670105:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940661760:0@lo:400:kworker.0
00000100:00100000:2.0:1767319986.670128:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319986.670273:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940661248:0@lo:400:kworker.0
00000100:00100000:3.0:1767319986.670307:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319986.670361:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661504
00000100:00100000:3.0:1767319986.670368:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661504
00000100:00100000:3.0:1767319986.670431:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661760
00000100:00100000:3.0:1767319986.670435:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661760
00000100:00100000:3.0:1767319986.670475:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4821
00000100:00100000:3.0:1767319986.670484:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940661504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319986.670539:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940661504:12345-0@lo:400:kworker.0 Request processed in 56us (505us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319986.670547:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4821
00000100:00100000:3.0:1767319986.670565:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4822
00000100:00100000:3.0:1767319986.670572:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940661760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319986.670598:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940661760:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319986.670604:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4822
00000100:00100000:3.0:1767319986.670647:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940661760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319986.670659:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940661504:0@lo:400:kworker.0
00000100:00080000:3.0:1767319986.670688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319986.670985:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940660864:0@lo:250:kworker.0
00000400:00000100:1.0:1767319986.671014:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940660864 offset 0 length 520: 4
00000100:00100000:1.0:1767319986.671034:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940660992:0@lo:38:kworker.0
00000100:00100000:1.0:1767319986.671057:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319986.671091:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940661120:0@lo:38:kworker.0
00000100:00100000:1.0:1767319986.671115:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319986.671133:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940661632:0@lo:38:kworker.0
00000100:00100000:1.0:1767319986.671153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319986.671168:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940661888:0@lo:38:kworker.0
00000100:00100000:1.0:1767319986.671188:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319986.671216:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661120
00000100:00100000:1.0:1767319986.671220:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661120
00000100:00100000:1.0:1767319986.671242:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211
00000100:00100000:1.0:1767319986.671247:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940661120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319986.671266:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319986.671300:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940661120:12345-0@lo:38:kworker.0 Request processed in 52us (184us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319986.671306:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211
00000100:00080000:1.0:1767319986.671503:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319986.671509:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319986.671513:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940661120:0@lo:38:kworker.0
00000100:00100000:2.0:1767319986.671592:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661248
00000100:00100000:2.0:1767319986.671597:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661248
00000100:00100000:2.0:1767319986.671642:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125
00000100:00100000:2.0:1767319986.671650:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940661248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319986.671689:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940661248:12345-0@lo:400:kworker.0 Request processed in 41us (1381us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319986.671695:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125
00000100:00100000:0.0:1767319986.672667:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940661376:0@lo:400:kworker.0
00000100:00100000:0.0:1767319986.672717:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319986.672893:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940660992
00000100:00100000:3.0:1767319986.672899:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940660992
00000100:00100000:3.0:1767319986.672930:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661632
00000100:00100000:3.0:1767319986.672933:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661632
00000100:00100000:3.0:1767319986.672949:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661888
00000100:00100000:3.0:1767319986.672952:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661888
00000100:00100000:3.0:1767319986.672969:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17507
00000100:00100000:3.0:1767319986.672974:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940660992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319986.672995:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319986.673036:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940660992:12345-0@lo:38:kworker.0 Request processed in 61us (1978us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319986.673043:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17507
00000100:00100000:3.0:1767319986.673057:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17508
00000100:00100000:3.0:1767319986.673061:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940661632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319986.673070:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319986.673105:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940661632:12345-0@lo:38:kworker.0 Request processed in 42us (1951us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319986.673110:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17508
00000100:00100000:3.0:1767319986.673122:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17509
00000100:00100000:3.0:1767319986.673126:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940661888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319986.673136:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319986.673160:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940661888:12345-0@lo:38:kworker.0 Request processed in 32us (1971us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319986.673166:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17509
00000100:00100000:3.0:1767319986.673221:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940661248:0@lo:400:kworker.0
00000100:00100000:2.0:1767319986.678234:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940661376
00000100:00100000:2.0:1767319986.678250:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940661376
00000100:00100000:2.0:1767319986.678338:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126
00000100:00100000:2.0:1767319986.678350:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940661376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319986.678463:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940661376:12345-0@lo:400:kworker.0 Request processed in 115us (5744us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319986.678470:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126
00000100:00080000:2.0:1767319986.678520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319986.678524:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319986.678570:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319986.678575:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319986.678580:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940660992:0@lo:38:kworker.0
00000100:00080000:2.0:1767319986.678594:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319986.678598:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319986.678601:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940661632:0@lo:38:kworker.0
00000100:00080000:2.0:1767319986.678613:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319986.678616:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319986.678619:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940661888:0@lo:38:kworker.0
00000100:00100000:3.0:1767319986.680147:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940661376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319987.374068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319987.629211:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319988.205141:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319988.205177:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940662016:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319988.205267:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319988.205633:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662016
00000100:00100000:2.0:1767319988.205642:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662016
00000100:00100000:2.0:1767319988.205714:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682
00000100:00100000:2.0:1767319988.205724:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940662016:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319988.205755:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319988.205839:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940662016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (571us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319988.205847:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682
00000100:00100000:1.0:1767319988.205939:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940662016:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319988.206014:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319988.296208:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767319988.296325:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319988.296661:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349696
00000100:00100000:1.0:1767319988.296678:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349696
00000100:00100000:1.0:1767319988.296811:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349568
00000100:00100000:1.0:1767319988.296814:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349568
00000100:00100000:1.0:1767319988.296833:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4823
00000100:00100000:1.0:1767319988.296844:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894349696:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319988.296937:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894349696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (748us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319988.296944:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4823
00000100:00100000:1.0:1767319988.296963:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17510
00000100:00100000:1.0:1767319988.296966:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894349568:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767319988.296991:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319988.297018:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894349568:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (693us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319988.297025:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17510
00000100:00080000:2.0:1767319988.299530:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319988.396969:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319988.653367:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319989.229529:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940662144:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319989.229629:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319989.230071:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662144
00000100:00100000:2.0:1767319989.230082:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662144
00000100:00100000:2.0:1767319989.230176:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683
00000100:00100000:2.0:1767319989.230186:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940662144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319989.230230:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767319989.230308:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940662144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (678us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319989.230317:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683
00000100:00080000:0.0:1767319989.230717:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319989.230769:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940662144:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319989.420935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319989.677047:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319990.445634:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319990.701415:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319991.468975:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319991.725466:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319991.790592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319991.790608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319991.790612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319991.790616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319991.790622:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319991.790634:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5236
00000100:00080000:3.0:1767319991.790641:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319991.790651:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319991.790708:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b100 x1853163940662272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319991.790817:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940662272:0@lo:38:kworker.0
00000100:00100000:2.0:1767319991.790926:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319991.791196:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662272
00000100:00100000:0.0:1767319991.791207:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662272
00000100:00100000:0.0:1767319991.791265:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17511
00000100:00100000:0.0:1767319991.791276:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940662272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319991.791306:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319991.791414:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319991.791419:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319991.791421:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319991.791425:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5236
00000100:00080000:3.0:1767319991.791427:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319991.791431:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319991.791445:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a300 x1853163940662400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319991.797996:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940662400:0@lo:38:kworker.0
00000100:00100000:2.0:1767319991.798113:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319991.798264:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662400
00000100:00100000:1.0:1767319991.798275:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662400
00000100:00100000:1.0:1767319991.798327:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212
00000100:00100000:1.0:1767319991.798336:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940662400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319991.798367:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319991.798430:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940662400:12345-0@lo:38:kworker.0 Request processed in 94us (317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319991.798438:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212
00000100:00100000:0.0:1767319991.800969:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940662272:12345-0@lo:38:kworker.0 Request processed in 9679us (10028us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319991.800989:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17511
00000100:00080000:3.0:1767319991.801403:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319991.801409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319991.801414:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319991.801419:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5236
00000100:00080000:3.0:1767319991.801424:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319991.801432:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319991.801457:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a680 x1853163940662912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319991.801481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319991.801484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319991.801486:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319991.801489:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5236
00000100:00080000:3.0:1767319991.801492:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319991.801495:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767319991.801505:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340aa00 x1853163940663168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319991.801545:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940662784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.801620:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319991.801668:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319991.801674:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940663040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.801698:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319991.801804:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940662528:0@lo:400:kworker.0
00000100:00100000:0.0:1767319991.801853:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319991.801889:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319991.801895:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940662656:0@lo:400:kworker.0
00000100:00100000:0.0:1767319991.801919:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319991.801958:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662784
00000100:00100000:0.0:1767319991.801967:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662784
00000100:00100000:0.0:1767319991.802025:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663040
00000100:00100000:0.0:1767319991.802028:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663040
00000100:00100000:0.0:1767319991.802057:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1767319991.802067:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940662784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319991.802129:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940662784:12345-0@lo:400:kworker.0 Request processed in 62us (508us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319991.802135:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1767319991.802151:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4825
00000100:00100000:0.0:1767319991.802157:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940663040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319991.802180:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940663040:12345-0@lo:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319991.802185:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4825
00000100:00080000:0.0:1767319991.802201:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319991.802245:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940663040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319991.802256:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940662784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.803125:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662528
00000100:00100000:3.0:1767319991.803134:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662528
00000100:00100000:3.0:1767319991.803207:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662656
00000100:00100000:3.0:1767319991.803211:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662656
00000100:00100000:3.0:1767319991.803245:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127
00000100:00100000:3.0:1767319991.803255:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940662528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.803324:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940662528:12345-0@lo:400:kworker.0 Request processed in 71us (1470us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319991.803332:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127
00000100:00100000:3.0:1767319991.803351:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128
00000100:00100000:3.0:1767319991.803357:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940662656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.803398:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940662656:12345-0@lo:400:kworker.0 Request processed in 41us (1478us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319991.803404:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128
00000100:00100000:3.0:1767319991.803448:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940662656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319991.803461:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940662528:0@lo:400:kworker.0
00000100:00080000:0.0:1767319991.804950:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319991.804962:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319991.806101:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319991.806116:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319991.806121:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940662272:0@lo:38:kworker.0
00000100:00100000:2.0:1767319991.806173:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940662912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319991.806260:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319991.806372:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940663168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319991.806408:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319991.806728:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319991.806734:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319991.806737:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940662400:0@lo:38:kworker.0
00000100:00100000:1.0:1767319991.807241:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940662912
00000100:00100000:1.0:1767319991.807251:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940662912
00000100:00100000:1.0:1767319991.807297:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663168
00000100:00100000:1.0:1767319991.807300:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663168
00000100:00100000:1.0:1767319991.807332:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17512
00000100:00100000:1.0:1767319991.807341:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940662912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319991.807369:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319991.807438:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940662912:12345-0@lo:38:kworker.0 Request processed in 96us (1177us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319991.807445:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17512
00000100:00100000:1.0:1767319991.807463:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17513
00000100:00100000:1.0:1767319991.807468:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940663168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319991.807477:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319991.807502:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940663168:12345-0@lo:38:kworker.0 Request processed in 33us (1093us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319991.807507:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17513
00000100:00080000:2.0:1767319991.807592:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319991.807597:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319991.807601:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940662912:0@lo:38:kworker.0
00000100:00080000:2.0:1767319991.807610:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319991.807614:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319991.807617:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940663168:0@lo:38:kworker.0
00000100:00100000:3.0:1767319992.492962:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319992.749501:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319993.333301:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319993.333337:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940663296:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319993.333467:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319993.333658:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663296
00000100:00100000:2.0:1767319993.333671:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663296
00000100:00100000:2.0:1767319993.333839:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684
00000100:00100000:2.0:1767319993.333854:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940663296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319993.333899:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767319993.333953:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940663296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (487us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319993.333962:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684
00000100:00080000:0.0:1767319993.334181:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319993.334490:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940663296:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319993.417054:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767319993.417579:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349952
00000100:00100000:1.0:1767319993.417596:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349952
00000100:00100000:1.0:1767319993.417703:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4826
00000100:00080000:0.0:1767319993.417870:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319993.418044:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894349952:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767319993.418159:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894349952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 445us (1123us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319993.418168:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4826
00000100:00100000:0.0:1767319993.418508:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319993.419052:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894349824
00000100:00100000:3.0:1767319993.419061:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894349824
00000100:00100000:3.0:1767319993.419107:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17514
00000100:00100000:3.0:1767319993.419114:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894349824:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767319993.419142:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319993.419206:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894349824:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 90us (697us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319993.419213:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17514
00000100:00100000:3.0:1767319993.517061:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319993.773959:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319994.354016:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319994.354055:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940663424:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319994.354191:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319994.354476:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663424
00000100:00100000:0.0:1767319994.354489:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663424
00000100:00100000:0.0:1767319994.354590:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685
00000100:00100000:0.0:1767319994.354600:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940663424:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319994.354644:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319994.354696:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940663424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (506us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319994.354704:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685
00000100:00100000:3.0:1767319994.355028:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940663424:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319994.355120:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319994.542121:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319994.797237:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319995.565514:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319995.827958:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319996.590612:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319996.850510:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319996.913837:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319996.913850:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319996.913853:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319996.913857:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319996.913862:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319996.913870:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5241
00000100:00080000:2.0:1767319996.913875:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319996.913884:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319996.913929:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839500 x1853163940663552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319996.913946:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319996.913950:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319996.913952:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319996.913955:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5241
00000100:00080000:2.0:1767319996.913957:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319996.913960:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319996.913973:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940663680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319996.914051:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319996.914054:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319996.914056:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319996.914060:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5241
00000100:00080000:2.0:1767319996.914062:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319996.914066:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319996.914077:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a300 x1853163940664192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319996.914091:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319996.914094:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319996.914096:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319996.914100:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5241
00000100:00080000:2.0:1767319996.914102:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319996.914106:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767319996.914115:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839180 x1853163940664448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319996.914173:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940663936:0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.914246:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319996.914319:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319996.914326:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940663808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.914365:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319996.914391:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940664320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.914416:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319996.914434:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319996.914439:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940664064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.914459:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319996.914487:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663936
00000100:00100000:2.0:1767319996.914494:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663936
00000100:00100000:2.0:1767319996.914549:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663808
00000100:00100000:2.0:1767319996.914552:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663808
00000100:00100000:2.0:1767319996.914574:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129
00000100:00100000:2.0:1767319996.914583:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940663936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319996.914819:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664320
00000100:00100000:1.0:1767319996.914825:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664320
00000100:00100000:1.0:1767319996.914879:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664064
00000100:00100000:1.0:1767319996.914884:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664064
00000100:00100000:3.0:1767319996.914893:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130
00000100:00100000:1.0:1767319996.914917:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4827
00000100:00100000:3.0:1767319996.914926:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940663808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319996.914935:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940664320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.915215:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940663936:12345-0@lo:400:kworker.0 Request processed in 55us (390us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319996.915224:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129
00000100:00080000:2.0:1767319996.915249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319996.915255:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319996.915257:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319996.915289:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940663936:0@lo:400:kworker.0
00000100:00100000:2.0:1767319996.915320:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4828
00000100:00100000:2.0:1767319996.915338:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940664064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319996.918515:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940663552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319996.919005:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940664320:12345-0@lo:400:kworker.0 Request processed in 4075us (4583us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319996.919020:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4827
00000100:00100000:1.0:1767319996.919935:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940664320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319996.920714:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319996.920751:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940663808:12345-0@lo:400:kworker.0 Request processed in 5833us (6371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319996.920754:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940664064:12345-0@lo:400:kworker.0 Request processed in 5421us (6288us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319996.920767:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663552
00000100:00100000:3.0:1767319996.920802:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130
00000100:00100000:0.0:1767319996.920803:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663552
00000100:00100000:2.0:1767319996.920812:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4828
00000100:00100000:0.0:1767319996.920854:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17515
00000100:00100000:0.0:1767319996.920863:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940663552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319996.920886:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319996.920891:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940664064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319996.920933:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940663552:12345-0@lo:38:kworker.0 Request processed in 71us (221us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319996.920940:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17515
00000100:00080000:0.0:1767319996.920976:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319996.920983:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319996.920988:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940663552:0@lo:38:kworker.0
00000100:00100000:0.0:1767319996.921001:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940663680:0@lo:38:kworker.0
00000100:00100000:1.0:1767319996.921020:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940663808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319996.921043:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319996.921077:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940664192:0@lo:38:kworker.0
00000100:00100000:0.0:1767319996.921104:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319996.921199:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940664448:0@lo:38:kworker.0
00000100:00100000:0.0:1767319996.921227:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319996.921248:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940663680
00000100:00100000:2.0:1767319996.921254:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940663680
00000100:00100000:2.0:1767319996.921285:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213
00000100:00100000:2.0:1767319996.921290:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940663680:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319996.921303:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319996.921348:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940663680:12345-0@lo:38:kworker.0 Request processed in 56us (307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319996.921353:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213
00000100:00080000:0.0:1767319996.927834:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319996.927849:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319996.927853:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940663680:0@lo:38:kworker.0
00000100:00100000:1.0:1767319996.930175:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664192
00000100:00100000:1.0:1767319996.930191:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664192
00000100:00100000:1.0:1767319996.930314:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664448
00000100:00100000:1.0:1767319996.930319:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664448
00000100:00100000:1.0:1767319996.930406:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17516
00000100:00100000:1.0:1767319996.930414:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940664192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319996.930438:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319996.930461:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17517
00000100:00100000:3.0:1767319996.930470:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940664448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319996.930485:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319996.930529:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940664192:12345-0@lo:38:kworker.0 Request processed in 113us (9425us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319996.930537:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940664448:12345-0@lo:38:kworker.0 Request processed in 66us (9309us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319996.930539:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17516
00000100:00100000:3.0:1767319996.930549:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17517
00000100:00080000:1.0:1767319996.930606:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319996.930611:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319996.930614:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940664192:0@lo:38:kworker.0
00000100:00080000:3.0:1767319996.930672:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319996.930678:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319996.930681:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940664448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319997.612914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767319997.869343:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319998.445086:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940664576:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319998.445159:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.445594:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664576
00000100:00100000:0.0:1767319998.445603:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664576
00000100:00100000:0.0:1767319998.445725:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686
00000100:00100000:0.0:1767319998.445736:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940664576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319998.445768:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767319998.445859:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940664576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319998.445871:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686
00000100:00100000:3.0:1767319998.445932:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940664576:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319998.446218:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319998.538006:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767319998.538105:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767319998.538872:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350208
00000100:00100000:3.0:1767319998.538885:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350208
00000100:00100000:3.0:1767319998.539107:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350080
00000100:00100000:3.0:1767319998.539111:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350080
00000100:00100000:3.0:1767319998.539140:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4829
00000100:00100000:3.0:1767319998.539152:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894350208:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767319998.539570:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17518
00000100:00100000:0.0:1767319998.539577:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894350080:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767319998.539598:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319998.539659:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894350080:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 80us (1553us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319998.539666:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17518
00000100:00100000:3.0:1767319998.540599:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894350208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1445us (2598us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319998.540608:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4829
00000100:00080000:2.0:1767319998.541844:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319998.640764:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767319998.892986:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319999.469574:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319999.477797:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940664704:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319999.477870:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319999.478804:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664704
00000100:00100000:0.0:1767319999.478816:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664704
00000100:00100000:0.0:1767319999.478898:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687
00000100:00100000:0.0:1767319999.478907:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940664704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319999.478939:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767319999.479011:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940664704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1141us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319999.479026:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687
00000100:00100000:3.0:1767319999.479080:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940664704:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319999.479614:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319999.660907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767319999.917347:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320000.686473:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320000.941027:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320001.708908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320001.966335:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320002.029971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320002.029984:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320002.029987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320002.029992:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320002.029996:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320002.030005:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5246
00000100:00080000:3.0:1767320002.030010:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320002.030018:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320002.030062:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409500 x1853163940664832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320002.030103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320002.030107:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320002.030109:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320002.030113:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5246
00000100:00080000:3.0:1767320002.030116:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320002.030120:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320002.030135:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073408e00 x1853163940664960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320002.030217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320002.030221:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320002.030222:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320002.030226:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5246
00000100:00080000:3.0:1767320002.030229:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320002.030232:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320002.030244:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b100 x1853163940665472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320002.030258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320002.030262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320002.030263:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320002.030266:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5246
00000100:00080000:3.0:1767320002.030269:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320002.030272:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320002.030294:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b480 x1853163940665728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320002.030325:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940665344:0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.030327:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940665088:0@lo:400:kworker.0
00000100:00100000:0.0:1767320002.030418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940664832:0@lo:38:kworker.0
00000100:00100000:2.0:1767320002.030434:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940665216:0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.034758:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320002.034915:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940665600:0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.034961:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320002.035010:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665600
00000100:00100000:1.0:1767320002.035019:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665600
00000100:00100000:1.0:1767320002.035089:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4830
00000100:00100000:1.0:1767320002.035100:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940665600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.035153:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940665600:12345-0@lo:400:kworker.0 Request processed in 56us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320002.035160:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4830
00000100:00100000:1.0:1767320002.035222:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940665600:0@lo:400:kworker.0
00000100:00080000:1.0:1767320002.035254:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320002.035272:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665088
00000100:00100000:1.0:1767320002.035276:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665088
00000100:00100000:1.0:1767320002.035477:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131
00000100:00100000:1.0:1767320002.035485:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940665088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.035525:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940665088:12345-0@lo:400:kworker.0 Request processed in 41us (775us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320002.035531:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131
00000100:00080000:1.0:1767320002.035549:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320002.035566:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940665088:0@lo:400:kworker.0
00000100:00100000:3.0:1767320002.038226:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320002.038414:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665344
00000100:00100000:1.0:1767320002.038426:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665344
00000100:00100000:1.0:1767320002.038509:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4831
00000100:00100000:1.0:1767320002.038519:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940665344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.039128:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940665344:12345-0@lo:400:kworker.0 Request processed in 609us (907us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320002.039137:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4831
00000100:00100000:0.0:1767320002.040809:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320002.040848:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940664960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320002.040883:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320002.040918:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940665472:0@lo:38:kworker.0
00000100:00100000:0.0:1767320002.040940:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320002.040957:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940665728:0@lo:38:kworker.0
00000100:00080000:3.0:1767320002.041491:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320002.041546:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940665344:0@lo:400:kworker.0
00000100:00100000:3.0:1767320002.041614:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664960
00000100:00100000:3.0:1767320002.041620:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664960
00000100:00100000:3.0:1767320002.041660:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214
00000100:00100000:3.0:1767320002.041667:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940664960:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320002.041669:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940664832
00000100:00100000:1.0:1767320002.041676:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940664832
00010000:00020000:3.0:1767320002.041692:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320002.041706:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665472
00000100:00100000:1.0:1767320002.041710:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665472
00000100:00100000:1.0:1767320002.041730:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17519
00000100:00100000:1.0:1767320002.041737:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940664832:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320002.041746:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940664960:12345-0@lo:38:kworker.0 Request processed in 77us (860us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767320002.041749:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320002.041759:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214
00000100:00100000:1.0:1767320002.041808:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940664832:12345-0@lo:38:kworker.0 Request processed in 69us (1006us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320002.041816:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17519
00000100:00100000:1.0:1767320002.041831:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17520
00000100:00100000:1.0:1767320002.041835:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940665472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320002.041844:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320002.041868:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940665472:12345-0@lo:38:kworker.0 Request processed in 31us (927us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320002.041873:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17520
00000100:00100000:2.0:1767320002.041940:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320002.042053:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665216
00000100:00100000:1.0:1767320002.042058:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665216
00000100:00100000:0.0:1767320002.042158:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320002.042191:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132
00000100:00100000:1.0:1767320002.042198:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940665216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320002.042242:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940665216:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320002.042248:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132
00000100:00080000:3.0:1767320002.042327:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320002.042357:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940665216:0@lo:400:kworker.0
00000100:00080000:0.0:1767320002.042416:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320002.042422:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320002.042426:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940664832:0@lo:38:kworker.0
00000100:00080000:0.0:1767320002.042436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320002.042439:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320002.042443:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940664960:0@lo:38:kworker.0
00000100:00080000:0.0:1767320002.042451:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320002.042454:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320002.042457:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940665472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320002.042522:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665728
00000100:00100000:2.0:1767320002.042527:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665728
00000100:00100000:2.0:1767320002.042562:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17521
00000100:00100000:2.0:1767320002.042567:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940665728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320002.042580:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320002.042655:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940665728:12345-0@lo:38:kworker.0 Request processed in 86us (497us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320002.042662:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17521
00000100:00080000:0.0:1767320002.044329:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320002.044339:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320002.044343:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940665728:0@lo:38:kworker.0
00000100:00100000:3.0:1767320002.733110:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320002.989042:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320003.565115:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940665856:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320003.565190:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.565451:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665856
00000100:00100000:0.0:1767320003.565461:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665856
00000100:00100000:0.0:1767320003.565526:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688
00000100:00100000:0.0:1767320003.565537:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940665856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320003.565569:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320003.565623:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940665856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (432us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320003.565630:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688
00000100:00100000:2.0:1767320003.565719:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940665856:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320003.655018:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320003.655117:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350592
00000100:00100000:2.0:1767320003.655127:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350592
00000100:00100000:2.0:1767320003.655533:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4832
00000100:00100000:2.0:1767320003.655544:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894350592:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320003.655616:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894350592:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (607us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320003.655621:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4832
00000100:00080000:3.0:1767320003.656595:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767320003.665929:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894350336 offset 0 length 520: 4
00000100:00100000:0.0:1767320003.665993:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320003.666482:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350464
00000100:00100000:2.0:1767320003.666491:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350464
00000100:00100000:2.0:1767320003.666539:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17522
00000100:00100000:2.0:1767320003.666548:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894350464:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320003.666573:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320003.666667:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894350464:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 119us (672us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320003.666672:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17522
00000100:00100000:3.0:1767320003.756996:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320004.016830:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320004.589060:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940665984:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320004.589131:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320004.589349:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940665984
00000100:00100000:0.0:1767320004.589358:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940665984
00000100:00100000:0.0:1767320004.589422:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689
00000100:00100000:0.0:1767320004.589432:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940665984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320004.589461:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767320004.589976:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320004.590114:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940665984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 683us (981us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320004.590122:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689
00000100:00100000:3.0:1767320004.590193:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940665984:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320004.781817:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320005.037052:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320005.808031:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320006.061091:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320006.828917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320007.088602:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320007.148872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320007.148885:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320007.148889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320007.148894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320007.148899:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320007.148908:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5252
00000100:00080000:3.0:1767320007.148912:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320007.148920:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320007.148965:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a300 x1853163940666112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320007.148995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320007.149000:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320007.149001:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320007.149005:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5252
00000100:00080000:3.0:1767320007.149007:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320007.149011:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320007.149028:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b480 x1853163940666240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320007.149039:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940666112:0@lo:38:kworker.0
00000100:00100000:0.0:1767320007.149114:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320007.149125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320007.149130:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320007.149142:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320007.149180:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940666240:0@lo:38:kworker.0
00000100:00100000:0.0:1767320007.149215:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320007.149276:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666240
00000100:00080000:3.0:1767320007.149283:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5252
00000100:00100000:0.0:1767320007.149284:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666240
00000100:00080000:3.0:1767320007.149289:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320007.149294:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320007.149311:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340aa00 x1853163940666752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320007.149320:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215
00000100:00100000:0.0:1767320007.149328:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940666240:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767320007.149339:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320007.149343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320007.149345:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320007.149348:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5252
00000100:00080000:3.0:1767320007.149351:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320007.149355:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320007.149366:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940667008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320007.149390:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940666624:0@lo:400:kworker.0
00000100:00100000:3.0:1767320007.149423:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320007.149443:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320007.149449:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940666880:0@lo:400:kworker.0
00000100:00100000:3.0:1767320007.149471:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767320007.149599:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320007.149635:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940666240:12345-0@lo:38:kworker.0 Request processed in 306us (419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320007.149643:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215
00000100:00100000:0.0:1767320007.149665:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940666752:0@lo:38:kworker.0
00000100:00100000:0.0:1767320007.149684:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320007.149713:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940667008:0@lo:38:kworker.0
00000100:00100000:0.0:1767320007.149729:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320007.149753:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320007.149757:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320007.149761:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940666240:0@lo:38:kworker.0
00000100:00100000:3.0:1767320007.149833:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666112
00000100:00100000:3.0:1767320007.149838:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666112
00000100:00100000:3.0:1767320007.149866:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666624
00000100:00100000:3.0:1767320007.149870:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666624
00000100:00100000:3.0:1767320007.149899:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666880
00000100:00100000:3.0:1767320007.149903:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666880
00000100:00100000:3.0:1767320007.149919:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666752
00000100:00100000:3.0:1767320007.149921:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666752
00000100:00100000:3.0:1767320007.149929:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667008
00000100:00100000:3.0:1767320007.149931:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667008
00000100:00100000:3.0:1767320007.149940:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4833
00000100:00100000:3.0:1767320007.149946:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940666624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320007.149980:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4834
00000100:00100000:0.0:1767320007.149992:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940666880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320007.149999:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940666624:12345-0@lo:400:kworker.0 Request processed in 52us (574us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320007.150007:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4833
00000100:00100000:3.0:1767320007.150027:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17523
00000100:00100000:0.0:1767320007.150030:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940666880:12345-0@lo:400:kworker.0 Request processed in 40us (556us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320007.150036:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940666112:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320007.150043:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4834
00010000:00020000:3.0:1767320007.150052:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320007.150064:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17524
00000100:00100000:0.0:1767320007.150070:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940666752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320007.150081:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320007.150089:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940666112:12345-0@lo:38:kworker.0 Request processed in 53us (975us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320007.150109:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940666752:12345-0@lo:38:kworker.0 Request processed in 36us (422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320007.150113:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17523
00000100:00100000:0.0:1767320007.150122:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17524
00000100:00100000:0.0:1767320007.150136:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17525
00000100:00100000:2.0:1767320007.150224:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940666496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320007.150264:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320007.150289:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320007.150294:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940666368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320007.150310:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320007.150441:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940667008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320007.150452:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320007.150475:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940667008:12345-0@lo:38:kworker.0 Request processed in 34us (745us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320007.151031:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666496
00000100:00100000:1.0:1767320007.151038:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666496
00000100:00100000:1.0:1767320007.151077:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940666368
00000100:00100000:1.0:1767320007.151080:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940666368
00000100:00100000:1.0:1767320007.151102:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133
00000100:00100000:1.0:1767320007.151109:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940666496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320007.151152:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940666496:12345-0@lo:400:kworker.0 Request processed in 43us (887us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320007.151159:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133
00000100:00100000:1.0:1767320007.151172:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134
00000100:00100000:1.0:1767320007.151178:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940666368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320007.151205:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940666368:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320007.151213:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134
00000100:00100000:1.0:1767320007.151434:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940666368:0@lo:400:kworker.0
00000100:00100000:1.0:1767320007.151444:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940666496:0@lo:400:kworker.0
00000100:00080000:1.0:1767320007.151493:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320007.151498:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320007.151501:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940666752:0@lo:38:kworker.0
00000100:00080000:1.0:1767320007.151509:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320007.151512:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320007.151514:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940667008:0@lo:38:kworker.0
00000100:00080000:1.0:1767320007.151523:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320007.151526:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320007.151529:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940666112:0@lo:38:kworker.0
00000100:00100000:1.0:1767320007.151578:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940666880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320007.151589:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940666624:0@lo:400:kworker.0
00000100:00080000:1.0:1767320007.151613:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320007.151617:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320007.151619:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320007.170278:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17525
00000100:00100000:3.0:1767320007.853052:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320008.109002:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320008.686918:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940667136:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320008.687008:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.687095:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667136
00000100:00100000:0.0:1767320008.687106:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667136
00000100:00100000:0.0:1767320008.687168:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690
00000100:00100000:0.0:1767320008.687179:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940667136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320008.687231:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320008.687288:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940667136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (279us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320008.687296:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690
00000100:00100000:3.0:1767320008.687946:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940667136:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320008.778601:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320008.778698:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320008.778822:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350848
00000100:00100000:1.0:1767320008.778832:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350848
00000100:00100000:1.0:1767320008.778905:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350720
00000100:00100000:1.0:1767320008.778908:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350720
00000100:00100000:1.0:1767320008.778932:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4835
00000100:00100000:1.0:1767320008.778943:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894350848:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320008.779020:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894350848:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (430us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320008.779028:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4835
00000100:00100000:1.0:1767320008.779047:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17526
00000100:00100000:1.0:1767320008.779051:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894350720:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320008.779071:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320008.779097:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894350720:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (399us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320008.779103:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17526
00000100:00080000:3.0:1767320008.779638:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320008.879497:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320009.133106:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320009.709920:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320009.710303:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940667264:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320009.710381:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320009.710702:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667264
00000100:00100000:1.0:1767320009.710713:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667264
00000100:00100000:1.0:1767320009.710885:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691
00000100:00100000:1.0:1767320009.710894:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940667264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320009.710931:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320009.710985:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940667264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (603us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320009.710992:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691
00000100:00100000:1.0:1767320009.711053:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940667264:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320009.711416:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320009.901004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320010.157044:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320010.927388:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320011.181023:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320011.244874:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319986/real 1767319986]  req@ffff93d06d195f80 x1853163940660864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320011.244911:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d06d195f80 x1853163940660864/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320011.244933:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320011.244957:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320011.244961:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940660864:0@lo:250:kworker.0
00000100:00080000:2.0:1767320011.244984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320011.244991:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320011.244995:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320011.245000:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5236
00000100:00080000:2.0:1767320011.245005:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320011.245012:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320011.245044:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839500 x1853163940667392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320011.245080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320011.245085:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320011.245087:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320011.245091:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5257
00000100:00080000:2.0:1767320011.245103:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320011.245107:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320011.245124:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838e00 x1853163940667520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320011.245133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320011.245136:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320011.245138:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320011.245141:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5257
00000100:00080000:2.0:1767320011.245143:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320011.245147:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320011.245159:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940667648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320011.245248:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940667776:0@lo:400:kworker.0
00000100:00100000:3.0:1767320011.245334:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320011.245343:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940667392:0@lo:250:kworker.0
00000400:00000100:1.0:1767320011.245373:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940667392 offset 0 length 520: 4
00000100:00100000:0.0:1767320011.245441:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667776
00000100:00100000:0.0:1767320011.245450:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667776
00000100:00100000:0.0:1767320011.245517:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135
00000100:00100000:0.0:1767320011.245527:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940667776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.245594:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940667776:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320011.245604:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135
00000100:00080000:2.0:1767320011.245620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320011.245624:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320011.245626:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320011.245631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320011.245631:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5257
00000100:00080000:2.0:1767320011.245634:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320011.245639:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320011.245647:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940667904:0@lo:400:kworker.0
00000100:00100000:2.0:1767320011.245654:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b800 x1853163940668160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320011.245674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320011.245678:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320011.245680:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320011.245684:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5257
00000100:00080000:2.0:1767320011.245687:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320011.245689:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320011.245695:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320011.245709:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839f80 x1853163940668416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320011.245716:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667904
00000100:00100000:0.0:1767320011.245721:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667904
00000100:00100000:2.0:1767320011.245748:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940668288:0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.245751:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136
00000100:00100000:0.0:1767320011.245761:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940667904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320011.245810:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320011.245841:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668288
00000100:00100000:0.0:1767320011.245843:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940667904:12345-0@lo:400:kworker.0 Request processed in 82us (154us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320011.245845:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668288
00000100:00100000:0.0:1767320011.245854:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136
00000100:00080000:0.0:1767320011.245881:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320011.245885:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4836
00000100:00080000:0.0:1767320011.245886:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320011.245897:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940668288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.245923:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940668032:0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.245950:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320011.245980:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940668288:12345-0@lo:400:kworker.0 Request processed in 86us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320011.245984:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668032
00000100:00100000:2.0:1767320011.245988:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4836
00000100:00100000:0.0:1767320011.245989:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668032
00000100:00100000:0.0:1767320011.246029:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4837
00000100:00100000:0.0:1767320011.246036:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940668032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.246079:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940668032:12345-0@lo:400:kworker.0 Request processed in 43us (128us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320011.246084:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4837
00000100:00080000:0.0:1767320011.246099:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320011.246348:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940667776:0@lo:400:kworker.0
00000100:00100000:0.0:1767320011.246532:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940667904:0@lo:400:kworker.0
00000100:00100000:2.0:1767320011.247250:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940668032:0@lo:400:kworker.0
00000100:00100000:3.0:1767320011.247982:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940668288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320011.248237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940667520:0@lo:38:kworker.0
00000100:00100000:1.0:1767320011.248917:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320011.249031:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940667648:0@lo:38:kworker.0
00000100:00100000:1.0:1767320011.249076:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320011.249121:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940668160:0@lo:38:kworker.0
00000100:00100000:1.0:1767320011.249144:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320011.249205:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667648
00000100:00100000:3.0:1767320011.249213:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667648
00000100:00100000:3.0:1767320011.249257:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216
00000100:00100000:3.0:1767320011.249264:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940667648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320011.249296:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320011.249334:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940667648:12345-0@lo:38:kworker.0 Request processed in 70us (258us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320011.249341:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216
00000100:00100000:1.0:1767320011.254275:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940668416:0@lo:38:kworker.0
00000100:00100000:1.0:1767320011.254352:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320011.261034:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940667520
00000100:00100000:0.0:1767320011.261050:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940667520
00000100:00100000:0.0:1767320011.261133:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668160
00000100:00100000:0.0:1767320011.261137:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668160
00000100:00100000:0.0:1767320011.261173:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17527
00000100:00100000:0.0:1767320011.261181:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940667520:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320011.261210:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17528
00010000:00020000:0.0:1767320011.261216:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320011.261221:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940668160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320011.261234:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320011.261393:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668416
00000100:00100000:2.0:1767320011.261397:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668416
00000100:00100000:2.0:1767320011.261419:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17529
00000100:00100000:2.0:1767320011.261422:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940668416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320011.261430:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320011.265132:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940668160:12345-0@lo:38:kworker.0 Request processed in 3903us (15977us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320011.265150:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17528
00000100:00080000:1.0:1767320011.265317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320011.265324:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320011.265328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940667648:0@lo:38:kworker.0
00000100:00080000:1.0:1767320011.265357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320011.265361:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320011.265364:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940668160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320011.268310:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940667520:12345-0@lo:38:kworker.0 Request processed in 7119us (19384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320011.268326:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17527
00000100:00080000:1.0:1767320011.269257:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320011.269264:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320011.269267:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940667520:0@lo:38:kworker.0
00000100:00100000:2.0:1767320011.271400:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940668416:12345-0@lo:38:kworker.0 Request processed in 9965us (17037us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320011.271418:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17529
00000100:00080000:1.0:1767320011.271533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320011.271540:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320011.271545:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940668416:0@lo:38:kworker.0
00000100:00100000:3.0:1767320011.948956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320012.205005:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320012.973660:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320013.233574:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320013.805231:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320013.805255:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940668544:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320013.805336:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320013.805419:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668544
00000100:00100000:0.0:1767320013.805426:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668544
00000100:00100000:0.0:1767320013.805714:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692
00000100:00100000:0.0:1767320013.805724:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940668544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320013.805763:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320013.806408:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940668544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (507us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320013.806417:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692
00000100:00100000:0.0:1767320013.806677:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940668544:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320013.807385:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320013.899993:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320013.900398:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894350976
00000100:00100000:2.0:1767320013.900411:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894350976
00000100:00100000:2.0:1767320013.900492:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17530
00000100:00100000:2.0:1767320013.900502:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894350976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320013.900531:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320013.900614:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894350976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 112us (639us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320013.900623:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17530
00000100:00100000:1.0:1767320013.904442:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320013.904640:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351104
00000100:00100000:0.0:1767320013.904652:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351104
00000100:00100000:0.0:1767320013.904739:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4838
00000100:00100000:0.0:1767320013.904750:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894351104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320013.904897:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894351104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 149us (466us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320013.904905:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4838
00000100:00080000:3.0:1767320013.905336:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320013.996901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320014.253076:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320014.829300:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320014.829325:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940668672:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320014.829395:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320014.830195:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668672
00000100:00100000:0.0:1767320014.830207:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668672
00000100:00100000:0.0:1767320014.830284:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693
00000100:00100000:0.0:1767320014.830294:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940668672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320014.830328:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320014.830391:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940668672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (996us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320014.830398:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693
00000100:00100000:2.0:1767320014.830528:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940668672:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320014.831187:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320015.025694:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320015.279289:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320016.045207:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320016.302251:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320016.365963:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320016.365975:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320016.365979:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320016.365982:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320016.365987:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320016.365995:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5261
00000100:00080000:2.0:1767320016.366000:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320016.366006:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320016.366049:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac700 x1853163940668800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320016.366077:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320016.366081:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320016.366083:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320016.366087:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5261
00000100:00080000:2.0:1767320016.366091:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320016.366094:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320016.366109:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac380 x1853163940668928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320016.366181:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767320016.366185:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940669184:0@lo:400:kworker.0
00000100:00080000:2.0:1767320016.366186:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320016.366190:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320016.366196:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5261
00000100:00080000:2.0:1767320016.366198:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320016.366202:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320016.366215:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940669440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320016.366233:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320016.366236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320016.366238:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320016.366242:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5261
00000100:00080000:2.0:1767320016.366245:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320016.366248:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320016.366262:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940669696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320016.366267:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320016.366275:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940669056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320016.366289:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940669312:0@lo:400:kworker.0
00000100:00100000:0.0:1767320016.366310:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320016.366320:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320016.366341:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320016.366346:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940669568:0@lo:400:kworker.0
00000100:00100000:0.0:1767320016.366353:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669184
00000100:00100000:0.0:1767320016.366360:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669184
00000100:00100000:2.0:1767320016.366368:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320016.366408:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669056
00000100:00100000:0.0:1767320016.366412:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669056
00000100:00100000:1.0:1767320016.366417:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940668800:0@lo:38:kworker.0
00000100:00100000:0.0:1767320016.366441:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137
00000100:00100000:0.0:1767320016.366449:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940669184:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320016.366474:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320016.366478:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320016.366499:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940669184:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320016.366517:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669312
00000100:00100000:3.0:1767320016.366522:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669312
00000100:00100000:3.0:1767320016.366568:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669568
00000100:00100000:3.0:1767320016.366572:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669568
00000100:00100000:3.0:1767320016.366597:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4839
00000100:00100000:3.0:1767320016.366604:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940669312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320016.366656:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940669312:12345-0@lo:400:kworker.0 Request processed in 53us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320016.366663:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4839
00000100:00100000:3.0:1767320016.366680:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4840
00000100:00100000:3.0:1767320016.366686:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940669568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320016.366714:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940669568:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320016.366719:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4840
00000100:00080000:3.0:1767320016.366741:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320016.366767:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940669568:0@lo:400:kworker.0
00000100:00100000:3.0:1767320016.366795:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940669312:0@lo:400:kworker.0
00000100:00100000:1.0:1767320016.374875:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138
00000100:00100000:1.0:1767320016.374907:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940669056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320016.375239:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137
00000100:00100000:3.0:1767320016.375355:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940669184:0@lo:400:kworker.0
00000100:00100000:1.0:1767320016.375395:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940669056:12345-0@lo:400:kworker.0 Request processed in 504us (9082us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320016.375404:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138
00000100:00100000:3.0:1767320016.375430:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940669056:0@lo:400:kworker.0
00000100:00100000:1.0:1767320016.375446:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320016.375472:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668800
00000100:00100000:1.0:1767320016.375477:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940668928:0@lo:38:kworker.0
00000100:00100000:3.0:1767320016.375480:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668800
00000100:00100000:1.0:1767320016.375513:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320016.375519:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17531
00000100:00100000:3.0:1767320016.375536:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940668800:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320016.375538:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940668928
00000100:00100000:1.0:1767320016.375543:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940668928
00010000:00020000:3.0:1767320016.375557:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320016.375565:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217
00000100:00100000:1.0:1767320016.375570:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940668928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320016.375583:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320016.375596:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940668800:12345-0@lo:38:kworker.0 Request processed in 68us (149us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320016.375604:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17531
00000100:00100000:1.0:1767320016.375614:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940668928:12345-0@lo:38:kworker.0 Request processed in 41us (101us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320016.375625:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217
00000100:00080000:1.0:1767320016.375658:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320016.375663:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320016.375666:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940668928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320016.375673:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940669440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320016.378224:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320016.378266:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940669696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320016.378303:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320016.378378:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320016.378383:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320016.378388:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940668800:0@lo:38:kworker.0
00000100:00100000:3.0:1767320016.378809:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669440
00000100:00100000:3.0:1767320016.378816:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669440
00000100:00100000:3.0:1767320016.378854:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669696
00000100:00100000:3.0:1767320016.378856:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669696
00000100:00100000:3.0:1767320016.378878:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17532
00000100:00100000:3.0:1767320016.378886:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940669440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320016.378910:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320016.378967:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940669440:12345-0@lo:38:kworker.0 Request processed in 80us (749us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320016.378974:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17532
00000100:00100000:3.0:1767320016.379088:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17533
00000100:00100000:3.0:1767320016.379092:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940669696:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320016.379103:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320016.379129:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940669696:12345-0@lo:38:kworker.0 Request processed in 35us (825us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320016.379139:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17533
00000100:00080000:1.0:1767320016.379824:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320016.379829:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320016.379834:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940669440:0@lo:38:kworker.0
00000100:00080000:1.0:1767320016.379844:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320016.379848:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320016.379850:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940669696:0@lo:38:kworker.0
00000100:00100000:2.0:1767320017.068924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320017.325111:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320018.092948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320018.349178:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320018.925815:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940669824:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320018.925888:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320018.926045:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669824
00000100:00100000:1.0:1767320018.926053:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669824
00000100:00100000:1.0:1767320018.926120:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694
00000100:00100000:1.0:1767320018.926142:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940669824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320018.926257:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320018.926309:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940669824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (421us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320018.926318:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694
00000100:00100000:1.0:1767320018.926365:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940669824:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320018.926436:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320019.015435:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320019.015483:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320019.015796:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351360
00000100:00100000:2.0:1767320019.015807:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351360
00000100:00100000:2.0:1767320019.015896:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351232
00000100:00100000:2.0:1767320019.015900:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351232
00000100:00100000:2.0:1767320019.015921:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4841
00000100:00100000:2.0:1767320019.015931:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894351360:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320019.016011:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894351360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (586us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320019.016019:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4841
00000100:00100000:2.0:1767320019.016036:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17534
00000100:00100000:2.0:1767320019.016040:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894351232:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320019.016059:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320019.016099:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894351232:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (615us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320019.016105:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17534
00000100:00080000:3.0:1767320019.017118:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320019.117904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320019.373405:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320019.949239:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940669952:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320019.949317:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320019.949462:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940669952
00000100:00100000:2.0:1767320019.949471:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940669952
00000100:00100000:2.0:1767320019.949540:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695
00000100:00100000:2.0:1767320019.949549:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940669952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320019.949578:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320019.949623:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940669952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (306us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320019.949630:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695
00000100:00080000:0.0:1767320019.949689:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320019.949725:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940669952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320020.140851:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320020.396976:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320021.168024:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320021.421011:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320021.485115:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320021.485126:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320021.485129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320021.485133:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320021.485138:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320021.485146:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5266
00000100:00080000:3.0:1767320021.485150:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320021.485157:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320021.485196:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45d88a80 x1853163940670080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320021.485229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320021.485232:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320021.485234:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320021.485238:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5266
00000100:00080000:3.0:1767320021.485240:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320021.485243:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320021.485263:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940670208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320021.485343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320021.485346:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320021.485348:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320021.485352:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5266
00000100:00080000:3.0:1767320021.485356:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320021.485360:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320021.485372:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519aea00 x1853163940670720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320021.485375:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940670464:0@lo:400:kworker.0
00000100:00080000:3.0:1767320021.485395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320021.485399:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320021.485400:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320021.485404:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5266
00000100:00080000:3.0:1767320021.485406:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320021.485409:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320021.485431:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af480 x1853163940670976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320021.485456:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940670592:0@lo:400:kworker.0
00000100:00100000:0.0:1767320021.485481:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320021.485556:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940670080:0@lo:38:kworker.0
00000100:00100000:2.0:1767320021.485560:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940670336:0@lo:400:kworker.0
00000100:00100000:3.0:1767320021.491209:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320021.491822:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320021.491837:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940670848:0@lo:400:kworker.0
00000100:00100000:3.0:1767320021.491894:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320021.491951:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670592
00000100:00100000:3.0:1767320021.491959:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670592
00000100:00100000:0.0:1767320021.492159:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670848
00000100:00100000:0.0:1767320021.492165:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670848
00000100:00100000:1.0:1767320021.492243:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320021.492276:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940670208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320021.492628:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320021.492649:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940670720:0@lo:38:kworker.0
00000100:00100000:1.0:1767320021.492671:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320021.492691:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940670976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320021.492711:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320021.492749:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670080
00000100:00100000:1.0:1767320021.492753:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670080
00000100:00100000:1.0:1767320021.492801:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670720
00000100:00100000:1.0:1767320021.492805:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670720
00000100:00100000:1.0:1767320021.492813:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670976
00000100:00100000:1.0:1767320021.492815:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670976
00000100:00100000:1.0:1767320021.492827:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17535
00000100:00100000:1.0:1767320021.492835:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320021.492855:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320021.492897:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670080:12345-0@lo:38:kworker.0 Request processed in 62us (654us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320021.492904:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17535
00000100:00100000:1.0:1767320021.492919:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17536
00000100:00100000:1.0:1767320021.492923:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320021.492932:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320021.492953:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670720:12345-0@lo:38:kworker.0 Request processed in 29us (281us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320021.492958:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17536
00000100:00100000:1.0:1767320021.492969:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17537
00000100:00100000:1.0:1767320021.492974:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670976:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320021.494167:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4842
00000100:00100000:3.0:1767320021.494182:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940670592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320021.494248:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940670592:12345-0@lo:400:kworker.0 Request processed in 72us (3047us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320021.494254:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4842
00010000:00020000:1.0:1767320021.494335:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320021.494363:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940670976:12345-0@lo:38:kworker.0 Request processed in 1388us (1651us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320021.494370:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17537
00000100:00100000:1.0:1767320021.494390:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670208
00000100:00100000:1.0:1767320021.494396:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670208
00000100:00100000:1.0:1767320021.494413:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218
00000100:00100000:1.0:1767320021.494417:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940670208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320021.494426:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320021.494449:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940670208:12345-0@lo:38:kworker.0 Request processed in 31us (1822us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320021.494454:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218
00000100:00080000:1.0:1767320021.495210:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320021.495216:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320021.495220:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940670080:0@lo:38:kworker.0
00000100:00080000:1.0:1767320021.495229:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320021.495232:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320021.495235:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940670208:0@lo:38:kworker.0
00000100:00080000:1.0:1767320021.495244:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320021.495247:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320021.495250:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940670720:0@lo:38:kworker.0
00000100:00080000:1.0:1767320021.495257:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320021.495260:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320021.495263:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940670976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320021.495341:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670464
00000100:00100000:1.0:1767320021.495344:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670464
00000100:00100000:2.0:1767320021.496240:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320021.496337:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940670592:0@lo:400:kworker.0
00000100:00100000:2.0:1767320021.496365:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940670336
00000100:00100000:2.0:1767320021.496369:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940670336
00000100:00100000:0.0:1767320021.504888:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4843
00000100:00100000:0.0:1767320021.504904:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940670848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320021.505021:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940670848:12345-0@lo:400:kworker.0 Request processed in 121us (13125us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320021.505029:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4843
00000100:00100000:0.0:1767320021.505096:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940670848:0@lo:400:kworker.0
00000100:00080000:3.0:1767320021.515228:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320021.515239:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320021.515243:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320021.516852:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139
00000100:00100000:2.0:1767320021.516869:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940670336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320021.516970:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940670336:12345-0@lo:400:kworker.0 Request processed in 107us (20733us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320021.516978:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139
00000100:00100000:2.0:1767320021.517032:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940670336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320021.522765:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140
00000100:00100000:3.0:1767320021.523245:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940670464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320021.523360:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940670464:12345-0@lo:400:kworker.0 Request processed in 194us (37878us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320021.523369:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140
00000100:00100000:1.0:1767320021.523953:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940670464:0@lo:400:kworker.0
00000100:00100000:2.0:1767320022.189556:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320022.445629:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320023.212907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320023.469866:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320024.045072:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320024.045106:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940671104:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320024.045184:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320024.045289:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671104
00000100:00100000:0.0:1767320024.045298:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671104
00000100:00100000:0.0:1767320024.045369:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696
00000100:00100000:0.0:1767320024.045380:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940671104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320024.045415:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320024.045470:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940671104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (285us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320024.045477:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696
00000100:00080000:3.0:1767320024.045550:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320024.045576:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940671104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320024.134626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320024.134685:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320024.134818:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351616
00000100:00100000:1.0:1767320024.134829:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351616
00000100:00100000:1.0:1767320024.134920:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351488
00000100:00100000:1.0:1767320024.134924:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351488
00000100:00100000:1.0:1767320024.134942:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4844
00000100:00100000:1.0:1767320024.134953:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894351616:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320024.135042:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894351616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320024.135050:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4844
00000100:00100000:1.0:1767320024.135069:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17538
00000100:00100000:1.0:1767320024.135073:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894351488:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320024.135125:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320024.135171:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894351488:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 87us (477us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320024.135178:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17538
00000100:00080000:2.0:1767320024.135567:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320024.236881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320024.496840:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320025.069373:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320025.069396:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940671232:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320025.069477:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320025.069808:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671232
00000100:00100000:1.0:1767320025.069817:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671232
00000100:00100000:1.0:1767320025.069878:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697
00000100:00100000:1.0:1767320025.069889:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940671232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320025.069936:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320025.069993:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940671232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (515us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320025.070001:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697
00000100:00100000:0.0:1767320025.071332:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940671232:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320025.077564:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320025.262513:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320025.517152:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320026.285270:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320026.541101:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320026.604960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320026.604971:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320026.604974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320026.604978:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320026.604982:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320026.604990:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5271
00000100:00080000:3.0:1767320026.604995:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320026.605002:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320026.605040:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838e00 x1853163940671360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320026.605080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320026.605084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320026.605086:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320026.605090:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5271
00000100:00080000:3.0:1767320026.605092:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320026.605095:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320026.605108:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b800 x1853163940671488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320026.605153:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940671360:0@lo:38:kworker.0
00000100:00080000:3.0:1767320026.605173:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320026.605178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320026.605180:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320026.605184:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5271
00000100:00080000:3.0:1767320026.605186:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320026.605191:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320026.605204:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940672000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320026.605222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320026.605225:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320026.605227:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320026.605233:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320026.605246:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5271
00000100:00080000:3.0:1767320026.605249:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320026.605253:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320026.605267:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073412d80 x1853163940672256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320026.605290:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940671488:0@lo:38:kworker.0
00000100:00100000:3.0:1767320026.605295:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940672128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320026.605328:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320026.605335:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320026.605355:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940672000:0@lo:38:kworker.0
00000100:00100000:3.0:1767320026.605362:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320026.605370:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940671872:0@lo:400:kworker.0
00000100:00100000:3.0:1767320026.605399:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320026.605413:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940671616:0@lo:400:kworker.0
00000100:00100000:0.0:1767320026.605445:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320026.605452:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671360
00000100:00100000:3.0:1767320026.605460:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671360
00000100:00100000:0.0:1767320026.605474:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320026.605482:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940671744:0@lo:400:kworker.0
00000100:00100000:3.0:1767320026.605492:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672128
00000100:00100000:3.0:1767320026.605495:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672128
00000100:00100000:0.0:1767320026.605508:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320026.605536:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671872
00000100:00100000:3.0:1767320026.605540:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671872
00000100:00100000:0.0:1767320026.605553:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671488
00000100:00100000:0.0:1767320026.605560:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671488
00000100:00100000:3.0:1767320026.605569:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4845
00000100:00100000:3.0:1767320026.605579:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940672128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320026.605588:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219
00000100:00100000:0.0:1767320026.605595:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940671488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320026.605615:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320026.605628:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940672128:12345-0@lo:400:kworker.0 Request processed in 50us (293us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320026.605635:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4845
00000100:00100000:3.0:1767320026.605662:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4846
00000100:00100000:3.0:1767320026.605668:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940671872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320026.605694:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940671872:12345-0@lo:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320026.605700:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4846
00000100:00100000:3.0:1767320026.605711:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17539
00000100:00100000:3.0:1767320026.605715:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940671360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320026.605724:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320026.605751:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940671488:12345-0@lo:38:kworker.0 Request processed in 154us (422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320026.605759:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940671360:12345-0@lo:38:kworker.0 Request processed in 41us (529us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320026.605762:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219
00000100:00100000:3.0:1767320026.605797:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17539
00000100:00100000:0.0:1767320026.605825:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671616
00000100:00100000:0.0:1767320026.605830:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671616
00000100:00100000:3.0:1767320026.605832:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940671744
00000100:00100000:3.0:1767320026.605837:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940671744
00000100:00100000:0.0:1767320026.605861:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141
00000100:00100000:3.0:1767320026.605870:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142
00000100:00100000:0.0:1767320026.605874:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940671616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320026.605882:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940671744:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320026.606011:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320026.606017:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320026.606082:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940671872:0@lo:400:kworker.0
00000100:00100000:2.0:1767320026.606094:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940672128:0@lo:400:kworker.0
00000100:00100000:2.0:1767320026.606136:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320026.606231:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672000
00000100:00100000:1.0:1767320026.606236:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672000
00000100:00100000:1.0:1767320026.606259:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17540
00000100:00100000:1.0:1767320026.606264:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940672000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320026.606275:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320026.609439:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940671744:12345-0@lo:400:kworker.0 Request processed in 3546us (3918us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320026.609455:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142
00000100:00100000:3.0:1767320026.609598:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940671744:0@lo:400:kworker.0
00000100:00100000:3.0:1767320026.609611:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940671616:0@lo:400:kworker.0
00000100:00100000:0.0:1767320026.609734:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940671616:12345-0@lo:400:kworker.0 Request processed in 3862us (4286us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320026.609742:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141
00000100:00100000:2.0:1767320026.610736:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940672256:0@lo:38:kworker.0
00000100:00100000:2.0:1767320026.610822:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320026.610855:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320026.610860:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320026.610863:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940671360:0@lo:38:kworker.0
00000100:00080000:2.0:1767320026.610876:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320026.610879:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320026.610882:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940671488:0@lo:38:kworker.0
00000100:00100000:1.0:1767320026.611179:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940672000:12345-0@lo:38:kworker.0 Request processed in 4911us (5039us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320026.611189:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17540
00000100:00100000:1.0:1767320026.611212:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672256
00000100:00100000:1.0:1767320026.611217:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672256
00000100:00100000:1.0:1767320026.611251:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17541
00000100:00100000:1.0:1767320026.611257:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940672256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320026.611282:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320026.611311:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940672256:12345-0@lo:38:kworker.0 Request processed in 54us (490us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320026.611316:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17541
00000100:00080000:0.0:1767320026.611396:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320026.611401:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320026.611404:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940672000:0@lo:38:kworker.0
00000100:00080000:0.0:1767320026.611412:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320026.611414:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320026.611417:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940672256:0@lo:38:kworker.0
00000100:00100000:2.0:1767320027.308902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320027.566289:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767320028.231282:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894351744 offset 0 length 520: 4
00000100:00100000:3.0:1767320028.231325:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320028.231364:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320028.232420:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894351872
00000100:00100000:2.0:1767320028.232439:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894351872
00000100:00100000:2.0:1767320028.232495:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352000
00000100:00100000:2.0:1767320028.232498:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352000
00000100:00100000:2.0:1767320028.232557:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4847
00000100:00100000:2.0:1767320028.232567:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894352000:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320028.232655:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894352000:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (1290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320028.232663:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4847
00000100:00100000:2.0:1767320028.232680:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17542
00000100:00100000:2.0:1767320028.232684:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894351872:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320028.232712:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320028.232733:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894351872:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (1408us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320028.232738:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17542
00000100:00080000:0.0:1767320028.233217:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320028.333396:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320028.589005:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320029.166523:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940672384:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320029.166612:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320029.167811:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672384
00000100:00100000:0.0:1767320029.167823:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672384
00000100:00080000:2.0:1767320029.167901:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320029.171435:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698
00000100:00100000:0.0:1767320029.171458:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940672384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320029.171492:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320029.171691:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940672384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 244us (5078us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320029.171698:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698
00000100:00100000:3.0:1767320029.178086:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940672384:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320029.356894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320029.613554:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320030.189978:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940672512:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320030.190064:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320030.190271:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672512
00000100:00100000:1.0:1767320030.190282:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672512
00000100:00100000:1.0:1767320030.190344:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699
00000100:00100000:1.0:1767320030.190353:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940672512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320030.190385:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767320030.190509:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320030.191040:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940672512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 687us (974us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320030.191049:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699
00000100:00100000:2.0:1767320030.198931:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940672512:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320030.380896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320030.637718:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320031.404886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320031.661540:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320031.725407:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320031.725421:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320031.725425:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320031.725431:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320031.725436:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320031.725448:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320031.725454:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320031.725464:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320031.725516:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411180 x1853163940672640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320031.725543:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320031.725548:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320031.725551:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320031.725554:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320031.725556:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320031.725560:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320031.725577:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411f80 x1853163940672768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320031.725658:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320031.725662:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320031.725663:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320031.725667:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320031.725669:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320031.725674:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320031.725687:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47171f80 x1853163940673280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320031.725695:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940672640:0@lo:38:kworker.0
00000100:00080000:3.0:1767320031.725703:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320031.725706:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320031.725708:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320031.725711:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320031.725713:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320031.725716:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320031.725725:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170e00 x1853163940673536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320031.725748:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940673152:0@lo:400:kworker.0
00000100:00100000:1.0:1767320031.725886:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940672896:0@lo:400:kworker.0
00000100:00100000:2.0:1767320031.725948:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940673024:0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.730249:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320031.730336:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320031.730350:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940673408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.730388:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320031.730436:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673152
00000100:00100000:3.0:1767320031.730446:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673152
00000100:00100000:3.0:1767320031.730523:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673408
00000100:00100000:3.0:1767320031.730526:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673408
00000100:00100000:3.0:1767320031.730556:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4848
00000100:00100000:3.0:1767320031.730565:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940673152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.731532:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940673152:12345-0@lo:400:kworker.0 Request processed in 963us (1285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320031.731544:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4848
00000100:00100000:3.0:1767320031.731572:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4849
00000100:00100000:3.0:1767320031.732355:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940673408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.732408:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940673408:12345-0@lo:400:kworker.0 Request processed in 66us (2020us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320031.732414:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4849
00000100:00100000:3.0:1767320031.732485:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940673408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.732498:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940673152:0@lo:400:kworker.0
00000100:00080000:3.0:1767320031.732660:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320031.733343:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.733389:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940672768:0@lo:38:kworker.0
00000100:00100000:0.0:1767320031.733426:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.733460:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940673280:0@lo:38:kworker.0
00000100:00100000:0.0:1767320031.733483:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.733503:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940673536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320031.733526:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.733566:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672768
00000100:00100000:0.0:1767320031.733575:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672768
00000100:00100000:0.0:1767320031.733609:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220
00000100:00100000:0.0:1767320031.733617:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940672768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320031.733639:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320031.733678:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940672768:12345-0@lo:38:kworker.0 Request processed in 60us (251us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320031.733685:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220
00000100:00100000:0.0:1767320031.733707:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672640
00000100:00100000:0.0:1767320031.733712:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672640
00000100:00100000:3.0:1767320031.733926:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673280
00000100:00100000:3.0:1767320031.734073:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673280
00000100:00100000:3.0:1767320031.734103:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673536
00000100:00100000:3.0:1767320031.734106:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673536
00000100:00100000:3.0:1767320031.734124:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17543
00000100:00100000:3.0:1767320031.734129:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940673280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320031.734140:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320031.734174:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940673280:12345-0@lo:38:kworker.0 Request processed in 44us (690us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320031.734180:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17543
00000100:00100000:3.0:1767320031.734194:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17544
00000100:00100000:3.0:1767320031.734197:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940673536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320031.734207:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320031.734230:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940673536:12345-0@lo:38:kworker.0 Request processed in 30us (703us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320031.734235:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17544
00000100:00080000:3.0:1767320031.734300:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320031.734305:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320031.734309:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940673280:0@lo:38:kworker.0
00000100:00080000:3.0:1767320031.734317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320031.734320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320031.734323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940673536:0@lo:38:kworker.0
00000100:00080000:3.0:1767320031.734331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320031.734334:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320031.734337:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940672768:0@lo:38:kworker.0
00000100:00100000:0.0:1767320031.735913:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17545
00000100:00100000:0.0:1767320031.735925:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940672640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320031.736037:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320031.736155:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940672640:12345-0@lo:38:kworker.0 Request processed in 228us (2811us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320031.736164:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17545
00000100:00080000:0.0:1767320031.736235:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320031.736241:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320031.736246:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940672640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320031.738116:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.739225:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940672896
00000100:00100000:0.0:1767320031.739237:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940672896
00000100:00100000:0.0:1767320031.739337:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143
00000100:00100000:0.0:1767320031.739349:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940672896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320031.739441:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940672896:12345-0@lo:400:kworker.0 Request processed in 94us (1329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320031.739447:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143
00000100:00080000:3.0:1767320031.739563:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320031.739711:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320031.743153:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673024
00000100:00100000:0.0:1767320031.743169:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673024
00000100:00100000:0.0:1767320031.743235:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144
00000100:00100000:0.0:1767320031.743245:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940673024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320031.743802:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940673024:12345-0@lo:400:kworker.0 Request processed in 556us (4090us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320031.743813:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144
00000100:00100000:0.0:1767320031.743895:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940672896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320031.745463:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940673024:0@lo:400:kworker.0
00000100:00100000:2.0:1767320032.429431:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320032.685536:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320033.359117:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320033.359583:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352128
00000100:00100000:3.0:1767320033.359594:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352128
00000100:00100000:3.0:1767320033.359649:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17546
00000100:00100000:3.0:1767320033.359658:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894352128:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320033.359682:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320033.359756:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894352128:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 98us (650us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320033.359764:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17546
00000100:00100000:1.0:1767320033.360044:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320033.360109:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352256
00000100:00100000:0.0:1767320033.360113:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352256
00000100:00100000:0.0:1767320033.360175:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4850
00000100:00100000:0.0:1767320033.360182:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894352256:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320033.360221:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894352256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 41us (178us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320033.360227:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4850
00000100:00080000:3.0:1767320033.360822:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320033.454118:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320033.710251:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320034.287543:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940673664:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320034.287626:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320034.287766:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673664
00000100:00100000:1.0:1767320034.287796:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673664
00000100:00100000:1.0:1767320034.287859:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700
00000100:00100000:1.0:1767320034.287869:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940673664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320034.287913:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767320034.288465:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320034.292117:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940673664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4240us (4480us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320034.292133:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700
00000100:00100000:0.0:1767320034.294091:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940673664:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320034.477188:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320034.737206:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320035.309067:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940673792:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320035.309315:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320035.309352:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673792
00000100:00100000:0.0:1767320035.309362:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673792
00000100:00100000:0.0:1767320035.309424:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701
00000100:00100000:0.0:1767320035.309434:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940673792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320035.309471:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320035.309515:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320035.311956:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940673792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2512us (2630us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320035.311973:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701
00000100:00100000:3.0:1767320035.312657:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940673792:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320035.500972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320035.757007:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320036.524929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320036.781751:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320036.845295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320036.845305:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320036.845308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320036.845311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320036.845316:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320036.845325:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5281
00000100:00080000:0.0:1767320036.845329:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320036.845336:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320036.845376:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340aa00 x1853163940673920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320036.845392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320036.845395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320036.845396:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320036.845399:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5281
00000100:00080000:0.0:1767320036.845401:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320036.845404:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320036.845415:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073408e00 x1853163940674048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320036.845477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320036.845480:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320036.845482:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320036.845484:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5281
00000100:00080000:0.0:1767320036.845487:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320036.845490:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320036.845499:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940674560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320036.845511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320036.845514:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320036.845515:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320036.845518:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5281
00000100:00080000:0.0:1767320036.845521:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320036.845524:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320036.845532:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac700 x1853163940674816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320036.845602:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940674304:0@lo:400:kworker.0
00000100:00100000:2.0:1767320036.845675:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320036.845751:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320036.845757:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940674176:0@lo:400:kworker.0
00000100:00100000:2.0:1767320036.845803:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320036.845875:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674304
00000100:00100000:0.0:1767320036.845883:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674304
00000100:00100000:3.0:1767320036.846117:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320011/real 1767320011]  req@ffff93cf51839500 x1853163940667392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320036 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320036.846138:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51839500 x1853163940667392/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320036 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320036.846151:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940673920:0@lo:38:kworker.0
00000100:00100000:3.0:1767320036.846181:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320036.846199:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940674048:0@lo:38:kworker.0
00000100:00100000:3.0:1767320036.846221:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320036.846243:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940674560:0@lo:38:kworker.0
00000100:00100000:3.0:1767320036.846266:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320036.846285:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940674816:0@lo:38:kworker.0
00000100:00100000:3.0:1767320036.846305:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320036.846321:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320036.846337:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320036.846341:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940667392:0@lo:250:kworker.0
00000100:00100000:1.0:1767320036.846352:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940674432:0@lo:400:kworker.0
00000100:00100000:3.0:1767320036.846376:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674048
00000100:00100000:3.0:1767320036.846382:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674048
00000100:00100000:1.0:1767320036.846388:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320036.846416:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221
00000100:00100000:1.0:1767320036.846417:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320036.846426:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940674048:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320036.846428:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940674688:0@lo:400:kworker.0
00010000:00020000:3.0:1767320036.846450:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320036.846457:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320036.846493:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940673920
00000100:00100000:1.0:1767320036.846498:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940673920
00000100:00100000:3.0:1767320036.846499:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940674048:12345-0@lo:38:kworker.0 Request processed in 73us (276us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320036.846508:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221
00000100:00100000:1.0:1767320036.846527:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674560
00000100:00100000:1.0:1767320036.846531:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674560
00000100:00100000:3.0:1767320036.846536:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674816
00000100:00100000:3.0:1767320036.846541:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674816
00000100:00100000:1.0:1767320036.846543:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674432
00000100:00100000:1.0:1767320036.846547:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674432
00000100:00100000:3.0:1767320036.846558:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674688
00000100:00100000:3.0:1767320036.846562:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674688
00000100:00100000:1.0:1767320036.846587:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4851
00000100:00100000:3.0:1767320036.846593:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4852
00000100:00100000:1.0:1767320036.846598:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940674432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320036.846605:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940674688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320036.846656:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940674432:12345-0@lo:400:kworker.0 Request processed in 58us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320036.846661:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940674688:12345-0@lo:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320036.846670:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4851
00000100:00100000:0.0:1767320036.846704:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940674176
00000100:00100000:0.0:1767320036.846709:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940674176
00000100:00100000:2.0:1767320036.849197:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145
00000100:00100000:2.0:1767320036.849221:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940674304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320036.849308:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940674304:12345-0@lo:400:kworker.0 Request processed in 99us (3632us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320036.849315:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145
00000100:00100000:2.0:1767320036.849335:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146
00000100:00100000:2.0:1767320036.849341:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940674176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320036.849364:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940674176:12345-0@lo:400:kworker.0 Request processed in 23us (3561us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320036.849369:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146
00000100:00100000:2.0:1767320036.849713:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940674176:0@lo:400:kworker.0
00000100:00100000:2.0:1767320036.849727:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940674304:0@lo:400:kworker.0
00000100:00100000:3.0:1767320036.850010:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4852
00000100:00100000:1.0:1767320036.850021:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17547
00000100:00100000:3.0:1767320036.850037:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17548
00000100:00100000:1.0:1767320036.850043:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940673920:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320036.850045:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940674560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320036.850070:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767320036.850074:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320036.850130:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940673920:12345-0@lo:38:kworker.0 Request processed in 88us (3947us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320036.850133:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940674560:12345-0@lo:38:kworker.0 Request processed in 87us (3864us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320036.850144:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17548
00000100:00100000:3.0:1767320036.850157:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17549
00000100:00100000:3.0:1767320036.850161:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940674816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320036.850170:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320036.850195:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940674816:12345-0@lo:38:kworker.0 Request processed in 32us (3889us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320036.850200:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17549
00000100:00080000:3.0:1767320036.850234:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320036.850239:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320036.850243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940673920:0@lo:38:kworker.0
00000100:00080000:3.0:1767320036.850255:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320036.850258:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320036.850260:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940674048:0@lo:38:kworker.0
00000100:00080000:3.0:1767320036.850267:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320036.850270:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320036.850273:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940674560:0@lo:38:kworker.0
00000100:00080000:3.0:1767320036.850280:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320036.850282:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320036.850285:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940674816:0@lo:38:kworker.0
00000100:00080000:3.0:1767320036.850313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320036.850318:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320036.850320:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320036.850324:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5261
00000100:00080000:3.0:1767320036.850328:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320036.850332:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320036.850357:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411180 x1853163940674944/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320036.850394:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940674944:0@lo:250:kworker.0
00000100:00100000:1.0:1767320036.850416:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17547
00000400:00000100:3.0:1767320036.850421:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940674944 offset 0 length 520: 4
00000100:00080000:1.0:1767320036.850446:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320036.850453:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320036.850484:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940674688:0@lo:400:kworker.0
00000100:00100000:1.0:1767320036.850498:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940674432:0@lo:400:kworker.0
00000100:00100000:2.0:1767320037.551388:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320037.806137:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320038.470136:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320038.470225:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352512
00000100:00100000:0.0:1767320038.470237:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352512
00000100:00100000:0.0:1767320038.470321:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4853
00000100:00100000:0.0:1767320038.470330:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894352512:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767320038.470398:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320038.470423:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894352512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320038.470431:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4853
00000100:00100000:2.0:1767320038.471564:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320038.471823:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352384
00000100:00100000:3.0:1767320038.471832:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352384
00000100:00100000:3.0:1767320038.471870:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17550
00000100:00100000:3.0:1767320038.471878:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894352384:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320038.471907:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320038.471985:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894352384:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 105us (427us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320038.471992:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17550
00000100:00100000:2.0:1767320038.572907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320038.832226:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320039.405156:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940675072:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320039.405236:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320039.405519:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675072
00000100:00100000:0.0:1767320039.405527:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675072
00000100:00100000:0.0:1767320039.405611:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702
00000100:00100000:0.0:1767320039.405621:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940675072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320039.405651:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767320039.405721:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320039.407034:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940675072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1409us (1791us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320039.407046:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702
00000100:00100000:1.0:1767320039.408099:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940675072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320039.596902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320039.855403:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320040.429220:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940675200:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320040.429323:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320040.429707:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675200
00000100:00100000:0.0:1767320040.429719:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675200
00000100:00100000:0.0:1767320040.429865:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703
00000100:00100000:0.0:1767320040.429876:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940675200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320040.429916:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320040.430002:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940675200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (679us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320040.430011:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703
00000100:00100000:1.0:1767320040.430105:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940675200:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320040.433304:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320040.621396:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320040.878123:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320041.644960:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320041.900969:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320041.965060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320041.965073:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320041.965076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320041.965080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320041.965087:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320041.965095:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320041.965100:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320041.965108:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320041.965513:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ad500 x1853163940675328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320041.965561:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940675328:0@lo:38:kworker.0
00000100:00100000:3.0:1767320041.965619:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320041.965696:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675328
00000100:00100000:0.0:1767320041.965703:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675328
00000100:00100000:0.0:1767320041.965738:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17551
00000100:00100000:0.0:1767320041.965744:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940675328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320041.965766:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320041.965869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320041.965873:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320041.965875:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320041.965877:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320041.965880:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320041.965883:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320041.965899:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af800 x1853163940675456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320041.973443:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940675456:0@lo:38:kworker.0
00000100:00100000:0.0:1767320041.973464:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940675328:12345-0@lo:38:kworker.0 Request processed in 7715us (7840us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320041.973477:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17551
00000100:00100000:3.0:1767320041.973641:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320041.973698:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320041.973704:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320041.973707:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940675328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320041.973795:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675456
00000100:00100000:0.0:1767320041.973803:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675456
00000100:00100000:0.0:1767320041.973834:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222
00000100:00100000:0.0:1767320041.973841:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940675456:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320041.973862:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320041.973909:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940675456:12345-0@lo:38:kworker.0 Request processed in 67us (268us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320041.973915:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222
00000100:00080000:3.0:1767320041.973947:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320041.973952:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320041.973955:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940675456:0@lo:38:kworker.0
00000100:00100000:2.0:1767320041.975018:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940675584:0@lo:400:kworker.0
00000100:00080000:1.0:1767320041.975034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320041.975038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320041.975041:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320041.975045:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320041.975049:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320041.975055:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320041.975067:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320041.975076:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9180 x1853163940675968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320041.975096:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320041.975099:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320041.975101:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320041.975105:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320041.975107:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320041.975111:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320041.975121:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9f80 x1853163940676224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320041.975126:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940675840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320041.975142:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940676096:0@lo:400:kworker.0
00000100:00100000:0.0:1767320041.975167:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320041.975270:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940675712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320041.975277:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675584
00000100:00100000:2.0:1767320041.975283:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675584
00000100:00100000:3.0:1767320041.975297:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320041.975332:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675712
00000100:00100000:3.0:1767320041.975336:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675712
00000100:00100000:2.0:1767320041.975341:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147
00000100:00100000:2.0:1767320041.975347:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940675584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320041.975359:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148
00000100:00100000:3.0:1767320041.975364:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940675712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320041.975392:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940675584:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320041.975392:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940675712:12345-0@lo:400:kworker.0 Request processed in 26us (93us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320041.975398:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148
00000100:00100000:2.0:1767320041.975401:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147
00000100:00080000:2.0:1767320041.975417:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320041.975432:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940675584:0@lo:400:kworker.0
00000100:00100000:3.0:1767320041.975432:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940675712:0@lo:400:kworker.0
00000100:00100000:3.0:1767320041.975451:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940675968:0@lo:38:kworker.0
00000100:00100000:3.0:1767320041.975474:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320041.975498:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940676224:0@lo:38:kworker.0
00000100:00100000:3.0:1767320041.975515:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320041.975542:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675840
00000100:00100000:3.0:1767320041.975546:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675840
00000100:00100000:3.0:1767320041.975577:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940675968
00000100:00100000:3.0:1767320041.975580:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940675968
00000100:00100000:2.0:1767320041.975583:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676224
00000100:00100000:2.0:1767320041.975585:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676224
00000100:00100000:3.0:1767320041.975595:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854
00000100:00100000:3.0:1767320041.975601:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940675840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320041.975602:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17552
00000100:00100000:2.0:1767320041.975607:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940675968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320041.975623:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320041.975630:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940675840:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320041.975635:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854
00000100:00100000:3.0:1767320041.975647:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17553
00000100:00100000:3.0:1767320041.975651:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940676224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320041.975660:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320041.975740:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940675968:12345-0@lo:38:kworker.0 Request processed in 129us (263us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320041.975747:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320041.975747:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17552
00000100:00100000:2.0:1767320041.975758:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676096
00000100:00100000:2.0:1767320041.975761:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676096
00000100:00100000:2.0:1767320041.975796:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855
00000100:00100000:2.0:1767320041.975803:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940676096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320041.975844:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940676096:12345-0@lo:400:kworker.0 Request processed in 42us (96us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320041.975858:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940676224:12345-0@lo:38:kworker.0 Request processed in 206us (341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320041.975860:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855
00000100:00100000:3.0:1767320041.975864:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17553
00000100:00080000:2.0:1767320041.975889:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320041.975901:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320041.975906:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320041.975909:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940675968:0@lo:38:kworker.0
00000100:00080000:3.0:1767320041.975926:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320041.975929:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320041.975931:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940676224:0@lo:38:kworker.0
00000100:00100000:1.0:1767320041.976014:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940676096:0@lo:400:kworker.0
00000100:00100000:0.0:1767320041.976066:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940675840:0@lo:400:kworker.0
00000100:00100000:2.0:1767320042.668941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320042.925329:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320043.590972:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320043.591105:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320043.592608:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352768
00000100:00100000:0.0:1767320043.592623:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352768
00000100:00100000:0.0:1767320043.592809:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352640
00000100:00100000:0.0:1767320043.592814:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352640
00000100:00100000:0.0:1767320043.592842:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4856
00000100:00100000:0.0:1767320043.592852:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894352768:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320043.592875:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17554
00000100:00100000:1.0:1767320043.592885:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894352640:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320043.592926:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320043.592963:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894352768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 110us (2000us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320043.592972:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894352640:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 84us (1865us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320043.592977:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4856
00000100:00100000:1.0:1767320043.592997:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17554
00000100:00080000:3.0:1767320043.593941:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320043.696050:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320043.949032:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320044.525281:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940676352:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320044.525374:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320044.525856:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676352
00000100:00100000:1.0:1767320044.525866:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676352
00000100:00100000:1.0:1767320044.525957:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704
00000100:00100000:1.0:1767320044.525967:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940676352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320044.526005:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767320044.526079:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320044.528995:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940676352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3010us (3610us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320044.529009:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704
00000100:00100000:0.0:1767320044.529940:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940676352:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320044.716953:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320044.973103:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320045.038854:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320045.038876:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320045.038879:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320045.038883:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320045.038896:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320045.038903:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5291
00000100:00080000:2.0:1767320045.038908:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320045.038914:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320045.038955:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b480 x1853163940676480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320045.038993:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320045.038997:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320045.038999:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320045.039002:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5291
00000100:00080000:2.0:1767320045.039005:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320045.039008:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320045.039024:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839500 x1853163940676608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320045.039094:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320045.039098:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320045.039099:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320045.039103:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5292
00000100:00080000:2.0:1767320045.039105:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320045.039109:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320045.039119:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940677120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320045.039133:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320045.039136:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320045.039137:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320045.039141:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5292
00000100:00080000:2.0:1767320045.039143:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320045.039147:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320045.039158:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838700 x1853163940677376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320045.039189:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940676864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320045.039254:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320045.039419:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940676736:0@lo:400:kworker.0
00000100:00100000:1.0:1767320045.039445:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940676992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320045.039455:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320045.039494:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320045.039498:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676864
00000100:00100000:0.0:1767320045.039506:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676864
00000100:00100000:1.0:1767320045.039526:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676992
00000100:00100000:1.0:1767320045.039531:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676992
00000100:00100000:0.0:1767320045.039564:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676736
00000100:00100000:0.0:1767320045.039569:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676736
00000100:00100000:1.0:1767320045.039576:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857
00000100:00100000:1.0:1767320045.039587:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940676992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320045.039593:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149
00000100:00100000:0.0:1767320045.039603:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940676864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320045.039649:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940676992:12345-0@lo:400:kworker.0 Request processed in 64us (155us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320045.039651:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940676864:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320045.039667:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149
00000100:00100000:1.0:1767320045.039668:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857
00000100:00100000:0.0:1767320045.039693:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150
00000100:00100000:0.0:1767320045.039701:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940676736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320045.039707:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940677248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320045.039742:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940676736:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320045.039746:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320045.039755:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150
00000100:00100000:1.0:1767320045.039800:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677248
00000100:00100000:1.0:1767320045.039805:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677248
00000100:00100000:1.0:1767320045.039836:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4858
00000100:00100000:1.0:1767320045.039843:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940677248:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320045.039855:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320045.039862:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320045.039881:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940677248:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320045.039899:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4858
00000100:00100000:2.0:1767320045.040179:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940676864:0@lo:400:kworker.0
00000100:00100000:3.0:1767320045.041019:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940676480:0@lo:38:kworker.0
00000100:00100000:3.0:1767320045.041060:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320045.041139:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940676736:0@lo:400:kworker.0
00000100:00100000:1.0:1767320045.041214:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676480
00000100:00100000:1.0:1767320045.041219:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676480
00000100:00100000:1.0:1767320045.041253:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17555
00000100:00100000:1.0:1767320045.041258:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940676480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320045.041277:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320045.041330:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940676480:12345-0@lo:38:kworker.0 Request processed in 70us (269us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320045.041336:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17555
00000100:00080000:3.0:1767320045.041494:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320045.041510:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320045.041514:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940676480:0@lo:38:kworker.0
00000100:00100000:3.0:1767320045.041521:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940676608:0@lo:38:kworker.0
00000100:00100000:3.0:1767320045.041547:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320045.041583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940677120:0@lo:38:kworker.0
00000100:00100000:3.0:1767320045.041606:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320045.041630:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940677376:0@lo:38:kworker.0
00000100:00100000:3.0:1767320045.041651:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320045.041687:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677120
00000100:00100000:3.0:1767320045.041691:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677120
00000100:00100000:3.0:1767320045.041707:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677376
00000100:00100000:3.0:1767320045.041710:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677376
00000100:00100000:3.0:1767320045.041726:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17556
00000100:00100000:3.0:1767320045.041730:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320045.041741:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320045.041769:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677120:12345-0@lo:38:kworker.0 Request processed in 37us (161us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320045.041798:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17556
00000100:00100000:3.0:1767320045.041812:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17557
00000100:00100000:3.0:1767320045.041816:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320045.041825:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320045.041850:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677376:12345-0@lo:38:kworker.0 Request processed in 32us (198us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320045.041855:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17557
00000100:00100000:0.0:1767320045.041967:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940676608
00000100:00100000:0.0:1767320045.041980:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940676608
00000100:00100000:0.0:1767320045.042004:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223
00000100:00100000:0.0:1767320045.042009:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940676608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320045.042019:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320045.042048:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940676608:12345-0@lo:38:kworker.0 Request processed in 38us (500us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320045.042053:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223
00000100:00080000:1.0:1767320045.042430:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320045.042436:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320045.042440:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940676608:0@lo:38:kworker.0
00000100:00100000:2.0:1767320045.042451:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940676992:0@lo:400:kworker.0
00000100:00080000:1.0:1767320045.042453:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320045.042460:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320045.042464:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940677120:0@lo:38:kworker.0
00000100:00080000:1.0:1767320045.042475:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320045.042478:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320045.042482:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940677376:0@lo:38:kworker.0
00000100:00100000:0.0:1767320045.042618:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940677248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320045.549327:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940677504:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320045.549418:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320045.549824:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677504
00000100:00100000:2.0:1767320045.549833:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677504
00000100:00100000:2.0:1767320045.549967:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705
00000100:00100000:2.0:1767320045.549978:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940677504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320045.550008:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320045.550069:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940677504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (651us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320045.550076:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705
00000100:00100000:0.0:1767320045.550152:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940677504:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320045.740992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320045.997087:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320046.765147:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320047.021026:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320047.788898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320048.045040:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320048.710354:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320048.710456:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320048.710565:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353024
00000100:00100000:0.0:1767320048.710578:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353024
00000100:00100000:0.0:1767320048.710661:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894352896
00000100:00100000:0.0:1767320048.710665:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894352896
00000100:00100000:0.0:1767320048.710685:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4859
00000100:00100000:0.0:1767320048.710697:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894353024:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320048.710729:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17558
00000100:00100000:1.0:1767320048.710738:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894352896:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320048.710760:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320048.710823:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894353024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 127us (479us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320048.710832:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4859
00000100:00100000:1.0:1767320048.710838:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894352896:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 95us (377us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320048.710847:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17558
00000100:00080000:2.0:1767320048.711089:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320048.812908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320049.071719:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320049.645391:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940677632:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320049.645469:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320049.645610:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677632
00000100:00100000:2.0:1767320049.645621:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677632
00000100:00100000:2.0:1767320049.645692:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706
00000100:00100000:2.0:1767320049.645704:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940677632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320049.645741:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320049.645830:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940677632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (348us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320049.645838:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706
00000100:00080000:0.0:1767320049.646155:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320049.646197:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940677632:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320049.836951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320050.093989:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320050.157270:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320050.157281:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320050.157284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320050.157288:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320050.157292:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320050.157301:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5295
00000100:00080000:1.0:1767320050.157314:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320050.157321:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320050.157360:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e8000 x1853163940677760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320050.157386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320050.157390:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320050.157392:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320050.157396:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5295
00000100:00080000:1.0:1767320050.157398:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320050.157402:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320050.157427:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9eb480 x1853163940677888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320050.157515:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940678016:0@lo:400:kworker.0
00000100:00100000:2.0:1767320050.157584:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.157692:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940677760:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.157728:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.157749:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940677888:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.157791:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320050.157884:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678016
00000100:00100000:0.0:1767320050.157893:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678016
00000100:00100000:0.0:1767320050.157958:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151
00000100:00100000:0.0:1767320050.157968:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940678016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.158063:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677888
00000100:00100000:3.0:1767320050.158068:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677888
00000100:00100000:3.0:1767320050.158093:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224
00000100:00100000:3.0:1767320050.158098:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940677888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320050.158120:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320050.158156:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940677888:12345-0@lo:38:kworker.0 Request processed in 56us (383us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320050.158165:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224
00000100:00080000:3.0:1767320050.158204:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320050.158209:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320050.158213:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940677888:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.158244:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940677760
00000100:00100000:3.0:1767320050.158247:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940677760
00000100:00100000:3.0:1767320050.158269:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17559
00000100:00100000:3.0:1767320050.158273:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320050.158284:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320050.158315:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940677760:12345-0@lo:38:kworker.0 Request processed in 40us (586us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320050.158321:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17559
00000100:00080000:3.0:1767320050.158342:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320050.158346:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320050.158349:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940677760:0@lo:38:kworker.0
00000100:00080000:1.0:1767320050.158805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320050.158809:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320050.158812:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320050.158816:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5295
00000100:00080000:1.0:1767320050.158819:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320050.158823:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320050.158836:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9eb480 x1853163940678400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320050.158906:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940678528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.158945:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.158974:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678528
00000100:00100000:3.0:1767320050.158978:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678528
00000100:00100000:3.0:1767320050.159011:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860
00000100:00100000:3.0:1767320050.159018:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940678528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159048:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940678528:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320050.159054:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860
00000100:00080000:3.0:1767320050.159067:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320050.159088:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940678528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940678400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.159126:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.159146:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678400
00000100:00100000:3.0:1767320050.159149:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678400
00000100:00100000:3.0:1767320050.159165:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17560
00000100:00100000:3.0:1767320050.159169:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940678400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320050.159180:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320050.159202:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940678400:12345-0@lo:38:kworker.0 Request processed in 32us (75us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320050.159208:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17560
00000100:00080000:3.0:1767320050.159230:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320050.159233:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320050.159236:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940678400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.159257:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940678144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159279:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.159303:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320050.159308:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940678272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159323:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.159339:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678144
00000100:00100000:3.0:1767320050.159341:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678144
00000100:00100000:3.0:1767320050.159363:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152
00000100:00100000:3.0:1767320050.159369:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940678144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159394:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940678144:12345-0@lo:400:kworker.0 Request processed in 26us (114us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320050.159403:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152
00000100:00080000:3.0:1767320050.159429:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320050.159442:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940678144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159454:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678272
00000100:00100000:3.0:1767320050.159457:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678272
00000100:00100000:3.0:1767320050.159913:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4861
00000100:00100000:3.0:1767320050.159931:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940678272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320050.159963:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940678272:12345-0@lo:400:kworker.0 Request processed in 43us (639us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320050.159969:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4861
00000100:00080000:3.0:1767320050.159984:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320050.159998:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940678272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320050.160757:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940678016:12345-0@lo:400:kworker.0 Request processed in 2788us (3170us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320050.160766:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151
00000100:00100000:2.0:1767320050.162862:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940678016:0@lo:400:kworker.0
00000100:00080000:1.0:1767320050.163183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320050.163189:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320050.163192:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320050.163198:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5295
00000100:00080000:1.0:1767320050.163202:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320050.163208:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320050.163248:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7b80 x1853163940678656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320050.164169:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940678656:0@lo:38:kworker.0
00000100:00100000:3.0:1767320050.164250:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320050.164646:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678656
00000100:00100000:0.0:1767320050.164654:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678656
00000100:00100000:0.0:1767320050.164704:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17561
00000100:00100000:0.0:1767320050.164712:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940678656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320050.164734:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320050.164906:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940678656:12345-0@lo:38:kworker.0 Request processed in 193us (656us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320050.164915:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17561
00000100:00080000:3.0:1767320050.165145:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320050.165151:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320050.165155:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940678656:0@lo:38:kworker.0
00000100:00100000:2.0:1767320050.671013:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940678784:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320050.671087:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320050.671239:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678784
00000100:00100000:0.0:1767320050.671247:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678784
00000100:00100000:0.0:1767320050.671306:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707
00000100:00100000:0.0:1767320050.671316:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940678784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320050.671348:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320050.671411:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940678784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (313us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320050.671419:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707
00000100:00100000:1.0:1767320050.671641:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940678784:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320050.860943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320051.117199:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320051.890524:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320052.141150:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320052.909081:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320053.168810:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320053.830416:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320053.831110:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767320053.832069:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894353408 offset 0 length 520: 4
00000100:00100000:1.0:1767320053.832378:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353280
00000100:00100000:1.0:1767320053.832391:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353280
00000100:00080000:3.0:1767320053.832534:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320053.832757:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353152
00000100:00100000:1.0:1767320053.832761:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353152
00000100:00100000:1.0:1767320053.832817:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4862
00000100:00100000:1.0:1767320053.832829:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894353280:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320053.833066:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17562
00000100:00100000:3.0:1767320053.833072:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353152:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320053.833093:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320053.833593:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894353280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 764us (3193us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320053.833612:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4862
00000100:00100000:3.0:1767320053.834758:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353152:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1677us (3642us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320053.834770:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17562
00000100:00100000:2.0:1767320053.933570:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320054.189573:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320054.765760:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320054.765812:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940678912:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320054.765898:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320054.766090:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940678912
00000100:00100000:2.0:1767320054.766099:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940678912
00000100:00100000:2.0:1767320054.766185:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708
00000100:00100000:2.0:1767320054.766194:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940678912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320054.766226:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320054.766276:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940678912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (378us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320054.766283:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708
00000100:00100000:1.0:1767320054.766308:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940678912:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320054.766590:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320054.958392:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320055.213143:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320055.278195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320055.278205:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320055.278209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320055.278213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320055.278218:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320055.278226:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5300
00000100:00080000:3.0:1767320055.278231:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320055.278238:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320055.278286:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ebb80 x1853163940679040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320055.278304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320055.278307:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320055.278309:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320055.278313:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5300
00000100:00080000:3.0:1767320055.278315:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320055.278318:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320055.278332:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9f80 x1853163940679168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320055.278504:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940679296:0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.278584:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320055.278770:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320055.278791:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320055.278793:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320055.278806:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5300
00000100:00080000:3.0:1767320055.278809:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320055.278813:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320055.278825:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eaa00 x1853163940679680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320055.278852:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320055.278855:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320055.278857:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320055.278861:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5300
00000100:00080000:3.0:1767320055.278864:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320055.278868:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320055.279058:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940679424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320055.279080:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940679808:0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.279099:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320055.279111:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320055.279131:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320055.279137:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940679552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.279159:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320055.279159:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679808
00000100:00100000:2.0:1767320055.279167:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679808
00000100:00100000:1.0:1767320055.279183:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679296
00000100:00100000:1.0:1767320055.279186:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679296
00000100:00100000:1.0:1767320055.279216:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679424
00000100:00100000:2.0:1767320055.279216:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679552
00000100:00100000:1.0:1767320055.279219:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679424
00000100:00100000:2.0:1767320055.279219:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679552
00000100:00100000:1.0:1767320055.279240:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153
00000100:00100000:2.0:1767320055.279240:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863
00000100:00100000:1.0:1767320055.279248:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940679296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320055.279248:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940679808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.279293:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940679296:12345-0@lo:400:kworker.0 Request processed in 46us (709us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320055.279301:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153
00000100:00100000:2.0:1767320055.279306:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940679808:12345-0@lo:400:kworker.0 Request processed in 60us (195us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320055.279313:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863
00000100:00100000:1.0:1767320055.279320:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154
00000100:00100000:2.0:1767320055.279323:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4864
00000100:00100000:1.0:1767320055.279325:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940679424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320055.279328:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940679552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320055.279620:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ead80 x1853163940679936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320055.279660:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320055.279665:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320055.279716:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940679808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320055.279754:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940679296:0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.280508:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940679424:12345-0@lo:400:kworker.0 Request processed in 1179us (1403us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320055.281605:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154
00000100:00100000:0.0:1767320055.281738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940679040:0@lo:38:kworker.0
00000100:00100000:0.0:1767320055.281851:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320055.281882:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940679168:0@lo:38:kworker.0
00000100:00100000:0.0:1767320055.281908:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320055.281930:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940679680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320055.281950:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320055.281966:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940679936:0@lo:38:kworker.0
00000100:00100000:0.0:1767320055.281986:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320055.282031:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679168
00000100:00100000:0.0:1767320055.282038:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679168
00000100:00100000:0.0:1767320055.282071:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225
00000100:00100000:0.0:1767320055.282078:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940679168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320055.282101:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320055.282142:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940679168:12345-0@lo:38:kworker.0 Request processed in 63us (233us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320055.282149:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225
00000100:00080000:0.0:1767320055.282185:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320055.282190:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320055.282193:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940679168:0@lo:38:kworker.0
00000100:00100000:0.0:1767320055.282217:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679040
00000100:00100000:0.0:1767320055.282221:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679040
00000100:00100000:0.0:1767320055.282248:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679680
00000100:00100000:0.0:1767320055.282251:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679680
00000100:00100000:0.0:1767320055.282266:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940679936
00000100:00100000:0.0:1767320055.282269:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940679936
00000100:00100000:0.0:1767320055.282279:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17563
00000100:00100000:0.0:1767320055.282283:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940679040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320055.282296:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320055.282325:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940679040:12345-0@lo:38:kworker.0 Request processed in 41us (475us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320055.282331:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17563
00000100:00100000:0.0:1767320055.282343:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17564
00000100:00100000:0.0:1767320055.282346:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940679680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320055.282355:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320055.282379:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940679680:12345-0@lo:38:kworker.0 Request processed in 31us (428us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320055.282655:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940679552:12345-0@lo:400:kworker.0 Request processed in 3323us (3492us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320055.282664:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4864
00000100:00100000:2.0:1767320055.282687:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17565
00000100:00100000:2.0:1767320055.282692:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940679936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320055.282702:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320055.282728:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940679936:12345-0@lo:38:kworker.0 Request processed in 34us (741us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320055.282733:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17565
00000100:00080000:3.0:1767320055.282808:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320055.282813:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320055.282816:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940679040:0@lo:38:kworker.0
00000100:00080000:3.0:1767320055.282825:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320055.282828:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320055.282831:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940679680:0@lo:38:kworker.0
00000100:00080000:3.0:1767320055.282838:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320055.282841:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320055.282843:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940679936:0@lo:38:kworker.0
00000100:00100000:1.0:1767320055.282957:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940679552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320055.282972:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940679424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320055.284348:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17564
00000100:00100000:2.0:1767320055.789670:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320055.789709:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940680064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320055.790055:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320055.790255:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680064
00000100:00100000:1.0:1767320055.790264:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680064
00000100:00100000:1.0:1767320055.790316:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709
00000100:00100000:1.0:1767320055.790325:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940680064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320055.790359:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320055.791159:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940680064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 833us (1102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320055.791167:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709
00000100:00100000:2.0:1767320055.791496:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940680064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320055.982209:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320056.237383:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320057.005072:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320057.261025:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320058.031024:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320058.285753:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320058.953058:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320058.953164:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320058.953968:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353664
00000100:00100000:2.0:1767320058.953983:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353664
00000100:00080000:3.0:1767320058.954165:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320058.954495:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353536
00000100:00100000:2.0:1767320058.954500:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353536
00000100:00100000:2.0:1767320058.954535:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4865
00000100:00100000:2.0:1767320058.954546:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894353664:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320058.954757:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17566
00000100:00100000:0.0:1767320058.954799:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353536:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320058.954827:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320058.954874:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353536:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 74us (1708us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320058.954883:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17566
00000100:00100000:2.0:1767320058.955261:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894353664:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 716us (2236us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320058.955269:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4865
00000100:00100000:3.0:1767320059.053076:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320059.309077:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320059.888611:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320059.888636:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940680192:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320059.888706:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320059.889175:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680192
00000100:00100000:2.0:1767320059.889185:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680192
00000100:00100000:2.0:1767320059.889295:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710
00000100:00100000:2.0:1767320059.889304:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940680192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320059.889337:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320059.889396:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940680192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (689us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320059.889403:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710
00000100:00100000:1.0:1767320059.889572:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940680192:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320059.892438:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320060.076971:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320060.333064:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320060.396962:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320060.396972:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320060.396975:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320060.396979:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320060.396983:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320060.396991:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5305
00000100:00080000:3.0:1767320060.396996:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320060.397003:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320060.397044:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea300 x1853163940680320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320060.397070:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320060.397074:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320060.397076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320060.397080:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5305
00000100:00080000:3.0:1767320060.397082:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320060.397086:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320060.397098:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ea680 x1853163940680448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320060.397178:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940680576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320060.397248:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.397379:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940680320:0@lo:38:kworker.0
00000100:00100000:0.0:1767320060.397413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.397448:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940680448:0@lo:38:kworker.0
00000100:00100000:0.0:1767320060.397474:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.397508:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680448
00000100:00100000:0.0:1767320060.397515:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680448
00000100:00100000:0.0:1767320060.397549:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226
00000100:00100000:0.0:1767320060.397556:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940680448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320060.397576:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320060.397615:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940680448:12345-0@lo:38:kworker.0 Request processed in 58us (140us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320060.397622:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226
00000100:00100000:0.0:1767320060.397650:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680320
00000100:00100000:0.0:1767320060.397654:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680320
00000100:00100000:0.0:1767320060.397676:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17567
00000100:00100000:0.0:1767320060.397680:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940680320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320060.397690:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320060.397717:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940680320:12345-0@lo:38:kworker.0 Request processed in 35us (303us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320060.397723:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17567
00000100:00080000:3.0:1767320060.397934:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320060.397938:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320060.397952:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320060.397956:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5305
00000100:00080000:3.0:1767320060.397959:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320060.397964:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320060.397979:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940680960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320060.398053:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940680960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320060.398081:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320060.398113:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320060.398117:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320060.398120:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940680320:0@lo:38:kworker.0
00000100:00080000:0.0:1767320060.398129:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320060.398132:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320060.398135:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940680448:0@lo:38:kworker.0
00000100:00100000:0.0:1767320060.398163:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680960
00000100:00100000:0.0:1767320060.398167:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680960
00000100:00100000:0.0:1767320060.398188:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17568
00000100:00100000:0.0:1767320060.398193:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940680960:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320060.398204:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320060.398235:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940680960:12345-0@lo:38:kworker.0 Request processed in 40us (153us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320060.398241:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17568
00000100:00080000:0.0:1767320060.398264:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320060.398268:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320060.398271:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940680960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320060.398300:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940681088:0@lo:400:kworker.0
00000100:00100000:0.0:1767320060.398324:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.398349:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681088
00000100:00100000:0.0:1767320060.398352:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681088
00000100:00100000:0.0:1767320060.398387:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866
00000100:00100000:0.0:1767320060.398394:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940681088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320060.398431:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940681088:12345-0@lo:400:kworker.0 Request processed in 38us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320060.398437:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866
00000100:00100000:0.0:1767320060.398466:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940681088:0@lo:400:kworker.0
00000100:00100000:0.0:1767320060.398492:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940680832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320060.398516:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.398533:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320060.398538:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940680704:0@lo:400:kworker.0
00000100:00100000:0.0:1767320060.398561:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.398592:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680576
00000100:00100000:0.0:1767320060.398595:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680576
00000100:00100000:0.0:1767320060.398619:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680704
00000100:00100000:0.0:1767320060.398622:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680704
00000100:00100000:0.0:1767320060.398644:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155
00000100:00100000:0.0:1767320060.398651:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940680576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320060.398766:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156
00000100:00100000:2.0:1767320060.398790:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940680704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320060.398832:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940680704:12345-0@lo:400:kworker.0 Request processed in 58us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320060.398838:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156
00000100:00100000:2.0:1767320060.398879:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940680704:0@lo:400:kworker.0
00000100:00080000:2.0:1767320060.398900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320060.398904:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320060.401667:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320060.401678:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320060.401681:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320060.401689:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5305
00000100:00080000:3.0:1767320060.401693:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320060.401700:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320060.401758:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8700 x1853163940681216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320060.401853:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940680832
00000100:00100000:3.0:1767320060.401861:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940680832
00000100:00100000:3.0:1767320060.401923:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4867
00000100:00100000:3.0:1767320060.401933:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940680832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320060.402022:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940680832:12345-0@lo:400:kworker.0 Request processed in 91us (3504us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320060.402029:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4867
00000100:00100000:0.0:1767320060.403479:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940680576:12345-0@lo:400:kworker.0 Request processed in 4819us (6222us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320060.403491:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155
00000100:00080000:2.0:1767320060.403682:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320060.403743:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940680832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320060.403814:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940681216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320060.403871:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.404131:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681216
00000100:00100000:0.0:1767320060.404138:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681216
00000100:00100000:0.0:1767320060.404175:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17569
00000100:00100000:0.0:1767320060.404181:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940681216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320060.404203:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320060.404241:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940681216:12345-0@lo:38:kworker.0 Request processed in 59us (370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320060.404247:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17569
00000100:00080000:2.0:1767320060.404319:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320060.404325:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320060.404328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940681216:0@lo:38:kworker.0
00000100:00100000:1.0:1767320060.405887:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940680576:0@lo:400:kworker.0
00000100:00100000:3.0:1767320060.909320:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940681344:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320060.909397:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.909524:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681344
00000100:00100000:0.0:1767320060.909535:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681344
00000100:00100000:0.0:1767320060.909599:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711
00000100:00100000:0.0:1767320060.909608:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940681344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320060.909637:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320060.917134:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940681344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7515us (7725us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320060.918804:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711
00000100:00100000:3.0:1767320060.921306:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940681344:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320061.100906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320061.365434:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320061.423006:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320036/real 1767320036]  req@ffff93d073411180 x1853163940674944/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320061.423046:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d073411180 x1853163940674944/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320061.423069:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320061.423100:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320061.423104:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940674944:0@lo:250:kworker.0
00000100:00080000:1.0:1767320061.425350:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320061.425361:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320061.425365:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320061.425373:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320061.425378:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320061.425385:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320061.425426:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4a80 x1853163940681472/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320061.425462:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320061.425466:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320061.425468:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320061.425472:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5310
00000100:00080000:1.0:1767320061.425475:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320061.425478:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320061.425494:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7480 x1853163940681600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320061.425503:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320061.425507:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320061.425509:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320061.425512:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5310
00000100:00080000:1.0:1767320061.425514:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320061.425517:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320061.425529:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea7b80 x1853163940681728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320061.425612:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320061.425616:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320061.425617:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320061.425621:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5310
00000100:00080000:1.0:1767320061.425623:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320061.425627:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320061.425637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47966d80 x1853163940682240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320061.425653:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320061.425656:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320061.425658:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320061.425661:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5310
00000100:00080000:1.0:1767320061.425663:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320061.425667:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320061.425676:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940682496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320061.425705:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940682112:0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.425706:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940681856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320061.425798:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940681984:0@lo:400:kworker.0
00000100:00100000:2.0:1767320061.425800:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940681472:0@lo:250:kworker.0
00000100:00100000:3.0:1767320061.427816:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320061.427925:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940682368:0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.428190:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320061.428243:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682368
00000100:00100000:3.0:1767320061.428252:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682368
00000100:00100000:3.0:1767320061.428305:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868
00000100:00100000:3.0:1767320061.428314:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940682368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.428364:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940682368:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320061.428371:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868
00000100:00100000:3.0:1767320061.428420:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940682368:0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.428456:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681856
00000100:00100000:3.0:1767320061.428460:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681856
00000100:00100000:3.0:1767320061.428496:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157
00000100:00100000:3.0:1767320061.428504:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940681856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.428542:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940681856:12345-0@lo:400:kworker.0 Request processed in 40us (731us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320061.428552:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157
00000100:00080000:3.0:1767320061.428580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320061.428606:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940681856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320061.433056:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320061.434113:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682112
00000100:00100000:3.0:1767320061.434125:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682112
00000100:00100000:3.0:1767320061.434186:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869
00000100:00100000:3.0:1767320061.434197:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940682112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.434276:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940682112:12345-0@lo:400:kworker.0 Request processed in 81us (1226us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320061.434283:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869
00000100:00100000:1.0:1767320061.434516:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940682112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320061.435531:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320061.435598:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681984
00000100:00100000:3.0:1767320061.435604:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681984
00000100:00100000:3.0:1767320061.435657:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158
00000100:00100000:3.0:1767320061.435666:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940681984:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320061.435721:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940681984:12345-0@lo:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320061.435728:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158
00000100:00100000:1.0:1767320061.435820:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940681984:0@lo:400:kworker.0
00000400:00000100:2.0:1767320061.435985:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940681472 offset 0 length 520: 4
00000100:00100000:2.0:1767320061.436066:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940681600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320061.436097:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320061.436161:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940681728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320061.436187:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320061.436216:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940682240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320061.436238:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320061.436278:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681728
00000100:00100000:0.0:1767320061.436283:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681728
00000100:00100000:0.0:1767320061.436317:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227
00000100:00100000:0.0:1767320061.436322:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940681728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320061.436342:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320061.436374:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940681728:12345-0@lo:38:kworker.0 Request processed in 50us (185us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320061.436379:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227
00000100:00100000:2.0:1767320061.437755:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940682496:0@lo:38:kworker.0
00000100:00100000:2.0:1767320061.437816:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320061.437889:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940681600
00000100:00100000:1.0:1767320061.437895:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940681600
00000100:00100000:1.0:1767320061.437933:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682240
00000100:00100000:1.0:1767320061.437936:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682240
00000100:00100000:1.0:1767320061.437952:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17570
00000100:00100000:1.0:1767320061.437959:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940681600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320061.437978:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320061.438086:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17571
00000100:00100000:0.0:1767320061.438092:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940682240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320061.438103:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320061.438133:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940682240:12345-0@lo:38:kworker.0 Request processed in 40us (1894us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320061.438140:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17571
00000100:00100000:1.0:1767320061.438278:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940681600:12345-0@lo:38:kworker.0 Request processed in 318us (2179us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320061.438285:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17570
00000100:00080000:2.0:1767320061.438372:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320061.438377:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320061.438381:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940681600:0@lo:38:kworker.0
00000100:00080000:2.0:1767320061.438390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320061.438393:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320061.438396:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940681728:0@lo:38:kworker.0
00000100:00080000:2.0:1767320061.438402:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320061.438405:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320061.438408:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940682240:0@lo:38:kworker.0
00000100:00100000:1.0:1767320061.438473:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682496
00000100:00100000:1.0:1767320061.438477:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682496
00000100:00100000:1.0:1767320061.438501:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17572
00000100:00100000:1.0:1767320061.438512:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940682496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320061.438522:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320061.438555:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940682496:12345-0@lo:38:kworker.0 Request processed in 49us (738us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320061.438561:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17572
00000100:00080000:2.0:1767320061.438614:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320061.438618:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320061.438620:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940682496:0@lo:38:kworker.0
00000100:00100000:3.0:1767320062.124919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320062.385706:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320063.149211:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320063.405052:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320064.081507:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320064.081986:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320064.083235:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353920
00000100:00100000:1.0:1767320064.083247:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353920
00000100:00100000:1.0:1767320064.083338:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894353792
00000100:00100000:1.0:1767320064.083342:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894353792
00000100:00100000:1.0:1767320064.083369:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4870
00000100:00100000:1.0:1767320064.083379:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894353920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767320064.083421:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320064.083461:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894353920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (1965us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320064.083471:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4870
00000100:00100000:1.0:1767320064.083492:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17573
00000100:00100000:1.0:1767320064.083498:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320064.083518:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320064.083711:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894353792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 212us (1725us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320064.083727:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17573
00000100:00100000:3.0:1767320064.172909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320064.432547:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320065.005395:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320065.005431:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940682624:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320065.005506:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320065.005752:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682624
00000100:00100000:0.0:1767320065.005763:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682624
00000100:00100000:0.0:1767320065.005889:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712
00000100:00100000:0.0:1767320065.005901:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940682624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320065.005938:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320065.006000:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940682624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (491us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320065.006008:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712
00000100:00080000:2.0:1767320065.006080:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320065.006080:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940682624:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320065.197200:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320065.453085:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320066.031943:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940682752:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320066.032029:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320066.032190:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682752
00000100:00100000:0.0:1767320066.032198:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682752
00000100:00100000:0.0:1767320066.032257:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713
00000100:00100000:0.0:1767320066.032266:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940682752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320066.032296:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320066.032347:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940682752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320066.032354:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713
00000100:00100000:3.0:1767320066.032441:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940682752:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320066.032451:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320066.221364:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320066.477521:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320066.541011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320066.541024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320066.541027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320066.541030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320066.541035:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320066.541044:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5311
00000100:00080000:3.0:1767320066.541049:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320066.541056:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320066.541098:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eb100 x1853163940682880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320066.541129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320066.541132:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320066.541134:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320066.541137:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5311
00000100:00080000:3.0:1767320066.541140:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320066.541143:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320066.541157:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9880 x1853163940683008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320066.541230:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940683136:0@lo:400:kworker.0
00000100:00100000:1.0:1767320066.541319:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320066.541432:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683136
00000100:00100000:0.0:1767320066.541441:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683136
00000100:00100000:0.0:1767320066.541494:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159
00000100:00100000:0.0:1767320066.541503:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940683136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320066.541586:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940682880:0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.541621:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320066.541641:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940683008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.541673:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320066.541736:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940682880
00000100:00100000:2.0:1767320066.541740:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940682880
00000100:00100000:2.0:1767320066.541793:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17574
00000100:00100000:2.0:1767320066.541798:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940682880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320066.541819:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320066.541851:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940682880:12345-0@lo:38:kworker.0 Request processed in 52us (228us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320066.541858:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17574
00000100:00100000:2.0:1767320066.541879:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683008
00000100:00100000:2.0:1767320066.541883:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683008
00000100:00100000:2.0:1767320066.541900:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228
00000100:00100000:2.0:1767320066.541904:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940683008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320066.541914:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320066.541938:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940683008:12345-0@lo:38:kworker.0 Request processed in 32us (264us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320066.541943:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228
00000100:00080000:2.0:1767320066.541972:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320066.541975:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320066.541978:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940682880:0@lo:38:kworker.0
00000100:00080000:2.0:1767320066.541983:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320066.541985:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320066.541987:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940683008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.544584:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940683264:0@lo:400:kworker.0
00000100:00100000:2.0:1767320066.544671:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320066.544745:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683264
00000100:00100000:2.0:1767320066.544752:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683264
00000100:00100000:2.0:1767320066.544825:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871
00000100:00100000:2.0:1767320066.544836:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940683264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320066.544885:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940683264:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320066.544893:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871
00000100:00080000:2.0:1767320066.544915:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320066.544952:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940683264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320066.546022:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940683136:12345-0@lo:400:kworker.0 Request processed in 4514us (4696us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320066.546033:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159
00000100:00100000:1.0:1767320066.546167:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940683136:0@lo:400:kworker.0
00000100:00080000:3.0:1767320066.550784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320066.550794:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320066.550799:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320066.550814:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5311
00000100:00080000:3.0:1767320066.550819:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320066.550826:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320066.550868:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3eb100 x1853163940683392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320066.550930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320066.550934:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320066.550936:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320066.550939:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5311
00000100:00080000:3.0:1767320066.550942:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320066.550945:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320066.550956:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e8700 x1853163940683648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320066.550972:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940683392:0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.551037:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320066.551096:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940683648:0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.551124:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320066.551146:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320066.551155:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683392
00000100:00100000:1.0:1767320066.551156:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940683520:0@lo:400:kworker.0
00000100:00100000:2.0:1767320066.551162:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683392
00000100:00100000:1.0:1767320066.551182:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320066.551190:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683648
00000100:00100000:2.0:1767320066.551193:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683648
00000100:00100000:2.0:1767320066.551205:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683520
00000100:00100000:2.0:1767320066.551207:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683520
00000100:00100000:1.0:1767320066.551228:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17575
00000100:00100000:1.0:1767320066.551235:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940683392:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320066.551241:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872
00000100:00100000:2.0:1767320066.551245:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940683520:12345-0@lo:400:kworker.0
00010000:00020000:1.0:1767320066.551254:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320066.551292:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940683392:12345-0@lo:38:kworker.0 Request processed in 55us (254us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320066.551296:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940683520:12345-0@lo:400:kworker.0 Request processed in 51us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320066.551299:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17575
00000100:00100000:2.0:1767320066.551302:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872
00000100:00100000:1.0:1767320066.551314:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17576
00000100:00100000:1.0:1767320066.551318:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940683648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320066.551339:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320066.551363:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940683648:12345-0@lo:38:kworker.0 Request processed in 43us (238us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320066.551367:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320066.551439:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320066.551444:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320066.551447:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940683648:0@lo:38:kworker.0
00000100:00080000:0.0:1767320066.551456:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320066.551459:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320066.551462:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940683392:0@lo:38:kworker.0
00000100:00100000:0.0:1767320066.551498:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940683520:0@lo:400:kworker.0
00000100:00100000:1.0:1767320066.561558:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17576
00000100:00100000:3.0:1767320067.245585:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320067.501002:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320068.268973:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320068.524999:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320069.194275:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320069.194495:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354176
00000100:00100000:0.0:1767320069.195510:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320069.195647:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354176
00000100:00080000:3.0:1767320069.195812:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320069.200824:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354048
00000100:00100000:2.0:1767320069.200847:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354048
00000100:00100000:2.0:1767320069.200924:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4873
00000100:00100000:2.0:1767320069.200945:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894354176:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320069.201083:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894354176:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 149us (6822us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320069.201091:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4873
00000100:00100000:2.0:1767320069.201118:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17577
00000100:00100000:2.0:1767320069.201123:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894354048:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320069.201150:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320069.201178:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894354048:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (5676us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320069.201184:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17577
00000100:00100000:3.0:1767320069.292931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320069.549344:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320070.125197:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320070.125230:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940683776:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320070.125600:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320070.125816:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683776
00000100:00100000:1.0:1767320070.125829:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683776
00000100:00100000:1.0:1767320070.125933:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714
00000100:00100000:1.0:1767320070.125946:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940683776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320070.125988:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320070.126053:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940683776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320070.126061:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714
00000100:00100000:2.0:1767320070.126162:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940683776:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320070.126230:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320070.317809:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320070.573016:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320071.149537:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940683904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320071.149644:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320071.150954:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940683904
00000100:00100000:1.0:1767320071.150971:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940683904
00000100:00100000:1.0:1767320071.151057:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715
00000100:00100000:1.0:1767320071.151069:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940683904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320071.151118:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320071.151212:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940683904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (1567us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320071.151220:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715
00000100:00100000:1.0:1767320071.151384:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940683904:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320071.153309:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320071.340949:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320071.599843:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320071.661814:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320071.661831:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320071.661835:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320071.661840:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320071.661845:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320071.661855:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5316
00000100:00080000:2.0:1767320071.661861:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320071.661869:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320071.661930:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8700 x1853163940684032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320071.661968:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320071.661973:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320071.661975:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320071.661979:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5316
00000100:00080000:2.0:1767320071.661981:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320071.661986:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320071.662004:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412aea00 x1853163940684160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320071.662066:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320071.662069:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320071.662071:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320071.662075:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5316
00000100:00080000:2.0:1767320071.662077:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320071.662080:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940684032:0@lo:38:kworker.0
00000100:00080000:2.0:1767320071.662081:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320071.662091:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ac000 x1853163940684544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320071.662105:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320071.662109:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320071.662110:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320071.662113:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5316
00000100:00080000:2.0:1767320071.662116:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320071.662119:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320071.662128:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ac380 x1853163940684800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320071.662154:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940684416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320071.662168:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320071.662183:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320071.662279:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940684288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320071.662317:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320071.662352:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684032
00000100:00100000:1.0:1767320071.662360:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684032
00000100:00100000:1.0:1767320071.662400:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684416
00000100:00100000:1.0:1767320071.662403:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684416
00000100:00100000:1.0:1767320071.662451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874
00000100:00100000:1.0:1767320071.662463:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940684416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320071.662518:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940684416:12345-0@lo:400:kworker.0 Request processed in 58us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320071.662526:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874
00000100:00100000:1.0:1767320071.662548:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17578
00000100:00100000:1.0:1767320071.662552:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940684032:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320071.662574:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320071.662603:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940684032:12345-0@lo:38:kworker.0 Request processed in 50us (435us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320071.662609:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17578
00000100:00080000:1.0:1767320071.662631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320071.662761:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940684416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320071.662807:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320071.662814:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940684672:0@lo:400:kworker.0
00000100:00100000:2.0:1767320071.662839:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320071.663186:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684672
00000100:00100000:0.0:1767320071.663193:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684672
00000100:00100000:0.0:1767320071.663239:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875
00000100:00100000:0.0:1767320071.663248:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940684672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320071.663298:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940684672:12345-0@lo:400:kworker.0 Request processed in 52us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320071.663304:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875
00000100:00100000:0.0:1767320071.663328:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684288
00000100:00100000:0.0:1767320071.663333:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684288
00000100:00100000:0.0:1767320071.663362:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160
00000100:00100000:0.0:1767320071.663367:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940684288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320071.663398:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940684288:12345-0@lo:400:kworker.0 Request processed in 31us (1081us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320071.663404:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160
00000100:00100000:0.0:1767320071.663431:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940684672:0@lo:400:kworker.0
00000100:00080000:3.0:1767320071.663789:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320071.663796:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320071.663801:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940684032:0@lo:38:kworker.0
00000100:00100000:3.0:1767320071.663809:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940684160:0@lo:38:kworker.0
00000100:00100000:3.0:1767320071.663848:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320071.663871:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320071.663892:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940684544:0@lo:38:kworker.0
00000100:00100000:1.0:1767320071.663898:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940684288:0@lo:400:kworker.0
00000100:00100000:3.0:1767320071.663917:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320071.663931:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940684800:0@lo:38:kworker.0
00000100:00100000:1.0:1767320071.663938:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684544
00000100:00100000:1.0:1767320071.663941:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684544
00000100:00100000:3.0:1767320071.663953:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320071.663993:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684160
00000100:00100000:2.0:1767320071.663998:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684160
00000100:00100000:2.0:1767320071.664022:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229
00000100:00100000:2.0:1767320071.664027:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940684160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320071.664049:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320071.664082:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940684160:12345-0@lo:38:kworker.0 Request processed in 54us (233us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320071.664088:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229
00000100:00080000:3.0:1767320071.664806:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320071.664814:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320071.664819:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940684160:0@lo:38:kworker.0
00000100:00100000:1.0:1767320071.668842:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684800
00000100:00100000:1.0:1767320071.668865:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684800
00000100:00100000:1.0:1767320071.668977:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17579
00000100:00100000:1.0:1767320071.668989:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940684544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320071.669024:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320071.669142:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940684544:12345-0@lo:38:kworker.0 Request processed in 154us (5223us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320071.669149:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17579
00000100:00100000:1.0:1767320071.669168:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17580
00000100:00100000:1.0:1767320071.669172:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940684800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320071.669181:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320071.669213:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940684800:12345-0@lo:38:kworker.0 Request processed in 39us (5259us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320071.669218:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17580
00000100:00080000:3.0:1767320071.669226:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320071.669232:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320071.669236:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940684544:0@lo:38:kworker.0
00000100:00080000:3.0:1767320071.669249:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320071.669253:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320071.669255:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940684800:0@lo:38:kworker.0
00000100:00100000:3.0:1767320072.366355:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320072.624978:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320073.389923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320073.645090:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320074.310820:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320074.311349:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320074.313647:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354432
00000100:00100000:2.0:1767320074.313672:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354432
00000100:00080000:3.0:1767320074.313815:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320074.313855:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354304
00000100:00100000:2.0:1767320074.313862:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354304
00000100:00100000:2.0:1767320074.313900:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4876
00000100:00100000:2.0:1767320074.313916:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894354432:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320074.313932:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17581
00000100:00100000:0.0:1767320074.313940:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894354304:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320074.313967:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320074.314110:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894354432:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 199us (3348us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320074.314120:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4876
00000100:00100000:0.0:1767320074.318267:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894354304:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4305us (6898us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320074.318288:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17581
00000100:00100000:3.0:1767320074.412907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320074.669073:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320075.245188:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320075.245393:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940684928:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320075.245642:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320075.245943:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940684928
00000100:00100000:1.0:1767320075.245955:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940684928
00000100:00100000:1.0:1767320075.246048:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716
00000100:00100000:1.0:1767320075.246060:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940684928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320075.246117:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320075.246179:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940684928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (537us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320075.246188:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716
00000100:00080000:3.0:1767320075.246371:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320075.246590:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940684928:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320075.436907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320075.693021:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320076.269150:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320076.269171:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940685056:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320076.269226:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320076.269336:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685056
00000100:00100000:0.0:1767320076.269345:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685056
00000100:00100000:0.0:1767320076.269410:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717
00000100:00100000:0.0:1767320076.269420:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940685056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320076.269458:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320076.269505:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940685056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320076.269511:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717
00000100:00080000:1.0:1767320076.269696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320076.269732:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940685056:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320076.460903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320076.718632:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320076.781050:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320076.781061:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320076.781063:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320076.781067:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320076.781072:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320076.781079:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5321
00000100:00080000:2.0:1767320076.781084:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320076.781090:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320076.781128:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412af100 x1853163940685184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320076.781152:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320076.781156:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320076.781158:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320076.781161:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5321
00000100:00080000:2.0:1767320076.781164:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320076.781167:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320076.781181:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412adc00 x1853163940685312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320076.781231:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320076.781234:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320076.781236:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320076.781239:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5321
00000100:00080000:2.0:1767320076.781242:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320076.781246:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320076.781255:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412adf80 x1853163940685696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320076.781278:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320076.781281:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320076.781282:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320076.781286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5321
00000100:00080000:2.0:1767320076.781288:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320076.781292:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320076.781300:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ae300 x1853163940685952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320076.781329:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940685568:0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781395:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320076.781453:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320076.781459:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940685440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781487:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320076.781526:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320076.781534:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940685824:0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781557:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320076.781587:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685440
00000100:00100000:2.0:1767320076.781594:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685440
00000100:00100000:2.0:1767320076.781649:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161
00000100:00100000:2.0:1767320076.781658:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940685440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781706:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940685440:12345-0@lo:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320076.781715:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161
00000100:00100000:2.0:1767320076.781738:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685568
00000100:00100000:2.0:1767320076.781742:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685568
00000100:00100000:2.0:1767320076.781793:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685824
00000100:00100000:2.0:1767320076.781797:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685824
00000100:00100000:2.0:1767320076.781823:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4877
00000100:00100000:2.0:1767320076.781829:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940685568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781860:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940685568:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320076.781866:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4877
00000100:00100000:2.0:1767320076.781877:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878
00000100:00100000:2.0:1767320076.781883:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940685824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781914:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940685824:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320076.781921:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878
00000100:00100000:2.0:1767320076.781964:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940685824:0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.781993:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940685440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320076.782002:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940685568:0@lo:400:kworker.0
00000100:00080000:1.0:1767320076.782178:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320076.782475:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940685184:0@lo:38:kworker.0
00000100:00100000:3.0:1767320076.782575:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320076.782611:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940685312:0@lo:38:kworker.0
00000100:00100000:3.0:1767320076.782637:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320076.782659:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940685696:0@lo:38:kworker.0
00000100:00100000:3.0:1767320076.782682:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320076.782791:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685312
00000100:00100000:2.0:1767320076.782796:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685312
00000100:00100000:2.0:1767320076.782819:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230
00000100:00100000:2.0:1767320076.782824:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940685312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320076.782843:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320076.782890:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940685312:12345-0@lo:38:kworker.0 Request processed in 65us (252us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320076.782896:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230
00000100:00100000:3.0:1767320076.783712:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940685952:0@lo:38:kworker.0
00000100:00100000:3.0:1767320076.783740:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320076.789873:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685184
00000100:00100000:1.0:1767320076.789889:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685184
00000100:00100000:1.0:1767320076.789943:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685696
00000100:00100000:1.0:1767320076.789946:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685696
00000100:00100000:1.0:1767320076.789963:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940685952
00000100:00100000:1.0:1767320076.789965:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940685952
00000100:00100000:1.0:1767320076.789997:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17582
00000100:00100000:1.0:1767320076.790005:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320076.790029:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320076.790629:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320076.790646:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320076.790653:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940685312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320076.790672:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685184:12345-0@lo:38:kworker.0 Request processed in 663us (8158us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320076.790685:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17582
00000100:00100000:1.0:1767320076.790711:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17583
00000100:00100000:1.0:1767320076.790717:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320076.790730:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320076.790814:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685696:12345-0@lo:38:kworker.0 Request processed in 95us (8129us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320076.790815:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320076.790824:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17583
00000100:00100000:1.0:1767320076.790838:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17584
00000100:00100000:1.0:1767320076.790843:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320076.790853:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320076.790890:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940685952:12345-0@lo:38:kworker.0 Request processed in 45us (7148us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320076.790896:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17584
00000100:00080000:3.0:1767320076.791426:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320076.791431:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940685184:0@lo:38:kworker.0
00000100:00080000:3.0:1767320076.791457:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320076.791461:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320076.791464:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940685696:0@lo:38:kworker.0
00000100:00080000:3.0:1767320076.791475:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320076.791479:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320076.791482:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940685952:0@lo:38:kworker.0
00000100:00100000:3.0:1767320077.485464:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320077.741094:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320078.410165:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767320078.410212:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894354560 offset 0 length 520: 4
00000100:00100000:3.0:1767320078.410269:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320078.410390:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354816
00000100:00100000:2.0:1767320078.410401:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354816
00000100:00100000:2.0:1767320078.410486:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354688
00000100:00100000:2.0:1767320078.410490:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354688
00000100:00100000:2.0:1767320078.410510:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4879
00000100:00100000:2.0:1767320078.410519:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894354816:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320078.410622:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894354816:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 103us (467us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320078.410630:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4879
00000100:00100000:2.0:1767320078.410649:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17585
00000100:00100000:2.0:1767320078.410654:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894354688:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320078.410686:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320078.410714:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894354688:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 58us (445us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320078.410722:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17585
00000100:00080000:1.0:1767320078.410755:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320078.509356:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320078.765271:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320079.532972:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320079.791363:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320080.365851:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940686080:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320080.365933:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320080.366666:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686080
00000100:00100000:2.0:1767320080.366676:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686080
00000100:00100000:2.0:1767320080.366756:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718
00000100:00100000:2.0:1767320080.366766:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940686080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320080.366840:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320080.366906:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940686080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (971us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320080.366914:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718
00000100:00100000:0.0:1767320080.366972:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940686080:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320080.366987:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320080.558342:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320080.815956:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320081.389258:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940686208:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320081.389334:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320081.389403:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686208
00000100:00100000:3.0:1767320081.389413:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686208
00000100:00100000:3.0:1767320081.389536:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719
00000100:00100000:3.0:1767320081.389548:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940686208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320081.389610:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320081.389747:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320081.393269:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940686208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3713us (3923us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320081.393286:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719
00000100:00100000:1.0:1767320081.396719:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940686208:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320081.581002:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320081.837209:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320081.902536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320081.902548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320081.902551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320081.902563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320081.902567:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320081.902576:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5326
00000100:00080000:2.0:1767320081.902581:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320081.902588:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320081.902634:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ad880 x1853163940686336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320081.902668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320081.902672:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320081.902674:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320081.902678:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5326
00000100:00080000:2.0:1767320081.902680:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320081.902684:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320081.902699:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ad180 x1853163940686464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320081.902767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320081.902770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767320081.903093:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940686720:0@lo:400:kworker.0
00000100:00100000:1.0:1767320081.903166:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320081.903241:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320081.903249:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940686592:0@lo:400:kworker.0
00000100:00100000:1.0:1767320081.903273:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320081.903397:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320081.903401:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686720
00000100:00080000:2.0:1767320081.903404:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5326
00000100:00080000:2.0:1767320081.903407:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320081.903410:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686720
00000100:00080000:2.0:1767320081.903413:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320081.903432:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412adf80 x1853163940686848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320081.903492:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320081.903517:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940686336:0@lo:38:kworker.0
00000100:00100000:0.0:1767320081.903545:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320081.903579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940686464:0@lo:38:kworker.0
00000100:00100000:0.0:1767320081.903604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320081.903632:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686336
00000100:00100000:3.0:1767320081.903635:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686336
00000100:00080000:2.0:1767320081.903712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320081.903717:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320081.903719:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320081.903724:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5326
00000100:00080000:2.0:1767320081.903726:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320081.903730:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320081.903745:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412adc00 x1853163940687104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320081.903877:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686592
00000100:00100000:2.0:1767320081.903882:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686592
00000100:00100000:2.0:1767320081.903915:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162
00000100:00100000:2.0:1767320081.903924:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940686592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320081.903979:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940686592:12345-0@lo:400:kworker.0 Request processed in 57us (704us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320081.903986:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162
00000100:00100000:2.0:1767320081.904009:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940686976:0@lo:400:kworker.0
00000100:00100000:2.0:1767320081.904045:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320081.904101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940686848:0@lo:38:kworker.0
00000100:00100000:0.0:1767320081.904161:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940686592:0@lo:400:kworker.0
00000100:00100000:0.0:1767320081.904194:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686464
00000100:00100000:0.0:1767320081.904198:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686464
00000100:00100000:0.0:1767320081.904219:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231
00000100:00100000:0.0:1767320081.904224:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940686464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320081.904243:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320081.904278:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940686464:12345-0@lo:38:kworker.0 Request processed in 52us (672us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320081.904284:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231
00000100:00100000:3.0:1767320081.911163:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686976
00000100:00100000:3.0:1767320081.911180:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686976
00000100:00100000:3.0:1767320081.911257:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880
00000100:00100000:3.0:1767320081.911267:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940686720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320081.911356:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940686720:12345-0@lo:400:kworker.0 Request processed in 90us (8189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320081.911364:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880
00000100:00100000:3.0:1767320081.911382:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881
00000100:00100000:3.0:1767320081.911389:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940686976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320081.911425:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940686976:12345-0@lo:400:kworker.0 Request processed in 37us (7379us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320081.911430:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881
00000100:00100000:3.0:1767320081.911444:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17586
00000100:00100000:3.0:1767320081.911449:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940686336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320081.911469:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320081.911498:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940686336:12345-0@lo:38:kworker.0 Request processed in 49us (7953us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320081.911505:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17586
00000100:00080000:3.0:1767320081.911520:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320081.911563:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940686720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320081.911604:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320081.911639:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940687104:0@lo:38:kworker.0
00000100:00100000:3.0:1767320081.911668:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320081.911685:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320081.911690:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320081.911694:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940686336:0@lo:38:kworker.0
00000100:00080000:3.0:1767320081.911704:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320081.911707:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320081.911710:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940686464:0@lo:38:kworker.0
00000100:00100000:3.0:1767320081.911730:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940686848
00000100:00100000:3.0:1767320081.911733:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940686848
00000100:00100000:3.0:1767320081.911744:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687104
00000100:00100000:0.0:1767320081.911790:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17587
00000100:00100000:0.0:1767320081.911796:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940686848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320081.911807:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320081.911850:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940686848:12345-0@lo:38:kworker.0 Request processed in 53us (245us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320081.911856:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17587
00000100:00100000:0.0:1767320081.911915:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940686976:0@lo:400:kworker.0
00000100:00100000:3.0:1767320081.918592:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687104
00000100:00100000:3.0:1767320081.918665:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17588
00000100:00100000:3.0:1767320081.918675:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940687104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320081.918699:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320081.918805:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940687104:12345-0@lo:38:kworker.0 Request processed in 128us (7134us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320081.918812:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17588
00000100:00080000:3.0:1767320081.918873:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320081.918879:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320081.918882:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940687104:0@lo:38:kworker.0
00000100:00080000:3.0:1767320081.918896:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320081.918900:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320081.918903:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940686848:0@lo:38:kworker.0
00000100:00100000:3.0:1767320082.604857:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320082.861121:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320083.526827:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320083.526941:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894354944
00000100:00100000:0.0:1767320083.526951:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894354944
00000100:00100000:0.0:1767320083.527009:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17589
00000100:00100000:0.0:1767320083.527018:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894354944:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320083.527042:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320083.527287:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894354944:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 267us (469us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320083.527296:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17589
00000100:00100000:2.0:1767320083.528040:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320083.528238:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355072
00000100:00100000:0.0:1767320083.528245:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355072
00000100:00100000:0.0:1767320083.528340:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4882
00000100:00100000:0.0:1767320083.528349:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894355072:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320083.528453:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894355072:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 105us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320083.528461:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4882
00000100:00080000:3.0:1767320083.528711:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320083.628980:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320083.885036:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320084.653423:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320084.909176:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320085.487977:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940687232:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320085.488057:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320085.489569:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687232
00000100:00100000:2.0:1767320085.489581:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687232
00000100:00100000:2.0:1767320085.489673:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720
00000100:00100000:2.0:1767320085.489683:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940687232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320085.489731:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320085.489846:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940687232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (1786us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320085.489855:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720
00000100:00100000:2.0:1767320085.489914:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940687232:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320085.489995:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320085.676904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320085.933157:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320086.512301:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940687360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320086.512633:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320086.512889:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687360
00000100:00100000:2.0:1767320086.512897:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687360
00000100:00100000:2.0:1767320086.512971:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721
00000100:00100000:2.0:1767320086.512980:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940687360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320086.513010:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320086.513104:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940687360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (704us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320086.513111:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721
00000100:00080000:3.0:1767320086.513281:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320086.519228:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940687360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320086.701114:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320086.959900:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320087.020946:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320061/real 1767320061]  req@ffff93cf51ea4a80 x1853163940681472/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320086 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320087.020987:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51ea4a80 x1853163940681472/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320086 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320087.021007:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320087.021033:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320087.021038:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940681472:0@lo:250:kworker.0
00000100:00080000:1.0:1767320087.021082:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320087.021089:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320087.021092:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320087.021098:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5311
00000100:00080000:1.0:1767320087.021103:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320087.021109:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320087.021144:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965c00 x1853163940687488/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320087.021418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940687488:0@lo:250:kworker.0
00000400:00000100:0.0:1767320087.021467:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940687488 offset 0 length 520: 4
00000100:00080000:1.0:1767320087.021535:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320087.021540:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320087.021542:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320087.021546:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5331
00000100:00080000:1.0:1767320087.021548:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320087.021552:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320087.021572:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47964000 x1853163940687616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320087.021679:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940687616:0@lo:38:kworker.0
00000100:00100000:0.0:1767320087.021900:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.021958:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687616
00000100:00100000:2.0:1767320087.021966:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687616
00000100:00100000:2.0:1767320087.022017:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17590
00000100:00100000:2.0:1767320087.022026:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940687616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320087.022058:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320087.022130:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320087.022135:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320087.022137:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320087.022142:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5331
00000100:00080000:1.0:1767320087.022145:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320087.022150:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320087.022297:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940687744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320087.022522:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940687744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320087.022554:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.022750:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940687616:12345-0@lo:38:kworker.0 Request processed in 723us (850us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320087.022760:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17590
00000100:00100000:2.0:1767320087.022824:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940687872:0@lo:400:kworker.0
00000100:00080000:1.0:1767320087.022830:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320087.022835:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320087.022838:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320087.022843:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5331
00000100:00080000:1.0:1767320087.022846:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320087.022852:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320087.022858:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.022883:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320087.022889:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940688000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320087.022911:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.022936:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687872
00000100:00100000:2.0:1767320087.022941:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687872
00000100:00100000:1.0:1767320087.022945:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c380 x1853163940688256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320087.022969:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320087.022973:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320087.022975:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320087.022980:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5331
00000100:00080000:1.0:1767320087.022983:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320087.022987:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688000
00000100:00080000:1.0:1767320087.022988:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320087.022993:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688000
00000100:00100000:1.0:1767320087.023005:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433f800 x1853163940688512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320087.023019:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163
00000100:00100000:2.0:1767320087.023030:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940687872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320087.023044:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940688384:0@lo:400:kworker.0
00000100:00100000:2.0:1767320087.023081:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940687872:12345-0@lo:400:kworker.0 Request processed in 52us (221us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320087.023089:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.023094:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163
00000100:00100000:2.0:1767320087.023110:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164
00000100:00100000:1.0:1767320087.023117:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320087.023123:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940688128:0@lo:400:kworker.0
00000100:00100000:2.0:1767320087.023132:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940688000:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320087.023145:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320087.023181:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940688000:12345-0@lo:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320087.023187:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164
00000100:00080000:2.0:1767320087.023213:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320087.023239:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940688000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320087.023250:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940687872:0@lo:400:kworker.0
00000100:00100000:1.0:1767320087.023258:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688384
00000100:00100000:1.0:1767320087.023264:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688384
00000100:00100000:2.0:1767320087.023312:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688128
00000100:00100000:2.0:1767320087.023316:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688128
00000100:00100000:2.0:1767320087.023348:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883
00000100:00100000:2.0:1767320087.023355:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940688128:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320087.023394:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940688128:12345-0@lo:400:kworker.0 Request processed in 40us (249us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320087.023399:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883
00000100:00080000:2.0:1767320087.023414:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320087.023859:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884
00000100:00100000:1.0:1767320087.023866:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940688384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320087.023989:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940688384:12345-0@lo:400:kworker.0 Request processed in 123us (903us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320087.023999:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884
00000100:00100000:1.0:1767320087.024036:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940688128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320087.024047:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940688384:0@lo:400:kworker.0
00000100:00080000:2.0:1767320087.024565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320087.025135:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940687744
00000100:00100000:0.0:1767320087.025143:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940687744
00000100:00100000:0.0:1767320087.025188:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232
00000100:00100000:0.0:1767320087.025194:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940687744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320087.025214:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320087.025268:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940687744:12345-0@lo:38:kworker.0 Request processed in 72us (2711us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320087.025274:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232
00000100:00080000:3.0:1767320087.025594:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320087.025601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320087.025605:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940687616:0@lo:38:kworker.0
00000100:00100000:3.0:1767320087.025633:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940688256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320087.025661:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320087.026585:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940688512:0@lo:38:kworker.0
00000100:00100000:3.0:1767320087.026619:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320087.029369:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688256
00000100:00100000:1.0:1767320087.029385:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688256
00000100:00080000:3.0:1767320087.029428:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320087.029438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320087.029443:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940687744:0@lo:38:kworker.0
00000100:00100000:1.0:1767320087.029498:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688512
00000100:00100000:1.0:1767320087.029502:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688512
00000100:00100000:2.0:1767320087.029721:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17591
00000100:00100000:2.0:1767320087.029729:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320087.029754:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320087.029843:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688256:12345-0@lo:38:kworker.0 Request processed in 112us (4179us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320087.029849:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17591
00000100:00100000:2.0:1767320087.029868:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17592
00000100:00100000:2.0:1767320087.029872:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320087.029881:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320087.029906:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688512:12345-0@lo:38:kworker.0 Request processed in 32us (3286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320087.029911:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17592
00000100:00080000:3.0:1767320087.030571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320087.030588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320087.030592:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940688256:0@lo:38:kworker.0
00000100:00080000:3.0:1767320087.030603:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320087.030607:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320087.030610:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940688512:0@lo:38:kworker.0
00000100:00100000:3.0:1767320087.725632:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320087.981211:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320088.647862:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320088.647916:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320088.647985:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355328
00000100:00100000:2.0:1767320088.647999:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355328
00000100:00100000:2.0:1767320088.648094:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355200
00000100:00100000:2.0:1767320088.648098:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355200
00000100:00100000:2.0:1767320088.648120:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4885
00000100:00100000:2.0:1767320088.648131:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894355328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320088.648227:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894355328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 97us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320088.648235:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4885
00000100:00100000:2.0:1767320088.648258:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17593
00000100:00100000:2.0:1767320088.648262:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894355200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320088.648285:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320088.648312:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894355200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (397us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320088.648319:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17593
00000100:00080000:3.0:1767320088.648504:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320088.748882:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320089.010790:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320089.772903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320090.029080:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320090.605012:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320090.605031:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940688640:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320090.605090:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320090.605318:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688640
00000100:00100000:2.0:1767320090.605327:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688640
00000100:00100000:2.0:1767320090.605389:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722
00000100:00100000:2.0:1767320090.605395:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940688640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320090.605421:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320090.605455:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940688640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (365us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320090.605460:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722
00000100:00080000:3.0:1767320090.605627:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320090.605665:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940688640:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320090.796914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320091.053116:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320091.629592:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940688768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320091.629679:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320091.629787:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688768
00000100:00100000:1.0:1767320091.629797:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688768
00000100:00100000:1.0:1767320091.629865:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723
00000100:00100000:1.0:1767320091.629875:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940688768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320091.629906:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320091.629953:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940688768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320091.629961:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723
00000100:00080000:3.0:1767320091.630017:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320091.630063:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940688768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320091.820913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320092.077510:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320092.140903:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320092.140915:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320092.140919:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320092.140923:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320092.140928:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320092.140936:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5337
00000100:00080000:1.0:1767320092.140941:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320092.140948:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320092.140986:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940688896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320092.141012:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320092.141017:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320092.141019:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320092.141022:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5337
00000100:00080000:1.0:1767320092.141025:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320092.141029:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320092.141042:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433c000 x1853163940689024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320092.141129:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940689152:0@lo:400:kworker.0
00000100:00100000:2.0:1767320092.141210:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320092.141473:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689152
00000100:00100000:0.0:1767320092.141482:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689152
00000100:00100000:3.0:1767320092.141493:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940688896:0@lo:38:kworker.0
00000100:00100000:0.0:1767320092.141542:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165
00000100:00100000:3.0:1767320092.141548:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320092.141556:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940689152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320092.141574:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940689024:0@lo:38:kworker.0
00000100:00100000:3.0:1767320092.141607:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320092.141636:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320092.141650:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940688896
00000100:00100000:3.0:1767320092.141655:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940688896
00000100:00080000:1.0:1767320092.141658:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320092.141663:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320092.141665:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320092.141669:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5337
00000100:00080000:1.0:1767320092.141672:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320092.141676:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320092.141684:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17594
00000100:00100000:1.0:1767320092.141691:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219dc00 x1853163940689536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320092.141692:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320092.141716:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320092.141722:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320092.141727:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320092.141729:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320092.141732:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5337
00000100:00080000:1.0:1767320092.141736:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320092.141741:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320092.141753:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940688896:12345-0@lo:38:kworker.0 Request processed in 60us (218us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320092.141756:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219c700 x1853163940689792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320092.141765:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17594
00000100:00100000:1.0:1767320092.141815:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940689280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320092.141818:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689024
00000100:00100000:3.0:1767320092.141823:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689024
00000100:00100000:3.0:1767320092.141847:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233
00000100:00100000:1.0:1767320092.141853:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320092.141856:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940689024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320092.141867:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320092.141900:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940689024:12345-0@lo:38:kworker.0 Request processed in 45us (291us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320092.141906:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233
00000100:00100000:1.0:1767320092.141911:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940689408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320092.141928:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940689664:0@lo:400:kworker.0
00000100:00100000:1.0:1767320092.141939:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320092.141963:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320092.141997:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689408
00000100:00100000:1.0:1767320092.142002:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689408
00000100:00100000:3.0:1767320092.142005:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689664
00000100:00100000:3.0:1767320092.142011:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689664
00000100:00100000:1.0:1767320092.142041:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4886
00000100:00100000:1.0:1767320092.142049:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940689408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320092.142052:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887
00000100:00100000:3.0:1767320092.142065:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940689664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320092.142095:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940689408:12345-0@lo:400:kworker.0 Request processed in 46us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320092.142103:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4886
00000100:00100000:3.0:1767320092.142109:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940689664:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320092.142116:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887
00000100:00080000:1.0:1767320092.142126:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320092.142159:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940689664:0@lo:400:kworker.0
00000100:00100000:1.0:1767320092.142160:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940689408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320092.142192:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940689536:0@lo:38:kworker.0
00000100:00100000:3.0:1767320092.142217:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320092.142237:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940689792:0@lo:38:kworker.0
00000100:00100000:3.0:1767320092.142256:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320092.142367:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940689152:12345-0@lo:400:kworker.0 Request processed in 815us (1156us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320092.142374:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165
00000100:00100000:0.0:1767320092.142387:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689280
00000100:00100000:0.0:1767320092.142392:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689280
00000100:00100000:0.0:1767320092.142413:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166
00000100:00100000:0.0:1767320092.142419:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940689280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320092.142450:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940689280:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320092.142455:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166
00000100:00100000:0.0:1767320092.142492:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940689280:0@lo:400:kworker.0
00000100:00100000:2.0:1767320092.142568:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940689152:0@lo:400:kworker.0
00000100:00080000:3.0:1767320092.143345:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320092.143351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320092.143354:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940688896:0@lo:38:kworker.0
00000100:00100000:1.0:1767320092.143359:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689536
00000100:00080000:3.0:1767320092.143362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320092.143365:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320092.143367:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689536
00000100:00100000:3.0:1767320092.143368:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940689024:0@lo:38:kworker.0
00000100:00100000:1.0:1767320092.143401:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689792
00000100:00100000:1.0:1767320092.143405:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689792
00000100:00100000:1.0:1767320092.143434:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17595
00000100:00100000:1.0:1767320092.143440:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940689536:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320092.143443:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17596
00000100:00100000:0.0:1767320092.143452:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940689792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320092.143471:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767320092.143477:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320092.143526:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940689536:12345-0@lo:38:kworker.0 Request processed in 84us (1307us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320092.143528:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940689792:12345-0@lo:38:kworker.0 Request processed in 75us (1269us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320092.143541:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17595
00000100:00100000:0.0:1767320092.143553:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17596
00000100:00080000:3.0:1767320092.143748:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320092.143752:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320092.143755:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940689536:0@lo:38:kworker.0
00000100:00080000:3.0:1767320092.143763:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320092.143766:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320092.143768:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940689792:0@lo:38:kworker.0
00000100:00100000:3.0:1767320092.844952:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320093.102313:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320093.766490:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320093.766548:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320093.766646:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355584
00000100:00100000:0.0:1767320093.766656:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355584
00000100:00100000:0.0:1767320093.766729:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355456
00000100:00100000:0.0:1767320093.766732:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355456
00000100:00100000:0.0:1767320093.766753:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4888
00000100:00100000:0.0:1767320093.766764:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894355584:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320093.766915:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894355584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 153us (434us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320093.766923:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4888
00000100:00100000:0.0:1767320093.766948:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17597
00000100:00100000:0.0:1767320093.766953:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894355456:12345-192.168.202.21@tcp:38:kworker.0
00000100:00080000:1.0:1767320093.766969:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767320093.766972:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320093.766998:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894355456:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (450us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320093.767005:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17597
00000100:00100000:3.0:1767320093.868899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320094.125003:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320094.892924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320095.150294:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320095.725666:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320095.725692:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940689920:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320095.725763:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320095.726548:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940689920
00000100:00100000:2.0:1767320095.726558:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940689920
00000100:00100000:2.0:1767320095.726681:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724
00000100:00100000:2.0:1767320095.726691:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940689920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320095.726727:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320095.726833:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940689920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (1069us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320095.726841:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724
00000100:00080000:1.0:1767320095.727147:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320095.727544:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940689920:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320095.916900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320096.173191:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320096.749112:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940690048:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320096.749186:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320096.750533:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690048
00000100:00100000:0.0:1767320096.750544:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690048
00000100:00100000:0.0:1767320096.750617:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725
00000100:00100000:0.0:1767320096.750627:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940690048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320096.750679:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320096.751350:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320096.757577:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940690048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6942us (8381us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320096.757593:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725
00000100:00100000:3.0:1767320096.761641:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940690048:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320096.940887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320097.199591:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320097.261083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320097.261096:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320097.261099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320097.261103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320097.261107:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320097.261116:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320097.261120:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320097.261128:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320097.261172:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412afb80 x1853163940690176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320097.261201:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320097.261205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320097.261207:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320097.261210:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320097.261213:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320097.261216:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320097.261231:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ae300 x1853163940690304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320097.261305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320097.261308:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320097.261310:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320097.261314:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320097.261316:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320097.261320:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320097.261334:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940690816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320097.261350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320097.261353:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320097.261355:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320097.261358:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320097.261360:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320097.261364:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320097.261374:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965f80 x1853163940691072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320097.261402:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940690688:0@lo:400:kworker.0
00000100:00100000:2.0:1767320097.261485:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320097.261545:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320097.261552:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940690944:0@lo:400:kworker.0
00000100:00100000:2.0:1767320097.261574:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320097.261614:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690688
00000100:00100000:2.0:1767320097.261621:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690688
00000100:00100000:2.0:1767320097.261673:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690944
00000100:00100000:2.0:1767320097.261676:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690944
00000100:00100000:2.0:1767320097.261699:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889
00000100:00100000:2.0:1767320097.261706:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940690688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320097.261806:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940690688:12345-0@lo:400:kworker.0 Request processed in 65us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320097.261814:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889
00000100:00100000:2.0:1767320097.261831:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890
00000100:00100000:2.0:1767320097.261837:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940690944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.261857:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940690560:0@lo:400:kworker.0
00000100:00100000:2.0:1767320097.261864:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940690944:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320097.261869:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890
00000100:00100000:0.0:1767320097.261904:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320097.261906:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940690944:0@lo:400:kworker.0
00000100:00100000:2.0:1767320097.261916:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940690688:0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.261930:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320097.261935:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940690432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.261954:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320097.261975:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690432
00000100:00100000:2.0:1767320097.261975:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690560
00000100:00100000:0.0:1767320097.261979:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690432
00000100:00100000:2.0:1767320097.261979:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690560
00000100:00080000:1.0:1767320097.262053:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320097.262059:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320097.262100:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167
00000100:00100000:0.0:1767320097.262107:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940690560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.262140:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940690560:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320097.262146:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167
00000100:00100000:0.0:1767320097.262156:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168
00000100:00100000:0.0:1767320097.262161:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940690432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.262184:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940690432:12345-0@lo:400:kworker.0 Request processed in 23us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320097.262189:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168
00000100:00100000:0.0:1767320097.262219:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940690432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320097.262228:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940690560:0@lo:400:kworker.0
00000100:00100000:3.0:1767320097.262318:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940690176:0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.262349:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320097.262378:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940690304:0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.262404:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320097.262434:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940690816:0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.262456:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320097.262472:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940691072:0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.262492:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320097.262522:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690304
00000100:00100000:3.0:1767320097.262526:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690304
00000100:00100000:3.0:1767320097.262549:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234
00000100:00100000:3.0:1767320097.262554:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940690304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320097.262572:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320097.262573:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690176
00000100:00100000:0.0:1767320097.262576:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690176
00000100:00100000:0.0:1767320097.262594:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940690816
00000100:00100000:0.0:1767320097.262597:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940690816
00000100:00100000:3.0:1767320097.262604:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940690304:12345-0@lo:38:kworker.0 Request processed in 50us (200us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320097.262608:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691072
00000100:00100000:0.0:1767320097.262610:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691072
00000100:00100000:3.0:1767320097.262611:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234
00000100:00100000:0.0:1767320097.262622:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17598
00000100:00100000:0.0:1767320097.262627:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940690176:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767320097.262635:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:0.0:1767320097.262636:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320097.262639:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320097.262642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940690304:0@lo:38:kworker.0
00000100:00100000:0.0:1767320097.262667:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940690176:12345-0@lo:38:kworker.0 Request processed in 39us (317us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320097.262674:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17598
00000100:00080000:3.0:1767320097.262684:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320097.262685:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17599
00000100:00080000:3.0:1767320097.262687:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320097.262689:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940690816:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.262690:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940690176:0@lo:38:kworker.0
00010000:00020000:0.0:1767320097.262711:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320097.262714:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17600
00000100:00100000:3.0:1767320097.262718:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940691072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320097.262728:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320097.262739:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940690816:12345-0@lo:38:kworker.0 Request processed in 48us (282us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320097.262745:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17599
00000100:00100000:3.0:1767320097.262747:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940691072:12345-0@lo:38:kworker.0 Request processed in 29us (254us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320097.262752:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17600
00000100:00080000:3.0:1767320097.262771:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320097.262788:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320097.262791:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940690816:0@lo:38:kworker.0
00000100:00080000:3.0:1767320097.262801:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320097.262804:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320097.262807:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940691072:0@lo:38:kworker.0
00000100:00100000:3.0:1767320097.965110:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320098.222762:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320098.893635:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320098.893679:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320098.893742:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355840
00000100:00100000:3.0:1767320098.893754:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355840
00000100:00100000:1.0:1767320098.893975:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894355712
00000100:00100000:1.0:1767320098.893981:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894355712
00000100:00100000:3.0:1767320098.893996:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4891
00000100:00100000:3.0:1767320098.894066:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894355840:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320098.894145:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894355840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (518us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320098.895704:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320098.897629:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17601
00000100:00100000:1.0:1767320098.897642:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894355712:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320098.897668:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320098.897754:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894355712:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 112us (4073us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320098.897762:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17601
00000100:00100000:3.0:1767320098.899692:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4891
00000100:00100000:3.0:1767320098.990794:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320099.245936:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320100.013320:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320100.269617:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320100.845251:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320100.845995:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940691200:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320100.846076:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320100.846210:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691200
00000100:00100000:2.0:1767320100.846221:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691200
00000100:00100000:2.0:1767320100.846602:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726
00000100:00100000:2.0:1767320100.846614:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940691200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320100.846652:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320100.846718:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940691200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (641us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320100.846726:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726
00000100:00100000:0.0:1767320100.846961:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940691200:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320100.847816:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320101.037886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320101.293318:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320101.869663:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940691328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320101.869746:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320101.870124:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691328
00000100:00100000:3.0:1767320101.870132:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691328
00000100:00100000:3.0:1767320101.870205:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727
00000100:00100000:3.0:1767320101.870217:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940691328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320101.870248:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320101.870292:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940691328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (546us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320101.870299:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727
00000100:00080000:0.0:1767320101.870454:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320101.870506:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940691328:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320102.061191:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320102.317055:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320102.391623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320102.391635:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320102.391638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320102.391642:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320102.391646:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320102.391654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320102.391659:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320102.391666:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320102.391716:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0bb80 x1853163940691456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320102.391732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320102.391736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320102.391737:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320102.391741:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320102.391743:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320102.391747:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320102.391761:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08380 x1853163940691584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320102.391842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320102.391845:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320102.391847:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320102.391851:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320102.391853:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320102.391859:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940691712:0@lo:400:kworker.0
00000100:00080000:3.0:1767320102.391859:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320102.391874:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08a80 x1853163940692096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320102.391891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320102.391895:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320102.391896:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320102.391900:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320102.391903:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320102.391906:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320102.391920:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940692352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320102.391932:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320102.391945:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940691968:0@lo:400:kworker.0
00000100:00100000:3.0:1767320102.391983:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320102.392007:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320102.392010:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320102.392017:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940691840:0@lo:400:kworker.0
00000100:00100000:3.0:1767320102.392020:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940692224:0@lo:400:kworker.0
00000100:00100000:2.0:1767320102.392054:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320102.392059:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320102.392100:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691712
00000100:00100000:3.0:1767320102.392101:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691968
00000100:00100000:2.0:1767320102.392109:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691712
00000100:00100000:3.0:1767320102.392109:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691968
00000100:00100000:2.0:1767320102.392162:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691840
00000100:00100000:2.0:1767320102.392165:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691840
00000100:00100000:2.0:1767320102.392185:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169
00000100:00100000:2.0:1767320102.392194:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940691712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320102.392211:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692224
00000100:00100000:1.0:1767320102.392217:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692224
00000100:00100000:2.0:1767320102.392251:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940691712:12345-0@lo:400:kworker.0 Request processed in 58us (319us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320102.392259:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892
00000100:00100000:2.0:1767320102.392260:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169
00000100:00100000:1.0:1767320102.392271:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940692224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320102.392281:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170
00000100:00100000:2.0:1767320102.392290:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940691840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320102.392319:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940692224:12345-0@lo:400:kworker.0 Request processed in 49us (259us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320102.392327:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940691840:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320102.392330:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892
00000100:00100000:2.0:1767320102.392337:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170
00000100:00100000:2.0:1767320102.392402:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940691840:0@lo:400:kworker.0
00000100:00100000:2.0:1767320102.392411:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940691712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320102.392452:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940692224:0@lo:400:kworker.0
00000100:00100000:3.0:1767320102.392761:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893
00000100:00100000:3.0:1767320102.392770:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940691968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320102.392844:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940691968:12345-0@lo:400:kworker.0 Request processed in 77us (860us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320102.392850:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893
00000100:00100000:2.0:1767320102.392876:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940691968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320102.392960:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940691456:0@lo:38:kworker.0
00000100:00100000:0.0:1767320102.392991:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320102.393016:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940691584:0@lo:38:kworker.0
00000100:00100000:0.0:1767320102.393038:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320102.393060:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940692096:0@lo:38:kworker.0
00000100:00100000:2.0:1767320102.393082:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691584
00000100:00100000:0.0:1767320102.393083:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320102.393088:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691584
00000100:00100000:0.0:1767320102.393102:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940692352:0@lo:38:kworker.0
00000100:00100000:2.0:1767320102.393113:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235
00000100:00100000:2.0:1767320102.393119:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940691584:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320102.393126:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767320102.393138:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320102.393178:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940691584:12345-0@lo:38:kworker.0 Request processed in 58us (139us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320102.393184:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235
00000100:00100000:0.0:1767320102.393192:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940691456
00000100:00100000:0.0:1767320102.393197:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940691456
00000100:00080000:2.0:1767320102.393213:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320102.393220:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320102.393222:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692096
00000100:00100000:0.0:1767320102.393226:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692096
00000100:00100000:0.0:1767320102.393245:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692352
00000100:00100000:0.0:1767320102.393247:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692352
00000100:00100000:2.0:1767320102.393253:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17602
00000100:00100000:2.0:1767320102.393259:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940691456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320102.393269:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320102.393296:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940691456:12345-0@lo:38:kworker.0 Request processed in 34us (303us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320102.402132:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17603
00000100:00100000:0.0:1767320102.402146:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940692096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320102.402695:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320102.402809:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940692096:12345-0@lo:38:kworker.0 Request processed in 663us (9724us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320102.402836:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17603
00000100:00100000:0.0:1767320102.402902:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17604
00000100:00100000:0.0:1767320102.402907:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940692352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320102.402918:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320102.402945:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940692352:12345-0@lo:38:kworker.0 Request processed in 36us (9820us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320102.402951:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17604
00000100:00100000:2.0:1767320102.403010:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17602
00000100:00080000:2.0:1767320102.403396:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320102.403402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320102.403406:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940691456:0@lo:38:kworker.0
00000100:00080000:2.0:1767320102.403419:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320102.403423:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320102.403426:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940691584:0@lo:38:kworker.0
00000100:00080000:2.0:1767320102.403434:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320102.403638:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320102.403642:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940692096:0@lo:38:kworker.0
00000100:00080000:2.0:1767320102.403668:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320102.403672:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320102.403676:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940692352:0@lo:38:kworker.0
00000100:00100000:0.0:1767320102.983736:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:0.0:1767320102.983799:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894355968 offset 0 length 520: 4
00000100:00100000:0.0:1767320102.983829:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320102.986244:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356224
00000100:00100000:3.0:1767320102.986259:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356224
00000100:00100000:3.0:1767320102.986348:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356096
00000100:00100000:3.0:1767320102.986352:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356096
00000100:00100000:3.0:1767320102.986397:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4894
00000100:00100000:3.0:1767320102.986408:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356224:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320102.986490:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356224:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (2763us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320102.986498:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4894
00000100:00100000:1.0:1767320102.986643:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17605
00000100:00100000:1.0:1767320102.986650:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894356096:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320102.986673:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320102.986704:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894356096:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (2874us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320102.986710:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17605
00000100:00080000:0.0:1767320102.986947:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320103.085065:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320103.341077:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320104.109016:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320104.365147:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320105.132902:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320105.389178:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320105.965162:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940692480:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320105.965366:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320105.965705:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692480
00000100:00100000:2.0:1767320105.965713:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692480
00000100:00100000:2.0:1767320105.965802:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728
00000100:00100000:2.0:1767320105.965812:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940692480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320105.965840:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320105.965885:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940692480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (520us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320105.965893:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728
00000100:00080000:0.0:1767320105.966076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320105.966129:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940692480:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320106.157026:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320106.413037:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320106.989943:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940692608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320106.990023:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320106.992637:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692608
00000100:00100000:3.0:1767320106.992651:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692608
00000100:00100000:3.0:1767320106.993073:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729
00000100:00100000:3.0:1767320106.993084:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940692608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320106.993117:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320106.993155:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320106.993199:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940692608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (3174us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320106.993206:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729
00000100:00100000:1.0:1767320106.995670:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940692608:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320107.181662:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320107.437204:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320107.501438:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320107.501450:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320107.501453:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320107.501457:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320107.501462:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320107.501471:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320107.501476:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320107.501483:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320107.501525:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412ad880 x1853163940692736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320107.501542:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320107.501545:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320107.501547:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320107.501548:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940692736:0@lo:38:kworker.0
00000100:00080000:2.0:1767320107.501550:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320107.501552:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320107.501556:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320107.501568:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0412aea00 x1853163940692864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320107.501616:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320107.501637:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320107.501641:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320107.501642:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320107.501645:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320107.501648:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320107.501651:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320107.501663:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08a80 x1853163940693248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320107.501678:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940692864:0@lo:38:kworker.0
00000100:00080000:2.0:1767320107.501700:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320107.501703:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320107.501705:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767320107.501710:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940692992:0@lo:400:kworker.0
00000100:00080000:2.0:1767320107.501711:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320107.501715:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320107.501721:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320107.501736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320107.501738:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0bb80 x1853163940693504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320107.501757:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320107.501761:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940693248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320107.501770:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940693120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320107.501877:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692864
00000100:00100000:3.0:1767320107.501885:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692864
00000100:00100000:3.0:1767320107.501920:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236
00000100:00100000:3.0:1767320107.501928:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940692864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320107.501947:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320107.505835:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320107.505912:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940693504:0@lo:38:kworker.0
00000100:00100000:0.0:1767320107.505947:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320107.505991:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692992
00000100:00100000:0.0:1767320107.505999:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692992
00000100:00100000:0.0:1767320107.506059:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171
00000100:00100000:0.0:1767320107.506068:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940692992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320107.506113:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320107.506117:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940692992:12345-0@lo:400:kworker.0 Request processed in 51us (4362us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320107.506124:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171
00000100:00100000:2.0:1767320107.506175:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940692736
00000100:00100000:2.0:1767320107.506180:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940692736
00000100:00100000:2.0:1767320107.506203:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693248
00000100:00100000:2.0:1767320107.506205:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693248
00000100:00100000:2.0:1767320107.506217:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693504
00000100:00100000:2.0:1767320107.506219:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693504
00000100:00100000:2.0:1767320107.506227:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693120
00000100:00100000:2.0:1767320107.506229:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693120
00000100:00100000:2.0:1767320107.506247:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895
00000100:00100000:2.0:1767320107.506255:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940693120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320107.506290:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940693120:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320107.506297:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895
00000100:00100000:2.0:1767320107.506396:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17606
00000100:00100000:2.0:1767320107.506400:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940692736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320107.506419:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320107.506453:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940692736:12345-0@lo:38:kworker.0 Request processed in 51us (4836us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320107.506458:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17606
00000100:00100000:2.0:1767320107.506471:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17607
00000100:00100000:2.0:1767320107.506475:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940693248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320107.506484:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320107.506763:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17608
00000100:00100000:0.0:1767320107.506769:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940693504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320107.506826:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320107.506856:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940693504:12345-0@lo:38:kworker.0 Request processed in 85us (907us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320107.506862:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17608
00000100:00080000:0.0:1767320107.506880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320107.506884:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320107.506912:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320107.506917:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320107.506920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940693504:0@lo:38:kworker.0
00000100:00080000:0.0:1767320107.506932:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320107.506935:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320107.506938:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940692736:0@lo:38:kworker.0
00000100:00100000:0.0:1767320107.506970:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320107.506981:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940693376:0@lo:400:kworker.0
00000100:00100000:0.0:1767320107.507007:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320107.507031:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693376
00000100:00100000:2.0:1767320107.507031:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940693248:12345-0@lo:38:kworker.0 Request processed in 553us (1202us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320107.507035:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693376
00000100:00100000:2.0:1767320107.507036:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17607
00000100:00100000:0.0:1767320107.507062:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896
00000100:00080000:2.0:1767320107.507064:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320107.507067:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940693376:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320107.507068:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320107.507071:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940693248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320107.507097:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940693120:0@lo:400:kworker.0
00000100:00100000:0.0:1767320107.507101:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940693376:12345-0@lo:400:kworker.0 Request processed in 35us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320107.507107:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896
00000100:00080000:0.0:1767320107.507119:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320107.507134:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940693376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320107.508531:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940692992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320107.508958:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940692864:12345-0@lo:38:kworker.0 Request processed in 7027us (7224us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320107.508968:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236
00000100:00080000:2.0:1767320107.509143:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320107.509149:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320107.509152:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940692864:0@lo:38:kworker.0
00000100:00100000:3.0:1767320108.102940:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320108.103933:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320108.122741:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356480
00000100:00100000:2.0:1767320108.122757:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356480
00000100:00100000:1.0:1767320108.122975:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356352
00000100:00100000:1.0:1767320108.122980:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356352
00000100:00100000:1.0:1767320108.123028:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4897
00000100:00100000:1.0:1767320108.123039:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356480:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320108.123205:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 167us (20276us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320108.123212:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4897
00000100:00100000:1.0:1767320108.123233:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17609
00000100:00100000:1.0:1767320108.123237:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894356352:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320108.123259:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320108.123286:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894356352:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 47us (19355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320108.123291:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17609
00000100:00080000:2.0:1767320108.123961:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320108.205819:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320108.461200:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320109.228910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320109.485046:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320110.253520:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320110.509015:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320111.085281:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940693632:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320111.085384:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320111.085749:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693632
00000100:00100000:2.0:1767320111.085758:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693632
00000100:00100000:2.0:1767320111.085892:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730
00000100:00100000:2.0:1767320111.085903:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940693632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320111.085938:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320111.086004:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940693632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (620us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320111.086011:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730
00000100:00100000:1.0:1767320111.086091:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940693632:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320111.088822:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320111.276920:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320111.534239:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320112.109370:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320112.109399:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940693760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320112.109485:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320112.109656:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940693760
00000100:00100000:2.0:1767320112.109665:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940693760
00000100:00100000:2.0:1767320112.109733:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731
00000100:00100000:2.0:1767320112.109743:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940693760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320112.109797:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320112.109846:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940693760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320112.109853:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731
00000100:00080000:0.0:1767320112.109912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320112.110202:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940693760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320112.302652:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320112.557093:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320112.621180:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320087/real 1767320087]  req@ffff93cf47965c00 x1853163940687488/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320112.621214:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47965c00 x1853163940687488/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320112.621233:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320112.621242:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320112.621245:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940687488:0@lo:250:kworker.0
00000100:00080000:3.0:1767320112.624635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320112.624646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320112.624650:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320112.624658:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5337
00000100:00080000:3.0:1767320112.624663:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320112.624669:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320112.624705:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940693888/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320112.624741:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320112.624745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320112.624747:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320112.624750:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320112.624752:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320112.624756:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320112.624810:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e680 x1853163940694016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320112.624819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320112.624830:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320112.624833:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320112.624837:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320112.624838:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320112.624841:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320112.624855:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940694144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320112.624916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320112.624919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320112.624920:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320112.624923:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320112.624926:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320112.624929:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320112.624940:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940694528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320112.624957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320112.624961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320112.624962:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320112.624965:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320112.624967:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320112.624970:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320112.624979:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96d80 x1853163940694784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320112.625009:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940694400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.625072:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320112.625136:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320112.625142:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940694656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.625164:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320112.625195:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694400
00000100:00100000:3.0:1767320112.625202:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694400
00000100:00100000:3.0:1767320112.625247:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694656
00000100:00100000:3.0:1767320112.625262:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694656
00000100:00100000:3.0:1767320112.625294:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898
00000100:00100000:3.0:1767320112.625301:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940694400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.625343:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940694400:12345-0@lo:400:kworker.0 Request processed in 43us (271us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320112.625350:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898
00000100:00100000:3.0:1767320112.625365:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899
00000100:00100000:3.0:1767320112.625370:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940694656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.625400:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940694656:12345-0@lo:400:kworker.0 Request processed in 20us (226us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320112.625406:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899
00000100:00080000:3.0:1767320112.625421:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320112.625447:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940694656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.625456:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940694400:0@lo:400:kworker.0
00000100:00100000:1.0:1767320112.625659:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320112.625669:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940694272:0@lo:400:kworker.0
00000100:00100000:1.0:1767320112.625702:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320112.626101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940693888:0@lo:250:kworker.0
00000400:00000100:2.0:1767320112.626127:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940693888 offset 0 length 520: 4
00000100:00100000:2.0:1767320112.626148:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940694016:0@lo:38:kworker.0
00000100:00100000:2.0:1767320112.626169:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320112.626196:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940694144:0@lo:38:kworker.0
00000100:00100000:2.0:1767320112.626217:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320112.626243:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940694528:0@lo:38:kworker.0
00000100:00100000:1.0:1767320112.626357:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694144
00000100:00100000:1.0:1767320112.626361:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694144
00000100:00100000:1.0:1767320112.626386:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237
00000100:00100000:1.0:1767320112.626401:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940694144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320112.626420:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320112.626455:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940694144:12345-0@lo:38:kworker.0 Request processed in 62us (236us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320112.626460:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237
00000100:00100000:0.0:1767320112.626583:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694016
00000100:00100000:0.0:1767320112.626588:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694016
00000100:00100000:0.0:1767320112.626618:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17610
00000100:00100000:0.0:1767320112.626623:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940694016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320112.626633:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320112.626660:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940694016:12345-0@lo:38:kworker.0 Request processed in 37us (490us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320112.626666:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17610
00000100:00100000:2.0:1767320112.626720:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320112.626745:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940694784:0@lo:38:kworker.0
00000100:00100000:2.0:1767320112.626764:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320112.626822:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320112.626827:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320112.626831:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940694016:0@lo:38:kworker.0
00000100:00080000:2.0:1767320112.626839:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320112.626842:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320112.626844:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940694144:0@lo:38:kworker.0
00000100:00100000:2.0:1767320112.626868:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694528
00000100:00100000:2.0:1767320112.626872:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694528
00000100:00100000:2.0:1767320112.626889:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694784
00000100:00100000:2.0:1767320112.626891:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694784
00000100:00100000:2.0:1767320112.626907:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17611
00000100:00100000:2.0:1767320112.626911:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940694528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320112.626920:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320112.626948:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940694528:12345-0@lo:38:kworker.0 Request processed in 35us (227us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320112.626953:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17611
00000100:00100000:2.0:1767320112.626965:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17612
00000100:00100000:2.0:1767320112.626968:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940694784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320112.626977:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320112.626998:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940694784:12345-0@lo:38:kworker.0 Request processed in 28us (233us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320112.627003:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17612
00000100:00080000:2.0:1767320112.627027:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320112.627031:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320112.627034:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940694528:0@lo:38:kworker.0
00000100:00080000:2.0:1767320112.627042:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320112.627045:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320112.627047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940694784:0@lo:38:kworker.0
00000100:00100000:3.0:1767320112.627179:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694272
00000100:00100000:3.0:1767320112.627183:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694272
00000100:00100000:3.0:1767320112.627219:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172
00000100:00100000:3.0:1767320112.627225:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940694272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320112.627285:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940694272:12345-0@lo:400:kworker.0 Request processed in 59us (1582us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320112.627294:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172
00000100:00100000:1.0:1767320112.627496:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940694272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320113.223940:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320113.224044:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320113.224151:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356736
00000100:00100000:1.0:1767320113.224161:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356736
00000100:00100000:1.0:1767320113.224244:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356608
00000100:00100000:1.0:1767320113.224247:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356608
00000100:00080000:0.0:1767320113.224278:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320113.224281:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4900
00000100:00100000:1.0:1767320113.224290:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320113.224311:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17613
00000100:00100000:0.0:1767320113.224317:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894356608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320113.224342:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320113.224446:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894356736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 157us (517us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320113.224458:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4900
00000100:00100000:0.0:1767320113.229698:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894356608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 5369us (5643us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320113.229716:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17613
00000100:00100000:2.0:1767320113.325363:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320113.581040:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320114.350136:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320114.605066:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320115.373343:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320115.629218:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320116.205176:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320116.205200:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940694912:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320116.205303:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320116.205660:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940694912
00000100:00100000:3.0:1767320116.205669:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940694912
00000100:00100000:3.0:1767320116.205737:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732
00000100:00100000:3.0:1767320116.205749:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940694912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320116.205816:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320116.205876:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940694912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320116.205883:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732
00000100:00100000:1.0:1767320116.206083:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940694912:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320116.207262:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320116.397008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320116.653078:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320117.229083:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940695040:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320117.229166:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320117.230579:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695040
00000100:00100000:3.0:1767320117.230590:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695040
00000100:00100000:3.0:1767320117.230665:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733
00000100:00100000:3.0:1767320117.230676:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940695040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320117.230707:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767320117.230789:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320117.232590:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940695040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1911us (3417us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320117.232602:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733
00000100:00100000:1.0:1767320117.241750:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940695040:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320117.423132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320117.677457:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320117.741156:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320117.741167:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320117.741170:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320117.741174:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320117.741179:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320117.741187:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320117.741192:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320117.741199:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320117.741254:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96a00 x1853163940695168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320117.741282:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320117.741286:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320117.741288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320117.741370:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320117.741374:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320117.741378:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320117.741394:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94380 x1853163940695296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320117.741488:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320117.741576:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940695168:0@lo:38:kworker.0
00000100:00100000:2.0:1767320117.741670:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320117.741719:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940695296:0@lo:38:kworker.0
00000100:00100000:2.0:1767320117.741746:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320117.742000:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320117.742009:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940695552:0@lo:400:kworker.0
00000100:00100000:0.0:1767320117.742036:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320117.742066:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695168
00000100:00100000:0.0:1767320117.742072:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695168
00000100:00100000:0.0:1767320117.742101:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695552
00000100:00100000:0.0:1767320117.742103:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695552
00000100:00100000:0.0:1767320117.742143:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901
00000100:00100000:0.0:1767320117.742152:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940695552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320117.742196:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940695552:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320117.742203:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901
00000100:00100000:0.0:1767320117.742221:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17614
00000100:00100000:0.0:1767320117.742234:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940695168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320117.742253:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320117.742301:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940695168:12345-0@lo:38:kworker.0 Request processed in 74us (630us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320117.742307:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17614
00000100:00080000:0.0:1767320117.742324:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320117.742357:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940695552:0@lo:400:kworker.0
00000100:00100000:0.0:1767320117.742425:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695296
00000100:00100000:0.0:1767320117.742429:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695296
00000100:00100000:0.0:1767320117.742449:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238
00000100:00100000:0.0:1767320117.742453:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940695296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320117.742463:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320117.742488:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940695296:12345-0@lo:38:kworker.0 Request processed in 34us (742us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320117.742494:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238
00000100:00080000:0.0:1767320117.742545:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320117.742550:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320117.742553:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940695168:0@lo:38:kworker.0
00000100:00080000:0.0:1767320117.742561:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320117.742564:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320117.742567:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940695296:0@lo:38:kworker.0
00000100:00100000:0.0:1767320117.747835:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940695424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320117.748182:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320117.748486:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695424
00000100:00100000:1.0:1767320117.748497:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695424
00000100:00100000:1.0:1767320117.748560:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173
00000100:00100000:1.0:1767320117.748571:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940695424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320117.748760:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940695424:12345-0@lo:400:kworker.0 Request processed in 190us (578us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320117.748768:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173
00000100:00080000:3.0:1767320117.749366:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320117.749371:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320117.749376:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320117.749382:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320117.749386:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320117.749391:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320117.749430:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940695680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320117.749477:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320117.749481:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320117.749482:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320117.749486:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320117.749488:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320117.749492:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320117.749504:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94380 x1853163940695936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320117.749529:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940695808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320117.749567:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320117.749610:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695808
00000100:00100000:3.0:1767320117.749614:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695808
00000100:00100000:3.0:1767320117.749655:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902
00000100:00100000:3.0:1767320117.749662:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940695808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320117.749695:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940695808:12345-0@lo:400:kworker.0 Request processed in 34us (128us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320117.749701:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902
00000100:00100000:3.0:1767320117.749738:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940695808:0@lo:400:kworker.0
00000100:00100000:1.0:1767320117.749830:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940695680:0@lo:38:kworker.0
00000100:00100000:1.0:1767320117.749858:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320117.749882:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940695936:0@lo:38:kworker.0
00000100:00100000:1.0:1767320117.749901:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320117.749943:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695680
00000100:00100000:1.0:1767320117.749947:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695680
00000100:00100000:1.0:1767320117.749964:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940695936
00000100:00100000:1.0:1767320117.749967:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940695936
00000100:00100000:1.0:1767320117.749983:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17615
00000100:00100000:1.0:1767320117.749987:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940695680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320117.750008:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320117.750051:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940695680:12345-0@lo:38:kworker.0 Request processed in 50us (180us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320117.750058:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17615
00000100:00100000:1.0:1767320117.750070:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17616
00000100:00100000:1.0:1767320117.750074:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940695936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320117.750083:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320117.750106:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940695936:12345-0@lo:38:kworker.0 Request processed in 30us (203us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320117.750111:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17616
00000100:00080000:1.0:1767320117.750137:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320117.750142:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320117.750145:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940695680:0@lo:38:kworker.0
00000100:00080000:1.0:1767320117.750152:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320117.750154:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320117.750157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940695936:0@lo:38:kworker.0
00000100:00080000:0.0:1767320117.752203:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320117.755366:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940695424:0@lo:400:kworker.0
00000100:00100000:1.0:1767320118.353513:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320118.353600:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320118.353859:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356992
00000100:00100000:3.0:1767320118.353870:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356992
00000100:00100000:3.0:1767320118.353947:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894356864
00000100:00100000:3.0:1767320118.353951:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894356864
00000100:00100000:3.0:1767320118.353971:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4903
00000100:00100000:3.0:1767320118.353985:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894356992:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320118.354066:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894356992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (560us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320118.354073:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4903
00000100:00100000:3.0:1767320118.354093:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17617
00000100:00100000:3.0:1767320118.354098:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894356864:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320118.354118:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320118.354143:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894356864:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (541us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320118.354150:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17617
00000100:00080000:0.0:1767320118.354207:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320118.446048:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320118.701059:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320119.469602:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320119.730427:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320120.493573:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320120.750865:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320121.325870:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940696064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320121.325938:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320121.326181:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696064
00000100:00100000:2.0:1767320121.326191:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696064
00000100:00100000:2.0:1767320121.326276:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734
00000100:00100000:2.0:1767320121.326285:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940696064:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320121.326471:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767320121.326503:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320121.326560:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940696064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 276us (621us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320121.326568:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734
00000100:00100000:0.0:1767320121.326714:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940696064:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320121.516896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320121.773247:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320122.350549:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940696192:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320122.350626:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320122.350749:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696192
00000100:00100000:2.0:1767320122.350758:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696192
00000100:00100000:2.0:1767320122.350842:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735
00000100:00100000:2.0:1767320122.350853:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940696192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320122.350882:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320122.350933:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940696192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (306us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320122.350941:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735
00000100:00100000:2.0:1767320122.350987:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940696192:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320122.351918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320122.540903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320122.797474:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320122.860992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320122.861002:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320122.861005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320122.861009:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320122.861013:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320122.861021:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320122.861025:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320122.861032:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320122.861077:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2a00 x1853163940696320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320122.861104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320122.861107:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320122.861109:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320122.861112:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320122.861114:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320122.861118:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320122.861130:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940696448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320122.861198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320122.861201:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320122.861203:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320122.861206:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320122.861208:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320122.861212:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320122.861223:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0700 x1853163940696832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320122.861238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320122.861241:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320122.861243:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320122.861246:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320122.861248:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320122.861251:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320122.861259:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0e00 x1853163940697088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320122.861282:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940696704:0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.861350:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320122.861415:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320122.861421:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940696960:0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.861439:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320122.861469:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696704
00000100:00100000:1.0:1767320122.861476:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696704
00000100:00100000:1.0:1767320122.861525:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696960
00000100:00100000:1.0:1767320122.861528:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696960
00000100:00100000:1.0:1767320122.861551:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904
00000100:00100000:1.0:1767320122.861558:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940696704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.861600:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940696704:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320122.861607:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904
00000100:00100000:1.0:1767320122.861621:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905
00000100:00100000:1.0:1767320122.861626:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940696960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.861646:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940696960:12345-0@lo:400:kworker.0 Request processed in 20us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320122.861651:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905
00000100:00080000:1.0:1767320122.861667:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320122.861693:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940696960:0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.861702:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940696704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320122.861819:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940696576:0@lo:400:kworker.0
00000100:00100000:2.0:1767320122.861848:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320122.862086:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940696320:0@lo:38:kworker.0
00000100:00100000:3.0:1767320122.862115:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320122.862139:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940696448:0@lo:38:kworker.0
00000100:00100000:3.0:1767320122.862160:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320122.862174:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940696832:0@lo:38:kworker.0
00000100:00100000:3.0:1767320122.862203:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320122.862216:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940697088:0@lo:38:kworker.0
00000100:00100000:3.0:1767320122.862233:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320122.862301:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696320
00000100:00100000:2.0:1767320122.862306:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696320
00000100:00100000:2.0:1767320122.862332:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696832
00000100:00100000:2.0:1767320122.862335:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696832
00000100:00100000:2.0:1767320122.862347:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697088
00000100:00100000:2.0:1767320122.862350:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697088
00000100:00100000:2.0:1767320122.862377:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17618
00000100:00100000:2.0:1767320122.862381:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940696320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320122.862400:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320122.862434:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940696320:12345-0@lo:38:kworker.0 Request processed in 51us (317us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320122.862441:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17618
00000100:00100000:2.0:1767320122.862453:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17619
00000100:00100000:2.0:1767320122.862457:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940696832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320122.862466:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320122.862487:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940696832:12345-0@lo:38:kworker.0 Request processed in 28us (283us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320122.862493:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17619
00000100:00100000:2.0:1767320122.862503:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17620
00000100:00100000:2.0:1767320122.862506:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940697088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320122.862515:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320122.862535:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940697088:12345-0@lo:38:kworker.0 Request processed in 27us (301us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320122.862541:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17620
00000100:00080000:2.0:1767320122.862571:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320122.862575:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320122.862578:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940696320:0@lo:38:kworker.0
00000100:00080000:2.0:1767320122.862585:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320122.862588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320122.862590:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940696832:0@lo:38:kworker.0
00000100:00080000:2.0:1767320122.862599:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320122.862601:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320122.862604:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940697088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320122.862883:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696576
00000100:00100000:1.0:1767320122.862887:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696576
00000100:00100000:1.0:1767320122.862926:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174
00000100:00100000:1.0:1767320122.862933:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940696576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320122.862972:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940696576:12345-0@lo:400:kworker.0 Request processed in 40us (1123us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320122.862978:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174
00000100:00100000:1.0:1767320122.863009:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940696576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320122.863384:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940696448
00000100:00100000:0.0:1767320122.863390:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940696448
00000100:00100000:0.0:1767320122.863420:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239
00000100:00100000:0.0:1767320122.863424:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940696448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320122.863436:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320122.863476:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940696448:12345-0@lo:38:kworker.0 Request processed in 50us (1315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320122.863482:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239
00000100:00080000:0.0:1767320122.863506:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320122.863510:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320122.863513:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940696448:0@lo:38:kworker.0
00000100:00100000:2.0:1767320123.464760:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320123.464846:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320123.464864:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357248
00000100:00100000:3.0:1767320123.464875:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357248
00000100:00100000:3.0:1767320123.464993:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357120
00000100:00100000:3.0:1767320123.464997:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357120
00000100:00100000:2.0:1767320123.465030:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4906
00000100:00100000:2.0:1767320123.465043:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894357248:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320123.465058:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17621
00000100:00100000:0.0:1767320123.465066:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894357120:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320123.465085:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320123.465136:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894357248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (384us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320123.465145:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4906
00000100:00100000:0.0:1767320123.465351:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894357120:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 282us (502us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320123.465358:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17621
00000100:00080000:1.0:1767320123.465794:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320123.564891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320123.821233:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320124.589544:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320124.847618:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320125.614014:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320125.869351:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320126.447799:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940697216:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320126.447871:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320126.448037:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697216
00000100:00100000:2.0:1767320126.448046:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697216
00000100:00100000:2.0:1767320126.448108:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736
00000100:00100000:2.0:1767320126.448117:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940697216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320126.448187:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320126.448243:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940697216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320126.448250:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736
00000100:00080000:1.0:1767320126.449845:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320126.449866:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940697216:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320126.637984:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320126.893290:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320127.468987:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320127.469017:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940697344:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320127.469365:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320127.469558:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697344
00000100:00100000:2.0:1767320127.469567:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697344
00000100:00080000:1.0:1767320127.469620:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320127.469634:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737
00000100:00100000:2.0:1767320127.469646:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940697344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320127.469677:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320127.469885:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940697344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 240us (633us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320127.469894:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737
00000100:00100000:0.0:1767320127.469967:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0712dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940697344:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320127.661357:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320127.917968:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320127.980924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320127.980936:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320127.980939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320127.980943:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320127.982155:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320127.982167:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5372
00000100:00080000:1.0:1767320127.982171:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320127.982178:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320127.982220:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2d80 x1853163940697472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320127.982311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940697472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320127.982382:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320127.982566:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697472
00000100:00100000:0.0:1767320127.982574:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697472
00000100:00100000:0.0:1767320127.982623:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17622
00000100:00100000:0.0:1767320127.982630:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940697472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320127.982651:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320127.984206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320127.984213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320127.984217:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320127.984222:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5372
00000100:00080000:1.0:1767320127.984226:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320127.984232:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320127.984265:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a1500 x1853163940697600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320127.984518:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940697600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320127.984574:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320127.986237:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940697472:12345-0@lo:38:kworker.0 Request processed in 3596us (3844us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320127.986251:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17622
00000100:00100000:3.0:1767320127.986396:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697600
00000100:00100000:3.0:1767320127.986407:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697600
00000100:00080000:1.0:1767320127.986583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320127.986588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320127.986592:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320127.986596:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5372
00000100:00080000:1.0:1767320127.986600:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320127.986606:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320127.986635:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0380 x1853163940698112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320127.986655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320127.986658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320127.986660:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320127.986663:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5372
00000100:00080000:1.0:1767320127.986665:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320127.986669:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320127.986680:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3100 x1853163940698368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320127.986710:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940697984:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.986762:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320127.986815:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320127.986821:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940698240:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.986844:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320127.986872:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940697856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.986911:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320127.986938:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320127.986944:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940697728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.986980:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320127.987006:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697856
00000100:00100000:1.0:1767320127.987010:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697856
00000100:00100000:1.0:1767320127.987044:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697728
00000100:00100000:1.0:1767320127.987047:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697728
00000100:00100000:1.0:1767320127.987067:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175
00000100:00100000:1.0:1767320127.987074:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940697856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987121:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940697856:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320127.987127:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175
00000100:00100000:1.0:1767320127.987152:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176
00000100:00100000:1.0:1767320127.987159:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940697728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987186:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940697728:12345-0@lo:400:kworker.0 Request processed in 29us (206us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320127.987192:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176
00000100:00100000:1.0:1767320127.987236:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940697728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987246:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940697856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987274:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940697984
00000100:00100000:1.0:1767320127.987277:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940697984
00000100:00100000:1.0:1767320127.987308:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698240
00000100:00100000:1.0:1767320127.987311:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698240
00000100:00100000:1.0:1767320127.987331:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907
00000100:00100000:1.0:1767320127.987338:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940697984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987372:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940697984:12345-0@lo:400:kworker.0 Request processed in 34us (610us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320127.987378:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907
00000100:00100000:1.0:1767320127.987390:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908
00000100:00100000:1.0:1767320127.987396:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940698240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987421:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940698240:12345-0@lo:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320127.987426:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908
00000100:00100000:1.0:1767320127.987451:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940698240:0@lo:400:kworker.0
00000100:00100000:1.0:1767320127.987461:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940697984:0@lo:400:kworker.0
00000100:00080000:1.0:1767320127.987476:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320127.987953:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240
00000100:00100000:3.0:1767320127.987961:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940697600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320127.987982:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320127.988019:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940697600:12345-0@lo:38:kworker.0 Request processed in 57us (3445us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320127.988026:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240
00000100:00080000:2.0:1767320127.988241:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320127.988246:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320127.988254:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940697472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320127.988274:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940698112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320127.988301:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320127.988326:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940698368:0@lo:38:kworker.0
00000100:00100000:2.0:1767320127.988344:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320127.988362:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320127.988366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320127.988369:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940697600:0@lo:38:kworker.0
00000100:00100000:1.0:1767320127.988502:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698112
00000100:00100000:1.0:1767320127.988506:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698112
00000100:00100000:1.0:1767320127.988534:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698368
00000100:00100000:1.0:1767320127.988537:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698368
00000100:00100000:1.0:1767320127.988553:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17623
00000100:00100000:1.0:1767320127.988557:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940698112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320127.988568:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320127.988598:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940698112:12345-0@lo:38:kworker.0 Request processed in 40us (297us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320127.988603:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17623
00000100:00100000:1.0:1767320127.988613:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17624
00000100:00100000:1.0:1767320127.988616:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940698368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320127.990216:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320127.990279:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940698368:12345-0@lo:38:kworker.0 Request processed in 1660us (1933us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320127.990289:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17624
00000100:00080000:2.0:1767320127.990416:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320127.990422:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320127.990425:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940698112:0@lo:38:kworker.0
00000100:00080000:2.0:1767320127.990434:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320127.990438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320127.990440:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940698368:0@lo:38:kworker.0
00000400:00000100:2.0:1767320128.586324:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894357376 offset 0 length 520: 4
00000100:00100000:2.0:1767320128.586403:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320128.586529:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320128.586684:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357504
00000100:00100000:1.0:1767320128.586703:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357504
00000100:00100000:1.0:1767320128.586817:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357632
00000100:00100000:1.0:1767320128.586821:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357632
00000100:00100000:1.0:1767320128.586889:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4909
00000100:00100000:1.0:1767320128.586901:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894357632:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:2.0:1767320128.586996:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320128.587005:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894357632:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (473us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320128.587016:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4909
00000100:00100000:1.0:1767320128.587042:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17625
00000100:00100000:1.0:1767320128.587048:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894357504:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320128.587071:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320128.587106:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894357504:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320128.587115:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17625
00000100:00100000:2.0:1767320128.685619:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320128.945485:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320129.710102:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320129.965698:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320130.733018:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320130.989162:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320131.565489:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320131.565518:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940698496:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320131.565610:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320131.565830:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698496
00000100:00100000:2.0:1767320131.565841:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698496
00000100:00100000:2.0:1767320131.565937:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738
00000100:00100000:2.0:1767320131.565950:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940698496:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320131.565970:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767320131.565994:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320131.566051:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940698496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (440us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320131.566057:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738
00000100:00100000:1.0:1767320131.566146:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940698496:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320131.756851:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320132.014718:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320132.591529:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320132.591565:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940698624:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320132.591681:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320132.592170:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698624
00000100:00100000:2.0:1767320132.592184:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698624
00000100:00100000:2.0:1767320132.592279:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739
00000100:00100000:2.0:1767320132.592291:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940698624:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320132.592297:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:2.0:1767320132.592340:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320132.592419:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940698624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (737us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320132.592428:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739
00000100:00100000:0.0:1767320132.592555:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940698624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320132.783067:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320133.037107:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320133.102305:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320133.102329:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320133.102332:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320133.102337:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320133.102343:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320133.102354:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5378
00000100:00080000:3.0:1767320133.102359:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320133.102369:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320133.102421:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940698752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320133.102453:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320133.102457:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320133.102468:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320133.102472:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5378
00000100:00080000:3.0:1767320133.102474:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320133.102478:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320133.102491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940698880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320133.102579:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320133.102583:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320133.102585:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320133.102589:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5378
00000100:00080000:3.0:1767320133.102591:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320133.102596:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320133.102611:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221880 x1853163940699392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320133.102627:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320133.102630:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320133.102632:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320133.102635:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5378
00000100:00080000:3.0:1767320133.102637:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320133.102641:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320133.102649:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940699648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320133.102685:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940699264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.102806:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320133.102880:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320133.102886:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940699520:0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.102909:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320133.102944:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699264
00000100:00100000:3.0:1767320133.102952:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699264
00000100:00100000:3.0:1767320133.103013:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699520
00000100:00100000:3.0:1767320133.103017:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699520
00000100:00100000:3.0:1767320133.103044:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910
00000100:00100000:3.0:1767320133.103052:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940699264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.103120:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940699264:12345-0@lo:400:kworker.0 Request processed in 68us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.103128:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910
00000100:00100000:3.0:1767320133.103150:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911
00000100:00100000:3.0:1767320133.103157:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940699520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.103183:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940699520:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.103188:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911
00000100:00080000:3.0:1767320133.103211:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320133.103250:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940699520:0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.103261:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940699264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.103443:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940699136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.103485:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320133.103523:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320133.103529:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940699008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.103563:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320133.103725:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940698752:0@lo:38:kworker.0
00000100:00100000:2.0:1767320133.103760:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320133.103797:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940698880:0@lo:38:kworker.0
00000100:00100000:2.0:1767320133.103823:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320133.103851:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940699392:0@lo:38:kworker.0
00000100:00100000:2.0:1767320133.103875:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320133.103891:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940699648:0@lo:38:kworker.0
00000100:00100000:2.0:1767320133.103911:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320133.104565:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699136
00000100:00100000:1.0:1767320133.104573:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699136
00000100:00100000:0.0:1767320133.104606:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698752
00000100:00100000:0.0:1767320133.104610:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698752
00000100:00100000:1.0:1767320133.104626:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699008
00000100:00100000:1.0:1767320133.104630:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699008
00000100:00100000:0.0:1767320133.104633:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699392
00000100:00100000:0.0:1767320133.104635:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699392
00000100:00100000:0.0:1767320133.104644:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699648
00000100:00100000:0.0:1767320133.104647:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699648
00000100:00100000:0.0:1767320133.104659:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17626
00000100:00100000:1.0:1767320133.104659:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177
00000100:00100000:0.0:1767320133.104666:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940698752:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.104666:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940699136:12345-0@lo:400:kworker.0
00010000:00020000:0.0:1767320133.104703:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320133.104728:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940699136:12345-0@lo:400:kworker.0 Request processed in 61us (1241us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320133.104735:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177
00000100:00100000:0.0:1767320133.104738:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940698752:12345-0@lo:38:kworker.0 Request processed in 73us (977us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320133.104743:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17626
00000100:00100000:1.0:1767320133.104750:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178
00000100:00100000:0.0:1767320133.104754:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17627
00000100:00100000:1.0:1767320133.104756:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940699008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.104758:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940699392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320133.104797:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320133.104808:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940699008:12345-0@lo:400:kworker.0 Request processed in 52us (1243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320133.104814:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178
00000100:00100000:0.0:1767320133.104817:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940699392:12345-0@lo:38:kworker.0 Request processed in 58us (942us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320133.104822:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17627
00000100:00100000:0.0:1767320133.104844:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17628
00000100:00100000:0.0:1767320133.104848:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940699648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320133.104855:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320133.104855:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940699008:0@lo:400:kworker.0
00000100:00100000:1.0:1767320133.104865:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940699136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.104878:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940699648:12345-0@lo:38:kworker.0 Request processed in 29us (966us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320133.104884:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17628
00000100:00080000:1.0:1767320133.104904:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.104909:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.104913:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940698752:0@lo:38:kworker.0
00000100:00080000:1.0:1767320133.104922:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.104925:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.104928:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940699392:0@lo:38:kworker.0
00000100:00080000:1.0:1767320133.104939:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.104942:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.104944:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940699648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320133.105897:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940698880
00000100:00100000:3.0:1767320133.105907:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940698880
00000100:00100000:3.0:1767320133.105956:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241
00000100:00100000:3.0:1767320133.105963:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940698880:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320133.105977:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320133.106044:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940698880:12345-0@lo:38:kworker.0 Request processed in 80us (2219us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320133.106051:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241
00000100:00080000:3.0:1767320133.106094:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320133.108894:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.108909:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.108914:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940698880:0@lo:38:kworker.0
00000100:00100000:3.0:1767320133.706682:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320133.707149:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357888
00000100:00100000:1.0:1767320133.707160:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357888
00000100:00100000:1.0:1767320133.707345:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4912
00000100:00100000:1.0:1767320133.707356:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894357888:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767320133.707559:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320133.707743:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894357888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 387us (1163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320133.707753:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4912
00000100:00100000:2.0:1767320133.712756:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320133.719610:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894357760
00000100:00100000:1.0:1767320133.719632:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894357760
00000100:00100000:1.0:1767320133.719797:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17629
00000100:00100000:1.0:1767320133.719819:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894357760:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320133.719865:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320133.719954:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894357760:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 135us (7208us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320133.719962:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17629
00000100:00100000:2.0:1767320133.804940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320134.061061:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320134.828901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320135.085401:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320135.854048:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320136.110382:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320136.686363:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940699776:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320136.686437:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320136.693750:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940699776
00000100:00100000:3.0:1767320136.693767:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940699776
00000100:00100000:3.0:1767320136.693969:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740
00000100:00100000:3.0:1767320136.693982:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940699776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320136.694024:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320136.694152:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940699776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (7714us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320136.694159:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740
00000100:00100000:1.0:1767320136.694283:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940699776:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320136.695624:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320136.877350:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320137.133182:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320137.197592:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320112/real 1767320112]  req@ffff93cf4430ce00 x1853163940693888/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320137 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320137.197626:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4430ce00 x1853163940693888/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320137 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320137.197646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320137.197672:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320137.197676:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940693888:0@lo:250:kworker.0
00000100:00080000:3.0:1767320137.198076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320137.198082:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320137.198086:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320137.198091:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320137.198095:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320137.198101:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320137.198131:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223800 x1853163940699904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320137.198191:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940699904:0@lo:250:kworker.0
00000400:00000100:1.0:1767320137.198242:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940699904 offset 0 length 520: 4
00000100:00080000:3.0:1767320137.198299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320137.198303:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320137.198305:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320137.198309:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5383
00000100:00080000:3.0:1767320137.198312:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320137.198316:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320137.198331:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222d80 x1853163940700032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320137.201457:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940700032:0@lo:38:kworker.0
00000100:00100000:1.0:1767320137.201538:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320137.202069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320137.202075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320137.202078:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320137.202083:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5383
00000100:00080000:3.0:1767320137.202087:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320137.202093:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320137.202128:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940700160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320137.202180:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940700160:0@lo:38:kworker.0
00000100:00100000:1.0:1767320137.202213:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.202292:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700032
00000100:00100000:2.0:1767320137.202300:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700032
00000100:00100000:2.0:1767320137.202346:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17630
00000100:00100000:2.0:1767320137.202354:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940700032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320137.202376:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320137.202485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320137.202489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320137.202491:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320137.202495:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5383
00000100:00080000:3.0:1767320137.202497:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320137.202501:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320137.202513:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222300 x1853163940700672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320137.202566:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700160
00000100:00100000:0.0:1767320137.202570:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700160
00000100:00100000:0.0:1767320137.202597:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242
00000100:00100000:0.0:1767320137.202602:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940700160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320137.202614:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320137.207817:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940700672:0@lo:38:kworker.0
00000100:00100000:1.0:1767320137.207910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.208338:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940700032:12345-0@lo:38:kworker.0 Request processed in 5980us (6797us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320137.208348:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17630
00000100:00100000:2.0:1767320137.208376:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700672
00000100:00100000:2.0:1767320137.208383:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700672
00000100:00100000:2.0:1767320137.208424:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17631
00000100:00100000:2.0:1767320137.208430:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940700672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320137.208452:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320137.208488:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940700672:12345-0@lo:38:kworker.0 Request processed in 57us (579us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320137.208494:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17631
00000100:00100000:2.0:1767320137.208543:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940700416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.208572:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.208598:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320137.208605:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940700544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.208628:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.208653:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700416
00000100:00100000:2.0:1767320137.208657:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700416
00000100:00100000:2.0:1767320137.208699:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179
00000100:00100000:2.0:1767320137.208705:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940700416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.208747:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940700416:12345-0@lo:400:kworker.0 Request processed in 42us (174us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320137.208754:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179
00000100:00080000:2.0:1767320137.208770:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320137.210244:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700544
00000100:00100000:2.0:1767320137.210253:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700544
00000100:00100000:2.0:1767320137.210307:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913
00000100:00100000:2.0:1767320137.210317:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940700544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.210374:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940700544:12345-0@lo:400:kworker.0 Request processed in 60us (1745us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320137.210381:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913
00000100:00080000:2.0:1767320137.210413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320137.210446:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940700544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.210459:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940700416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.210482:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320137.210493:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940700288:0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.210526:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.210555:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700288
00000100:00100000:2.0:1767320137.210559:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700288
00000100:00100000:2.0:1767320137.210585:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180
00000100:00100000:2.0:1767320137.210590:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940700288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.210623:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940700288:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320137.210629:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180
00000100:00100000:2.0:1767320137.210655:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940700288:0@lo:400:kworker.0
00000100:00080000:3.0:1767320137.213037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320137.213045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320137.213060:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320137.213070:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5383
00000100:00080000:3.0:1767320137.213077:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320137.213093:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320137.213124:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223b80 x1853163940700928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320137.213183:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320137.213204:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940700800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320137.213663:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320137.213746:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700800
00000100:00100000:2.0:1767320137.213754:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700800
00000100:00100000:2.0:1767320137.214034:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914
00000100:00100000:2.0:1767320137.214044:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940700800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320137.214105:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940700800:12345-0@lo:400:kworker.0 Request processed in 63us (442us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320137.214112:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914
00000100:00100000:3.0:1767320137.214663:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940700800:0@lo:400:kworker.0
00000100:00080000:3.0:1767320137.214687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320137.214767:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940700160:12345-0@lo:38:kworker.0 Request processed in 12161us (12551us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320137.214802:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242
00000100:00080000:1.0:1767320137.217085:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320137.217099:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320137.217105:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940700160:0@lo:38:kworker.0
00000100:00080000:1.0:1767320137.217122:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320137.217125:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320137.217128:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940700032:0@lo:38:kworker.0
00000100:00100000:1.0:1767320137.217479:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940700928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320137.218515:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320137.218610:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320137.218615:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320137.218619:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940700672:0@lo:38:kworker.0
00000100:00100000:2.0:1767320137.225101:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940700928
00000100:00100000:2.0:1767320137.225119:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940700928
00000100:00100000:2.0:1767320137.226270:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17632
00000100:00100000:2.0:1767320137.226280:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940700928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320137.226304:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320137.229822:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320137.230003:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320137.230011:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940700928:0@lo:38:kworker.0
00000100:00100000:2.0:1767320137.230169:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940700928:12345-0@lo:38:kworker.0 Request processed in 3885us (11651us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320137.230182:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17632
00000100:00100000:1.0:1767320137.709231:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320137.710364:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940701056:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320137.710439:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320137.710532:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701056
00000100:00100000:3.0:1767320137.710542:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701056
00000100:00100000:3.0:1767320137.710598:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741
00000100:00100000:3.0:1767320137.710607:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940701056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320137.710644:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320137.710694:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940701056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (254us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320137.710703:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741
00000100:00100000:1.0:1767320137.710887:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940701056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320137.900878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320138.160187:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320138.828093:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320138.828557:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358144
00000100:00100000:2.0:1767320138.828568:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358144
00000100:00100000:2.0:1767320138.828661:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4915
00000100:00100000:2.0:1767320138.828671:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894358144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320138.828751:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894358144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (667us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320138.828759:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4915
00000100:00100000:3.0:1767320138.829041:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320138.829066:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358016
00000100:00100000:3.0:1767320138.829071:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358016
00000100:00100000:3.0:1767320138.829093:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17633
00000100:00100000:3.0:1767320138.829098:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894358016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320138.829119:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320138.829661:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894358016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 557us (624us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320138.829669:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17633
00000100:00080000:1.0:1767320138.829974:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320138.924981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320139.181171:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320139.948892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320140.205005:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320140.974534:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320141.229066:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320141.805359:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940701184:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320141.805433:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320141.805600:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701184
00000100:00100000:3.0:1767320141.805609:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701184
00000100:00100000:3.0:1767320141.805695:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742
00000100:00100000:3.0:1767320141.805706:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940701184:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320141.805740:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:1.0:1767320141.805914:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320141.807331:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940701184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1620us (1890us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320141.807344:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742
00000100:00100000:0.0:1767320141.807465:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940701184:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320141.996898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320142.253664:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320142.317064:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320142.317075:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320142.317078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320142.317082:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320142.317238:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320142.317248:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5387
00000100:00080000:3.0:1767320142.317253:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320142.317260:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320142.317302:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45223b80 x1853163940701312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320142.317330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320142.317333:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320142.317335:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320142.317339:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5387
00000100:00080000:3.0:1767320142.317341:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320142.317345:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320142.317358:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222300 x1853163940701440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320142.317423:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940701568:0@lo:400:kworker.0
00000100:00100000:2.0:1767320142.317484:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320142.317560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320142.317562:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320142.317563:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320142.317566:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5387
00000100:00080000:3.0:1767320142.317568:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320142.317571:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320142.317578:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221500 x1853163940701952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320142.317587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320142.317589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320142.317591:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320142.317593:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5387
00000100:00080000:3.0:1767320142.317594:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320142.317596:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320142.317601:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940702208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320142.317617:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940701696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320142.317642:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940701824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320142.317659:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320142.317715:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701824
00000100:00100000:3.0:1767320142.317721:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701824
00000100:00100000:3.0:1767320142.317765:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916
00000100:00100000:3.0:1767320142.317791:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940701824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320142.317848:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940701824:12345-0@lo:400:kworker.0 Request processed in 77us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320142.317856:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916
00000100:00080000:3.0:1767320142.317880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320142.317908:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940701824:0@lo:400:kworker.0
00000100:00100000:2.0:1767320142.317991:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320142.317996:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940702080:0@lo:400:kworker.0
00000100:00100000:2.0:1767320142.318026:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320142.318054:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702080
00000100:00100000:2.0:1767320142.318058:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702080
00000100:00100000:2.0:1767320142.318099:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917
00000100:00100000:2.0:1767320142.318105:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940702080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320142.318139:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940702080:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320142.318144:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917
00000100:00080000:2.0:1767320142.318158:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320142.318187:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940702080:0@lo:400:kworker.0
00000100:00100000:3.0:1767320142.318258:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320142.318360:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940701312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320142.318402:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320142.318422:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940701440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320142.318445:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320142.318462:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940701952:0@lo:38:kworker.0
00000100:00100000:1.0:1767320142.318483:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320142.318499:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940702208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320142.318518:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320142.318546:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701312
00000100:00100000:1.0:1767320142.318550:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701312
00000100:00100000:1.0:1767320142.318578:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702208
00000100:00100000:2.0:1767320142.318578:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701952
00000100:00100000:1.0:1767320142.318582:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702208
00000100:00100000:2.0:1767320142.318585:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701952
00000100:00100000:1.0:1767320142.318602:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17634
00000100:00100000:1.0:1767320142.318609:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940701312:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320142.318614:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17635
00000100:00100000:2.0:1767320142.318620:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940702208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320142.318628:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767320142.318633:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320142.318684:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940701312:12345-0@lo:38:kworker.0 Request processed in 74us (290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320142.318690:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17634
00000100:00100000:1.0:1767320142.318703:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17636
00000100:00100000:1.0:1767320142.318707:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940701952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320142.318716:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320142.318748:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940702208:12345-0@lo:38:kworker.0 Request processed in 125us (228us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320142.318755:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17635
00000100:00100000:2.0:1767320142.318924:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701440
00000100:00100000:2.0:1767320142.318929:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701440
00000100:00100000:2.0:1767320142.318949:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243
00000100:00100000:2.0:1767320142.318953:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940701440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320142.318965:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320142.318991:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940701440:12345-0@lo:38:kworker.0 Request processed in 35us (545us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320142.318997:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243
00000100:00100000:0.0:1767320142.319064:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701568
00000100:00100000:0.0:1767320142.319069:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701568
00000100:00100000:3.0:1767320142.319233:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940701696
00000100:00100000:3.0:1767320142.319238:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940701696
00000100:00100000:0.0:1767320142.319330:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181
00000100:00100000:0.0:1767320142.319339:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940701568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320142.319361:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940701952:12345-0@lo:38:kworker.0 Request processed in 651us (875us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320142.319370:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17636
00000100:00100000:0.0:1767320142.319388:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940701568:12345-0@lo:400:kworker.0 Request processed in 50us (1902us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320142.319395:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181
00000100:00100000:0.0:1767320142.319409:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182
00000100:00100000:0.0:1767320142.319415:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940701696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320142.319448:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940701696:12345-0@lo:400:kworker.0 Request processed in 33us (1190us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320142.319454:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182
00000100:00080000:2.0:1767320142.319480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320142.319528:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940701696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320142.326841:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940701568:0@lo:400:kworker.0
00000100:00080000:1.0:1767320142.346555:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320142.346568:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320142.346574:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940701312:0@lo:38:kworker.0
00000100:00080000:0.0:1767320142.346720:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320142.346725:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320142.346727:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940701440:0@lo:38:kworker.0
00000100:00080000:0.0:1767320142.346738:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320142.346742:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320142.346744:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940701952:0@lo:38:kworker.0
00000100:00080000:0.0:1767320142.346755:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320142.346758:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320142.346760:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940702208:0@lo:38:kworker.0
00000100:00100000:2.0:1767320142.834596:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320142.834622:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940702336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320142.834696:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320142.834824:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702336
00000100:00100000:3.0:1767320142.834832:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702336
00000100:00100000:3.0:1767320142.834890:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743
00000100:00100000:3.0:1767320142.834898:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940702336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320142.834930:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320142.834974:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940702336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320142.834982:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743
00000100:00100000:2.0:1767320142.835641:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940702336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320143.021133:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320143.277150:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320143.942713:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320143.942876:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358400
00000100:00100000:1.0:1767320143.942886:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358400
00000100:00100000:1.0:1767320143.942975:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4918
00000100:00100000:1.0:1767320143.942996:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894358400:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320143.943084:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894358400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (384us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320143.943093:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4918
00000100:00080000:2.0:1767320143.943186:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320143.952350:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320143.952495:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358272
00000100:00100000:1.0:1767320143.952506:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358272
00000100:00100000:1.0:1767320143.959660:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17637
00000100:00100000:1.0:1767320143.959824:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894358272:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320143.959851:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320143.959931:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894358272:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 195us (7594us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320143.959939:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17637
00000100:00100000:2.0:1767320144.044948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320144.308155:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320145.068912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320145.324989:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320146.093000:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320146.350883:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320146.925323:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940702464:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320146.925395:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320146.925530:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702464
00000100:00100000:2.0:1767320146.925539:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702464
00000100:00100000:2.0:1767320146.925622:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744
00000100:00100000:2.0:1767320146.925640:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940702464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320146.925670:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320146.925721:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940702464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320146.925729:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744
00000100:00100000:2.0:1767320146.925802:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940702464:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320146.926277:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320147.116991:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320147.373684:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320147.436941:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320147.436950:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320147.436952:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320147.436966:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320147.436971:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320147.436979:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5392
00000100:00080000:0.0:1767320147.436984:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320147.436990:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320147.437035:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8a80 x1853163940702592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320147.437076:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320147.437079:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320147.437081:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320147.437084:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5392
00000100:00080000:0.0:1767320147.437086:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320147.437090:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320147.437103:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa680 x1853163940702720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320147.437168:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940702848:0@lo:400:kworker.0
00000100:00100000:3.0:1767320147.437238:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320147.437261:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940702592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320147.437291:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320147.437309:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940702720:0@lo:38:kworker.0
00000100:00080000:0.0:1767320147.437341:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767320147.437341:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320147.437344:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320147.437346:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320147.437350:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5392
00000100:00080000:0.0:1767320147.437352:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320147.437356:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320147.437367:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8000 x1853163940703232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320147.437380:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702720
00000100:00100000:2.0:1767320147.437386:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702720
00000100:00100000:1.0:1767320147.437445:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702592
00000100:00100000:1.0:1767320147.437450:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702592
00000100:00100000:1.0:1767320147.437485:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17638
00000100:00100000:1.0:1767320147.437493:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940702592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320147.437512:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320147.437528:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244
00000100:00100000:2.0:1767320147.437533:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940702720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320147.437543:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320147.437549:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940702592:12345-0@lo:38:kworker.0 Request processed in 56us (256us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320147.437556:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17638
00000100:00100000:2.0:1767320147.437563:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940702720:12345-0@lo:38:kworker.0 Request processed in 30us (222us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320147.437568:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244
00000100:00100000:2.0:1767320147.437587:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940703104:0@lo:400:kworker.0
00000100:00100000:1.0:1767320147.437589:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940702976:0@lo:400:kworker.0
00000100:00100000:1.0:1767320147.437610:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320147.437610:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320147.437642:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940703360:0@lo:400:kworker.0
00000100:00100000:1.0:1767320147.437663:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320147.437693:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940703232:0@lo:38:kworker.0
00000100:00100000:1.0:1767320147.437713:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320147.437744:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320147.437748:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320147.437752:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940702592:0@lo:38:kworker.0
00000100:00080000:1.0:1767320147.437760:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320147.437763:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320147.437765:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940702720:0@lo:38:kworker.0
00000100:00100000:2.0:1767320147.437814:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703104
00000100:00100000:1.0:1767320147.437816:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702848
00000100:00100000:1.0:1767320147.437818:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702848
00000100:00100000:2.0:1767320147.437818:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703104
00000100:00100000:1.0:1767320147.437844:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940702976
00000100:00100000:1.0:1767320147.437846:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940702976
00000100:00100000:2.0:1767320147.437848:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703360
00000100:00100000:2.0:1767320147.437850:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703360
00000100:00100000:2.0:1767320147.437863:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703232
00000100:00100000:1.0:1767320147.437866:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183
00000100:00100000:2.0:1767320147.437866:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703232
00000100:00100000:1.0:1767320147.437872:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940702848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320147.437873:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919
00000100:00100000:2.0:1767320147.437878:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940703104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320147.438198:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940703104:12345-0@lo:400:kworker.0 Request processed in 318us (586us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320147.438205:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919
00000100:00100000:2.0:1767320147.438219:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920
00000100:00100000:2.0:1767320147.438225:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940703360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320147.438256:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940703360:12345-0@lo:400:kworker.0 Request processed in 32us (593us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320147.438262:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920
00000100:00100000:2.0:1767320147.438273:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17639
00000100:00100000:2.0:1767320147.438277:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940703232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320147.438288:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320147.438314:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940703232:12345-0@lo:38:kworker.0 Request processed in 35us (600us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320147.438320:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17639
00000100:00080000:0.0:1767320147.438343:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320147.438347:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320147.438349:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320147.438353:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5392
00000100:00080000:0.0:1767320147.438356:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320147.438359:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320147.438376:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9880 x1853163940703488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320147.438489:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184
00000100:00100000:0.0:1767320147.438500:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940702976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320147.438536:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940702976:12345-0@lo:400:kworker.0 Request processed in 40us (926us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320147.438542:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184
00000100:00100000:0.0:1767320147.438588:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940702976:0@lo:400:kworker.0
00000100:00100000:1.0:1767320147.438634:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940702848:12345-0@lo:400:kworker.0 Request processed in 761us (1396us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320147.438641:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183
00000100:00100000:3.0:1767320147.438681:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940702848:0@lo:400:kworker.0
00000100:00080000:3.0:1767320147.438705:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320147.438709:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320147.438835:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940703360:0@lo:400:kworker.0
00000100:00100000:0.0:1767320147.438867:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940703488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320147.438892:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320147.438913:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320147.438918:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320147.438920:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940703232:0@lo:38:kworker.0
00000100:00100000:0.0:1767320147.438941:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703488
00000100:00100000:0.0:1767320147.438945:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703488
00000100:00100000:0.0:1767320147.438977:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17640
00000100:00100000:0.0:1767320147.438982:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940703488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320147.438992:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320147.439022:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940703488:12345-0@lo:38:kworker.0 Request processed in 39us (129us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320147.439028:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17640
00000100:00080000:0.0:1767320147.439062:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320147.439066:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320147.439069:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940703488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320147.439105:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940703104:0@lo:400:kworker.0
00000100:00100000:0.0:1767320147.949144:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320147.949260:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940703616:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320147.949991:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320147.950214:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703616
00000100:00100000:2.0:1767320147.950224:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703616
00000100:00100000:2.0:1767320147.950267:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745
00000100:00100000:2.0:1767320147.950275:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940703616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320147.950304:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320147.950375:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940703616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (385us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320147.950382:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745
00000100:00100000:0.0:1767320147.950474:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940703616:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320148.141255:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320148.398677:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320149.065385:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320149.065463:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358656
00000100:00100000:0.0:1767320149.065475:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358656
00000100:00100000:3.0:1767320149.065487:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320149.065556:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358528
00000100:00100000:0.0:1767320149.065560:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358528
00000100:00100000:0.0:1767320149.065592:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4921
00000100:00100000:0.0:1767320149.065603:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894358656:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320149.065673:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17641
00000100:00100000:1.0:1767320149.065681:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894358528:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:0.0:1767320149.065689:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894358656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320149.065699:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4921
00010000:00020000:1.0:1767320149.065706:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320149.065739:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894358528:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (252us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320149.065747:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17641
00000100:00080000:0.0:1767320149.065749:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320149.164915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320149.426132:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320150.189286:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320150.445161:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320151.212974:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320151.469118:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320152.045091:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320152.045115:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940703744:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320152.045181:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320152.045328:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703744
00000100:00100000:3.0:1767320152.045335:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703744
00000100:00100000:3.0:1767320152.045399:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746
00000100:00100000:3.0:1767320152.045408:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940703744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320152.045435:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320152.045474:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940703744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320152.045480:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746
00000100:00080000:1.0:1767320152.045534:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320152.045568:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940703744:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320152.236909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320152.494126:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320152.557041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320152.557051:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320152.557053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320152.557058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320152.557062:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320152.557069:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5397
00000100:00080000:3.0:1767320152.557073:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320152.557079:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320152.557116:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940703872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320152.557141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320152.557144:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320152.557146:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320152.557149:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5397
00000100:00080000:3.0:1767320152.557151:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320152.557154:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320152.557165:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222a00 x1853163940704000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320152.557222:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320152.557723:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940703872:0@lo:38:kworker.0
00000100:00100000:2.0:1767320152.557815:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320152.557883:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940704000:0@lo:38:kworker.0
00000100:00100000:2.0:1767320152.557919:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320152.557957:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704000
00000100:00100000:2.0:1767320152.557963:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704000
00000100:00080000:3.0:1767320152.557970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320152.557975:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320152.557977:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320152.557981:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5397
00000100:00080000:3.0:1767320152.557984:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320152.557988:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320152.557992:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245
00000100:00100000:2.0:1767320152.557998:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940704000:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320152.558000:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d180 x1853163940704384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00020000:2.0:1767320152.558017:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320152.558019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320152.558022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320152.558023:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320152.558026:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5397
00000100:00080000:3.0:1767320152.558029:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320152.558032:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320152.558040:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940704640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320152.558050:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940704000:12345-0@lo:38:kworker.0 Request processed in 51us (141us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320152.558056:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245
00000100:00100000:3.0:1767320152.558060:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940704256:0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.558087:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320152.558091:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940704512:0@lo:400:kworker.0
00000100:00100000:2.0:1767320152.558114:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320152.558209:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940704384:0@lo:38:kworker.0
00000100:00100000:2.0:1767320152.558234:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320152.562797:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940704128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320152.562877:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320152.563021:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940703872
00000100:00100000:3.0:1767320152.563029:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940703872
00000100:00100000:3.0:1767320152.563043:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704128
00000100:00100000:3.0:1767320152.563045:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704128
00000100:00100000:3.0:1767320152.563099:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185
00000100:00100000:3.0:1767320152.563107:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940704128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.563160:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940704128:12345-0@lo:400:kworker.0 Request processed in 55us (283us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320152.563166:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185
00000100:00100000:3.0:1767320152.563198:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704256
00000100:00100000:3.0:1767320152.563201:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704256
00000100:00100000:3.0:1767320152.563224:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704512
00000100:00100000:3.0:1767320152.563227:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704512
00000100:00100000:3.0:1767320152.563245:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922
00000100:00100000:3.0:1767320152.563262:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940704256:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.563301:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940704256:12345-0@lo:400:kworker.0 Request processed in 40us (5214us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320152.563307:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922
00000100:00100000:3.0:1767320152.563318:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923
00000100:00100000:3.0:1767320152.563323:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940704512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.563348:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940704512:12345-0@lo:400:kworker.0 Request processed in 26us (5234us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320152.563353:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923
00000100:00100000:3.0:1767320152.563362:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17642
00000100:00100000:3.0:1767320152.563365:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940703872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320152.563383:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320152.563405:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940703872:12345-0@lo:38:kworker.0 Request processed in 38us (5591us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320152.563410:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17642
00000100:00100000:3.0:1767320152.563443:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940704256:0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.563485:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940704512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320152.563510:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940704128:0@lo:400:kworker.0
00000100:00080000:3.0:1767320152.563526:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320152.563530:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320152.568396:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940704640:0@lo:38:kworker.0
00000100:00100000:2.0:1767320152.568463:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320152.572074:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320152.572087:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320152.572092:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940703872:0@lo:38:kworker.0
00000100:00080000:2.0:1767320152.572107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320152.572111:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320152.572115:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940704000:0@lo:38:kworker.0
00000100:00100000:0.0:1767320152.573895:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704384
00000100:00100000:0.0:1767320152.573916:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704384
00000100:00100000:0.0:1767320152.573969:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704640
00000100:00100000:0.0:1767320152.573972:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704640
00000100:00100000:0.0:1767320152.573997:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17643
00000100:00100000:0.0:1767320152.574005:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940704384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320152.574027:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320152.574098:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940704384:12345-0@lo:38:kworker.0 Request processed in 93us (15863us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320152.574104:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17643
00000100:00100000:0.0:1767320152.574118:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17644
00000100:00100000:0.0:1767320152.574121:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940704640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320152.574129:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320152.574181:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940704640:12345-0@lo:38:kworker.0 Request processed in 59us (5719us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320152.574186:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17644
00000100:00080000:2.0:1767320152.576013:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320152.576024:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320152.576028:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940704384:0@lo:38:kworker.0
00000100:00080000:2.0:1767320152.576040:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320152.576044:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320152.576047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940704640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320153.069862:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320153.069888:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940704768:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320153.069969:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320153.070382:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704768
00000100:00100000:2.0:1767320153.070393:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704768
00000100:00100000:2.0:1767320153.070452:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747
00000100:00100000:2.0:1767320153.070461:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940704768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320153.070490:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320153.070547:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940704768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (578us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320153.070556:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747
00000100:00100000:0.0:1767320153.070676:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940704768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320153.159757:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767320153.159837:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894358784 offset 0 length 520: 4
00000100:00100000:3.0:1767320153.159861:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320153.159939:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359040
00000100:00100000:2.0:1767320153.159952:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359040
00000100:00100000:2.0:1767320153.160035:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894358912
00000100:00100000:2.0:1767320153.160039:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894358912
00000100:00100000:2.0:1767320153.160064:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4924
00000100:00100000:1.0:1767320153.160073:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17645
00000100:00100000:2.0:1767320153.160076:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894359040:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320153.160084:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894358912:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320153.160109:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320153.160153:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894359040:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (404us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320153.160161:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4924
00000100:00080000:0.0:1767320153.160257:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320153.161482:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894358912:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1391us (1612us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320153.161493:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17645
00000100:00100000:2.0:1767320153.260934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320153.516994:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320154.285033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320154.541158:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320155.308983:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320155.565120:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320156.332906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320156.589008:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320157.166593:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940704896:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320157.167068:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320157.167209:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940704896
00000100:00100000:2.0:1767320157.167218:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940704896
00000100:00100000:2.0:1767320157.167294:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748
00000100:00100000:2.0:1767320157.167304:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940704896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320157.167335:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320157.167387:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940704896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320157.167394:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748
00000100:00080000:1.0:1767320157.168118:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320157.168167:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940704896:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320157.357532:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320157.617951:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320157.677894:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320157.677906:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320157.677909:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320157.677913:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320157.677917:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320157.677925:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5402
00000100:00080000:2.0:1767320157.677930:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320157.677936:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320157.677975:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399e300 x1853163940705024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320157.678006:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320157.678009:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320157.678011:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320157.678014:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5402
00000100:00080000:2.0:1767320157.678017:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320157.678020:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320157.678031:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399ca80 x1853163940705152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320157.678071:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320157.678075:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320157.678076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320157.678079:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5402
00000100:00080000:2.0:1767320157.678081:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320157.678084:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320157.678094:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399e680 x1853163940705536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320157.678112:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320157.678115:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320157.678116:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320157.678118:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5402
00000100:00080000:2.0:1767320157.678120:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320157.678124:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320157.678131:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940705792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320157.678189:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940705280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320157.678250:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320157.678307:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320157.678312:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940705408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320157.678333:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320157.678356:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940705664:0@lo:400:kworker.0
00000100:00100000:3.0:1767320157.678374:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320157.678400:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705408
00000100:00100000:3.0:1767320157.678406:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705408
00000100:00100000:3.0:1767320157.678447:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705664
00000100:00100000:3.0:1767320157.678449:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705664
00000100:00100000:3.0:1767320157.678470:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925
00000100:00100000:3.0:1767320157.678476:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940705408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320157.678517:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940705408:12345-0@lo:400:kworker.0 Request processed in 41us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320157.678618:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705280
00000100:00100000:2.0:1767320157.678623:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705280
00000100:00100000:2.0:1767320157.678652:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186
00000100:00100000:2.0:1767320157.678659:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940705280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320157.678699:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925
00000100:00100000:2.0:1767320157.678731:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940705280:12345-0@lo:400:kworker.0 Request processed in 72us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320157.678737:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186
00000100:00100000:2.0:1767320157.678797:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940705408:0@lo:400:kworker.0
00000100:00100000:2.0:1767320157.678810:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940705280:0@lo:400:kworker.0
00000100:00080000:2.0:1767320157.678848:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320157.678853:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320157.681476:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926
00000100:00100000:1.0:1767320157.681500:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940705664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320157.681610:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940705664:12345-0@lo:400:kworker.0 Request processed in 122us (3234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320157.681618:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926
00000100:00100000:1.0:1767320157.681684:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940705024:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.681943:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320157.681966:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940705152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.681987:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320157.682009:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940705536:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.682027:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320157.682045:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940705792:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.682062:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320157.682093:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705024
00000100:00100000:1.0:1767320157.682099:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705024
00000100:00100000:1.0:1767320157.682118:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705536
00000100:00100000:1.0:1767320157.682120:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705536
00000100:00100000:1.0:1767320157.682127:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705792
00000100:00100000:1.0:1767320157.682129:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705792
00000100:00100000:1.0:1767320157.682138:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17646
00000100:00100000:1.0:1767320157.682143:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320157.682161:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320157.682189:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705024:12345-0@lo:38:kworker.0 Request processed in 45us (246us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320157.682195:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17646
00000100:00100000:1.0:1767320157.682206:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17647
00000100:00100000:1.0:1767320157.682210:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705536:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320157.682218:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320157.682233:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705536:12345-0@lo:38:kworker.0 Request processed in 23us (206us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320157.682239:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17647
00000100:00100000:1.0:1767320157.682246:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17648
00000100:00100000:1.0:1767320157.682250:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320157.682332:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320157.682354:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940705792:12345-0@lo:38:kworker.0 Request processed in 102us (290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320157.682360:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17648
00000100:00080000:1.0:1767320157.682390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320157.682395:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320157.682399:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940705024:0@lo:38:kworker.0
00000100:00080000:1.0:1767320157.682406:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320157.682409:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320157.682412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940705536:0@lo:38:kworker.0
00000100:00080000:1.0:1767320157.682418:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320157.682421:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320157.682424:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940705792:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.682464:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705152
00000100:00100000:1.0:1767320157.682466:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705152
00000100:00100000:1.0:1767320157.682483:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246
00000100:00100000:1.0:1767320157.682488:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940705152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320157.682497:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320157.682522:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940705152:12345-0@lo:38:kworker.0 Request processed in 33us (533us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320157.682527:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246
00000100:00080000:1.0:1767320157.682548:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320157.682552:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320157.682555:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940705152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320157.682888:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940705664:0@lo:400:kworker.0
00000100:00100000:3.0:1767320158.189804:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320158.189827:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940705920:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320158.189911:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320158.190464:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940705920
00000100:00100000:2.0:1767320158.190473:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940705920
00000100:00100000:2.0:1767320158.190573:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749
00000100:00100000:2.0:1767320158.190583:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940705920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320158.190614:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320158.190887:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940705920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 306us (976us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320158.190893:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749
00000100:00100000:3.0:1767320158.191490:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940705920:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320158.279110:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320158.279161:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320158.279425:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359168
00000100:00100000:3.0:1767320158.279436:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359168
00000100:00100000:3.0:1767320158.279573:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359296
00000100:00100000:3.0:1767320158.279578:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359296
00000100:00080000:2.0:1767320158.279647:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320158.280920:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4927
00000100:00100000:0.0:1767320158.281134:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894359296:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320158.281371:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894359296:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 440us (2208us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320158.281379:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4927
00000100:00100000:0.0:1767320158.281405:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17649
00000100:00100000:0.0:1767320158.281409:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359168:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320158.281429:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320158.281450:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359168:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 40us (2352us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320158.281456:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17649
00000100:00100000:2.0:1767320158.381310:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320158.639366:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320159.406647:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320159.661088:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320160.431227:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320160.685216:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320161.455136:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320161.712968:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320162.285172:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940706048:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320162.285274:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.285505:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706048
00000100:00100000:2.0:1767320162.285515:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706048
00000100:00080000:1.0:1767320162.285657:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320162.285695:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750
00000100:00100000:2.0:1767320162.285709:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940706048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320162.285751:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320162.285873:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940706048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (597us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320162.285882:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750
00000100:00100000:0.0:1767320162.285976:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940706048:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320162.477167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320162.733174:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320162.797183:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320162.797197:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320162.797201:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320162.797206:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320162.797211:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320162.797222:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5407
00000100:00080000:1.0:1767320162.797228:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320162.797236:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320162.797297:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3800 x1853163940706176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320162.797319:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320162.797322:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320162.797324:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320162.797327:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5407
00000100:00080000:1.0:1767320162.797329:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320162.797333:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320162.797353:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a89f80 x1853163940706304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320162.797421:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320162.797425:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320162.797427:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320162.797431:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5407
00000100:00080000:1.0:1767320162.797433:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320162.797437:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320162.797450:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88a80 x1853163940706688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320162.797467:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320162.797470:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320162.797472:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320162.797475:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5407
00000100:00080000:1.0:1767320162.797478:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320162.797481:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320162.797491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88380 x1853163940706944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320162.797538:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940706816:0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.797627:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320162.797720:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320162.797727:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940706560:0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.797752:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320162.797807:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706816
00000100:00100000:1.0:1767320162.797826:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706816
00000100:00100000:1.0:1767320162.797890:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706560
00000100:00100000:1.0:1767320162.797894:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706560
00000100:00100000:1.0:1767320162.797924:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928
00000100:00100000:1.0:1767320162.797933:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940706816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.797998:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940706816:12345-0@lo:400:kworker.0 Request processed in 65us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320162.798005:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928
00000100:00100000:1.0:1767320162.798023:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929
00000100:00100000:1.0:1767320162.798029:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940706560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.798056:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940706560:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320162.798062:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929
00000100:00080000:1.0:1767320162.798081:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320162.798122:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940706560:0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.798134:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940706816:0@lo:400:kworker.0
00000100:00100000:0.0:1767320162.798346:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320162.798360:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940706432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320162.798405:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.798587:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320137/real 1767320137]  req@ffff93cf45223800 x1853163940699904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320162.798607:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45223800 x1853163940699904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320162.798624:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940706176:0@lo:38:kworker.0
00000100:00100000:2.0:1767320162.798657:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.798685:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940706304:0@lo:38:kworker.0
00000100:00100000:2.0:1767320162.798711:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.798738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940706688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320162.798760:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.798808:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940706944:0@lo:38:kworker.0
00000100:00100000:2.0:1767320162.798841:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320162.798861:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320162.798876:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320162.798881:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940699904:0@lo:250:kworker.0
00000100:00100000:2.0:1767320162.798914:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706176
00000100:00100000:2.0:1767320162.798918:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706176
00000100:00100000:2.0:1767320162.798947:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706688
00000100:00100000:2.0:1767320162.798950:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706688
00000100:00100000:2.0:1767320162.798965:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706944
00000100:00100000:2.0:1767320162.798968:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706944
00000100:00100000:2.0:1767320162.798984:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17650
00000100:00100000:2.0:1767320162.798989:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706176:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320162.799011:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320162.799050:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706176:12345-0@lo:38:kworker.0 Request processed in 59us (392us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320162.799056:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17650
00000100:00100000:2.0:1767320162.799071:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17651
00000100:00100000:2.0:1767320162.799075:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320162.799085:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320162.799110:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706688:12345-0@lo:38:kworker.0 Request processed in 33us (348us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320162.799115:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17651
00000100:00100000:2.0:1767320162.799126:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17652
00000100:00100000:2.0:1767320162.799130:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320162.799138:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320162.799160:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940706944:12345-0@lo:38:kworker.0 Request processed in 28us (317us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320162.799165:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17652
00000100:00080000:2.0:1767320162.799203:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320162.799208:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320162.799211:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940706176:0@lo:38:kworker.0
00000100:00080000:2.0:1767320162.799219:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320162.799222:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320162.799225:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940706688:0@lo:38:kworker.0
00000100:00080000:2.0:1767320162.799232:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320162.799234:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320162.799237:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940706944:0@lo:38:kworker.0
00000100:00100000:0.0:1767320162.799472:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706304
00000100:00100000:0.0:1767320162.799478:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706304
00000100:00100000:0.0:1767320162.799510:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247
00000100:00100000:0.0:1767320162.799515:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940706304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320162.799525:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320162.799577:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940706304:12345-0@lo:38:kworker.0 Request processed in 61us (864us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320162.799583:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247
00000100:00080000:0.0:1767320162.799607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320162.799612:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320162.799615:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320162.799620:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5387
00000100:00080000:0.0:1767320162.799623:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320162.799628:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320162.799652:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb100 x1853163940707072/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320162.799725:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940707072:0@lo:250:kworker.0
00000400:00000100:3.0:1767320162.799755:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940707072 offset 0 length 520: 4
00000100:00080000:3.0:1767320162.799824:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320162.799828:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320162.799831:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940706304:0@lo:38:kworker.0
00000100:00100000:1.0:1767320162.800463:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940706432
00000100:00100000:1.0:1767320162.800470:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940706432
00000100:00080000:2.0:1767320162.800583:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320162.800621:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187
00000100:00100000:1.0:1767320162.800630:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940706432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320162.800717:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940706432:12345-0@lo:400:kworker.0 Request processed in 88us (2310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320162.800723:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187
00000100:00100000:0.0:1767320162.800835:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940706432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320163.309425:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940707200:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320163.309526:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320163.309653:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707200
00000100:00100000:1.0:1767320163.309663:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707200
00000100:00100000:1.0:1767320163.309741:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751
00000100:00100000:1.0:1767320163.309752:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940707200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320163.309844:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320163.315625:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940707200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5859us (6083us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320163.315643:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751
00000100:00100000:0.0:1767320163.319139:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940707200:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320163.404208:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320163.404292:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320163.406429:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359552
00000100:00100000:0.0:1767320163.406453:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359552
00000100:00100000:0.0:1767320163.406593:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359424
00000100:00100000:0.0:1767320163.406598:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359424
00000100:00100000:0.0:1767320163.406635:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4930
00000100:00100000:0.0:1767320163.406649:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894359552:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320163.406770:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894359552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 124us (2568us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320163.406840:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4930
00000100:00100000:0.0:1767320163.406865:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17653
00000100:00100000:0.0:1767320163.406871:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359424:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320163.406899:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320163.406935:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359424:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 64us (2642us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320163.406942:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17653
00000100:00080000:2.0:1767320163.407622:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320163.500956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320163.757344:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320164.524946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320164.788189:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320165.548945:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320165.805017:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320166.572893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320166.829484:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320167.405207:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320167.405231:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940707328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320167.405297:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320167.405639:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707328
00000100:00100000:1.0:1767320167.405649:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707328
00000100:00100000:1.0:1767320167.405728:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752
00000100:00100000:1.0:1767320167.405737:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940707328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320167.405768:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320167.405922:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940707328:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320167.405987:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320167.406204:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940707328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 466us (905us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320167.406213:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752
00000100:00100000:2.0:1767320167.597041:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320167.854812:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320167.917053:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320167.917065:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320167.917068:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320167.917072:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320167.917078:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320167.917087:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5412
00000100:00080000:0.0:1767320167.917094:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320167.917100:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320167.917145:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9f80 x1853163940707456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320167.917217:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940707456:0@lo:38:kworker.0
00000100:00100000:3.0:1767320167.917319:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320167.917453:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707456
00000100:00100000:2.0:1767320167.917462:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707456
00000100:00100000:2.0:1767320167.917501:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17654
00000100:00100000:2.0:1767320167.917508:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940707456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320167.917529:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320167.917542:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320167.917547:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320167.917550:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320167.917555:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5412
00000100:00080000:0.0:1767320167.917558:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320167.917563:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320167.918034:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459faa00 x1853163940707584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320167.919579:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940707584:0@lo:38:kworker.0
00000100:00100000:3.0:1767320167.919649:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320167.919799:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707584
00000100:00100000:1.0:1767320167.919806:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707584
00000100:00100000:1.0:1767320167.919844:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248
00000100:00100000:1.0:1767320167.919851:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940707584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320167.919872:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320167.919920:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940707584:12345-0@lo:38:kworker.0 Request processed in 68us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320167.919928:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248
00000100:00100000:2.0:1767320167.923902:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940707456:12345-0@lo:38:kworker.0 Request processed in 6382us (6571us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320167.923929:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17654
00000100:00080000:0.0:1767320167.926543:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320167.926550:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320167.926553:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320167.926561:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5412
00000100:00080000:0.0:1767320167.926566:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320167.926573:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320167.926599:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470fd880 x1853163940707968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320167.926637:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320167.926641:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320167.926642:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320167.926645:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5412
00000100:00080000:0.0:1767320167.926649:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320167.926652:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320167.926669:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940708096:0@lo:400:kworker.0
00000100:00100000:0.0:1767320167.926736:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320167.926821:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940707712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320167.926861:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320167.926869:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d880 x1853163940708224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320167.926896:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320167.926905:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940707840:0@lo:400:kworker.0
00000100:00100000:2.0:1767320167.926930:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320167.926933:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708096
00000100:00100000:0.0:1767320167.926941:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708096
00000100:00080000:2.0:1767320167.926968:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320167.926982:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707840
00000100:00100000:2.0:1767320167.926987:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707840
00000100:00100000:0.0:1767320167.927001:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931
00000100:00100000:0.0:1767320167.927012:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940708096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320167.927029:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932
00000100:00100000:2.0:1767320167.927038:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940707840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320167.927115:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707712
00000100:00100000:1.0:1767320167.927120:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707712
00000100:00100000:1.0:1767320167.927152:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188
00000100:00100000:1.0:1767320167.927159:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940707712:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320167.927263:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320167.927268:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320167.927272:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940707456:0@lo:38:kworker.0
00000100:00100000:3.0:1767320167.927307:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940707968:0@lo:38:kworker.0
00000100:00100000:0.0:1767320167.929904:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940708096:12345-0@lo:400:kworker.0 Request processed in 2885us (3158us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320167.929919:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931
00000100:00100000:0.0:1767320167.930012:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940708096:0@lo:400:kworker.0
00000100:00080000:0.0:1767320167.930190:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320167.930197:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320167.936566:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940707840:12345-0@lo:400:kworker.0 Request processed in 9518us (9625us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320167.936581:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932
00000100:00100000:1.0:1767320167.940428:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940707712:12345-0@lo:400:kworker.0 Request processed in 13256us (13554us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320167.940444:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188
00000100:00100000:0.0:1767320167.945415:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940707840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320167.945433:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940707712:0@lo:400:kworker.0
00000100:00100000:3.0:1767320167.949244:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320167.949307:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940707968
00000100:00100000:3.0:1767320167.949311:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940708224:0@lo:38:kworker.0
00000100:00100000:2.0:1767320167.949316:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940707968
00000100:00100000:3.0:1767320167.949351:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320167.949400:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320167.949407:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320167.949412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940707584:0@lo:38:kworker.0
00000100:00100000:2.0:1767320167.949706:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708224
00000100:00100000:2.0:1767320167.949710:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708224
00000100:00100000:2.0:1767320167.949743:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17655
00000100:00100000:2.0:1767320167.949750:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940707968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320167.949803:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320167.949851:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940707968:12345-0@lo:38:kworker.0 Request processed in 100us (626us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320167.949859:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17655
00000100:00100000:2.0:1767320167.949875:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17656
00000100:00100000:2.0:1767320167.949884:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940708224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320167.949894:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320167.949918:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940708224:12345-0@lo:38:kworker.0 Request processed in 36us (566us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320167.949924:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17656
00000100:00080000:3.0:1767320167.950360:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320167.950366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320167.950370:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940707968:0@lo:38:kworker.0
00000100:00080000:3.0:1767320167.950377:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320167.950380:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320167.950382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940708224:0@lo:38:kworker.0
00000100:00100000:0.0:1767320168.429948:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320168.429974:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940708352:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320168.430050:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320168.430271:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708352
00000100:00100000:1.0:1767320168.430280:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708352
00000100:00100000:1.0:1767320168.430336:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753
00000100:00100000:1.0:1767320168.430346:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940708352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320168.430377:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320168.430478:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940708352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (427us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320168.430486:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753
00000100:00100000:2.0:1767320168.431854:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940708352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320168.522249:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320168.522503:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359680
00000100:00100000:0.0:1767320168.522513:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359680
00000100:00100000:0.0:1767320168.522603:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17657
00000100:00100000:0.0:1767320168.522612:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359680:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320168.522641:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320168.522721:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894359680:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 108us (540us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320168.522728:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17657
00000100:00100000:3.0:1767320168.523358:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320168.534104:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359808
00000100:00100000:1.0:1767320168.534122:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359808
00000100:00080000:1.0:1767320168.534158:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320168.534386:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4933
00000100:00100000:1.0:1767320168.534400:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894359808:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320168.534578:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894359808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 181us (11220us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320168.535606:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4933
00000100:00100000:2.0:1767320168.621828:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320168.877176:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320169.645210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320169.901504:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320170.668903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320170.925395:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320171.693324:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320171.959668:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320172.527001:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320172.527025:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940708480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320172.527094:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320172.527294:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708480
00000100:00100000:3.0:1767320172.527311:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708480
00000100:00100000:3.0:1767320172.527372:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754
00000100:00100000:3.0:1767320172.527383:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940708480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320172.527427:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320172.527581:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940708480:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320172.527725:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940708480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320172.527742:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754
00000100:00080000:1.0:1767320172.527819:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320172.717246:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320172.974170:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320173.036930:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320173.036940:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320173.036943:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320173.036947:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320173.036951:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320173.036958:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5417
00000100:00080000:0.0:1767320173.036963:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320173.036970:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320173.037012:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3ed80 x1853163940708608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320173.037051:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320173.037055:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320173.037057:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320173.037060:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5417
00000100:00080000:0.0:1767320173.037063:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320173.037066:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320173.037086:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d500 x1853163940708736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320173.037159:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940708608:0@lo:38:kworker.0
00000100:00080000:0.0:1767320173.037162:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320173.037168:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320173.037170:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320173.037174:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5417
00000100:00080000:0.0:1767320173.037177:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320173.037180:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320173.037193:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470fd880 x1853163940709248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320173.037210:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320173.037213:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320173.037215:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320173.037218:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5417
00000100:00080000:0.0:1767320173.037219:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320173.037224:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320173.037234:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.037239:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3480 x1853163940709504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320173.037264:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940708992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.037304:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940708736:0@lo:38:kworker.0
00000100:00100000:0.0:1767320173.037314:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.037340:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.037358:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320173.037367:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940709120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.037374:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940709248:0@lo:38:kworker.0
00000100:00100000:0.0:1767320173.037395:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.037422:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708736
00000100:00100000:3.0:1767320173.037431:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708736
00000100:00100000:3.0:1767320173.037463:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249
00000100:00100000:3.0:1767320173.037470:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940708736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320173.037500:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320173.037539:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940708736:12345-0@lo:38:kworker.0 Request processed in 68us (200us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320173.037545:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249
00000100:00100000:3.0:1767320173.037582:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708992
00000100:00100000:3.0:1767320173.037585:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708992
00000100:00100000:3.0:1767320173.037623:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189
00000100:00100000:3.0:1767320173.037632:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940708992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.037668:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940708992:12345-0@lo:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320173.037675:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189
00000100:00080000:3.0:1767320173.037692:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320173.038685:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708608
00000100:00100000:1.0:1767320173.038692:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708608
00000100:00100000:0.0:1767320173.038740:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940708992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.038945:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940709376:0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.038985:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.039260:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940708864:0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.039581:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.039616:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940708864
00000100:00100000:3.0:1767320173.039621:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940708864
00000100:00100000:3.0:1767320173.039652:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190
00000100:00100000:3.0:1767320173.039660:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940708864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.039702:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940708864:12345-0@lo:400:kworker.0 Request processed in 43us (121us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320173.039709:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190
00000100:00100000:3.0:1767320173.039764:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940708864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320173.050427:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709120
00000100:00100000:1.0:1767320173.050442:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709120
00000100:00100000:1.0:1767320173.050532:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709376
00000100:00100000:1.0:1767320173.050534:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709376
00000100:00100000:1.0:1767320173.050557:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934
00000100:00100000:1.0:1767320173.050564:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940709120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320173.050675:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940709120:12345-0@lo:400:kworker.0 Request processed in 111us (13280us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320173.050683:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934
00000100:00100000:1.0:1767320173.050701:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935
00000100:00100000:1.0:1767320173.050708:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940709376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320173.050755:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940709376:12345-0@lo:400:kworker.0 Request processed in 47us (11770us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320173.050761:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935
00000100:00100000:1.0:1767320173.050788:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17658
00000100:00100000:1.0:1767320173.050793:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940708608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320173.051061:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320173.051207:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940708608:12345-0@lo:38:kworker.0 Request processed in 411us (13973us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320173.051214:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17658
00000100:00100000:1.0:1767320173.051567:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940709376:0@lo:400:kworker.0
00000100:00080000:1.0:1767320173.051600:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320173.051715:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940709120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320173.051946:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320173.051975:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940709504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.052004:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320173.052020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320173.052023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320173.052157:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940708608:0@lo:38:kworker.0
00000100:00080000:1.0:1767320173.052170:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320173.052173:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320173.052175:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940708736:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.052200:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709248
00000100:00100000:1.0:1767320173.052203:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709248
00000100:00100000:1.0:1767320173.052216:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709504
00000100:00100000:1.0:1767320173.052217:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709504
00000100:00100000:1.0:1767320173.052223:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17659
00000100:00100000:1.0:1767320173.052227:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940709248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320173.052239:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320173.052263:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940709248:12345-0@lo:38:kworker.0 Request processed in 35us (317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320173.052267:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17659
00000100:00100000:1.0:1767320173.052418:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17660
00000100:00100000:1.0:1767320173.052421:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940709504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320173.052428:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320173.052446:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940709504:12345-0@lo:38:kworker.0 Request processed in 24us (442us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320173.052449:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17660
00000100:00080000:1.0:1767320173.052467:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320173.052470:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320173.052847:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940709248:0@lo:38:kworker.0
00000100:00080000:1.0:1767320173.052863:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320173.052866:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320173.052869:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940709504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.549338:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320173.549363:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940709632:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320173.549503:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.551931:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709632
00000100:00100000:3.0:1767320173.551945:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709632
00000100:00100000:3.0:1767320173.552029:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755
00000100:00100000:3.0:1767320173.552039:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940709632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320173.552081:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320173.552166:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940709632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (2662us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320173.552173:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755
00000100:00100000:1.0:1767320173.552333:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940709632:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320173.642427:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320173.642502:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360064
00000100:00100000:2.0:1767320173.642513:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360064
00000100:00100000:3.0:1767320173.642588:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767320173.642673:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320173.643800:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894359936
00000100:00100000:2.0:1767320173.643811:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894359936
00000100:00100000:2.0:1767320173.643869:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4936
00000100:00100000:2.0:1767320173.643882:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894360064:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320173.643971:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894360064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (1554us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320173.643979:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4936
00000100:00100000:2.0:1767320173.643999:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17661
00000100:00100000:2.0:1767320173.644004:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894359936:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320173.644025:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320173.644052:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894359936:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 46us (1465us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320173.644059:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17661
00000100:00100000:2.0:1767320173.740913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320173.997012:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320174.765557:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320175.021877:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320175.788908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320176.045064:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320176.814055:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320177.069274:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320177.645215:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320177.645238:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940709760:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320177.645304:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320177.646104:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709760
00000100:00100000:2.0:1767320177.646114:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709760
00000100:00100000:2.0:1767320177.646179:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756
00000100:00100000:2.0:1767320177.646187:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940709760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320177.646215:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320177.646276:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940709760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (971us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320177.646283:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756
00000100:00100000:0.0:1767320177.646376:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940709760:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320177.646469:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320177.837321:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320178.093009:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320178.157954:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320178.157966:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320178.157969:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320178.157972:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320178.157977:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320178.157985:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5423
00000100:00080000:2.0:1767320178.157989:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320178.157996:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320178.158036:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940709888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320178.158054:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320178.158058:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320178.158060:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320178.158064:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5423
00000100:00080000:2.0:1767320178.158066:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320178.158069:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320178.158088:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399e680 x1853163940710016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320178.158117:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940709888:0@lo:38:kworker.0
00000100:00080000:2.0:1767320178.158166:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320178.158170:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320178.158172:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320178.158176:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5423
00000100:00080000:2.0:1767320178.158179:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320178.158183:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320178.158190:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.158197:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220380 x1853163940710528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320178.158218:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320178.158221:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320178.158223:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320178.158227:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5423
00000100:00080000:2.0:1767320178.158229:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320178.158233:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320178.158246:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc3b100 x1853163940710784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320178.158257:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940710016:0@lo:38:kworker.0
00000100:00100000:1.0:1767320178.158283:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.158292:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940710272:0@lo:400:kworker.0
00000100:00100000:1.0:1767320178.158305:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940710528:0@lo:38:kworker.0
00000100:00100000:2.0:1767320178.158333:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320178.158341:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320178.158409:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940709888
00000100:00100000:0.0:1767320178.158418:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940709888
00000100:00100000:0.0:1767320178.158449:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710528
00000100:00100000:0.0:1767320178.158452:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710528
00000100:00100000:0.0:1767320178.158470:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17662
00000100:00100000:0.0:1767320178.158476:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940709888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320178.158495:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320178.158535:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940709888:12345-0@lo:38:kworker.0 Request processed in 58us (345us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320178.158541:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17662
00000100:00100000:0.0:1767320178.158555:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17663
00000100:00100000:0.0:1767320178.158559:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940710528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320178.158567:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320178.158587:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940710528:12345-0@lo:38:kworker.0 Request processed in 26us (248us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320178.158592:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17663
00000100:00100000:0.0:1767320178.158613:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940710144:0@lo:400:kworker.0
00000100:00100000:0.0:1767320178.158637:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.158879:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320178.158887:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940710400:0@lo:400:kworker.0
00000100:00100000:2.0:1767320178.158912:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.158936:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710400
00000100:00100000:2.0:1767320178.158939:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710400
00000100:00100000:2.0:1767320178.158980:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937
00000100:00100000:2.0:1767320178.158992:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940710400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320178.159033:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940710400:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320178.159039:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937
00000100:00080000:2.0:1767320178.159056:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320178.159083:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940710400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.159174:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940710656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.159203:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.159243:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710016
00000100:00100000:3.0:1767320178.159247:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710016
00000100:00100000:3.0:1767320178.159269:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250
00000100:00100000:3.0:1767320178.159273:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940710016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320178.159284:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320178.159310:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940710016:12345-0@lo:38:kworker.0 Request processed in 35us (1027us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320178.159317:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250
00000100:00100000:3.0:1767320178.159336:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710272
00000100:00100000:3.0:1767320178.159339:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710272
00000100:00100000:3.0:1767320178.159379:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710144
00000100:00100000:3.0:1767320178.159382:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710144
00000100:00100000:3.0:1767320178.159400:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191
00000100:00100000:3.0:1767320178.159405:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940710272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.159439:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940710272:12345-0@lo:400:kworker.0 Request processed in 33us (1106us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.159445:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191
00000100:00100000:3.0:1767320178.159456:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192
00000100:00100000:3.0:1767320178.159461:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940710144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.159488:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940710144:12345-0@lo:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.159493:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192
00000100:00100000:3.0:1767320178.159512:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710656
00000100:00100000:3.0:1767320178.159515:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710656
00000100:00100000:3.0:1767320178.159539:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938
00000100:00100000:3.0:1767320178.159545:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940710656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.159576:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940710656:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.159581:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938
00000100:00100000:3.0:1767320178.159614:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940710656:0@lo:400:kworker.0
00000100:00080000:1.0:1767320178.159737:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320178.159743:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320178.159747:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940710528:0@lo:38:kworker.0
00000100:00100000:1.0:1767320178.159754:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940710784:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.159809:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940710144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320178.159879:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320178.159969:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320178.159973:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320178.159976:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940709888:0@lo:38:kworker.0
00000100:00080000:1.0:1767320178.159984:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320178.159988:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320178.159990:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940710016:0@lo:38:kworker.0
00000100:00080000:2.0:1767320178.160943:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320178.160950:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320178.160988:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940710272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320178.163985:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710784
00000100:00100000:2.0:1767320178.164008:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710784
00000100:00100000:2.0:1767320178.164075:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17664
00000100:00100000:2.0:1767320178.164083:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940710784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320178.164108:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320178.164191:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940710784:12345-0@lo:38:kworker.0 Request processed in 107us (4310us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320178.164197:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17664
00000100:00080000:1.0:1767320178.167175:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320178.167189:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320178.167194:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940710784:0@lo:38:kworker.0
00000100:00100000:2.0:1767320178.669247:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320178.669268:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940710912:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320178.669332:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.669391:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940710912
00000100:00100000:2.0:1767320178.669399:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940710912
00000100:00100000:2.0:1767320178.669441:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757
00000100:00100000:2.0:1767320178.669450:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940710912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320178.669479:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320178.669520:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940710912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (187us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320178.669527:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757
00000100:00100000:2.0:1767320178.669574:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940710912:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320178.758012:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320178.758096:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767320178.758176:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894360448 offset 0 length 520: 4
00000100:00100000:3.0:1767320178.762758:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360192
00000100:00100000:3.0:1767320178.762800:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360192
00000100:00100000:3.0:1767320178.762850:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360320
00000100:00100000:3.0:1767320178.762853:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360320
00000100:00100000:3.0:1767320178.762921:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4939
00000100:00100000:3.0:1767320178.762931:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894360320:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320178.763010:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894360320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (4914us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.763016:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4939
00000100:00100000:3.0:1767320178.763034:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17665
00000100:00100000:3.0:1767320178.763037:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894360192:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320178.763055:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320178.763078:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894360192:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 39us (5079us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320178.763085:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17665
00000100:00080000:2.0:1767320178.763259:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320178.860951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320179.117002:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320179.885411:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320180.141742:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320180.908907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320181.165372:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320181.933934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320182.192054:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320182.765372:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940711040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320182.765490:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320182.765606:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711040
00000100:00100000:1.0:1767320182.765613:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711040
00000100:00100000:1.0:1767320182.765690:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758
00000100:00100000:1.0:1767320182.765700:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940711040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320182.765734:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767320182.765807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320182.766267:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940711040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 568us (775us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320182.766276:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758
00000100:00100000:0.0:1767320182.766485:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940711040:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320182.957084:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320183.214056:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320183.277065:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320183.277076:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320183.277080:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320183.277083:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320183.277088:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320183.277096:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5428
00000100:00080000:0.0:1767320183.277101:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320183.277107:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320183.277147:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c1880 x1853163940711168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320183.277173:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320183.277177:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320183.277178:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320183.277182:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5428
00000100:00080000:0.0:1767320183.277184:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320183.277187:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320183.277201:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3100 x1853163940711296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320183.277263:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320183.277266:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320183.277268:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320183.277271:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5428
00000100:00080000:0.0:1767320183.277273:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320183.277277:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320183.277290:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3ed80 x1853163940711808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320183.277305:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320183.277307:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320183.277309:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320183.277312:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5428
00000100:00080000:0.0:1767320183.277314:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320183.277318:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320183.277326:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3fb80 x1853163940712064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320183.277351:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940711936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320183.277431:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320183.277500:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320183.277506:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940711424:0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.278131:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940711680:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.278233:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711936
00000100:00100000:1.0:1767320183.278241:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711936
00000100:00100000:1.0:1767320183.278304:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940
00000100:00100000:1.0:1767320183.278314:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940711936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320183.278418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940711168:0@lo:38:kworker.0
00000100:00100000:3.0:1767320183.285064:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320183.285145:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320183.285156:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940711552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.285201:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320183.285266:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711680
00000100:00100000:3.0:1767320183.285275:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711680
00000100:00100000:3.0:1767320183.285326:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941
00000100:00100000:3.0:1767320183.285335:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940711680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.285399:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940711680:12345-0@lo:400:kworker.0 Request processed in 65us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320183.285406:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941
00000100:00100000:3.0:1767320183.285453:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940711680:0@lo:400:kworker.0
00000100:00080000:3.0:1767320183.285933:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320183.285955:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711552
00000100:00100000:3.0:1767320183.285960:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711552
00000100:00100000:3.0:1767320183.285997:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193
00000100:00100000:3.0:1767320183.286005:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940711552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.286043:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940711552:12345-0@lo:400:kworker.0 Request processed in 39us (841us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320183.286049:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193
00000100:00080000:3.0:1767320183.286063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320183.286098:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940711552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.288218:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940711936:12345-0@lo:400:kworker.0 Request processed in 9900us (10780us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320183.288230:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940
00000100:00100000:2.0:1767320183.292030:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.292095:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940711296:0@lo:38:kworker.0
00000100:00100000:2.0:1767320183.292141:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.292170:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940711808:0@lo:38:kworker.0
00000100:00100000:2.0:1767320183.292193:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.292236:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711168
00000100:00100000:2.0:1767320183.292245:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711168
00000100:00100000:2.0:1767320183.292282:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711808
00000100:00100000:2.0:1767320183.292285:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711808
00000100:00100000:2.0:1767320183.292307:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17666
00000100:00100000:2.0:1767320183.292314:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940711168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320183.292338:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320183.292379:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940711168:12345-0@lo:38:kworker.0 Request processed in 64us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320183.292388:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17666
00000100:00100000:2.0:1767320183.292404:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17667
00000100:00100000:2.0:1767320183.292408:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940711808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320183.292418:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320183.292441:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940711808:12345-0@lo:38:kworker.0 Request processed in 31us (248us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320183.292446:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17667
00000100:00080000:2.0:1767320183.292486:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320183.292491:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320183.292495:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940711808:0@lo:38:kworker.0
00000100:00100000:2.0:1767320183.292502:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940712064:0@lo:38:kworker.0
00000100:00100000:2.0:1767320183.292524:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.292543:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712064
00000100:00100000:2.0:1767320183.292547:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712064
00000100:00100000:2.0:1767320183.292565:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17668
00000100:00100000:2.0:1767320183.292569:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940712064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320183.292579:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320183.292602:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940712064:12345-0@lo:38:kworker.0 Request processed in 32us (78us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320183.292608:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17668
00000100:00080000:2.0:1767320183.292642:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320183.292647:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320183.292650:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940712064:0@lo:38:kworker.0
00000100:00080000:2.0:1767320183.292683:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320183.292687:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320183.292690:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940711168:0@lo:38:kworker.0
00000100:00100000:3.0:1767320183.293007:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711296
00000100:00100000:3.0:1767320183.293012:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711296
00000100:00100000:3.0:1767320183.293042:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251
00000100:00100000:3.0:1767320183.293047:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940711296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320183.293057:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320183.293098:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940711296:12345-0@lo:38:kworker.0 Request processed in 50us (956us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320183.293107:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251
00000100:00080000:1.0:1767320183.293169:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320183.293174:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320183.293177:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940711296:0@lo:38:kworker.0
00000100:00100000:0.0:1767320183.293321:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320183.293366:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940711936:0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.293425:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940711424
00000100:00100000:3.0:1767320183.293429:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940711424
00000100:00100000:3.0:1767320183.293473:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194
00000100:00100000:3.0:1767320183.293480:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940711424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.293533:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940711424:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320183.293540:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194
00000100:00100000:1.0:1767320183.293603:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940711424:0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.789955:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940712192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320183.790047:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.790255:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712192
00000100:00100000:2.0:1767320183.790264:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712192
00000100:00100000:2.0:1767320183.790659:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759
00000100:00100000:2.0:1767320183.790670:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940712192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320183.790713:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320183.790836:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940712192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (788us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320183.790844:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759
00000100:00100000:0.0:1767320183.791185:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940712192:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320183.879978:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320183.880028:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320183.880104:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360576
00000100:00100000:1.0:1767320183.880114:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360576
00000100:00100000:1.0:1767320183.880157:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360704
00000100:00100000:1.0:1767320183.880159:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360704
00000100:00100000:3.0:1767320183.880193:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17669
00000100:00100000:3.0:1767320183.880204:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894360576:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767320183.880209:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4942
00000100:00100000:1.0:1767320183.880218:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894360704:12345-192.168.202.21@tcp:400:kworker.0
00010000:00020000:3.0:1767320183.880236:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320183.880358:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894360704:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 139us (328us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320183.880371:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4942
00000100:00080000:0.0:1767320183.880372:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320183.882010:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894360576:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1800us (2034us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320183.882022:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17669
00000100:00100000:2.0:1767320183.980946:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320184.239319:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320185.004923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320185.261008:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320186.030274:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320186.285177:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320187.052986:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320187.309795:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320187.373030:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320162/real 1767320162]  req@ffff93cf459fb100 x1853163940707072/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320187.373070:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf459fb100 x1853163940707072/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320187.373088:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320187.373272:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320187.373277:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940707072:0@lo:250:kworker.0
00000100:00080000:0.0:1767320187.376946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320187.376956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320187.376959:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320187.377269:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5412
00000100:00080000:0.0:1767320187.377274:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320187.377291:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320187.377328:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d500 x1853163940712320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320187.377415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320187.377420:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320187.377422:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320187.377425:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5433
00000100:00080000:0.0:1767320187.377428:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320187.377432:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320187.377449:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3c700 x1853163940712448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320187.377458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320187.377461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320187.377463:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320187.377466:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5433
00000100:00080000:0.0:1767320187.377468:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320187.377471:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320187.377483:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71c00 x1853163940712576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320187.377735:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940712320:0@lo:250:kworker.0
00000400:00000100:1.0:1767320187.377836:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940712320 offset 0 length 520: 4
00000100:00100000:1.0:1767320187.377905:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940712448:0@lo:38:kworker.0
00000100:00100000:1.0:1767320187.377938:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320187.377959:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940712576:0@lo:38:kworker.0
00000100:00100000:1.0:1767320187.377994:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320187.378036:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712448
00000100:00100000:2.0:1767320187.378388:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940712832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320187.378391:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712448
00000100:00100000:2.0:1767320187.378424:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320187.378451:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320187.378458:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940712704:0@lo:400:kworker.0
00000100:00100000:1.0:1767320187.378461:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17670
00000100:00100000:1.0:1767320187.378471:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940712448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320187.378490:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320187.378501:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320187.378537:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712576
00000100:00100000:2.0:1767320187.378541:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712576
00000100:00100000:1.0:1767320187.378543:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940712448:12345-0@lo:38:kworker.0 Request processed in 69us (602us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320187.378551:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17670
00000100:00100000:2.0:1767320187.378572:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252
00000100:00100000:2.0:1767320187.378577:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940712576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320187.378588:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320187.378626:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940712576:12345-0@lo:38:kworker.0 Request processed in 47us (631us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320187.378633:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252
00000100:00100000:2.0:1767320187.378652:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712832
00000100:00100000:2.0:1767320187.378656:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712832
00000100:00100000:2.0:1767320187.378694:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712704
00000100:00100000:2.0:1767320187.378697:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712704
00000100:00100000:2.0:1767320187.378720:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195
00000100:00100000:2.0:1767320187.378726:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940712832:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320187.378742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320187.378754:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320187.378757:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320187.378762:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5433
00000100:00080000:0.0:1767320187.378766:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320187.378770:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940712832:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320187.378796:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320187.378814:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195
00000100:00100000:0.0:1767320187.378825:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72a00 x1853163940713088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320187.378831:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196
00000100:00100000:2.0:1767320187.378842:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940712704:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320187.378870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320187.378876:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767320187.378876:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940712704:12345-0@lo:400:kworker.0 Request processed in 34us (374us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320187.378879:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320187.378888:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5433
00000100:00100000:2.0:1767320187.378889:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196
00000100:00080000:0.0:1767320187.378893:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320187.378899:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320187.378909:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72300 x1853163940713344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320187.378927:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320187.378931:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320187.378935:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940712960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320187.378968:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320187.379129:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940712704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320187.379146:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940712832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320187.379174:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940713216:0@lo:400:kworker.0
00000100:00100000:2.0:1767320187.380409:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940713088:0@lo:38:kworker.0
00000100:00100000:3.0:1767320187.390508:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320187.396284:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320187.396357:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940712960
00000100:00100000:1.0:1767320187.396366:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940712960
00000100:00100000:1.0:1767320187.396424:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713216
00000100:00100000:1.0:1767320187.396428:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713216
00000100:00100000:1.0:1767320187.396448:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943
00000100:00100000:1.0:1767320187.396456:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940712960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320187.396533:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940712960:12345-0@lo:400:kworker.0 Request processed in 78us (17565us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320187.396540:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943
00000100:00100000:1.0:1767320187.396557:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944
00000100:00100000:1.0:1767320187.396563:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940713216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320187.396616:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940713216:12345-0@lo:400:kworker.0 Request processed in 54us (6116us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320187.396622:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944
00000100:00100000:1.0:1767320187.396668:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940712960:0@lo:400:kworker.0
00000100:00080000:1.0:1767320187.396692:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320187.400814:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940713216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320187.408282:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940713344:0@lo:38:kworker.0
00000100:00100000:3.0:1767320187.408353:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320187.408391:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320187.408395:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320187.408399:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940712448:0@lo:38:kworker.0
00000100:00080000:3.0:1767320187.408412:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320187.408416:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320187.408418:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940712576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320187.408541:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713088
00000100:00100000:2.0:1767320187.408548:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713088
00000100:00100000:2.0:1767320187.408598:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713344
00000100:00100000:2.0:1767320187.408601:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713344
00000100:00100000:2.0:1767320187.408631:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17671
00000100:00100000:2.0:1767320187.408639:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940713088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320187.408662:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320187.408704:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940713088:12345-0@lo:38:kworker.0 Request processed in 65us (12425us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320187.408710:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17671
00000100:00100000:2.0:1767320187.408726:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17672
00000100:00100000:2.0:1767320187.408731:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940713344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320187.408741:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320187.408764:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940713344:12345-0@lo:38:kworker.0 Request processed in 31us (412us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320187.408769:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17672
00000100:00080000:3.0:1767320187.409256:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320187.409261:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320187.409264:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940713088:0@lo:38:kworker.0
00000100:00080000:3.0:1767320187.409273:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320187.409276:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320187.409278:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940713344:0@lo:38:kworker.0
00000100:00100000:3.0:1767320187.885188:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940713472:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320187.885258:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320187.885345:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713472
00000100:00100000:1.0:1767320187.885352:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713472
00000100:00100000:1.0:1767320187.885413:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760
00000100:00100000:1.0:1767320187.885422:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940713472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320187.885453:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320187.885921:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940713472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 499us (662us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320187.885930:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760
00000100:00100000:3.0:1767320187.886221:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940713472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320188.076915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320188.333595:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320188.910055:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320188.910080:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940713600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320188.910159:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320188.910264:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713600
00000100:00100000:1.0:1767320188.910273:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713600
00000100:00100000:1.0:1767320188.910383:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761
00000100:00100000:1.0:1767320188.910395:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940713600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320188.910423:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320188.910464:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940713600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320188.910470:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761
00000100:00100000:2.0:1767320188.910555:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940713600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320188.998232:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320188.998327:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360832
00000100:00100000:1.0:1767320188.998339:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360832
00000100:00100000:1.0:1767320188.998441:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17673
00000100:00100000:1.0:1767320188.998448:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894360832:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320188.998468:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320188.998519:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894360832:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 70us (295us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320188.998524:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17673
00000100:00100000:3.0:1767320188.998680:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320188.999306:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894360960
00000100:00100000:0.0:1767320188.999311:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894360960
00000100:00100000:0.0:1767320188.999401:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4945
00000100:00100000:0.0:1767320188.999409:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894360960:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320188.999451:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894360960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 45us (772us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320188.999456:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4945
00000100:00080000:3.0:1767320188.999880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320189.100988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320189.362843:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320190.126069:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320190.383838:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320191.148895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320191.405011:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320192.173638:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320192.430174:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320192.493035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320192.493049:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320192.493053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320192.493058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320192.493064:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320192.493074:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5437
00000100:00080000:1.0:1767320192.493080:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320192.493089:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320192.493147:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abfb80 x1853163940713728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320192.493184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320192.493188:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320192.493190:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320192.493194:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5437
00000100:00080000:1.0:1767320192.493196:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320192.493200:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320192.493215:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abf100 x1853163940713856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320192.493604:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940713728:0@lo:38:kworker.0
00000100:00100000:3.0:1767320192.493696:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320192.493824:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940713856:0@lo:38:kworker.0
00000100:00100000:3.0:1767320192.493855:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320192.494027:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940713984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320192.494070:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320192.494160:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713984
00000100:00100000:3.0:1767320192.494170:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713984
00000100:00100000:3.0:1767320192.494261:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197
00000100:00100000:3.0:1767320192.494275:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940713984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.494655:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713856
00000100:00100000:2.0:1767320192.494660:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713856
00000100:00100000:2.0:1767320192.494690:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253
00000100:00100000:2.0:1767320192.494696:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940713856:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320192.494721:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320192.494873:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940713856:12345-0@lo:38:kworker.0 Request processed in 175us (1015us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320192.494881:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253
00000100:00100000:2.0:1767320192.494915:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940713728
00000100:00100000:2.0:1767320192.494919:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940713728
00000100:00100000:2.0:1767320192.494944:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17674
00000100:00100000:2.0:1767320192.494949:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940713728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320192.494960:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320192.494986:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940713728:12345-0@lo:38:kworker.0 Request processed in 37us (1291us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320192.494993:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17674
00000100:00080000:2.0:1767320192.495033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320192.495039:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320192.495043:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940713728:0@lo:38:kworker.0
00000100:00080000:2.0:1767320192.495054:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320192.495057:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320192.495060:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940713856:0@lo:38:kworker.0
00000100:00080000:2.0:1767320192.495106:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320192.495139:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940714112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.495170:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320192.495211:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714112
00000100:00100000:2.0:1767320192.495215:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714112
00000100:00100000:2.0:1767320192.495247:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198
00000100:00100000:2.0:1767320192.495254:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940714112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.495289:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940714112:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320192.495295:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198
00000100:00080000:2.0:1767320192.495313:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320192.495332:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940714112:0@lo:400:kworker.0
00000100:00100000:3.0:1767320192.499186:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940713984:12345-0@lo:400:kworker.0 Request processed in 4895us (5095us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320192.499209:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197
00000100:00080000:1.0:1767320192.499690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320192.499698:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320192.499702:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320192.499709:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5437
00000100:00080000:1.0:1767320192.499714:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320192.499721:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320192.499748:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abd180 x1853163940714368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320192.499801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320192.499805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320192.499807:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320192.499811:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5437
00000100:00080000:1.0:1767320192.499814:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320192.499817:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320192.499830:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50abe680 x1853163940714624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320192.499876:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940714368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320192.499976:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320192.500013:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940714624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320192.500039:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320192.500575:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714368
00000100:00100000:1.0:1767320192.500599:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714368
00000100:00100000:1.0:1767320192.500682:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714624
00000100:00100000:1.0:1767320192.500687:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714624
00000100:00100000:2.0:1767320192.501158:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940714240:0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.501225:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320192.501266:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320192.501272:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940714496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.501311:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320192.501764:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714240
00000100:00100000:3.0:1767320192.501802:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714240
00000100:00100000:3.0:1767320192.501875:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946
00000100:00100000:3.0:1767320192.501891:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940714240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320192.501978:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940714240:12345-0@lo:400:kworker.0 Request processed in 93us (751us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320192.501986:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946
00000100:00100000:3.0:1767320192.502007:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714496
00000100:00100000:3.0:1767320192.502011:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714496
00000100:00100000:3.0:1767320192.502030:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947
00000100:00100000:3.0:1767320192.502036:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940714496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320192.502065:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940714496:12345-0@lo:400:kworker.0 Request processed in 30us (754us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320192.502072:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947
00000100:00100000:3.0:1767320192.502085:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17675
00000100:00100000:3.0:1767320192.502090:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940714368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320192.502118:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320192.502156:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940714368:12345-0@lo:38:kworker.0 Request processed in 64us (2180us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320192.502164:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17675
00000100:00080000:3.0:1767320192.502198:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320192.502276:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320192.502282:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320192.502304:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940714368:0@lo:38:kworker.0
00000100:00100000:2.0:1767320192.503130:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940714496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320192.503145:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940714240:0@lo:400:kworker.0
00000100:00100000:0.0:1767320192.503249:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940713984:0@lo:400:kworker.0
00000100:00100000:1.0:1767320192.504514:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17676
00000100:00100000:1.0:1767320192.504528:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940714624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320192.504564:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320192.504673:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940714624:12345-0@lo:38:kworker.0 Request processed in 146us (4631us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320192.504681:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17676
00000100:00080000:2.0:1767320192.504819:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320192.504830:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320192.504836:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940714624:0@lo:38:kworker.0
00000100:00100000:0.0:1767320193.008885:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940714752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320193.008995:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320193.009649:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714752
00000100:00100000:2.0:1767320193.009663:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714752
00000100:00100000:2.0:1767320193.009734:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762
00000100:00100000:2.0:1767320193.009746:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940714752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320193.009824:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320193.009909:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940714752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (904us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320193.009918:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762
00000100:00100000:0.0:1767320193.010165:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940714752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320193.197867:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320193.454658:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320194.029179:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940714880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320194.029262:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320194.029452:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940714880
00000100:00100000:0.0:1767320194.029461:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940714880
00000100:00100000:0.0:1767320194.029568:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763
00000100:00100000:0.0:1767320194.029577:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940714880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320194.029608:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320194.033655:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320194.035464:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940714880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5881us (6193us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320194.035478:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763
00000100:00100000:3.0:1767320194.036142:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf426d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940714880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320194.118069:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320194.118200:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320194.118699:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361088
00000100:00100000:3.0:1767320194.118709:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361088
00000100:00100000:3.0:1767320194.118754:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361216
00000100:00100000:3.0:1767320194.118758:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361216
00000100:00100000:3.0:1767320194.118845:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4948
00000100:00100000:3.0:1767320194.118856:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320194.118942:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (741us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320194.118949:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4948
00000100:00100000:3.0:1767320194.118968:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17677
00000100:00100000:3.0:1767320194.118972:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894361088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320194.118991:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320194.119012:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894361088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (952us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320194.119017:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17677
00000100:00080000:0.0:1767320194.119582:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320194.222272:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320194.476943:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320195.244907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320195.501361:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320196.269139:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320196.529558:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320197.292896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320197.549128:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320197.614159:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320197.614170:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320197.614173:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320197.614177:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320197.614182:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320197.614189:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5442
00000100:00080000:2.0:1767320197.614193:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320197.614200:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320197.614250:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a300 x1853163940715008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320197.614276:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320197.614280:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320197.614282:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320197.614286:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5442
00000100:00080000:2.0:1767320197.614288:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320197.614292:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320197.614308:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4540a680 x1853163940715136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320197.614382:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320197.614386:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320197.614388:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320197.614391:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5442
00000100:00080000:2.0:1767320197.614393:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320197.614397:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320197.614407:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073411f80 x1853163940715648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320197.614427:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320197.614430:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320197.614431:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320197.614434:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5442
00000100:00080000:2.0:1767320197.614436:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320197.614440:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320197.614449:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeae300 x1853163940715904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320197.614607:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940715392:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.614696:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320197.614761:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320197.614767:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940715264:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.614813:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320197.614851:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940715520:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.614879:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320197.614899:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320197.614915:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940715776:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.614940:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320197.614945:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940715008:0@lo:38:kworker.0
00000100:00100000:1.0:1767320197.614972:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715520
00000100:00100000:1.0:1767320197.614981:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715520
00000100:00100000:1.0:1767320197.615031:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715776
00000100:00100000:1.0:1767320197.615034:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715776
00000100:00100000:1.0:1767320197.615059:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4949
00000100:00100000:1.0:1767320197.615067:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940715520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.615117:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940715520:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320197.615124:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4949
00000100:00100000:3.0:1767320197.615134:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320197.615146:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715008
00000100:00100000:1.0:1767320197.615151:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715008
00000100:00100000:3.0:1767320197.615161:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940715136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320197.615174:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950
00000100:00100000:1.0:1767320197.615184:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940715776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320197.615193:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320197.615215:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940715648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320197.615239:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320197.615248:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940715904:0@lo:38:kworker.0
00000100:00100000:3.0:1767320197.615264:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320197.615288:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715648
00000100:00100000:3.0:1767320197.615292:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715648
00000100:00100000:3.0:1767320197.615305:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715904
00000100:00100000:3.0:1767320197.615308:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715904
00000100:00100000:3.0:1767320197.615317:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17678
00000100:00100000:3.0:1767320197.615322:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320197.615341:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320197.615371:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715008:12345-0@lo:38:kworker.0 Request processed in 48us (239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320197.615378:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17678
00000100:00100000:3.0:1767320197.615391:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17679
00000100:00100000:3.0:1767320197.615394:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320197.615403:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320197.615424:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715648:12345-0@lo:38:kworker.0 Request processed in 28us (185us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320197.615430:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17679
00000100:00100000:3.0:1767320197.615442:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17680
00000100:00100000:3.0:1767320197.615446:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320197.615454:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320197.615477:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940715904:12345-0@lo:38:kworker.0 Request processed in 29us (212us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320197.615482:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17680
00000100:00100000:3.0:1767320197.615523:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715136
00000100:00100000:3.0:1767320197.615527:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715136
00000100:00100000:3.0:1767320197.615546:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254
00000100:00100000:3.0:1767320197.615551:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940715136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320197.615561:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320197.615566:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940715776:12345-0@lo:400:kworker.0 Request processed in 382us (622us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320197.615574:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950
00000100:00100000:3.0:1767320197.615597:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940715136:12345-0@lo:38:kworker.0 Request processed in 42us (403us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320197.615605:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254
00000100:00100000:1.0:1767320197.615619:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940715776:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.615634:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940715520:0@lo:400:kworker.0
00000100:00080000:3.0:1767320197.615646:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320197.615653:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320197.615656:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940715008:0@lo:38:kworker.0
00000100:00080000:3.0:1767320197.615670:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320197.615674:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320197.615677:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4540a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940715136:0@lo:38:kworker.0
00000100:00100000:2.0:1767320197.615882:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715392
00000100:00100000:2.0:1767320197.615887:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715392
00000100:00100000:2.0:1767320197.616021:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940715264
00000100:00100000:2.0:1767320197.616025:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940715264
00000100:00100000:2.0:1767320197.616051:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199
00000100:00100000:2.0:1767320197.616058:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940715392:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320197.616094:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940715392:12345-0@lo:400:kworker.0 Request processed in 37us (1398us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320197.616100:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199
00000100:00100000:2.0:1767320197.616547:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200
00000100:00100000:2.0:1767320197.616555:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940715264:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320197.616709:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320197.616714:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320197.616717:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320197.616961:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940715264:0@lo:400:kworker.0
00000100:00100000:1.0:1767320197.616972:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940715392:0@lo:400:kworker.0
00000100:00100000:2.0:1767320197.617100:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940715264:12345-0@lo:400:kworker.0 Request processed in 30us (1770us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320197.617106:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200
00000100:00080000:3.0:1767320197.618108:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320197.618116:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320197.618120:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940715648:0@lo:38:kworker.0
00000100:00080000:3.0:1767320197.618142:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320197.618146:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320197.618148:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940715904:0@lo:38:kworker.0
00000100:00100000:1.0:1767320198.125112:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320198.125137:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940716032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320198.125222:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320198.125347:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716032
00000100:00100000:3.0:1767320198.125358:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716032
00000100:00100000:3.0:1767320198.125417:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764
00000100:00100000:3.0:1767320198.125426:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940716032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320198.125457:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320198.125519:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940716032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320198.125526:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764
00000100:00100000:1.0:1767320198.126230:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940716032:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320198.316908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320198.573359:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320199.149757:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940716160:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320199.150074:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320199.150193:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716160
00000100:00100000:2.0:1767320199.150202:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716160
00000100:00100000:2.0:1767320199.150431:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765
00000100:00100000:2.0:1767320199.150440:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940716160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320199.150469:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320199.150542:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940716160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (468us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320199.150549:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765
00000100:00100000:1.0:1767320199.150683:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940716160:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320199.150816:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320199.242744:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320199.242823:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320199.243024:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361472
00000100:00100000:1.0:1767320199.243035:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361472
00000100:00100000:1.0:1767320199.243113:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361344
00000100:00100000:1.0:1767320199.243117:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361344
00000100:00100000:1.0:1767320199.243144:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4951
00000100:00100000:1.0:1767320199.243154:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361472:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320199.243222:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361472:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (487us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320199.243229:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4951
00000100:00100000:1.0:1767320199.243246:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17681
00000100:00100000:1.0:1767320199.243250:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894361344:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320199.243271:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320199.243296:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894361344:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (472us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320199.243302:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17681
00000100:00080000:3.0:1767320199.244110:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320199.344041:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320199.596999:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320200.365179:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320200.622180:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320201.388881:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320201.645041:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320202.412910:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320202.669018:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320202.733229:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320202.733240:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320202.733243:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320202.733247:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320202.733251:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320202.733258:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5447
00000100:00080000:3.0:1767320202.733263:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320202.733269:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320202.733306:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93b80 x1853163940716288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320202.733335:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320202.733339:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320202.733341:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320202.733344:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5447
00000100:00080000:3.0:1767320202.733347:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320202.733350:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320202.733366:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940716416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320202.733433:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320202.733436:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320202.733439:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320202.733443:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5447
00000100:00080000:3.0:1767320202.733446:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320202.733460:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320202.733471:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93480 x1853163940716928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320202.733485:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320202.733490:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320202.733491:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320202.733495:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5447
00000100:00080000:3.0:1767320202.733497:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320202.733500:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320202.733510:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92d80 x1853163940717184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320202.733531:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940716544:0@lo:400:kworker.0
00000100:00100000:3.0:1767320202.733531:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940717056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320202.733589:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940716672:0@lo:400:kworker.0
00000100:00100000:0.0:1767320202.733793:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940716800:0@lo:400:kworker.0
00000100:00100000:1.0:1767320202.737821:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320202.737917:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716544
00000100:00100000:1.0:1767320202.737926:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716544
00000100:00100000:1.0:1767320202.740255:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201
00000100:00100000:1.0:1767320202.740267:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940716544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320202.740351:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940716544:12345-0@lo:400:kworker.0 Request processed in 86us (2536us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320202.740359:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201
00000100:00100000:1.0:1767320202.740417:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940716544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320202.740697:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320202.740760:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320202.740799:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940716288:0@lo:38:kworker.0
00000100:00100000:2.0:1767320202.740832:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.740852:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940716416:0@lo:38:kworker.0
00000100:00100000:2.0:1767320202.740874:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.740890:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940716928:0@lo:38:kworker.0
00000100:00100000:2.0:1767320202.740910:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.740926:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940717184:0@lo:38:kworker.0
00000100:00100000:2.0:1767320202.740944:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.740976:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716288
00000100:00100000:2.0:1767320202.740982:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716288
00000100:00100000:2.0:1767320202.741003:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716928
00000100:00100000:2.0:1767320202.741005:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716928
00000100:00100000:2.0:1767320202.741016:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717184
00000100:00100000:2.0:1767320202.741019:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717184
00000100:00100000:2.0:1767320202.741034:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17682
00000100:00100000:2.0:1767320202.741039:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940716288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320202.741057:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320202.741092:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940716288:12345-0@lo:38:kworker.0 Request processed in 51us (258us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320202.741097:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17682
00000100:00100000:2.0:1767320202.741345:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17683
00000100:00100000:2.0:1767320202.741350:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940716928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320202.741360:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320202.741387:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940716928:12345-0@lo:38:kworker.0 Request processed in 35us (476us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320202.741392:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17683
00000100:00100000:2.0:1767320202.741405:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17684
00000100:00100000:2.0:1767320202.741408:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940717184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320202.741417:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320202.741438:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940717184:12345-0@lo:38:kworker.0 Request processed in 29us (493us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320202.741444:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17684
00000100:00100000:1.0:1767320202.741469:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716672
00000100:00100000:1.0:1767320202.741475:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716672
00000100:00100000:1.0:1767320202.741507:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202
00000100:00100000:1.0:1767320202.741513:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940716672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320202.741552:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940716672:12345-0@lo:400:kworker.0 Request processed in 40us (857us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320202.741558:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202
00000100:00080000:1.0:1767320202.741579:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320202.741600:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940716672:0@lo:400:kworker.0
00000100:00100000:1.0:1767320202.741705:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716416
00000100:00100000:1.0:1767320202.741709:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716416
00000100:00100000:1.0:1767320202.741729:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255
00000100:00100000:1.0:1767320202.741734:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940716416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320202.741744:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320202.741770:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940716416:12345-0@lo:38:kworker.0 Request processed in 35us (896us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320202.741793:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255
00000100:00080000:1.0:1767320202.741831:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320202.741837:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320202.741840:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940716288:0@lo:38:kworker.0
00000100:00080000:1.0:1767320202.741849:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320202.741852:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320202.741855:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940716416:0@lo:38:kworker.0
00000100:00080000:1.0:1767320202.741862:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320202.741865:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320202.741868:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940716928:0@lo:38:kworker.0
00000100:00080000:1.0:1767320202.741875:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320202.741878:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320202.741880:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940717184:0@lo:38:kworker.0
00000100:00100000:3.0:1767320202.746846:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320202.749933:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.753385:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717056
00000100:00100000:2.0:1767320202.753399:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717056
00000100:00100000:2.0:1767320202.753501:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940716800
00000100:00100000:2.0:1767320202.753505:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940716800
00000100:00080000:0.0:1767320202.753818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320202.753973:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4952
00000100:00100000:3.0:1767320202.753988:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940717056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320202.754082:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940717056:12345-0@lo:400:kworker.0 Request processed in 100us (7242us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320202.754090:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4952
00000100:00100000:3.0:1767320202.754122:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4953
00000100:00100000:3.0:1767320202.754130:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940716800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320202.754172:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940716800:12345-0@lo:400:kworker.0 Request processed in 43us (4245us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320202.754179:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4953
00000100:00100000:0.0:1767320202.754701:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940716800:0@lo:400:kworker.0
00000100:00100000:0.0:1767320202.754738:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940717056:0@lo:400:kworker.0
00000100:00100000:3.0:1767320203.245168:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320203.245191:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940717312:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320203.245269:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320203.245413:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717312
00000100:00100000:0.0:1767320203.245422:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717312
00000100:00100000:0.0:1767320203.245497:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766
00000100:00100000:0.0:1767320203.245508:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940717312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320203.245585:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320203.245653:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940717312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (383us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320203.245661:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766
00000100:00100000:3.0:1767320203.245980:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940717312:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320203.336173:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320203.336301:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361856
00000100:00100000:1.0:1767320203.336312:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361856
00000100:00100000:1.0:1767320203.336427:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4954
00000100:00100000:1.0:1767320203.336437:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361856:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320203.336530:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894361856:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320203.336538:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4954
00000100:00080000:0.0:1767320203.336803:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767320203.337030:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894361600 offset 0 length 520: 4
00000100:00100000:3.0:1767320203.337145:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320203.337210:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361728
00000100:00100000:0.0:1767320203.337214:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361728
00000100:00100000:0.0:1767320203.337248:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17685
00000100:00100000:0.0:1767320203.337254:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894361728:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320203.337277:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320203.337319:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894361728:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 63us (174us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320203.337326:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17685
00000100:00100000:2.0:1767320203.437992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320203.693505:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320204.269217:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320204.269242:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940717440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320204.269315:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320204.269512:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717440
00000100:00100000:0.0:1767320204.269522:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717440
00000100:00100000:0.0:1767320204.269610:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767
00000100:00100000:0.0:1767320204.269621:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940717440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320204.269655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320204.269874:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320204.269936:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940717440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 316us (620us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320204.269945:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767
00000100:00100000:3.0:1767320204.275165:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940717440:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320204.461538:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320204.718894:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320205.484897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320205.740926:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320206.508893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320206.765180:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320207.533819:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320207.789075:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320207.853051:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320207.853103:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320207.853106:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320207.853111:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320207.853115:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320207.853123:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5452
00000100:00080000:3.0:1767320207.853128:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320207.853134:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320207.853284:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90700 x1853163940717568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320207.853313:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320207.853317:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320207.853319:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320207.853323:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5452
00000100:00080000:3.0:1767320207.853325:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320207.853330:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320207.853346:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93100 x1853163940717696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320207.853693:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940717568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320207.853761:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320207.853931:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320207.853935:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320207.853938:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320207.853942:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5452
00000100:00080000:3.0:1767320207.853945:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320207.853951:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940717824:0@lo:400:kworker.0
00000100:00080000:3.0:1767320207.853963:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320207.853977:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940718208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320207.853994:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320207.853997:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320207.853999:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320207.854002:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5452
00000100:00080000:3.0:1767320207.854005:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320207.854009:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320207.854021:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320207.854022:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91180 x1853163940718464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320207.854049:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940718080:0@lo:400:kworker.0
00000100:00100000:0.0:1767320207.854078:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320207.854088:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940717952:0@lo:400:kworker.0
00000100:00100000:3.0:1767320207.854103:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940718336:0@lo:400:kworker.0
00000100:00100000:0.0:1767320207.854125:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320207.854186:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717824
00000100:00100000:3.0:1767320207.854194:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717824
00000100:00100000:0.0:1767320207.854200:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717952
00000100:00100000:0.0:1767320207.854205:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717952
00000100:00100000:1.0:1767320207.854272:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940717696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320207.854302:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320207.854322:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940718208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320207.854343:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320207.855386:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203
00000100:00100000:0.0:1767320207.855433:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940717952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320207.856089:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940717952:12345-0@lo:400:kworker.0 Request processed in 688us (1967us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320207.856099:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203
00000100:00100000:0.0:1767320207.856201:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940717952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320207.858822:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940718464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320207.858894:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320207.862567:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717568
00000100:00100000:2.0:1767320207.862586:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717568
00000100:00100000:3.0:1767320207.862744:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204
00000100:00100000:3.0:1767320207.862786:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940717824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320207.863538:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940717824:12345-0@lo:400:kworker.0 Request processed in 780us (9516us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320207.863548:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204
00000100:00100000:3.0:1767320207.864526:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940717824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320207.864593:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718208
00000100:00100000:3.0:1767320207.864599:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718208
00000100:00100000:3.0:1767320207.866086:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17686
00000100:00100000:3.0:1767320207.866096:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940718208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320207.866131:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320207.866203:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940718208:12345-0@lo:38:kworker.0 Request processed in 107us (11858us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320207.866211:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17686
00000100:00100000:3.0:1767320207.866264:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940717696
00000100:00100000:3.0:1767320207.866270:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940717696
00000100:00100000:3.0:1767320207.866294:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256
00000100:00100000:3.0:1767320207.866299:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940717696:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320207.866307:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320207.866335:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940717696:12345-0@lo:38:kworker.0 Request processed in 35us (12033us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320207.866341:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256
00000100:00100000:2.0:1767320207.866945:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17687
00000100:00100000:2.0:1767320207.866952:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940717568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320207.866964:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320207.867000:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940717568:12345-0@lo:38:kworker.0 Request processed in 48us (13239us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320207.867006:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17687
00000100:00100000:1.0:1767320207.868592:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320207.868651:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718464
00000100:00100000:3.0:1767320207.868664:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718464
00000100:00100000:1.0:1767320207.868672:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320207.868708:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718080
00000100:00100000:3.0:1767320207.868712:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718080
00000100:00100000:1.0:1767320207.868717:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718336
00000100:00100000:1.0:1767320207.868722:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718336
00000100:00100000:3.0:1767320207.868756:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955
00000100:00100000:3.0:1767320207.868793:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940718080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320207.868885:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940718080:12345-0@lo:400:kworker.0 Request processed in 119us (298us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320207.868971:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320207.868977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320207.868981:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320207.871980:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956
00000100:00100000:1.0:1767320207.872005:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940718336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320207.872097:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940718336:12345-0@lo:400:kworker.0 Request processed in 105us (3423us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320207.872104:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956
00000100:00100000:1.0:1767320207.872124:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17688
00000100:00100000:1.0:1767320207.872129:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940718464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320207.872147:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320207.872173:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940718464:12345-0@lo:38:kworker.0 Request processed in 43us (13280us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320207.872179:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17688
00000100:00100000:1.0:1767320207.872232:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940718080:0@lo:400:kworker.0
00000100:00100000:1.0:1767320207.872261:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940718336:0@lo:400:kworker.0
00000100:00080000:2.0:1767320207.872946:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320207.872953:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320207.872957:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940718464:0@lo:38:kworker.0
00000100:00080000:2.0:1767320207.872967:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320207.872970:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320207.872974:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940717568:0@lo:38:kworker.0
00000100:00080000:2.0:1767320207.872983:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320207.872986:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320207.872989:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940717696:0@lo:38:kworker.0
00000100:00080000:2.0:1767320207.873013:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320207.873016:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320207.873019:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940718208:0@lo:38:kworker.0
00000100:00100000:3.0:1767320207.874566:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955
00000100:00100000:3.0:1767320208.365026:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940718592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320208.365102:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320208.365272:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718592
00000100:00100000:0.0:1767320208.365280:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718592
00000100:00100000:0.0:1767320208.365342:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768
00000100:00100000:0.0:1767320208.365351:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940718592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320208.365390:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320208.366040:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940718592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 689us (936us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320208.366048:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768
00000100:00100000:3.0:1767320208.366147:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940718592:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320208.459683:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320208.459733:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320208.460197:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362112
00000100:00100000:1.0:1767320208.460208:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362112
00000100:00100000:1.0:1767320208.460283:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894361984
00000100:00100000:1.0:1767320208.460287:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894361984
00000100:00100000:1.0:1767320208.460307:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4957
00000100:00100000:1.0:1767320208.460317:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362112:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320208.460410:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362112:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (727us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320208.460418:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4957
00000100:00100000:1.0:1767320208.460436:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17689
00000100:00100000:1.0:1767320208.460441:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894361984:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320208.460461:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320208.460486:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894361984:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (752us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320208.460492:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17689
00000100:00080000:0.0:1767320208.460547:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320208.560695:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320208.815116:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320209.389986:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320209.390010:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940718720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320209.390078:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320209.390462:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718720
00000100:00100000:0.0:1767320209.390471:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718720
00000100:00100000:0.0:1767320209.390552:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769
00000100:00100000:0.0:1767320209.390561:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940718720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320209.390591:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320209.390689:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940718720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (611us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320209.390696:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769
00000100:00080000:1.0:1767320209.390754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320209.391381:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940718720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320209.580895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320209.837142:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320210.605020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320210.862701:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320211.628894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320211.884988:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320212.653031:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320212.913752:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320212.972862:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.972874:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320212.972878:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.972882:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320212.972886:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320212.972894:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5457
00000100:00080000:3.0:1767320212.972898:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320212.972951:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320212.972996:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940718848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320212.973022:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.973025:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320212.973027:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320212.973042:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5457
00000100:00080000:3.0:1767320212.973044:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320212.973048:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320212.973061:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93100 x1853163940718976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320212.973135:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940719104:0@lo:400:kworker.0
00000100:00080000:3.0:1767320212.973137:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.973144:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320212.973147:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320212.973150:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5457
00000100:00080000:3.0:1767320212.973153:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320212.973158:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320212.973171:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93480 x1853163940719488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320212.973188:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.973192:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320212.973193:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320212.973197:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5457
00000100:00080000:3.0:1767320212.973200:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320212.973203:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320212.973216:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a300 x1853163940719744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320212.973217:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973246:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940719360:0@lo:400:kworker.0
00000100:00100000:3.0:1767320212.973289:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973312:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320212.973313:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320212.973322:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940719616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320212.973325:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940719232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320212.973353:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320212.973391:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973410:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719104
00000100:00100000:3.0:1767320212.973419:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719104
00000100:00100000:1.0:1767320212.973433:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719232
00000100:00100000:1.0:1767320212.973438:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719232
00000100:00100000:1.0:1767320212.973480:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205
00000100:00100000:1.0:1767320212.973489:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940719232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320212.973545:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940719232:12345-0@lo:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320212.973553:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205
00000100:00100000:1.0:1767320212.973571:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206
00000100:00100000:1.0:1767320212.973578:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940719104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320212.973584:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719360
00000100:00100000:2.0:1767320212.973592:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719360
00000100:00100000:1.0:1767320212.973607:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940719104:12345-0@lo:400:kworker.0 Request processed in 30us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320212.973614:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206
00000100:00100000:2.0:1767320212.973629:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719616
00000100:00100000:3.0:1767320212.973698:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958
00000100:00100000:3.0:1767320212.973708:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940719360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320212.973746:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940719360:12345-0@lo:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320212.973753:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958
00000100:00100000:3.0:1767320212.973808:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940719360:0@lo:400:kworker.0
00000100:00100000:3.0:1767320212.973855:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320187/real 1767320187]  req@ffff93cf45c3d500 x1853163940712320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320212.973871:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf45c3d500 x1853163940712320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320212.973885:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940718848:0@lo:38:kworker.0
00000100:00100000:3.0:1767320212.973909:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973926:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940718976:0@lo:38:kworker.0
00000100:00100000:3.0:1767320212.973948:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973963:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940719488:0@lo:38:kworker.0
00000100:00100000:3.0:1767320212.973984:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320212.973998:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940719744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320212.974017:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320212.974033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320212.974044:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320212.974048:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940712320:0@lo:250:kworker.0
00000100:00100000:3.0:1767320212.974071:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718976
00000100:00100000:3.0:1767320212.974074:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718976
00000100:00100000:3.0:1767320212.974109:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257
00000100:00100000:3.0:1767320212.974114:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940718976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320212.974134:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320212.974165:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940718976:12345-0@lo:38:kworker.0 Request processed in 49us (216us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320212.974171:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257
00000100:00100000:3.0:1767320212.974190:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940718848
00000100:00100000:3.0:1767320212.974193:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940718848
00000100:00100000:3.0:1767320212.974227:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719488
00000100:00100000:3.0:1767320212.974230:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719488
00000100:00100000:3.0:1767320212.974246:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940719744
00000100:00100000:3.0:1767320212.974249:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719744
00000100:00100000:3.0:1767320212.974260:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17690
00000100:00100000:3.0:1767320212.974264:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940718848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320212.974274:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320212.974300:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940718848:12345-0@lo:38:kworker.0 Request processed in 35us (391us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320212.974306:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17690
00000100:00100000:3.0:1767320212.974317:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17691
00000100:00100000:3.0:1767320212.974321:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940719488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320212.974330:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320212.974351:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940719488:12345-0@lo:38:kworker.0 Request processed in 29us (367us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320212.974356:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17691
00000100:00100000:3.0:1767320212.974381:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17692
00000100:00100000:3.0:1767320212.974385:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940719744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320212.974395:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320212.974417:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940719744:12345-0@lo:38:kworker.0 Request processed in 30us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320212.974422:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17692
00000100:00080000:3.0:1767320212.974442:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320212.974446:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320212.974448:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320212.974452:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5437
00000100:00080000:3.0:1767320212.974454:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320212.974459:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320212.974473:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d2d80 x1853163940719872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320212.974497:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940719872:0@lo:250:kworker.0
00000400:00000100:3.0:1767320212.974516:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940719872 offset 0 length 520: 4
00000100:00080000:3.0:1767320212.974540:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320212.974544:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320212.974547:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940718848:0@lo:38:kworker.0
00000100:00080000:3.0:1767320212.974556:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320212.974559:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320212.974562:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940718976:0@lo:38:kworker.0
00000100:00080000:3.0:1767320212.974570:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320212.974574:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320212.974577:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940719488:0@lo:38:kworker.0
00000100:00080000:3.0:1767320212.974585:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320212.974588:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320212.974591:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940719744:0@lo:38:kworker.0
00000100:00080000:3.0:1767320212.974626:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320212.974631:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320212.974633:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320212.974649:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940719232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320212.974659:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940719104:0@lo:400:kworker.0
00000100:00100000:2.0:1767320212.974754:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940719616
00000100:00100000:2.0:1767320212.974810:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959
00000100:00100000:2.0:1767320212.974816:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940719616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320212.974859:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940719616:12345-0@lo:400:kworker.0 Request processed in 44us (1508us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320212.974866:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959
00000100:00100000:2.0:1767320212.974893:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940719616:0@lo:400:kworker.0
00000100:00080000:3.0:1767320212.975250:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320213.485435:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320213.485459:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940720000:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320213.485525:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320213.485724:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720000
00000100:00100000:2.0:1767320213.485731:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720000
00000100:00100000:2.0:1767320213.485837:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770
00000100:00100000:2.0:1767320213.485844:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940720000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320213.485880:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320213.485920:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940720000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320213.485930:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770
00000100:00100000:1.0:1767320213.485987:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940720000:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320213.574873:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320213.577331:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362240
00000100:00100000:2.0:1767320213.577366:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362240
00000100:00100000:2.0:1767320213.577425:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17693
00000100:00100000:2.0:1767320213.577434:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894362240:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320213.577459:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320213.577582:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894362240:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 147us (2717us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320213.577590:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17693
00000100:00100000:2.0:1767320213.583661:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320213.583757:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362368
00000100:00100000:0.0:1767320213.583768:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362368
00000100:00100000:0.0:1767320213.583873:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4960
00000100:00100000:0.0:1767320213.583885:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362368:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320213.583982:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320213.583990:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4960
00000100:00080000:3.0:1767320213.584589:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320213.678313:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320213.933215:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320214.509458:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940720128:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320214.509546:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320214.509619:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720128
00000100:00100000:2.0:1767320214.509628:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720128
00000100:00100000:2.0:1767320214.509750:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771
00000100:00100000:2.0:1767320214.509762:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940720128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320214.510124:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320214.510199:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320214.518531:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940720128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8760us (8974us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320214.518546:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771
00000100:00100000:1.0:1767320214.530573:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940720128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320214.700922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320214.957224:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320215.725322:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320215.981214:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320216.748909:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320217.005101:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320217.772924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320218.031569:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320218.093529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320218.093541:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320218.093544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320218.093549:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320218.093554:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320218.093564:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5463
00000100:00080000:1.0:1767320218.093569:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320218.093578:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320218.093642:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50adc000 x1853163940720256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320218.093673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320218.093677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320218.093678:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320218.093682:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5463
00000100:00100000:3.0:1767320218.093811:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940720256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320218.093931:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320218.094527:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320218.094534:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320218.094586:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add880 x1853163940720384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320218.094814:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940720512:0@lo:400:kworker.0
00000100:00100000:0.0:1767320218.094895:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320218.094966:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320218.094972:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940720640:0@lo:400:kworker.0
00000100:00100000:0.0:1767320218.094995:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320218.095044:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720512
00000100:00100000:0.0:1767320218.095052:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720512
00000100:00100000:0.0:1767320218.095340:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720640
00000100:00100000:0.0:1767320218.095344:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720640
00000100:00100000:0.0:1767320218.095368:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207
00000100:00100000:0.0:1767320218.095376:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940720512:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320218.095437:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940720512:12345-0@lo:400:kworker.0 Request processed in 61us (541us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320218.095444:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207
00000100:00100000:0.0:1767320218.095461:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208
00000100:00100000:0.0:1767320218.095468:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940720640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320218.095508:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940720640:12345-0@lo:400:kworker.0 Request processed in 40us (511us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320218.095514:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208
00000100:00080000:0.0:1767320218.095531:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320218.095535:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320218.095565:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940720640:0@lo:400:kworker.0
00000100:00100000:0.0:1767320218.095575:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940720512:0@lo:400:kworker.0
00000100:00080000:1.0:1767320218.095849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320218.095854:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320218.095857:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320218.095862:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5463
00000100:00080000:1.0:1767320218.095864:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320218.095869:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320218.095891:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797ad80 x1853163940720896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320218.096371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320218.096374:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320218.096376:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320218.096380:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5463
00000100:00080000:1.0:1767320218.096383:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320218.096387:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320218.096483:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4797a680 x1853163940721152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320218.096515:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940721024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320218.096558:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320218.096588:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320218.096595:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940720768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320218.096618:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320218.096645:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720256
00000100:00100000:1.0:1767320218.096650:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720256
00000100:00100000:1.0:1767320218.096669:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721024
00000100:00100000:1.0:1767320218.096672:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721024
00000100:00100000:3.0:1767320218.096838:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720768
00000100:00100000:3.0:1767320218.096842:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720768
00000100:00100000:3.0:1767320218.096883:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961
00000100:00100000:3.0:1767320218.096893:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940720768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320218.096964:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940720768:12345-0@lo:400:kworker.0 Request processed in 73us (344us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320218.096970:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961
00000100:00100000:3.0:1767320218.096986:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17694
00000100:00100000:3.0:1767320218.096990:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940720256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320218.097022:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320218.097255:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940720256:12345-0@lo:38:kworker.0 Request processed in 262us (3322us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320218.097261:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17694
00000100:00080000:3.0:1767320218.097286:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320218.097299:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940720384:0@lo:38:kworker.0
00000100:00100000:3.0:1767320218.097348:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320218.097367:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940720896:0@lo:38:kworker.0
00000100:00100000:3.0:1767320218.097387:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320218.097492:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940721152:0@lo:38:kworker.0
00000100:00100000:3.0:1767320218.097515:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320218.097541:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320218.097546:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320218.097550:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940720256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320218.097578:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720384
00000100:00100000:3.0:1767320218.097582:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720384
00000100:00100000:3.0:1767320218.097603:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258
00000100:00100000:3.0:1767320218.097608:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940720384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320218.097621:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320218.097650:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940720384:12345-0@lo:38:kworker.0 Request processed in 41us (302us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320218.097656:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258
00000100:00100000:3.0:1767320218.097676:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940720896
00000100:00100000:3.0:1767320218.097680:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940720896
00000100:00100000:2.0:1767320218.097819:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721152
00000100:00100000:2.0:1767320218.097823:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721152
00000100:00100000:2.0:1767320218.097847:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17695
00000100:00100000:2.0:1767320218.097852:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940721152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320218.097864:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320218.097911:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940721152:12345-0@lo:38:kworker.0 Request processed in 57us (394us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320218.097917:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17695
00000100:00080000:2.0:1767320218.097983:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320218.097988:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320218.097991:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940720384:0@lo:38:kworker.0
00000100:00080000:2.0:1767320218.097999:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320218.098002:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320218.098006:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940721152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320218.098341:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962
00000100:00100000:1.0:1767320218.098347:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940721024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320218.098381:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940721024:12345-0@lo:400:kworker.0 Request processed in 35us (1823us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320218.098386:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962
00000100:00100000:3.0:1767320218.098521:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17696
00000100:00100000:3.0:1767320218.098526:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940720896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320218.098538:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320218.098569:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940720896:12345-0@lo:38:kworker.0 Request processed in 42us (1180us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320218.098575:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17696
00000100:00100000:1.0:1767320218.098888:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940720768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320218.098900:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940721024:0@lo:400:kworker.0
00000100:00080000:2.0:1767320218.099348:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320218.099374:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320218.099380:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320218.099383:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940720896:0@lo:38:kworker.0
00000100:00100000:0.0:1767320218.606297:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940721280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320218.606396:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320218.606534:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721280
00000100:00100000:1.0:1767320218.606542:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721280
00000100:00100000:1.0:1767320218.606602:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772
00000100:00100000:1.0:1767320218.606612:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940721280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320218.606642:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320218.610499:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940721280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3878us (4092us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320218.610517:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772
00000100:00100000:0.0:1767320218.610927:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940721280:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320218.696168:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320218.696211:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320218.696407:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362496
00000100:00100000:0.0:1767320218.696421:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362496
00000100:00100000:0.0:1767320218.696523:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362624
00000100:00100000:0.0:1767320218.696527:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362624
00000100:00080000:1.0:1767320218.696592:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320218.700254:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4963
00000100:00100000:3.0:1767320218.700290:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894362624:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320218.700477:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894362624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 208us (4265us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320218.700486:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4963
00000100:00100000:3.0:1767320218.700513:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17697
00000100:00100000:3.0:1767320218.700519:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894362496:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320218.700541:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320218.700568:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894362496:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (4410us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320218.700575:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17697
00000100:00100000:2.0:1767320218.798529:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320219.058372:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320219.634121:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940721408:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320219.634196:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320219.634402:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721408
00000100:00100000:1.0:1767320219.634412:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721408
00000100:00100000:1.0:1767320219.634472:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773
00000100:00100000:1.0:1767320219.634481:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940721408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320219.634530:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320219.634591:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940721408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (394us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320219.634598:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773
00000100:00100000:2.0:1767320219.634816:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940721408:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320219.820898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320220.077190:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320220.845654:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320221.101099:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320221.871992:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320222.125423:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320222.893900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320223.149750:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320223.213391:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320223.213404:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320223.213407:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320223.213411:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320223.213415:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320223.213424:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5468
00000100:00080000:0.0:1767320223.213429:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320223.213438:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320223.213479:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72d80 x1853163940721536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320223.213508:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320223.213514:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320223.213516:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320223.213519:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5468
00000100:00080000:0.0:1767320223.213522:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320223.213525:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320223.213541:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71180 x1853163940721664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320223.213647:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320223.213650:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320223.213652:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320223.213656:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5468
00000100:00080000:0.0:1767320223.213658:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767320223.213727:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940721920:0@lo:400:kworker.0
00000100:00100000:1.0:1767320223.213850:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320223.213909:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320223.213916:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940721792:0@lo:400:kworker.0
00000100:00100000:1.0:1767320223.213955:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320223.214006:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940722048:0@lo:400:kworker.0
00000100:00100000:1.0:1767320223.214033:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320223.214153:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721920
00000100:00100000:3.0:1767320223.214161:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721920
00000100:00100000:3.0:1767320223.214235:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721792
00000100:00100000:3.0:1767320223.214238:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721792
00000100:00100000:3.0:1767320223.214260:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209
00000100:00100000:3.0:1767320223.214300:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940721920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320223.214347:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940721920:12345-0@lo:400:kworker.0 Request processed in 50us (496us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.214353:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209
00000100:00100000:3.0:1767320223.214369:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210
00000100:00100000:3.0:1767320223.214380:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940721792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320223.214407:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940721792:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.214413:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210
00000100:00100000:3.0:1767320223.214451:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722048
00000100:00100000:3.0:1767320223.214454:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722048
00000100:00100000:3.0:1767320223.214483:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964
00000100:00100000:3.0:1767320223.214490:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940722048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320223.214534:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940722048:12345-0@lo:400:kworker.0 Request processed in 44us (499us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.214540:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964
00000100:00100000:2.0:1767320223.214554:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940721536:0@lo:38:kworker.0
00000100:00100000:2.0:1767320223.214582:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320223.214612:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940721664:0@lo:38:kworker.0
00000100:00100000:2.0:1767320223.214629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320223.214655:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721664
00000100:00100000:2.0:1767320223.214659:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721664
00000100:00100000:2.0:1767320223.214685:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259
00000100:00080000:1.0:1767320223.214689:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320223.214691:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940721664:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767320223.214696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320223.214699:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00020000:2.0:1767320223.214714:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320223.214731:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940722048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320223.214754:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940721664:12345-0@lo:38:kworker.0 Request processed in 61us (121us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320223.214761:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259
00000100:00100000:1.0:1767320223.214764:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940721792:0@lo:400:kworker.0
00000100:00100000:1.0:1767320223.214795:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940721920:0@lo:400:kworker.0
00000100:00080000:2.0:1767320223.214827:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320223.214874:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320223.214900:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50addc00 x1853163940722176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320223.214915:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940721536
00000100:00100000:3.0:1767320223.214920:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940721536
00000100:00080000:0.0:1767320223.214927:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320223.214932:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320223.214935:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320223.214940:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17698
00000100:00080000:0.0:1767320223.214941:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5468
00000100:00100000:3.0:1767320223.214946:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940721536:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767320223.214947:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320223.214955:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00010000:00020000:3.0:1767320223.214959:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320223.214972:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50add880 x1853163940722432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320223.214983:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940721536:12345-0@lo:38:kworker.0 Request processed in 36us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320223.214988:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17698
00000100:00100000:1.0:1767320223.215116:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940722304:0@lo:400:kworker.0
00000100:00100000:1.0:1767320223.215156:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320223.215247:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320223.215259:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940721664:0@lo:38:kworker.0
00000100:00100000:2.0:1767320223.215282:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940722176:0@lo:38:kworker.0
00000100:00100000:2.0:1767320223.215304:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320223.215350:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722304
00000100:00100000:3.0:1767320223.215355:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722304
00000100:00100000:3.0:1767320223.215404:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722176
00000100:00100000:3.0:1767320223.215408:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722176
00000100:00100000:3.0:1767320223.215425:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965
00000100:00100000:3.0:1767320223.215432:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940722304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320223.215468:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940722304:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.215474:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965
00000100:00100000:3.0:1767320223.215487:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17699
00000100:00100000:3.0:1767320223.215491:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940722176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320223.215507:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320223.215533:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940722176:12345-0@lo:38:kworker.0 Request processed in 40us (227us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320223.215540:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17699
00000100:00100000:2.0:1767320223.215562:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940722432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320223.215582:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320223.215605:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320223.215608:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320223.215610:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940721536:0@lo:38:kworker.0
00000100:00080000:2.0:1767320223.215621:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320223.215623:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320223.215625:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940722176:0@lo:38:kworker.0
00000100:00080000:1.0:1767320223.215654:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320223.215674:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940722304:0@lo:400:kworker.0
00000100:00100000:3.0:1767320223.215954:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722432
00000100:00100000:3.0:1767320223.215957:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722432
00000100:00100000:3.0:1767320223.215975:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17700
00000100:00100000:3.0:1767320223.215981:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940722432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320223.215990:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320223.216018:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf426d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940722432:12345-0@lo:38:kworker.0 Request processed in 38us (435us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320223.216022:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17700
00000100:00080000:2.0:1767320223.216076:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320223.216080:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320223.216083:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940722432:0@lo:38:kworker.0
00000100:00100000:0.0:1767320223.725178:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940722560:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320223.725248:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320223.725388:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722560
00000100:00100000:3.0:1767320223.725396:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722560
00000100:00100000:3.0:1767320223.725460:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774
00000100:00100000:3.0:1767320223.725469:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940722560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320223.725539:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320223.734292:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940722560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8793us (9013us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.734309:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774
00000100:00100000:0.0:1767320223.734696:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0737f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940722560:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320223.821138:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320223.821248:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320223.821340:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362752
00000100:00100000:0.0:1767320223.821352:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362752
00000100:00100000:0.0:1767320223.821480:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894362880
00000100:00100000:0.0:1767320223.821484:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894362880
00000100:00100000:3.0:1767320223.823519:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4966
00000100:00100000:3.0:1767320223.823542:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362880:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320223.823855:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894362880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 324us (2605us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320223.823869:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4966
00000100:00100000:3.0:1767320223.823897:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17701
00000100:00100000:3.0:1767320223.823902:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894362752:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320223.823923:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320223.823947:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0737f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894362752:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (2820us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320223.823954:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17701
00000100:00080000:1.0:1767320223.834466:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320223.916897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320224.174056:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320224.749895:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320224.749919:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940722688:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320224.750003:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320224.750125:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722688
00000100:00100000:3.0:1767320224.750134:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722688
00000100:00100000:3.0:1767320224.750186:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775
00000100:00100000:3.0:1767320224.750195:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940722688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320224.750225:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320224.750289:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940722688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320224.750296:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775
00000100:00100000:0.0:1767320224.750386:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940722688:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320224.940854:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320225.199273:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320225.964889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320226.223652:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320226.989705:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320227.245014:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320227.920700:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767320227.920915:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894363008 offset 0 length 520: 4
00000100:00100000:3.0:1767320227.920972:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320227.921079:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363264
00000100:00100000:2.0:1767320227.921089:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363264
00000100:00100000:2.0:1767320227.921195:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363136
00000100:00100000:2.0:1767320227.921199:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363136
00000100:00080000:1.0:1767320227.921228:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320227.921240:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4967
00000100:00100000:2.0:1767320227.921252:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894363264:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320227.921278:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17702
00000100:00100000:1.0:1767320227.921286:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894363136:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320227.921308:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320227.921331:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894363264:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (647us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320227.921341:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4967
00000100:00100000:1.0:1767320227.921346:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894363136:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 56us (368us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320227.921355:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17702
00000100:00100000:2.0:1767320228.016109:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320228.271755:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320228.333011:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320228.333022:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320228.333024:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320228.333028:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320228.333033:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320228.333041:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5473
00000100:00080000:3.0:1767320228.333045:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320228.333052:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320228.333089:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d1880 x1853163940722816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320228.333117:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320228.333121:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320228.333123:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320228.333126:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5473
00000100:00080000:3.0:1767320228.333129:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320228.333133:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320228.333148:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf520d3b80 x1853163940722944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320228.333249:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320228.333253:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320228.333255:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320228.333258:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5473
00000100:00080000:3.0:1767320228.333261:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320228.333265:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320228.333277:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b92d80 x1853163940723456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320228.333293:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320228.333296:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320228.333298:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320228.333301:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5473
00000100:00080000:3.0:1767320228.333303:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320228.333308:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320228.333317:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91180 x1853163940723712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320228.333468:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940723328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.333584:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320228.333659:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320228.333666:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940723584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.333689:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320228.333715:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940722816:0@lo:38:kworker.0
00000100:00100000:0.0:1767320228.333743:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320228.333751:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723200:0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.333792:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940722944:0@lo:38:kworker.0
00000100:00100000:2.0:1767320228.333810:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320228.333831:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320228.333837:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320228.333843:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723072:0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.333856:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940723456:0@lo:38:kworker.0
00000100:00100000:2.0:1767320228.333864:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320228.333888:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320228.333894:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722944
00000100:00100000:2.0:1767320228.333902:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722944
00000100:00100000:0.0:1767320228.333911:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940723712:0@lo:38:kworker.0
00000100:00100000:0.0:1767320228.333938:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320228.333942:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260
00000100:00100000:2.0:1767320228.333950:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940722944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320228.333971:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320228.334024:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723328
00000100:00100000:1.0:1767320228.334029:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723328
00000100:00100000:3.0:1767320228.334042:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723584
00000100:00100000:3.0:1767320228.334045:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723584
00000100:00100000:1.0:1767320228.334085:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940722816
00000100:00100000:0.0:1767320228.334089:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723456
00000100:00100000:1.0:1767320228.334089:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940722816
00000100:00100000:0.0:1767320228.334092:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723456
00000100:00100000:1.0:1767320228.334098:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723712
00000100:00100000:1.0:1767320228.334100:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723712
00000100:00100000:0.0:1767320228.334105:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968
00000100:00100000:0.0:1767320228.334112:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940723328:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.334156:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940723328:12345-0@lo:400:kworker.0 Request processed in 45us (572us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320228.334277:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940722944:12345-0@lo:38:kworker.0 Request processed in 317us (439us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320228.334285:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260
00000100:00100000:2.0:1767320228.334314:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723200
00000100:00100000:2.0:1767320228.334318:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723200
00000100:00100000:2.0:1767320228.334342:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723072
00000100:00100000:2.0:1767320228.334345:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723072
00000100:00100000:2.0:1767320228.334366:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211
00000100:00100000:2.0:1767320228.334372:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320228.334407:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723200:12345-0@lo:400:kworker.0 Request processed in 36us (597us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320228.334414:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211
00000100:00100000:2.0:1767320228.334425:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212
00000100:00100000:2.0:1767320228.334431:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320228.334454:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723072:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320228.334459:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212
00000100:00100000:1.0:1767320228.339478:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17703
00000100:00100000:1.0:1767320228.339492:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940722816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320228.339517:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320228.339595:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940722816:12345-0@lo:38:kworker.0 Request processed in 103us (5850us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320228.339603:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17703
00000100:00100000:1.0:1767320228.339623:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17704
00000100:00100000:1.0:1767320228.339628:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940723456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320228.339638:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320228.339662:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940723456:12345-0@lo:38:kworker.0 Request processed in 33us (5775us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320228.339668:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17704
00000100:00100000:1.0:1767320228.339682:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17705
00000100:00100000:1.0:1767320228.339686:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940723712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320228.339696:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320228.339720:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf439b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940723712:12345-0@lo:38:kworker.0 Request processed in 32us (5783us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320228.339726:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17705
00000100:00080000:1.0:1767320228.339766:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320228.339785:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320228.339788:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320228.340081:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940723328:0@lo:400:kworker.0
00000100:00080000:1.0:1767320228.340130:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320228.340136:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320228.340140:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940722816:0@lo:38:kworker.0
00000100:00080000:1.0:1767320228.340151:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320228.340155:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320228.340158:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940722944:0@lo:38:kworker.0
00000100:00080000:1.0:1767320228.340166:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320228.340169:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320228.340172:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940723456:0@lo:38:kworker.0
00000100:00080000:1.0:1767320228.340183:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320228.340185:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320228.340188:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940723712:0@lo:38:kworker.0
00000100:00100000:1.0:1767320228.340282:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723072:0@lo:400:kworker.0
00000100:00100000:1.0:1767320228.340293:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723200:0@lo:400:kworker.0
00000100:00100000:0.0:1767320228.342108:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968
00000100:00100000:2.0:1767320228.342237:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4969
00000100:00100000:2.0:1767320228.342255:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940723584:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320228.343090:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940723584:12345-0@lo:400:kworker.0 Request processed in 841us (9397us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320228.343099:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4969
00000100:00100000:2.0:1767320228.343150:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940723584:0@lo:400:kworker.0
00000100:00100000:3.0:1767320228.846802:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320228.846827:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723840:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320228.846898:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320228.847029:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723840
00000100:00100000:1.0:1767320228.847038:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723840
00000100:00100000:1.0:1767320228.847277:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776
00000100:00100000:1.0:1767320228.847288:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320228.847405:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320228.847515:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 228us (616us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320228.847523:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776
00000100:00100000:2.0:1767320228.847753:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723840:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320229.036955:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320229.293115:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320229.869164:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320229.869314:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320229.869482:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940723968
00000100:00100000:3.0:1767320229.869490:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940723968
00000100:00100000:3.0:1767320229.869548:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777
00000100:00100000:3.0:1767320229.869558:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320229.869589:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320229.869641:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940723968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (327us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320229.869649:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777
00000100:00100000:2.0:1767320229.869736:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940723968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320230.060908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320230.317102:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320231.084900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320231.341221:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320232.109257:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320232.364994:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320233.034143:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320233.034970:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363520
00000100:00100000:2.0:1767320233.034981:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363520
00000100:00100000:2.0:1767320233.035060:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4970
00000100:00100000:2.0:1767320233.035070:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894363520:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320233.035144:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894363520:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (1255us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320233.035153:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4970
00000100:00100000:1.0:1767320233.035886:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320233.036049:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363392
00000100:00100000:2.0:1767320233.036055:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363392
00000100:00100000:2.0:1767320233.036078:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17706
00000100:00100000:2.0:1767320233.036083:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894363392:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320233.036103:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320233.036136:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894363392:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 51us (458us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320233.036142:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17706
00000100:00080000:3.0:1767320233.038427:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320233.132958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320233.389717:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320233.453364:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320233.453377:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320233.453380:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320233.453384:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320233.453390:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320233.453398:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5478
00000100:00080000:0.0:1767320233.453403:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320233.453422:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320233.453480:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc3480 x1853163940724096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320233.453509:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320233.453513:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320233.453514:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320233.453524:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5478
00000100:00080000:0.0:1767320233.453527:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320233.453530:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320233.453540:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0a80 x1853163940724224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320233.453631:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320233.453635:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320233.453637:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320233.453653:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5478
00000100:00100000:1.0:1767320233.453800:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940724608:0@lo:400:kworker.0
00000100:00100000:1.0:1767320233.453931:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320233.454012:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940724096:0@lo:38:kworker.0
00000100:00100000:1.0:1767320233.454031:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320233.454048:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940724224:0@lo:38:kworker.0
00000100:00100000:1.0:1767320233.454067:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320233.454092:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724608
00000100:00100000:1.0:1767320233.454100:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724608
00000100:00100000:1.0:1767320233.454211:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724096
00000100:00100000:1.0:1767320233.454215:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724096
00000100:00100000:1.0:1767320233.454239:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971
00000100:00100000:1.0:1767320233.454248:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940724608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320233.454326:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940724608:12345-0@lo:400:kworker.0 Request processed in 80us (394us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320233.454335:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971
00000100:00100000:1.0:1767320233.454357:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17707
00000100:00100000:1.0:1767320233.454360:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940724096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320233.454392:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320233.454431:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940724096:12345-0@lo:38:kworker.0 Request processed in 69us (398us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320233.454436:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17707
00000100:00080000:1.0:1767320233.454483:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320233.454488:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320233.454492:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940724096:0@lo:38:kworker.0
00000100:00100000:1.0:1767320233.454530:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940724608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320233.454831:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940724352:0@lo:400:kworker.0
00000100:00100000:2.0:1767320233.454877:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320233.454925:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320233.454931:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940724480:0@lo:400:kworker.0
00000100:00100000:2.0:1767320233.454950:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320233.454979:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724224
00000100:00100000:2.0:1767320233.454983:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724224
00000100:00100000:2.0:1767320233.455002:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261
00000100:00100000:2.0:1767320233.455007:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940724224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320233.455017:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320233.455039:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940724224:12345-0@lo:38:kworker.0 Request processed in 32us (970us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320233.455043:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261
00000100:00080000:2.0:1767320233.455064:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320233.455066:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320233.455068:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940724224:0@lo:38:kworker.0
00000100:00080000:0.0:1767320233.455135:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320233.455140:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320233.455166:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0e00 x1853163940724736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320233.455205:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320233.455209:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320233.455211:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320233.455215:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5478
00000100:00080000:0.0:1767320233.455217:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320233.455221:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320233.455230:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940724992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320233.455283:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940724864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320233.455309:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320233.455336:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940724736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320233.455352:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320233.455363:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940724992:0@lo:38:kworker.0
00000100:00100000:2.0:1767320233.455375:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320233.455392:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724864
00000100:00100000:2.0:1767320233.455395:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724864
00000100:00100000:2.0:1767320233.455421:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724736
00000100:00100000:2.0:1767320233.455422:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724736
00000100:00100000:2.0:1767320233.455431:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724992
00000100:00100000:2.0:1767320233.455433:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724992
00000100:00100000:2.0:1767320233.455443:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972
00000100:00100000:2.0:1767320233.455447:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940724864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320233.455473:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940724864:12345-0@lo:400:kworker.0 Request processed in 26us (164us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320233.455477:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972
00000100:00100000:2.0:1767320233.455484:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17708
00000100:00100000:2.0:1767320233.455498:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940724736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320233.455506:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320233.455523:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940724736:12345-0@lo:38:kworker.0 Request processed in 24us (170us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320233.455527:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17708
00000100:00100000:2.0:1767320233.455534:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17709
00000100:00100000:2.0:1767320233.455537:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940724992:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320233.455542:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320233.455554:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940724992:12345-0@lo:38:kworker.0 Request processed in 16us (178us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320233.455558:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17709
00000100:00100000:2.0:1767320233.455588:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940724864:0@lo:400:kworker.0
00000100:00080000:2.0:1767320233.455605:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320233.455609:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320233.455612:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940724736:0@lo:38:kworker.0
00000100:00080000:2.0:1767320233.455620:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320233.455623:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320233.455626:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940724992:0@lo:38:kworker.0
00000100:00080000:3.0:1767320233.456505:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320233.456614:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724352
00000100:00100000:1.0:1767320233.456625:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724352
00000100:00100000:1.0:1767320233.456827:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940724480
00000100:00100000:1.0:1767320233.456831:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940724480
00000100:00100000:1.0:1767320233.456860:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213
00000100:00100000:1.0:1767320233.456869:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940724352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320233.456933:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4540b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940724352:12345-0@lo:400:kworker.0 Request processed in 67us (2056us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320233.456940:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213
00000100:00100000:1.0:1767320233.456954:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214
00000100:00100000:1.0:1767320233.456957:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940724480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320233.456974:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940724480:12345-0@lo:400:kworker.0 Request processed in 17us (2023us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320233.456977:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214
00000100:00100000:1.0:1767320233.457011:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940724480:0@lo:400:kworker.0
00000100:00100000:1.0:1767320233.457019:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940724352:0@lo:400:kworker.0
00000100:00080000:3.0:1767320233.457076:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320233.457078:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320233.965248:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320233.965284:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940725120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320233.965377:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320233.965598:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725120
00000100:00100000:0.0:1767320233.965606:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725120
00000100:00100000:0.0:1767320233.965661:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778
00000100:00100000:0.0:1767320233.965667:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940725120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320233.965704:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320233.965750:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940725120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320233.965755:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778
00000100:00100000:2.0:1767320233.965840:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940725120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320234.156903:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320234.414801:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320234.989174:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940725248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320234.989244:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320234.989300:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725248
00000100:00100000:3.0:1767320234.989307:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725248
00000100:00100000:3.0:1767320234.989358:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779
00000100:00100000:3.0:1767320234.989370:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940725248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320234.989399:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320234.989449:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940725248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (205us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320234.989456:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779
00000100:00100000:2.0:1767320234.989523:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940725248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320235.180912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320235.437900:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320236.205287:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320236.460999:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320237.228914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320237.485035:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320237.548929:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320212/real 1767320212]  req@ffff93cf520d2d80 x1853163940719872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320237.548969:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf520d2d80 x1853163940719872/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320237.548990:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320237.549011:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320237.549015:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940719872:0@lo:250:kworker.0
00000100:00080000:1.0:1767320237.556717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320237.556728:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320237.556732:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320237.556757:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5463
00000100:00080000:1.0:1767320237.556810:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320237.556819:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320237.556885:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72d80 x1853163940725376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320237.556943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320237.556946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320237.556948:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320237.556952:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5483
00000100:00080000:1.0:1767320237.556954:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320237.556970:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320237.557003:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71180 x1853163940725504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320237.557013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320237.557016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320237.557017:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320237.557036:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5483
00000100:00080000:1.0:1767320237.557038:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320237.557041:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320237.557069:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71880 x1853163940725632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320237.557194:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320237.557197:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320237.557199:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320237.557347:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5483
00000100:00080000:1.0:1767320237.557350:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320237.557371:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320237.557395:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012d80 x1853163940726144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320237.557430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320237.557446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320237.557448:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320237.557452:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5483
00000100:00080000:1.0:1767320237.557455:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320237.557458:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320237.557482:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940726400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320237.557526:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940726272:0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.558638:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320237.559437:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320237.559449:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940726016:0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.559509:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320237.559584:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726272
00000100:00100000:1.0:1767320237.559602:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726272
00000100:00100000:1.0:1767320237.559741:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726016
00000100:00100000:1.0:1767320237.559770:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726016
00000100:00100000:1.0:1767320237.559839:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973
00000100:00100000:1.0:1767320237.559865:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940726272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.559963:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940726272:12345-0@lo:400:kworker.0 Request processed in 100us (1326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320237.559970:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973
00000100:00100000:1.0:1767320237.559986:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974
00000100:00100000:1.0:1767320237.559992:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940726016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.560018:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940726016:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320237.560024:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974
00000100:00100000:1.0:1767320237.560081:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940726016:0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.560092:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940726272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320237.560106:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940725888:0@lo:400:kworker.0
00000100:00100000:0.0:1767320237.560151:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320237.560185:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725888
00000100:00100000:1.0:1767320237.560189:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725888
00000100:00100000:0.0:1767320237.560195:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320237.560202:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940725760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320237.560224:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320237.560248:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725760
00000100:00100000:0.0:1767320237.560253:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725760
00000100:00080000:3.0:1767320237.560651:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320237.560656:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320237.560658:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320237.561485:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215
00000100:00100000:1.0:1767320237.561509:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940725888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320237.561573:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940725888:12345-0@lo:400:kworker.0 Request processed in 80us (1421us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320237.561580:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215
00000100:00100000:3.0:1767320237.561915:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940725888:0@lo:400:kworker.0
00000100:00100000:2.0:1767320237.562987:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940725376:0@lo:250:kworker.0
00000400:00000100:2.0:1767320237.563063:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940725376 offset 0 length 520: 4
00000100:00100000:2.0:1767320237.563547:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940725504:0@lo:38:kworker.0
00000100:00100000:2.0:1767320237.563585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320237.563666:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940725632:0@lo:38:kworker.0
00000100:00100000:2.0:1767320237.563691:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320237.563708:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940726144:0@lo:38:kworker.0
00000100:00100000:2.0:1767320237.563746:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320237.563972:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216
00000100:00100000:0.0:1767320237.563987:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940725760:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320237.564042:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940725760:12345-0@lo:400:kworker.0 Request processed in 62us (3817us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320237.564049:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216
00000100:00100000:0.0:1767320237.564105:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940725760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320237.564148:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725632
00000100:00100000:0.0:1767320237.564163:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725632
00000100:00100000:0.0:1767320237.564189:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262
00000100:00100000:0.0:1767320237.564194:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940725632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320237.564214:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320237.564245:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940725632:12345-0@lo:38:kworker.0 Request processed in 49us (553us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320237.564251:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262
00000100:00100000:2.0:1767320237.564429:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940726400:0@lo:38:kworker.0
00000100:00100000:2.0:1767320237.564456:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320237.564536:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940725504
00000100:00100000:3.0:1767320237.564540:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940725504
00000100:00100000:3.0:1767320237.564565:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726144
00000100:00100000:3.0:1767320237.564568:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726144
00000100:00100000:3.0:1767320237.564582:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17710
00000100:00100000:3.0:1767320237.564587:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940725504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320237.564598:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320237.564639:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940725504:12345-0@lo:38:kworker.0 Request processed in 51us (1053us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320237.564645:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17710
00000100:00100000:3.0:1767320237.564659:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17711
00000100:00100000:3.0:1767320237.564662:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320237.564670:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320237.564692:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726144:12345-0@lo:38:kworker.0 Request processed in 28us (947us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320237.564713:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17711
00000100:00080000:2.0:1767320237.565087:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320237.565093:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320237.565097:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940725504:0@lo:38:kworker.0
00000100:00080000:2.0:1767320237.565106:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320237.565109:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320237.565112:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940725632:0@lo:38:kworker.0
00000100:00080000:2.0:1767320237.565121:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320237.565124:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320237.565126:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940726144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320237.565255:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726400
00000100:00100000:3.0:1767320237.565260:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726400
00000100:00100000:3.0:1767320237.565291:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17712
00000100:00100000:3.0:1767320237.565295:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320237.565307:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320237.565342:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726400:12345-0@lo:38:kworker.0 Request processed in 45us (884us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320237.565347:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17712
00000100:00080000:3.0:1767320237.565371:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320237.565375:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320237.565378:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940726400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320238.153252:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320238.154338:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363648
00000100:00100000:0.0:1767320238.154374:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363648
00000100:00100000:0.0:1767320238.154464:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17713
00000100:00100000:0.0:1767320238.154478:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894363648:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320238.154515:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320238.154630:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894363648:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 151us (1942us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320238.154639:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17713
00000100:00100000:3.0:1767320238.156191:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320238.157197:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363776
00000100:00100000:0.0:1767320238.157207:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363776
00000100:00100000:0.0:1767320238.157600:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4975
00000100:00080000:3.0:1767320238.157602:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320238.157615:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894363776:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320238.157728:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894363776:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 117us (1544us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320238.157737:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4975
00000100:00100000:3.0:1767320238.252959:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320238.510555:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320239.085903:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320239.085942:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940726528:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320239.086029:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320239.089320:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726528
00000100:00100000:1.0:1767320239.089340:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726528
00000100:00100000:1.0:1767320239.089470:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780
00000100:00100000:1.0:1767320239.089480:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940726528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320239.089512:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320239.089578:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940726528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (3549us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320239.089586:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780
00000100:00100000:0.0:1767320239.089713:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940726528:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320239.089982:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320239.276897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320239.533210:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320240.109142:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940726656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320240.109216:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320240.109345:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726656
00000100:00100000:3.0:1767320240.109355:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726656
00000100:00100000:3.0:1767320240.109417:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781
00000100:00100000:3.0:1767320240.109427:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940726656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320240.109495:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320240.109536:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940726656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (320us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320240.109543:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781
00000100:00100000:0.0:1767320240.109631:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940726656:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320240.109689:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320240.302387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320240.557086:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320241.325030:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320241.581653:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320242.349067:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320242.607027:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320242.669026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320242.669036:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320242.669038:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320242.669042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320242.669046:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320242.669054:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5487
00000100:00080000:1.0:1767320242.669058:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320242.669065:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320242.669116:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52012300 x1853163940726784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320242.669142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320242.669146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320242.669148:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320242.669151:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5487
00000100:00080000:1.0:1767320242.669154:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320242.669158:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320242.669180:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940726912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320242.669244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320242.669247:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320242.669249:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320242.669252:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5487
00000100:00080000:1.0:1767320242.669254:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320242.669258:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320242.669272:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940727424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320242.669290:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320242.669292:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320242.669294:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320242.669297:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5487
00000100:00080000:1.0:1767320242.669299:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320242.669302:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320242.669311:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940727680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320242.669336:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940727168:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669397:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320242.669454:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320242.669460:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940727040:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669481:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320242.669522:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727168
00000100:00100000:1.0:1767320242.669529:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727168
00000100:00100000:1.0:1767320242.669583:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727040
00000100:00100000:1.0:1767320242.669586:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727040
00000100:00100000:1.0:1767320242.669609:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217
00000100:00100000:1.0:1767320242.669617:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940727168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669667:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940727168:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320242.669674:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217
00000100:00100000:1.0:1767320242.669690:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218
00000100:00100000:1.0:1767320242.669695:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940727040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669720:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940727040:12345-0@lo:400:kworker.0 Request processed in 25us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320242.669725:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218
00000100:00080000:1.0:1767320242.669739:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320242.669743:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320242.669752:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940727296:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669801:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320242.669857:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320242.669863:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940727552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.669885:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320242.669912:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727296
00000100:00100000:1.0:1767320242.669915:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727296
00000100:00100000:1.0:1767320242.669943:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727552
00000100:00100000:1.0:1767320242.669946:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727552
00000100:00100000:1.0:1767320242.669966:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976
00000100:00100000:1.0:1767320242.669972:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940727296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.670009:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940727296:12345-0@lo:400:kworker.0 Request processed in 33us (204us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320242.670014:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976
00000100:00100000:1.0:1767320242.670027:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977
00000100:00100000:1.0:1767320242.670032:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940727552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.670054:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940727552:12345-0@lo:400:kworker.0 Request processed in 23us (169us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320242.670059:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977
00000100:00080000:1.0:1767320242.670077:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320242.670116:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940727552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.670125:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940727296:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.670150:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940727040:0@lo:400:kworker.0
00000100:00100000:1.0:1767320242.670158:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940727168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320242.670449:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940726784:0@lo:38:kworker.0
00000100:00100000:3.0:1767320242.670506:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320242.670529:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940726912:0@lo:38:kworker.0
00000100:00100000:3.0:1767320242.670566:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320242.670592:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940727424:0@lo:38:kworker.0
00000100:00100000:3.0:1767320242.670614:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320242.670630:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940727680:0@lo:38:kworker.0
00000100:00100000:3.0:1767320242.670649:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320242.670676:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726784
00000100:00100000:3.0:1767320242.670680:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726784
00000100:00100000:3.0:1767320242.670698:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727424
00000100:00100000:3.0:1767320242.670700:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727424
00000100:00100000:3.0:1767320242.670706:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727680
00000100:00100000:3.0:1767320242.670708:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727680
00000100:00100000:3.0:1767320242.670716:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17714
00000100:00100000:3.0:1767320242.670720:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320242.670737:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320242.670768:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940726784:12345-0@lo:38:kworker.0 Request processed in 47us (261us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320242.670792:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17714
00000100:00100000:3.0:1767320242.670807:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17715
00000100:00100000:3.0:1767320242.670811:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940727424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320242.670820:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320242.670841:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940727424:12345-0@lo:38:kworker.0 Request processed in 29us (227us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320242.670847:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17715
00000100:00100000:3.0:1767320242.670858:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17716
00000100:00100000:3.0:1767320242.670861:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940727680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320242.670869:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320242.670890:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940727680:12345-0@lo:38:kworker.0 Request processed in 27us (239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320242.670895:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17716
00000100:00080000:3.0:1767320242.670919:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320242.670924:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320242.670927:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940726784:0@lo:38:kworker.0
00000100:00080000:3.0:1767320242.670934:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320242.670937:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320242.670940:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940727424:0@lo:38:kworker.0
00000100:00080000:3.0:1767320242.670946:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320242.670949:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320242.670951:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940727680:0@lo:38:kworker.0
00000100:00100000:2.0:1767320242.671025:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940726912
00000100:00100000:2.0:1767320242.671030:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940726912
00000100:00100000:2.0:1767320242.671065:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263
00000100:00100000:2.0:1767320242.671070:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940726912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320242.671081:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320242.671126:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940726912:12345-0@lo:38:kworker.0 Request processed in 55us (559us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320242.671132:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263
00000100:00080000:2.0:1767320242.671160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320242.671163:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320242.671166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940726912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320243.271427:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320243.271537:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320243.283499:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364032
00000100:00100000:2.0:1767320243.283516:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364032
00000100:00100000:2.0:1767320243.283658:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894363904
00000100:00100000:2.0:1767320243.283663:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894363904
00000100:00100000:2.0:1767320243.283689:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4978
00000100:00100000:2.0:1767320243.283701:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894364032:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320243.283826:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894364032:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 126us (12407us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320243.283835:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4978
00000100:00100000:2.0:1767320243.283856:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17717
00000100:00100000:2.0:1767320243.283861:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894363904:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320243.283879:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320243.283908:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894363904:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (12370us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320243.283913:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17717
00000100:00080000:1.0:1767320243.284581:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320243.375752:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320243.628991:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320244.205402:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940727808:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320244.205487:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320244.205608:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727808
00000100:00100000:1.0:1767320244.205616:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727808
00000100:00100000:1.0:1767320244.205679:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782
00000100:00100000:1.0:1767320244.205688:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940727808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320244.205718:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:3.0:1767320244.205946:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320244.206244:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940727808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 556us (757us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320244.206253:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782
00000100:00100000:0.0:1767320244.206655:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940727808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320244.397466:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320244.653745:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320245.229550:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320245.229572:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940727936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320245.229641:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320245.230360:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940727936
00000100:00100000:1.0:1767320245.230368:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940727936
00000100:00100000:1.0:1767320245.230449:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783
00000100:00100000:1.0:1767320245.230458:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940727936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320245.230489:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320245.230542:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940727936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (901us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320245.230551:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783
00000100:00100000:1.0:1767320245.230602:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940727936:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320245.230981:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320245.422866:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320245.677244:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320246.447040:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320246.701309:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320247.469824:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320247.725085:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320247.789347:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320247.789359:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320247.789362:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320247.789366:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320247.789370:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320247.789377:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5492
00000100:00080000:0.0:1767320247.789382:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320247.789388:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320247.789425:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc0a80 x1853163940728064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320247.789450:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320247.789454:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320247.789455:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320247.789459:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5492
00000100:00080000:0.0:1767320247.789461:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320247.789464:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320247.789476:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1f80 x1853163940728192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320247.789561:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320247.789605:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320247.789607:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320247.789611:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5492
00000100:00080000:0.0:1767320247.789613:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320247.789617:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320247.789631:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2680 x1853163940728704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320247.789646:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320247.789649:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320247.789651:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320247.789654:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5492
00000100:00080000:0.0:1767320247.789656:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320247.789659:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320247.789669:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c2d80 x1853163940728960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320247.789744:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940728576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.789832:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320247.789898:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320247.789905:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940728832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.789937:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320247.789962:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940728320:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.789991:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320247.790020:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320247.790026:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940728448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.790059:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320247.790104:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728320
00000100:00100000:1.0:1767320247.790112:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728320
00000100:00100000:1.0:1767320247.790330:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728448
00000100:00100000:1.0:1767320247.790335:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728448
00000100:00100000:1.0:1767320247.790357:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219
00000100:00100000:1.0:1767320247.790365:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940728320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.790420:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940728320:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320247.790428:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219
00000100:00100000:1.0:1767320247.790444:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220
00000100:00100000:1.0:1767320247.790450:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940728448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.790477:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940728448:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320247.790482:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220
00000100:00080000:1.0:1767320247.790501:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320247.790519:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320247.790558:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940728448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.790569:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940728320:0@lo:400:kworker.0
00000100:00100000:0.0:1767320247.790651:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728576
00000100:00100000:0.0:1767320247.790655:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728576
00000100:00100000:0.0:1767320247.790694:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728832
00000100:00100000:0.0:1767320247.790697:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728832
00000100:00100000:0.0:1767320247.790716:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979
00000100:00100000:0.0:1767320247.790722:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940728576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320247.790761:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940728576:12345-0@lo:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320247.790766:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979
00000100:00100000:0.0:1767320247.790814:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980
00000100:00100000:0.0:1767320247.790820:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940728832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320247.790848:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940728832:12345-0@lo:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320247.790854:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980
00000100:00100000:2.0:1767320247.791362:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940728064:0@lo:38:kworker.0
00000100:00100000:2.0:1767320247.791402:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320247.791433:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940728192:0@lo:38:kworker.0
00000100:00100000:2.0:1767320247.791458:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320247.791480:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940728704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320247.791500:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320247.791529:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940728960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320247.791597:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320247.791628:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728064
00000100:00100000:2.0:1767320247.791632:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728064
00000100:00100000:2.0:1767320247.791652:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728704
00000100:00100000:2.0:1767320247.791655:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728704
00000100:00100000:2.0:1767320247.791665:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728960
00000100:00100000:2.0:1767320247.791667:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728960
00000100:00100000:2.0:1767320247.791680:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17718
00000100:00100000:2.0:1767320247.791684:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320247.791702:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320247.791735:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728064:12345-0@lo:38:kworker.0 Request processed in 50us (333us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320247.791742:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17718
00000100:00100000:2.0:1767320247.791755:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17719
00000100:00100000:2.0:1767320247.791759:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320247.791768:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320247.791813:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728704:12345-0@lo:38:kworker.0 Request processed in 52us (312us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320247.791819:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17719
00000100:00100000:2.0:1767320247.791829:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17720
00000100:00100000:2.0:1767320247.791833:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320247.791842:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320247.791864:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940728960:12345-0@lo:38:kworker.0 Request processed in 29us (267us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320247.791869:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17720
00000100:00080000:2.0:1767320247.791901:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320247.791907:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320247.791910:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940728064:0@lo:38:kworker.0
00000100:00080000:1.0:1767320247.792580:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320247.792611:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940728832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320247.792623:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940728576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320247.792704:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940728192
00000100:00100000:0.0:1767320247.792708:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940728192
00000100:00100000:0.0:1767320247.792744:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264
00000100:00100000:0.0:1767320247.792749:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940728192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320247.792760:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320247.792814:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940728192:12345-0@lo:38:kworker.0 Request processed in 64us (1355us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320247.792820:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264
00000100:00080000:2.0:1767320247.793400:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320247.793406:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320247.793409:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940728192:0@lo:38:kworker.0
00000100:00080000:2.0:1767320247.793417:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320247.793420:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320247.793422:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940728704:0@lo:38:kworker.0
00000100:00080000:2.0:1767320247.793430:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320247.793433:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320247.793435:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940728960:0@lo:38:kworker.0
00000100:00100000:1.0:1767320248.392386:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320248.392448:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320248.396326:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364288
00000100:00100000:0.0:1767320248.396340:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364288
00000100:00100000:0.0:1767320248.396435:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364160
00000100:00100000:0.0:1767320248.396440:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364160
00000100:00100000:0.0:1767320248.396471:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4981
00000100:00100000:0.0:1767320248.396482:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894364288:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320248.396566:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894364288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (4189us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320248.396573:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4981
00000100:00100000:0.0:1767320248.396593:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17721
00000100:00100000:0.0:1767320248.396598:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894364160:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320248.396619:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320248.396649:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894364160:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (4200us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320248.396655:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17721
00000100:00080000:1.0:1767320248.396797:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320248.493265:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320248.751320:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320249.325146:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940729088:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320249.325237:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320249.325685:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729088
00000100:00100000:3.0:1767320249.325694:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729088
00000100:00100000:3.0:1767320249.325770:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784
00000100:00100000:3.0:1767320249.325815:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940729088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320249.325845:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767320249.325910:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320249.330451:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940729088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4629us (5204us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320249.330466:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784
00000100:00100000:1.0:1767320249.336355:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940729088:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320249.516905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320249.773993:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320250.349798:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940729216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320250.350144:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320250.350261:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729216
00000100:00100000:3.0:1767320250.350268:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729216
00000100:00100000:3.0:1767320250.350315:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785
00000100:00100000:3.0:1767320250.350323:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940729216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320250.350349:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320250.350382:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940729216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320250.350387:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785
00000100:00080000:1.0:1767320250.350981:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320250.351030:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940729216:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320250.540948:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320250.798622:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320251.564894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320251.821062:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320252.588894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320252.845179:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320252.912077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320252.912088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320252.912091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320252.912095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320252.912100:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320252.912107:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5497
00000100:00080000:1.0:1767320252.912112:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320252.912119:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320252.912153:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8aa00 x1853163940729344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320252.915106:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940729344:0@lo:38:kworker.0
00000100:00100000:0.0:1767320252.915187:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320252.915385:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320252.915391:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320252.915394:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320252.915399:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5497
00000100:00080000:1.0:1767320252.915403:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320252.915408:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320252.915439:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52010a80 x1853163940729472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320252.915531:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940729472:0@lo:38:kworker.0
00000100:00100000:0.0:1767320252.915560:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320252.917133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320252.917138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320252.917141:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320252.917147:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5497
00000100:00080000:1.0:1767320252.917151:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320252.917156:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320252.917174:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940729984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320252.917190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320252.917193:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320252.917195:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320252.917198:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5497
00000100:00080000:1.0:1767320252.917200:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320252.917203:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320252.917218:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb94a80 x1853163940730240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320252.917250:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940729728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320252.917299:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320252.917379:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940729984:0@lo:38:kworker.0
00000100:00100000:0.0:1767320252.917408:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320252.918302:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729472
00000100:00100000:3.0:1767320252.918306:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729344
00000100:00100000:2.0:1767320252.918313:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729472
00000100:00100000:3.0:1767320252.918313:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729344
00000100:00100000:3.0:1767320252.918355:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729984
00000100:00100000:3.0:1767320252.918359:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729984
00000100:00100000:2.0:1767320252.918364:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265
00000100:00100000:2.0:1767320252.918373:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940729472:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320252.918381:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17722
00000100:00100000:3.0:1767320252.918386:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940729344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320252.918397:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767320252.918399:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320252.920233:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17723
00000100:00100000:0.0:1767320252.920243:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940729984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320252.920264:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320252.920405:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940729472:12345-0@lo:38:kworker.0 Request processed in 2031us (4842us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320252.920416:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265
00000100:00100000:2.0:1767320252.920859:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940729856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320252.921165:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940729984:12345-0@lo:38:kworker.0 Request processed in 920us (3754us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320252.921172:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17723
00000100:00080000:0.0:1767320252.921222:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320252.921226:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320252.921229:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940729984:0@lo:38:kworker.0
00000100:00100000:0.0:1767320252.921236:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940730240:0@lo:38:kworker.0
00000100:00100000:0.0:1767320252.921277:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940730112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320252.921304:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940729600:0@lo:400:kworker.0
00000100:00100000:0.0:1767320252.921327:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320252.921430:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940729344:12345-0@lo:38:kworker.0 Request processed in 3041us (6242us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320252.921437:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17722
00000100:00100000:2.0:1767320252.921487:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320252.921518:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320252.921626:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729728
00000100:00100000:3.0:1767320252.921633:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729728
00000100:00100000:3.0:1767320252.921693:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729600
00000100:00100000:3.0:1767320252.921696:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729600
00000100:00100000:3.0:1767320252.921718:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221
00000100:00100000:3.0:1767320252.921724:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940729728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320252.921765:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940729728:12345-0@lo:400:kworker.0 Request processed in 41us (4465us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320252.921789:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221
00000100:00100000:3.0:1767320252.921803:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222
00000100:00100000:3.0:1767320252.921809:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940729600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320252.921843:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940729600:12345-0@lo:400:kworker.0 Request processed in 34us (515us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320252.921849:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222
00000100:00080000:3.0:1767320252.921868:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320252.921872:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320252.921890:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940729600:0@lo:400:kworker.0
00000100:00100000:3.0:1767320252.921914:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320252.921985:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940729728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320252.924142:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940729856
00000100:00100000:1.0:1767320252.924154:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940729856
00000100:00080000:3.0:1767320252.924180:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320252.924189:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320252.924194:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940729472:0@lo:38:kworker.0
00000100:00080000:3.0:1767320252.924210:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320252.924214:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320252.924217:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940729344:0@lo:38:kworker.0
00000100:00100000:1.0:1767320252.924223:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730112
00000100:00100000:1.0:1767320252.924229:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730112
00000100:00100000:1.0:1767320252.924254:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730240
00000100:00100000:1.0:1767320252.924257:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730240
00000100:00100000:1.0:1767320252.924278:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982
00000100:00080000:3.0:1767320252.924287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320252.924288:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940729856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320252.924307:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4983
00000100:00100000:3.0:1767320252.924320:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940730112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320252.924363:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940729856:12345-0@lo:400:kworker.0 Request processed in 77us (2876us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320252.924372:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982
00000100:00100000:3.0:1767320252.924376:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940730112:12345-0@lo:400:kworker.0 Request processed in 59us (2857us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320252.924388:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4983
00000100:00100000:1.0:1767320252.924394:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17724
00000100:00100000:1.0:1767320252.924400:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940730240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320252.924419:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320252.924448:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940730112:0@lo:400:kworker.0
00000100:00100000:3.0:1767320252.927115:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940729856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320252.927128:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940730240:12345-0@lo:38:kworker.0 Request processed in 2723us (5208us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320252.927139:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17724
00000100:00080000:2.0:1767320252.927233:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320252.927239:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320252.927243:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940730240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320253.512233:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767320253.512265:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894364416 offset 0 length 520: 4
00000100:00100000:2.0:1767320253.512284:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320253.512423:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364672
00000100:00100000:3.0:1767320253.512434:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364672
00000100:00080000:0.0:1767320253.512490:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320253.512533:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364544
00000100:00100000:3.0:1767320253.512536:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364544
00000100:00100000:2.0:1767320253.512567:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4984
00000100:00100000:2.0:1767320253.512578:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894364672:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320253.512579:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17725
00000100:00100000:1.0:1767320253.512591:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894364544:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320253.512613:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320253.512645:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894364672:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (420us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320253.512653:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4984
00000100:00100000:1.0:1767320253.512667:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0712dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894364544:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 74us (378us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320253.512675:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17725
00000100:00100000:2.0:1767320253.612914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320253.869894:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320254.446609:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320254.446633:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940730368:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320254.446726:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320254.447118:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730368
00000100:00100000:0.0:1767320254.447128:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730368
00000100:00100000:0.0:1767320254.447258:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786
00000100:00100000:0.0:1767320254.447268:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940730368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320254.447321:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320254.447380:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940730368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (653us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320254.447387:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786
00000100:00100000:2.0:1767320254.447562:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940730368:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320254.447992:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320254.636885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320254.895054:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320255.470643:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940730496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320255.470718:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320255.471071:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730496
00000100:00100000:1.0:1767320255.471080:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730496
00000100:00100000:1.0:1767320255.471188:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787
00000100:00100000:1.0:1767320255.471198:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940730496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320255.471228:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:3.0:1767320255.471291:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320255.471332:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940730496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (614us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320255.471340:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787
00000100:00100000:2.0:1767320255.471410:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940730496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320255.661223:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320255.918694:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320256.686162:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320256.942069:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320257.708930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320257.965307:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320258.029177:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320258.029189:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320258.029192:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320258.029196:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320258.029200:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320258.029207:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5502
00000100:00080000:2.0:1767320258.029211:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320258.029218:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320258.029264:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940730624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320258.029283:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320258.029286:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320258.029288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320258.029291:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5502
00000100:00080000:2.0:1767320258.029294:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320258.029297:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320258.029310:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea6300 x1853163940730752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320258.029382:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320258.029386:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320258.029388:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320258.029391:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5502
00000100:00080000:2.0:1767320258.029394:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320258.029398:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320258.029411:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340b100 x1853163940731264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320258.029425:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320258.029428:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320258.029430:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320258.029433:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5502
00000100:00080000:2.0:1767320258.029435:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320258.029438:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320258.029447:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a680 x1853163940731520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320258.029476:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940731136:0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.029489:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940731008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320258.029573:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940730880:0@lo:400:kworker.0
00000100:00100000:3.0:1767320258.029871:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940730624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320258.036489:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320258.036594:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731008
00000100:00100000:1.0:1767320258.036602:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731008
00000100:00100000:1.0:1767320258.036669:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223
00000100:00100000:1.0:1767320258.036678:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940731008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.036762:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940731008:12345-0@lo:400:kworker.0 Request processed in 85us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320258.036769:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223
00000100:00100000:1.0:1767320258.036831:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940731008:0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.036880:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940731392:0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.036926:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320258.036965:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731392
00000100:00100000:1.0:1767320258.036969:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731392
00000100:00100000:1.0:1767320258.037000:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4985
00000100:00100000:1.0:1767320258.037007:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940731392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.037282:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940731392:12345-0@lo:400:kworker.0 Request processed in 274us (354us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320258.037288:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4985
00000100:00100000:1.0:1767320258.037315:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940731392:0@lo:400:kworker.0
00000100:00080000:1.0:1767320258.037342:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320258.037346:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320258.038212:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320258.038411:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731136
00000100:00100000:1.0:1767320258.038418:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731136
00000100:00100000:1.0:1767320258.038513:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986
00000100:00100000:1.0:1767320258.038520:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940731136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.038569:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940731136:12345-0@lo:400:kworker.0 Request processed in 49us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320258.038575:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986
00000100:00080000:2.0:1767320258.041683:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320258.041786:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940731136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320258.043714:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320258.043929:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730880
00000100:00100000:1.0:1767320258.043938:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730880
00000100:00100000:1.0:1767320258.044315:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224
00000100:00100000:1.0:1767320258.044326:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940730880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320258.044409:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940730880:12345-0@lo:400:kworker.0 Request processed in 85us (700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320258.044415:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224
00000100:00100000:1.0:1767320258.044473:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940730880:0@lo:400:kworker.0
00000100:00100000:3.0:1767320258.044681:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320258.044716:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940730752:0@lo:38:kworker.0
00000100:00100000:3.0:1767320258.044749:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320258.044766:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940731264:0@lo:38:kworker.0
00000100:00100000:2.0:1767320258.044794:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730752
00000100:00100000:2.0:1767320258.044799:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730752
00000100:00100000:3.0:1767320258.044801:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320258.044819:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266
00000100:00100000:3.0:1767320258.044822:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940730624
00000100:00100000:2.0:1767320258.044824:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940730752:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320258.044825:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940730624
00000100:00100000:3.0:1767320258.044842:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731264
00010000:00020000:2.0:1767320258.044843:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320258.044844:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731264
00000100:00100000:3.0:1767320258.044858:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17726
00000100:00100000:3.0:1767320258.044862:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940730624:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320258.044871:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940730752:12345-0@lo:38:kworker.0 Request processed in 46us (122us total) trans 0 rc -19/-19
00010000:00020000:3.0:1767320258.044872:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320258.044878:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266
00000100:00100000:3.0:1767320258.044893:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940730624:12345-0@lo:38:kworker.0 Request processed in 30us (212us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320258.044910:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17727
00000100:00100000:2.0:1767320258.044915:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940731264:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320258.045178:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320258.045204:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940731264:12345-0@lo:38:kworker.0 Request processed in 288us (402us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767320258.045410:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320258.052452:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17726
00000100:00100000:2.0:1767320258.052580:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17727
00000100:00080000:3.0:1767320258.055998:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320258.056012:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320258.056017:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940731264:0@lo:38:kworker.0
00000100:00100000:3.0:1767320258.056029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940731520:0@lo:38:kworker.0
00000100:00100000:3.0:1767320258.056102:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320258.056176:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320258.056181:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320258.056184:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940730624:0@lo:38:kworker.0
00000100:00080000:3.0:1767320258.056194:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320258.056197:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320258.056200:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940730752:0@lo:38:kworker.0
00000100:00100000:2.0:1767320258.057148:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731520
00000100:00100000:2.0:1767320258.057158:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731520
00000100:00100000:2.0:1767320258.057211:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17728
00000100:00100000:2.0:1767320258.057218:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940731520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320258.057244:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320258.057319:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940731520:12345-0@lo:38:kworker.0 Request processed in 100us (1216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320258.057326:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17728
00000100:00080000:0.0:1767320258.057396:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320258.057401:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320258.057404:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940731520:0@lo:38:kworker.0
00000100:00100000:3.0:1767320258.639106:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320258.639150:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320258.639235:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364800
00000100:00100000:1.0:1767320258.639247:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364800
00000100:00100000:1.0:1767320258.639298:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894364928
00000100:00100000:1.0:1767320258.639301:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894364928
00000100:00100000:1.0:1767320258.639360:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4987
00000100:00100000:2.0:1767320258.639369:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17729
00000100:00100000:1.0:1767320258.639372:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894364928:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320258.639381:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894364800:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320258.639404:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320258.639446:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894364928:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320258.639454:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4987
00000100:00080000:0.0:1767320258.639467:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320258.643909:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894364800:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4518us (4801us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320258.643924:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17729
00000100:00100000:3.0:1767320258.733167:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320258.991165:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320259.565170:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940731648:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320259.565244:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320259.567169:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731648
00000100:00100000:0.0:1767320259.567182:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731648
00000100:00100000:0.0:1767320259.567248:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788
00000100:00100000:0.0:1767320259.567258:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940731648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320259.567288:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320259.567355:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940731648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (2110us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320259.567362:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788
00000100:00100000:1.0:1767320259.567518:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940731648:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320259.756878:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320260.013998:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320260.589138:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320260.590238:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940731776:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320260.590305:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320260.591152:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940731776
00000100:00100000:2.0:1767320260.591161:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940731776
00000100:00100000:2.0:1767320260.591224:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789
00000100:00100000:2.0:1767320260.591231:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940731776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320260.591258:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320260.591428:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940731776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 197us (1122us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320260.591434:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789
00000100:00080000:0.0:1767320260.591489:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320260.593769:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940731776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320260.781069:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320261.037089:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320261.805153:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320262.067692:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320262.189200:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320237/real 1767320237]  req@ffff93d042b72d80 x1853163940725376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320262.189234:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d042b72d80 x1853163940725376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320262.189254:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320262.189289:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320262.189294:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940725376:0@lo:250:kworker.0
00000100:00080000:2.0:1767320262.189390:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320262.189396:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320262.189399:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320262.189404:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5487
00000100:00080000:2.0:1767320262.189408:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320262.189415:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320262.189449:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409f80 x1853163940731904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320262.189476:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320262.189479:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320262.189481:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320262.189485:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5508
00000100:00080000:2.0:1767320262.189488:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320262.189491:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320262.189508:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409c00 x1853163940732032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320262.189517:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320262.189520:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320262.189522:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320262.189525:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5508
00000100:00080000:2.0:1767320262.189527:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320262.189530:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320262.189541:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a680 x1853163940732160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320262.189607:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320262.189610:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320262.189612:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320262.189615:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5508
00000100:00080000:2.0:1767320262.189618:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320262.189621:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320262.189634:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7f480 x1853163940732672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320262.189650:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320262.189653:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320262.189655:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320262.189658:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5508
00000100:00080000:2.0:1767320262.189660:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320262.189664:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320262.189673:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221500 x1853163940732928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320262.189709:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940732800:0@lo:400:kworker.0
00000100:00100000:2.0:1767320262.189768:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320262.190159:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940731904:0@lo:250:kworker.0
00000400:00000100:0.0:1767320262.190186:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940731904 offset 0 length 520: 4
00000100:00100000:0.0:1767320262.190229:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732800
00000100:00100000:0.0:1767320262.190236:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732800
00000100:00100000:0.0:1767320262.190293:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988
00000100:00100000:0.0:1767320262.190302:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940732800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320262.190346:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940732800:12345-0@lo:400:kworker.0 Request processed in 45us (577us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320262.190353:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988
00000100:00080000:0.0:1767320262.190373:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320262.190465:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940732800:0@lo:400:kworker.0
00000100:00100000:2.0:1767320262.190481:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320262.190487:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940732544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320262.190510:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320262.190595:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732544
00000100:00100000:3.0:1767320262.190600:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732544
00000100:00100000:3.0:1767320262.190641:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989
00000100:00100000:3.0:1767320262.190648:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940732544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320262.190682:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940732544:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320262.190689:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989
00000100:00100000:3.0:1767320262.190710:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940732288:0@lo:400:kworker.0
00000100:00100000:3.0:1767320262.190736:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320262.190760:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320262.190766:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940732416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320262.190828:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320262.190933:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732288
00000100:00100000:1.0:1767320262.190938:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732288
00000100:00100000:1.0:1767320262.190965:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732416
00000100:00100000:1.0:1767320262.190968:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732416
00000100:00100000:1.0:1767320262.190986:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225
00000100:00100000:1.0:1767320262.190992:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940732288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320262.191028:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940732288:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320262.191034:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225
00000100:00100000:1.0:1767320262.191047:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226
00000100:00100000:1.0:1767320262.191053:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940732416:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320262.191058:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320262.191061:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320262.191063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320262.191081:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940732416:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320262.191082:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940732544:0@lo:400:kworker.0
00000100:00100000:1.0:1767320262.191087:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226
00000100:00100000:3.0:1767320262.191163:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940732416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320262.191172:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940732288:0@lo:400:kworker.0
00000100:00100000:0.0:1767320262.191248:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940732032:0@lo:38:kworker.0
00000100:00100000:0.0:1767320262.191276:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320262.191305:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940732160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320262.191329:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320262.191357:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940732672:0@lo:38:kworker.0
00000100:00100000:0.0:1767320262.191380:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320262.191395:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940732928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320262.191413:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320262.191482:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732160
00000100:00100000:3.0:1767320262.191486:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732160
00000100:00100000:3.0:1767320262.191515:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267
00000100:00100000:3.0:1767320262.191520:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940732160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320262.191537:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320262.191574:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940732160:12345-0@lo:38:kworker.0 Request processed in 52us (243us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320262.191580:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267
00000100:00100000:3.0:1767320262.191597:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732032
00000100:00100000:3.0:1767320262.191601:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732032
00000100:00100000:3.0:1767320262.202951:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732672
00000100:00100000:3.0:1767320262.202968:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732672
00000100:00100000:2.0:1767320262.203353:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940732928
00000100:00100000:2.0:1767320262.203358:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940732928
00000100:00100000:2.0:1767320262.203390:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17730
00000100:00100000:2.0:1767320262.203399:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320262.203425:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320262.203512:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732032:12345-0@lo:38:kworker.0 Request processed in 112us (12233us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320262.203518:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17730
00000100:00100000:2.0:1767320262.203537:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17731
00000100:00100000:2.0:1767320262.203540:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320262.203549:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320262.203574:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732672:12345-0@lo:38:kworker.0 Request processed in 32us (12193us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320262.203579:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17731
00000100:00100000:2.0:1767320262.203590:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17732
00000100:00100000:2.0:1767320262.203593:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320262.203602:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320262.203623:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940732928:12345-0@lo:38:kworker.0 Request processed in 28us (12209us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320262.203628:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17732
00000100:00080000:2.0:1767320262.203679:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320262.203684:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320262.203689:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940732032:0@lo:38:kworker.0
00000100:00080000:2.0:1767320262.203700:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320262.203703:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320262.203707:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940732160:0@lo:38:kworker.0
00000100:00080000:2.0:1767320262.203715:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320262.203718:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320262.203721:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940732672:0@lo:38:kworker.0
00000100:00080000:2.0:1767320262.203730:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320262.203733:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320262.203736:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940732928:0@lo:38:kworker.0
00000100:00100000:3.0:1767320262.829204:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320263.088808:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320263.751303:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320263.751450:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365184
00000100:00100000:0.0:1767320263.751460:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365184
00000100:00100000:0.0:1767320263.751536:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4990
00000100:00100000:0.0:1767320263.751546:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894365184:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320263.751639:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894365184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320263.751648:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4990
00000100:00080000:2.0:1767320263.752821:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320263.762369:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320263.764548:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365056
00000100:00100000:1.0:1767320263.764563:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365056
00000100:00100000:1.0:1767320263.764623:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17733
00000100:00100000:1.0:1767320263.764632:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894365056:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320263.764656:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320263.764737:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894365056:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 104us (2377us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320263.764745:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17733
00000100:00100000:3.0:1767320263.852914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320264.109085:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320264.685726:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940733056:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320264.685823:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320264.685922:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733056
00000100:00100000:0.0:1767320264.685929:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733056
00000100:00100000:0.0:1767320264.685983:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790
00000100:00100000:0.0:1767320264.685993:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940733056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320264.686022:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320264.686065:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940733056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320264.686072:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790
00000100:00100000:0.0:1767320264.686115:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940733056:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320264.686148:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320264.879679:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320265.133093:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320265.709679:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320265.709699:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940733184:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320265.709754:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320265.710396:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733184
00000100:00100000:2.0:1767320265.710404:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733184
00000100:00100000:2.0:1767320265.710473:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791
00000100:00100000:2.0:1767320265.710486:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940733184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320265.710517:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320265.710572:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940733184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (816us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320265.710577:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791
00000100:00100000:1.0:1767320265.710706:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940733184:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320265.711091:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320265.900924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320266.157055:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320266.925049:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320267.182792:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320267.245210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320267.245220:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320267.245223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320267.245227:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320267.245232:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320267.245240:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5512
00000100:00080000:1.0:1767320267.245245:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320267.245251:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320267.245292:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3e9180 x1853163940733312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320267.245322:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320267.245326:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320267.245328:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320267.245331:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5512
00000100:00080000:1.0:1767320267.245334:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320267.245337:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320267.245350:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d06d3ebb80 x1853163940733440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320267.245405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320267.245409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320267.245411:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320267.245414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5512
00000100:00080000:1.0:1767320267.245417:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320267.245422:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320267.245433:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8380 x1853163940733952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320267.245447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320267.245449:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320267.245450:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320267.245453:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5512
00000100:00080000:1.0:1767320267.245455:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320267.245458:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320267.245467:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967480 x1853163940734208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320267.245490:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940734080:0@lo:400:kworker.0
00000100:00100000:1.0:1767320267.245550:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320267.245603:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320267.245609:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940733824:0@lo:400:kworker.0
00000100:00100000:1.0:1767320267.245630:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320267.245659:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734080
00000100:00100000:1.0:1767320267.245665:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734080
00000100:00100000:1.0:1767320267.245708:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733824
00000100:00100000:1.0:1767320267.245710:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733824
00000100:00100000:1.0:1767320267.245730:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991
00000100:00100000:1.0:1767320267.245737:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940734080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320267.245803:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940734080:12345-0@lo:400:kworker.0 Request processed in 67us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320267.245811:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991
00000100:00100000:1.0:1767320267.245826:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992
00000100:00100000:1.0:1767320267.245832:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940733824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320267.245955:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940733312:0@lo:38:kworker.0
00000100:00100000:2.0:1767320267.246014:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940733696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320267.246088:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940733568:0@lo:400:kworker.0
00000100:00100000:0.0:1767320267.253411:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320267.253491:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940733440:0@lo:38:kworker.0
00000100:00100000:0.0:1767320267.253530:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320267.253548:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940733952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320267.253570:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320267.253594:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940734208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320267.253616:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320267.253666:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733312
00000100:00100000:0.0:1767320267.253674:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733312
00000100:00100000:0.0:1767320267.253700:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733952
00000100:00100000:0.0:1767320267.253703:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733952
00000100:00100000:0.0:1767320267.253710:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734208
00000100:00100000:0.0:1767320267.253712:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734208
00000100:00100000:0.0:1767320267.253724:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17734
00000100:00100000:0.0:1767320267.253731:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940733312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320267.253750:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320267.253803:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940733312:12345-0@lo:38:kworker.0 Request processed in 71us (399us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320267.253946:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17734
00000100:00100000:0.0:1767320267.253964:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17735
00000100:00100000:0.0:1767320267.253968:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940733952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320267.253978:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320267.254004:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940733952:12345-0@lo:38:kworker.0 Request processed in 34us (432us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320267.254009:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17735
00000100:00100000:0.0:1767320267.254021:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17736
00000100:00100000:0.0:1767320267.254025:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940734208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320267.254034:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320267.254187:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320267.254247:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733696
00000100:00100000:2.0:1767320267.254252:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733696
00000100:00100000:2.0:1767320267.254287:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227
00000100:00100000:2.0:1767320267.254292:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940733696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320267.254333:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940733696:12345-0@lo:400:kworker.0 Request processed in 40us (146us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320267.254339:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227
00000100:00100000:2.0:1767320267.254372:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940733696:0@lo:400:kworker.0
00000100:00100000:2.0:1767320267.254417:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733440
00000100:00100000:2.0:1767320267.254421:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733440
00000100:00100000:2.0:1767320267.254438:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268
00000100:00100000:2.0:1767320267.254442:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940733440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320267.254452:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320267.254475:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940733440:12345-0@lo:38:kworker.0 Request processed in 32us (945us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320267.254480:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268
00000100:00080000:2.0:1767320267.254494:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320267.254498:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320267.254540:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940734080:0@lo:400:kworker.0
00000100:00080000:2.0:1767320267.254583:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320267.254589:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320267.254592:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940733312:0@lo:38:kworker.0
00000100:00080000:2.0:1767320267.254601:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320267.254604:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320267.254607:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940733440:0@lo:38:kworker.0
00000100:00080000:2.0:1767320267.254614:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320267.254617:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320267.254619:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940733952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320267.254794:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940734208:12345-0@lo:38:kworker.0 Request processed in 747us (1158us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320267.254801:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17736
00000100:00100000:3.0:1767320267.255570:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320267.256527:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320267.256535:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320267.256539:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940734208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320267.256614:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940733568
00000100:00100000:0.0:1767320267.256620:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940733568
00000100:00100000:0.0:1767320267.256688:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228
00000100:00100000:0.0:1767320267.256696:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940733568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320267.256754:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940733568:12345-0@lo:400:kworker.0 Request processed in 59us (1185us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320267.256760:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228
00000100:00100000:3.0:1767320267.257002:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940733568:0@lo:400:kworker.0
00000100:00080000:2.0:1767320267.259203:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320267.264134:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940733824:12345-0@lo:400:kworker.0 Request processed in 18290us (18491us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320267.264150:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992
00000100:00100000:2.0:1767320267.264373:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940733824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320267.949036:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320268.206294:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320268.870458:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320268.870608:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365440
00000100:00100000:2.0:1767320268.870621:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365440
00000100:00100000:2.0:1767320268.870709:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4993
00000100:00100000:2.0:1767320268.870719:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894365440:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320268.870839:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894365440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 121us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320268.870854:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4993
00000100:00080000:0.0:1767320268.871145:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320268.875736:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320268.879203:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365312
00000100:00100000:1.0:1767320268.879219:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365312
00000100:00100000:1.0:1767320268.879935:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17737
00000100:00100000:1.0:1767320268.879946:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894365312:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320268.879969:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320268.880061:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894365312:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 114us (4335us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320268.880069:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17737
00000100:00100000:3.0:1767320268.972927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320269.229200:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320269.807676:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320269.807910:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940734336:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320269.807982:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320269.808033:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734336
00000100:00100000:3.0:1767320269.808042:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734336
00000100:00080000:2.0:1767320269.808100:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320269.808198:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792
00000100:00100000:3.0:1767320269.808210:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940734336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320269.808239:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320269.808304:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940734336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320269.808310:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792
00000100:00100000:0.0:1767320269.808372:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940734336:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320269.997637:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320270.253000:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320270.829126:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320270.829150:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940734464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320270.829216:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320270.829370:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734464
00000100:00100000:3.0:1767320270.829379:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734464
00000100:00100000:3.0:1767320270.829445:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793
00000100:00100000:3.0:1767320270.829456:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940734464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320270.829485:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320270.829535:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940734464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (317us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320270.829541:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793
00000100:00100000:3.0:1767320270.829589:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940734464:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320270.829688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320271.022447:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320271.277166:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320272.045297:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320272.301086:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320272.365161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320272.365173:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320272.365175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320272.365179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320272.365183:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320272.365189:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320272.365192:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320272.365197:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320272.365243:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340a300 x1853163940734592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320272.365269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320272.365273:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320272.365275:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320272.365278:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320272.365280:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320272.365284:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320272.365299:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d073409c00 x1853163940734720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320272.365300:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940734592:0@lo:38:kworker.0
00000100:00080000:3.0:1767320272.365362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767320272.365366:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320272.365366:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320272.365368:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320272.365371:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320272.365373:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320272.365376:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320272.365386:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52013100 x1853163940735232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320272.365400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320272.365403:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320272.365405:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320272.365408:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320272.365410:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320272.365413:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320272.365418:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940734720:0@lo:38:kworker.0
00000100:00100000:3.0:1767320272.365422:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf52011880 x1853163940735488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320272.365442:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940735360:0@lo:400:kworker.0
00000100:00100000:2.0:1767320272.365443:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320272.365460:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940735232:0@lo:38:kworker.0
00000100:00100000:3.0:1767320272.365467:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320272.365480:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320272.365485:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320272.365491:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940735104:0@lo:400:kworker.0
00000100:00100000:2.0:1767320272.365493:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940735488:0@lo:38:kworker.0
00000100:00100000:3.0:1767320272.365510:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320272.365520:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734720
00000100:00100000:2.0:1767320272.365527:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734720
00000100:00100000:3.0:1767320272.365555:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320272.365558:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269
00000100:00100000:2.0:1767320272.365565:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940734720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320272.365585:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320272.365600:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734592
00000100:00100000:3.0:1767320272.365603:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734592
00000100:00100000:3.0:1767320272.365622:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735360
00000100:00100000:3.0:1767320272.365625:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735360
00000100:00100000:2.0:1767320272.365634:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940734720:12345-0@lo:38:kworker.0 Request processed in 68us (190us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320272.365642:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269
00000100:00100000:3.0:1767320272.365652:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735232
00000100:00100000:3.0:1767320272.365655:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735232
00000100:00100000:3.0:1767320272.365663:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735104
00000100:00100000:2.0:1767320272.365664:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735488
00000100:00100000:3.0:1767320272.365665:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735104
00000100:00100000:2.0:1767320272.365666:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735488
00000100:00100000:2.0:1767320272.365677:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994
00000100:00100000:2.0:1767320272.365683:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940735360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.365724:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940734976:0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.365754:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320272.365801:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320272.365807:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940734848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.365851:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320272.365881:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734976
00000100:00100000:0.0:1767320272.365884:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734976
00000100:00100000:0.0:1767320272.365914:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940734848
00000100:00100000:0.0:1767320272.365917:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940734848
00000100:00100000:0.0:1767320272.365939:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229
00000100:00100000:0.0:1767320272.365946:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940734976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.365987:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940734976:12345-0@lo:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320272.365987:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995
00000100:00100000:0.0:1767320272.365993:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229
00000100:00100000:3.0:1767320272.365995:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940735104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.366005:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230
00000100:00100000:0.0:1767320272.366010:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940734848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320272.366033:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940734848:12345-0@lo:400:kworker.0 Request processed in 23us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320272.366038:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230
00000100:00100000:3.0:1767320272.366067:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940735104:12345-0@lo:400:kworker.0 Request processed in 74us (556us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320272.366074:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940734848:0@lo:400:kworker.0
00000100:00100000:3.0:1767320272.366076:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995
00000100:00100000:0.0:1767320272.366083:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940734976:0@lo:400:kworker.0
00000100:00100000:3.0:1767320272.366090:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17738
00000100:00100000:3.0:1767320272.366093:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940734592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320272.366104:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320272.366116:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320272.366120:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320272.366122:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320272.366127:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940734592:12345-0@lo:38:kworker.0 Request processed in 32us (761us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320272.366132:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17739
00000100:00100000:0.0:1767320272.366137:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940735232:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320272.366198:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940735360:12345-0@lo:400:kworker.0 Request processed in 515us (729us total) trans 0 rc 0/0
00010000:00020000:0.0:1767320272.366226:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320272.366253:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940735232:12345-0@lo:38:kworker.0 Request processed in 114us (772us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320272.366261:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17738
00000100:00100000:3.0:1767320272.366275:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17740
00000100:00100000:3.0:1767320272.366279:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940735488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320272.366289:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320272.366314:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940735488:12345-0@lo:38:kworker.0 Request processed in 34us (759us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320272.366319:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17740
00000100:00100000:2.0:1767320272.366331:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994
00000100:00100000:3.0:1767320272.366349:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940735104:0@lo:400:kworker.0
00000100:00100000:3.0:1767320272.366360:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940735360:0@lo:400:kworker.0
00000100:00080000:2.0:1767320272.366361:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320272.366365:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320272.366368:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940735488:0@lo:38:kworker.0
00000100:00080000:2.0:1767320272.366376:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320272.366379:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320272.366382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940734720:0@lo:38:kworker.0
00000100:00080000:2.0:1767320272.366390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320272.366392:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320272.366395:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940735232:0@lo:38:kworker.0
00000100:00080000:2.0:1767320272.366402:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320272.366404:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320272.366408:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940734592:0@lo:38:kworker.0
00000100:00100000:0.0:1767320272.367872:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17739
00000100:00100000:3.0:1767320273.075301:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320273.326012:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320274.003408:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320274.003466:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320274.003560:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365568
00000100:00100000:2.0:1767320274.003570:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365568
00000100:00100000:2.0:1767320274.003617:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365696
00000100:00100000:2.0:1767320274.003620:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365696
00000100:00100000:2.0:1767320274.003684:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4996
00000100:00100000:2.0:1767320274.003694:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894365696:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320274.003709:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17741
00000100:00100000:3.0:1767320274.003723:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894365568:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320274.003754:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320274.003839:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894365696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 144us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320274.003852:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4996
00000100:00100000:3.0:1767320274.003902:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894365568:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 178us (502us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320274.003914:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17741
00000100:00080000:0.0:1767320274.004432:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320274.093463:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320274.351427:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320274.925224:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320274.925249:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940735616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320274.925314:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320274.925505:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735616
00000100:00100000:2.0:1767320274.925513:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735616
00000100:00100000:2.0:1767320274.925638:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794
00000100:00100000:2.0:1767320274.925648:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940735616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320274.925677:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320274.925906:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940735616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 260us (590us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320274.925914:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794
00000100:00080000:0.0:1767320274.925983:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320274.926019:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d06d3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940735616:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320275.117132:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320275.378410:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320275.949038:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940735744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320275.949110:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320275.949261:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735744
00000100:00100000:1.0:1767320275.949269:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735744
00000100:00100000:1.0:1767320275.949350:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795
00000100:00080000:2.0:1767320275.949354:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320275.949359:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940735744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320275.949389:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320275.949973:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940735744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 614us (861us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320275.949986:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795
00000100:00100000:0.0:1767320275.950106:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940735744:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320276.142014:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320276.403034:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320277.164908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320277.423371:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320277.485312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320277.485325:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320277.485328:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320277.485332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320277.485336:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320277.485344:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5522
00000100:00080000:3.0:1767320277.485348:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320277.485355:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320277.485405:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019500 x1853163940735872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320277.485442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320277.485446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320277.485448:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320277.485452:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5522
00000100:00080000:3.0:1767320277.485454:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320277.485458:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320277.485473:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b800 x1853163940736000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320277.485562:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320277.485613:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940735872:0@lo:38:kworker.0
00000100:00100000:2.0:1767320277.485685:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320277.485742:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940736000:0@lo:38:kworker.0
00000100:00100000:2.0:1767320277.485831:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320277.485867:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940735872
00000100:00100000:2.0:1767320277.485875:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940735872
00000100:00100000:2.0:1767320277.485911:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17742
00000100:00100000:2.0:1767320277.485920:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940735872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320277.485940:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320277.485990:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940735872:12345-0@lo:38:kworker.0 Request processed in 69us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320277.485997:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17742
00000100:00100000:2.0:1767320277.486018:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736000
00000100:00100000:2.0:1767320277.486022:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736000
00000100:00100000:2.0:1767320277.486040:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270
00000100:00100000:2.0:1767320277.486045:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940736000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320277.486056:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320277.486080:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940736000:12345-0@lo:38:kworker.0 Request processed in 33us (249us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320277.486087:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270
00000100:00080000:2.0:1767320277.486124:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320277.486128:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320277.486132:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940735872:0@lo:38:kworker.0
00000100:00080000:2.0:1767320277.486141:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320277.486144:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320277.486147:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940736000:0@lo:38:kworker.0
00000100:00100000:0.0:1767320277.489964:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320277.489989:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940736256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320277.490059:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320277.490717:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736256
00000100:00100000:2.0:1767320277.490727:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736256
00000100:00100000:2.0:1767320277.490847:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231
00000100:00100000:2.0:1767320277.490858:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940736256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320277.490924:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940736256:12345-0@lo:400:kworker.0 Request processed in 69us (865us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320277.490936:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231
00000100:00080000:0.0:1767320277.491067:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320277.491107:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940736256:0@lo:400:kworker.0
00000100:00100000:1.0:1767320277.492193:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940736128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320277.492450:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320277.492544:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736128
00000100:00100000:0.0:1767320277.492550:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736128
00000100:00100000:0.0:1767320277.492619:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232
00000100:00100000:0.0:1767320277.492627:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940736128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320277.492675:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940736128:12345-0@lo:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320277.492682:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232
00000100:00080000:2.0:1767320277.492751:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320277.492829:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940736128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320277.494240:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:3.0:1767320277.494389:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320277.494394:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320277.494398:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320277.494404:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5522
00000100:00080000:3.0:1767320277.494410:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320277.494415:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320277.494436:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019f80 x1853163940736512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320277.494519:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940736512:0@lo:38:kworker.0
00000100:00100000:1.0:1767320277.494573:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320277.495072:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320277.495084:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940736640:0@lo:400:kworker.0
00000100:00100000:2.0:1767320277.495116:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320277.495159:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736512
00000100:00100000:2.0:1767320277.495166:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736512
00000100:00100000:2.0:1767320277.495198:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736640
00000100:00100000:2.0:1767320277.495202:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736640
00000100:00100000:2.0:1767320277.495237:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4997
00000100:00100000:2.0:1767320277.495246:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940736640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320277.495293:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d06d3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940736640:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320277.495300:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4997
00000100:00100000:2.0:1767320277.495316:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17743
00000100:00100000:2.0:1767320277.495320:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940736512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320277.495341:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320277.495370:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940736512:12345-0@lo:38:kworker.0 Request processed in 48us (797us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320277.495375:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17743
00000100:00080000:2.0:1767320277.495394:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320277.495419:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940736640:0@lo:400:kworker.0
00000100:00080000:1.0:1767320277.499940:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320277.499955:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320277.499960:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940736512:0@lo:38:kworker.0
00000100:00100000:0.0:1767320277.500118:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940736384:0@lo:400:kworker.0
00000100:00100000:0.0:1767320277.500201:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320277.500389:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736384
00000100:00100000:1.0:1767320277.500397:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736384
00000100:00100000:1.0:1767320277.500473:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4998
00000100:00100000:1.0:1767320277.500483:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940736384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320277.500537:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940736384:12345-0@lo:400:kworker.0 Request processed in 56us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320277.500544:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4998
00000100:00080000:2.0:1767320277.500620:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320277.500867:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940736384:0@lo:400:kworker.0
00000100:00080000:3.0:1767320277.500967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320277.500973:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320277.500976:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320277.500982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5522
00000100:00080000:3.0:1767320277.500986:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320277.500992:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320277.501022:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940736768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320277.501083:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940736768:0@lo:38:kworker.0
00000100:00100000:1.0:1767320277.501114:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320277.501263:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736768
00000100:00100000:0.0:1767320277.501267:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736768
00000100:00100000:0.0:1767320277.501300:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17744
00000100:00100000:0.0:1767320277.501305:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940736768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320277.501324:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320277.501661:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940736768:12345-0@lo:38:kworker.0 Request processed in 353us (545us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320277.501669:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17744
00000100:00080000:2.0:1767320277.506164:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320277.506179:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320277.506185:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940736768:0@lo:38:kworker.0
00000400:00000100:3.0:1767320278.087055:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894365824 offset 0 length 520: 4
00000100:00100000:3.0:1767320278.087194:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320278.087474:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320278.101555:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894365952
00000100:00100000:0.0:1767320278.101571:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894365952
00000100:00100000:1.0:1767320278.104750:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366080
00000100:00100000:1.0:1767320278.104786:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366080
00000100:00100000:1.0:1767320278.104850:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4999
00000100:00100000:1.0:1767320278.104861:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894366080:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320278.104898:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17745
00000100:00100000:2.0:1767320278.104904:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894365952:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320278.104924:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320278.104959:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894365952:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 54us (17766us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320278.104967:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17745
00000100:00100000:1.0:1767320278.105232:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894366080:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 372us (17756us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320278.105239:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4999
00000100:00080000:0.0:1767320278.105420:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320278.190934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320278.445095:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320279.212943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320279.469032:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320280.046404:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320280.046426:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940736896:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320280.046530:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320280.046731:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940736896
00000100:00100000:3.0:1767320280.046739:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940736896
00000100:00100000:3.0:1767320280.046843:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796
00000100:00100000:3.0:1767320280.046856:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940736896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320280.046888:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320280.046928:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940736896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (398us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320280.046933:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796
00000100:00080000:2.0:1767320280.046983:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320280.048205:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940736896:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320280.237269:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320280.493028:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320281.071429:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940737024:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320281.071566:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320281.077219:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737024
00000100:00100000:2.0:1767320281.077238:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737024
00000100:00100000:2.0:1767320281.077405:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797
00000100:00100000:2.0:1767320281.077417:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940737024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320281.077452:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320281.083667:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320281.085543:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940737024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8120us (13968us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320281.085558:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797
00000100:00100000:1.0:1767320281.086179:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940737024:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320281.261763:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320281.519670:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320282.284898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320282.541107:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320282.608241:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320282.608250:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320282.608253:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320282.608257:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320282.608261:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320282.608269:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5527
00000100:00080000:3.0:1767320282.608274:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320282.608280:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320282.608336:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019c00 x1853163940737152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320282.608367:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320282.608370:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320282.608372:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320282.608375:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5527
00000100:00080000:3.0:1767320282.608377:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320282.608381:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320282.608393:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940737280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320282.608413:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940737152:0@lo:38:kworker.0
00000100:00080000:3.0:1767320282.608466:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320282.608468:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320282.608470:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320282.608473:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5527
00000100:00080000:3.0:1767320282.608475:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320282.608479:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320282.608480:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320282.608490:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401ad80 x1853163940737792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320282.608503:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320282.608505:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320282.608507:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320282.608510:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5527
00000100:00080000:3.0:1767320282.608512:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320282.608515:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320282.608526:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401bb80 x1853163940738048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320282.608548:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940737664:0@lo:400:kworker.0
00000100:00100000:0.0:1767320282.608557:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940737408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320282.608576:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320282.608583:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320282.608635:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940737536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320282.608663:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320282.608711:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940737280:0@lo:38:kworker.0
00000100:00100000:2.0:1767320282.608926:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320282.608953:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940737792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320282.608974:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320282.608989:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940738048:0@lo:38:kworker.0
00000100:00100000:2.0:1767320282.609006:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320282.609052:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737280
00000100:00100000:2.0:1767320282.609058:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737280
00000100:00100000:2.0:1767320282.609088:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271
00000100:00100000:2.0:1767320282.609094:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940737280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320282.609113:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320282.609151:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940737280:12345-0@lo:38:kworker.0 Request processed in 56us (224us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320282.609158:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271
00000100:00100000:2.0:1767320282.609179:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737152
00000100:00100000:2.0:1767320282.609183:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737152
00000100:00100000:2.0:1767320282.609200:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737664
00000100:00100000:2.0:1767320282.609203:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737664
00000100:00100000:2.0:1767320282.609235:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737792
00000100:00100000:2.0:1767320282.609238:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737792
00000100:00100000:2.0:1767320282.609246:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738048
00000100:00100000:2.0:1767320282.609248:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738048
00000100:00100000:2.0:1767320282.609256:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5000
00000100:00100000:2.0:1767320282.609262:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940737664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320282.609299:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940737664:12345-0@lo:400:kworker.0 Request processed in 37us (722us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320282.609306:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5000
00000100:00100000:2.0:1767320282.609319:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17746
00000100:00100000:2.0:1767320282.609322:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940737152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320282.609333:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320282.609355:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d073409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940737152:12345-0@lo:38:kworker.0 Request processed in 31us (875us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320282.609360:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17746
00000100:00100000:2.0:1767320282.609371:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17747
00000100:00100000:2.0:1767320282.609374:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940737792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320282.609383:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320282.609403:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940737792:12345-0@lo:38:kworker.0 Request processed in 27us (428us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320282.609409:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17747
00000100:00100000:2.0:1767320282.609419:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17748
00000100:00100000:2.0:1767320282.609423:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940738048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320282.609431:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320282.609451:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940738048:12345-0@lo:38:kworker.0 Request processed in 27us (445us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320282.609457:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17748
00000100:00080000:2.0:1767320282.609497:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320282.609501:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320282.609505:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940737792:0@lo:38:kworker.0
00000100:00080000:2.0:1767320282.609513:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320282.609516:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320282.609519:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940738048:0@lo:38:kworker.0
00000100:00080000:2.0:1767320282.609526:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320282.609528:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320282.609531:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940737152:0@lo:38:kworker.0
00000100:00080000:2.0:1767320282.609538:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320282.609542:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320282.609544:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940737280:0@lo:38:kworker.0
00000100:00100000:2.0:1767320282.609613:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737408
00000100:00100000:2.0:1767320282.609617:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737408
00000100:00100000:2.0:1767320282.609645:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737536
00000100:00100000:2.0:1767320282.609648:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737536
00000100:00100000:2.0:1767320282.609666:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233
00000100:00100000:2.0:1767320282.609672:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940737408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320282.609702:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940737408:12345-0@lo:400:kworker.0 Request processed in 31us (1117us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320282.609707:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233
00000100:00100000:2.0:1767320282.609716:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234
00000100:00100000:2.0:1767320282.609732:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940737536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320282.609760:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940737536:12345-0@lo:400:kworker.0 Request processed in 39us (1095us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320282.609766:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234
00000100:00100000:2.0:1767320282.609811:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940737920:0@lo:400:kworker.0
00000100:00100000:2.0:1767320282.609836:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320282.609865:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940737920
00000100:00100000:2.0:1767320282.609868:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940737920
00000100:00100000:2.0:1767320282.609891:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5001
00000100:00100000:2.0:1767320282.609896:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940737920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320282.609926:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940737920:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320282.609931:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5001
00000100:00100000:2.0:1767320282.609958:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940737920:0@lo:400:kworker.0
00000100:00080000:2.0:1767320282.609984:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320282.609988:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320282.612602:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940737664:0@lo:400:kworker.0
00000100:00100000:0.0:1767320282.613258:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940737408:0@lo:400:kworker.0
00000100:00100000:1.0:1767320282.618588:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940737536:0@lo:400:kworker.0
00000100:00100000:2.0:1767320283.206146:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320283.206259:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366336
00000100:00100000:0.0:1767320283.206272:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366336
00000100:00100000:0.0:1767320283.206366:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5002
00000100:00100000:0.0:1767320283.206379:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894366336:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767320283.206469:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320283.209728:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894366336:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3330us (3568us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320283.209745:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5002
00000100:00100000:2.0:1767320283.211031:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320283.218167:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366208
00000100:00100000:0.0:1767320283.218200:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366208
00000100:00100000:0.0:1767320283.218272:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17749
00000100:00100000:0.0:1767320283.218280:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894366208:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320283.218305:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320283.218395:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894366208:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 113us (7369us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320283.218404:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17749
00000100:00100000:3.0:1767320283.308893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320283.565108:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320284.335645:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320284.589577:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320285.165185:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320285.168835:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940738176:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320285.168916:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320285.169149:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738176
00000100:00100000:2.0:1767320285.169158:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738176
00000100:00100000:2.0:1767320285.169217:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798
00000100:00100000:2.0:1767320285.169225:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940738176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320285.169259:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320285.170049:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940738176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 821us (1129us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320285.170058:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798
00000100:00100000:1.0:1767320285.170304:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940738176:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320285.173899:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320285.356876:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320285.613090:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320286.189214:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320286.189237:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940738304:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320286.189319:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320286.189753:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738304
00000100:00100000:2.0:1767320286.189762:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738304
00000100:00100000:2.0:1767320286.189849:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799
00000100:00100000:2.0:1767320286.189859:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940738304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320286.189889:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320286.189937:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940738304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (617us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320286.189944:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799
00000100:00100000:2.0:1767320286.189997:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940738304:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320286.190082:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320286.382446:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320286.638262:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320287.404891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320287.661204:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320287.725123:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320262/real 1767320262]  req@ffff93d073409f80 x1853163940731904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320287 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320287.725166:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d073409f80 x1853163940731904/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320287 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320287.725187:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320287.725262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320287.725274:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d073409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940731904:0@lo:250:kworker.0
00000100:00080000:1.0:1767320287.729027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320287.729038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320287.729044:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320287.729054:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5512
00000100:00080000:1.0:1767320287.729059:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320287.729065:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320287.729100:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340d500 x1853163940738432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320287.729137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320287.729141:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320287.729143:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320287.729146:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5532
00000100:00080000:1.0:1767320287.729149:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320287.729152:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320287.729166:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340f800 x1853163940738560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320287.729175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320287.729178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320287.729179:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320287.729182:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5532
00000100:00080000:1.0:1767320287.729184:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320287.729186:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320287.729195:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340c000 x1853163940738688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320287.729271:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940738816:0@lo:400:kworker.0
00000100:00100000:3.0:1767320287.729328:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320287.729382:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940738944:0@lo:400:kworker.0
00000100:00100000:3.0:1767320287.729410:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940739072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320287.729421:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320287.729455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320287.729459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320287.729461:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320287.729465:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5532
00000100:00080000:1.0:1767320287.729468:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320287.729472:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320287.729486:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340d880 x1853163940739200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320287.729500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320287.729503:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320287.729505:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320287.729512:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5532
00000100:00080000:1.0:1767320287.729515:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320287.729518:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320287.729529:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340e300 x1853163940739456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320287.729554:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940739328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320287.729766:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940738432:0@lo:250:kworker.0
00000100:00100000:3.0:1767320287.730472:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320287.730521:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320287.730552:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738816
00000100:00100000:3.0:1767320287.730561:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738816
00000100:00100000:1.0:1767320287.730568:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739072
00000100:00100000:1.0:1767320287.730586:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739072
00000100:00100000:3.0:1767320287.730618:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738944
00000100:00100000:3.0:1767320287.730623:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738944
00000100:00100000:1.0:1767320287.730628:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739328
00000100:00100000:1.0:1767320287.730633:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739328
00000100:00100000:1.0:1767320287.730658:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5003
00000100:00100000:3.0:1767320287.730670:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235
00000100:00100000:1.0:1767320287.730672:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940739072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320287.730693:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940738816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320287.730753:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940739072:12345-0@lo:400:kworker.0 Request processed in 85us (280us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320287.730764:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5003
00000100:00100000:3.0:1767320287.730770:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940738816:12345-0@lo:400:kworker.0 Request processed in 69us (1427us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320287.730801:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5004
00000100:00100000:3.0:1767320287.730806:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235
00000100:00100000:1.0:1767320287.730814:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940739328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320287.730828:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236
00000100:00100000:3.0:1767320287.730839:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940738944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320287.730864:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940739328:12345-0@lo:400:kworker.0 Request processed in 41us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320287.730872:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5004
00000100:00100000:3.0:1767320287.730879:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940738944:12345-0@lo:400:kworker.0 Request processed in 42us (1456us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320287.730887:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236
00000100:00080000:1.0:1767320287.730893:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320287.730900:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320287.730943:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940738816:0@lo:400:kworker.0
00000100:00100000:1.0:1767320287.730944:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940739328:0@lo:400:kworker.0
00000100:00100000:3.0:1767320287.730993:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940739072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320287.732236:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940738944:0@lo:400:kworker.0
00000400:00000100:0.0:1767320287.732449:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940738432 offset 0 length 520: 4
00000100:00100000:0.0:1767320287.732471:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940738560:0@lo:38:kworker.0
00000100:00100000:0.0:1767320287.732494:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320287.732513:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940738688:0@lo:38:kworker.0
00000100:00100000:0.0:1767320287.732528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320287.732543:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940739200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320287.732556:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320287.732573:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940739456:0@lo:38:kworker.0
00000100:00100000:0.0:1767320287.732585:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320287.732611:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738560
00000100:00100000:0.0:1767320287.732616:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738560
00000100:00100000:0.0:1767320287.732647:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739200
00000100:00100000:0.0:1767320287.732649:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739200
00000100:00100000:0.0:1767320287.732656:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739456
00000100:00100000:0.0:1767320287.732658:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739456
00000100:00100000:0.0:1767320287.732669:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17750
00000100:00100000:0.0:1767320287.732684:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940738560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320287.732704:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320287.732739:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940738560:12345-0@lo:38:kworker.0 Request processed in 63us (244us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320287.732746:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17750
00000100:00100000:1.0:1767320287.732848:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17751
00000100:00100000:1.0:1767320287.732852:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940739200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320287.732860:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320287.732880:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940739200:12345-0@lo:38:kworker.0 Request processed in 28us (324us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320287.732884:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17751
00000100:00100000:1.0:1767320287.732893:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17752
00000100:00100000:1.0:1767320287.732895:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940739456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320287.732900:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320287.732911:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940739456:12345-0@lo:38:kworker.0 Request processed in 15us (326us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320287.732915:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17752
00000100:00080000:1.0:1767320287.732944:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320287.732948:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320287.732950:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940738560:0@lo:38:kworker.0
00000100:00080000:1.0:1767320287.732955:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320287.732957:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320287.732959:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940739200:0@lo:38:kworker.0
00000100:00080000:1.0:1767320287.732966:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320287.732970:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320287.732972:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940739456:0@lo:38:kworker.0
00000100:00100000:2.0:1767320287.733038:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940738688
00000100:00100000:2.0:1767320287.733042:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940738688
00000100:00100000:2.0:1767320287.733080:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272
00000100:00100000:2.0:1767320287.733085:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940738688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320287.733095:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320287.733131:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940738688:12345-0@lo:38:kworker.0 Request processed in 44us (600us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320287.733137:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272
00000100:00080000:2.0:1767320287.733166:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320287.733170:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320287.733172:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940738688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320288.329151:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320288.329416:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320288.330503:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366592
00000100:00100000:0.0:1767320288.330594:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366592
00000100:00100000:0.0:1767320288.330700:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366464
00000100:00100000:0.0:1767320288.330703:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366464
00000100:00100000:0.0:1767320288.330727:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5005
00000100:00080000:1.0:1767320288.331926:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320288.332119:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894366592:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320288.332587:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17753
00000100:00100000:2.0:1767320288.332595:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894366464:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320288.332620:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320288.332740:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894366592:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 623us (3589us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320288.332749:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5005
00000100:00100000:2.0:1767320288.333743:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894366464:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 1141us (4320us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320288.333753:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17753
00000100:00100000:2.0:1767320288.428924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320288.685003:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320289.452999:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320289.709799:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320290.290207:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940739584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320290.290301:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320290.292020:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739584
00000100:00100000:2.0:1767320290.292033:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739584
00000100:00100000:2.0:1767320290.292123:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800
00000100:00100000:2.0:1767320290.292133:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940739584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320290.292168:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320290.292252:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940739584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (1950us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320290.292263:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800
00000100:00100000:0.0:1767320290.292530:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940739584:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320290.292827:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320290.476908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320290.733145:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320291.309758:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320291.309816:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940739712:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320291.309886:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320291.312002:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739712
00000100:00100000:3.0:1767320291.312014:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739712
00000100:00100000:3.0:1767320291.312098:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801
00000100:00100000:3.0:1767320291.312110:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940739712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320291.312144:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320291.312228:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940739712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (2340us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320291.312235:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801
00000100:00080000:1.0:1767320291.312312:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320291.314058:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940739712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320291.500958:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320291.758838:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320292.524901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320292.781452:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320292.847353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320292.847365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320292.847368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320292.847372:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320292.847376:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320292.847384:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5537
00000100:00080000:3.0:1767320292.847389:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320292.847396:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320292.847436:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940739840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320292.847468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320292.847472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320292.847473:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320292.847477:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5537
00000100:00080000:3.0:1767320292.847479:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320292.847482:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320292.847496:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019500 x1853163940739968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320292.847549:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320292.847553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320292.847555:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320292.847558:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5537
00000100:00080000:3.0:1767320292.847560:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320292.847563:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320292.847574:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940740480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320292.847588:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320292.847591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320292.847592:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320292.847596:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5537
00000100:00080000:3.0:1767320292.847598:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320292.847601:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320292.847610:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019c00 x1853163940740736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320292.849932:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940739840:0@lo:38:kworker.0
00000100:00100000:2.0:1767320292.850016:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.850078:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940739968:0@lo:38:kworker.0
00000100:00100000:2.0:1767320292.850105:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.850128:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940740480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320292.850151:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.850275:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940740736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320292.850298:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.850344:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739840
00000100:00100000:2.0:1767320292.850352:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739840
00000100:00100000:2.0:1767320292.850385:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740480
00000100:00100000:2.0:1767320292.850388:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740480
00000100:00100000:2.0:1767320292.850401:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740736
00000100:00100000:2.0:1767320292.850403:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740736
00000100:00100000:2.0:1767320292.850421:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17754
00000100:00100000:2.0:1767320292.850428:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940739840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320292.850450:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320292.850493:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940739840:12345-0@lo:38:kworker.0 Request processed in 63us (475us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320292.850499:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17754
00000100:00100000:2.0:1767320292.850514:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17755
00000100:00100000:2.0:1767320292.850518:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940740480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320292.850528:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320292.850550:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940740480:12345-0@lo:38:kworker.0 Request processed in 31us (399us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320292.850556:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17755
00000100:00100000:2.0:1767320292.850566:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17756
00000100:00100000:2.0:1767320292.850570:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940740736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320292.850578:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320292.850598:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940740736:12345-0@lo:38:kworker.0 Request processed in 27us (299us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320292.850604:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17756
00000100:00100000:2.0:1767320292.850620:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940739968
00000100:00100000:2.0:1767320292.850623:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940739968
00000100:00100000:2.0:1767320292.850653:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273
00000100:00100000:2.0:1767320292.850658:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940739968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320292.850667:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320292.850690:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940739968:12345-0@lo:38:kworker.0 Request processed in 31us (585us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320292.850696:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273
00000100:00080000:2.0:1767320292.850748:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320292.850753:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320292.850757:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940739840:0@lo:38:kworker.0
00000100:00080000:2.0:1767320292.850767:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320292.850770:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320292.850792:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940739968:0@lo:38:kworker.0
00000100:00080000:2.0:1767320292.850804:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320292.850807:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320292.850809:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940740480:0@lo:38:kworker.0
00000100:00080000:2.0:1767320292.850816:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320292.850819:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320292.850822:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940740736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320292.850919:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940740352:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.850942:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.850961:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320292.850967:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940740608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.850988:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.851010:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740096:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851035:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.851060:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320292.851065:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740224:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851083:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320292.851113:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740352
00000100:00100000:2.0:1767320292.851117:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740352
00000100:00100000:2.0:1767320292.851152:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740608
00000100:00100000:2.0:1767320292.851155:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740608
00000100:00100000:2.0:1767320292.851188:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006
00000100:00100000:2.0:1767320292.851195:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940740352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851236:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940740352:12345-0@lo:400:kworker.0 Request processed in 41us (292us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320292.851242:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006
00000100:00100000:2.0:1767320292.851254:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007
00000100:00100000:2.0:1767320292.851260:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940740608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851284:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940740608:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320292.851289:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007
00000100:00100000:2.0:1767320292.851307:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740096
00000100:00100000:2.0:1767320292.851311:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740096
00000100:00100000:2.0:1767320292.851335:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740224
00000100:00100000:2.0:1767320292.851338:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740224
00000100:00100000:2.0:1767320292.851362:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237
00000100:00100000:2.0:1767320292.851368:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851399:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740096:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320292.851405:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237
00000100:00100000:2.0:1767320292.851415:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238
00000100:00100000:2.0:1767320292.851420:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851446:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740224:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320292.851451:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238
00000100:00100000:2.0:1767320292.851483:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940740608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851493:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940740352:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851513:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740224:0@lo:400:kworker.0
00000100:00100000:2.0:1767320292.851522:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740096:0@lo:400:kworker.0
00000100:00080000:1.0:1767320292.857468:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320292.857480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320293.446881:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320293.446998:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366720
00000100:00100000:2.0:1767320293.447009:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366720
00000100:00100000:2.0:1767320293.447066:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17757
00000100:00100000:2.0:1767320293.447075:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894366720:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320293.447101:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320293.447174:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894366720:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 97us (302us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320293.447181:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17757
00000100:00100000:2.0:1767320293.448012:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320293.448075:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366848
00000100:00100000:0.0:1767320293.448081:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366848
00000100:00100000:0.0:1767320293.448143:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5008
00000100:00100000:0.0:1767320293.448152:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894366848:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320293.448216:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894366848:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 65us (206us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320293.448222:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5008
00000100:00080000:1.0:1767320293.448367:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320293.548898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320293.807234:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320294.572912:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320294.834390:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320295.405067:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320295.405244:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940740864:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320295.405310:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320295.405944:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740864
00000100:00100000:2.0:1767320295.405953:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740864
00000100:00100000:3.0:1767320295.406137:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802
00000100:00100000:3.0:1767320295.406149:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940740864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320295.406185:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320295.406248:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940740864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (937us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320295.406255:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802
00000100:00100000:0.0:1767320295.406342:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940740864:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320295.406423:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320295.597890:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320295.854985:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320296.429021:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320296.429041:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740992:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320296.429111:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320296.429239:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940740992
00000100:00100000:3.0:1767320296.429247:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940740992
00000100:00100000:3.0:1767320296.429319:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803
00000100:00100000:3.0:1767320296.429327:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320296.429353:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320296.429390:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940740992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320296.429395:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803
00000100:00100000:3.0:1767320296.429432:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940740992:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320296.429480:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320296.620895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320296.877026:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320297.644998:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320297.901383:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320297.966746:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320297.966757:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320297.966760:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320297.966764:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320297.966768:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320297.966792:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5542
00000100:00080000:3.0:1767320297.966796:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320297.966803:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320297.966852:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401bb80 x1853163940741120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320297.966881:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320297.966885:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320297.966887:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320297.966891:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5542
00000100:00080000:3.0:1767320297.966893:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320297.966896:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320297.966909:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401ad80 x1853163940741248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320297.966998:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320297.967001:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320297.967003:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320297.967006:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5542
00000100:00080000:3.0:1767320297.967008:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320297.967012:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320297.967023:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018e00 x1853163940741760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320297.967039:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320297.967042:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320297.967045:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320297.967048:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5542
00000100:00080000:3.0:1767320297.967051:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320297.967054:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320297.967064:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940742016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320297.967082:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940741376:0@lo:400:kworker.0
00000100:00100000:3.0:1767320297.967093:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940741888:0@lo:400:kworker.0
00000100:00100000:2.0:1767320297.967207:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940741120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320297.967231:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320297.967262:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320297.967297:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940741248:0@lo:38:kworker.0
00000100:00100000:0.0:1767320297.967299:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320297.967308:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940741504:0@lo:400:kworker.0
00000100:00100000:2.0:1767320297.967329:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320297.967342:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320297.967352:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940741760:0@lo:38:kworker.0
00000100:00100000:1.0:1767320297.967445:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741248
00000100:00100000:1.0:1767320297.967453:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741248
00000100:00100000:1.0:1767320297.967493:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274
00000100:00100000:1.0:1767320297.967501:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940741248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320297.967526:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320297.967630:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741120
00000100:00100000:0.0:1767320297.967635:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741120
00000100:00100000:0.0:1767320297.967663:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17758
00000100:00100000:0.0:1767320297.967668:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940741120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320297.967681:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320297.967718:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940741120:12345-0@lo:38:kworker.0 Request processed in 49us (457us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320297.967725:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17758
00000100:00100000:0.0:1767320297.967757:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741376
00000100:00100000:0.0:1767320297.967761:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741376
00000100:00100000:0.0:1767320297.967823:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741504
00000100:00100000:0.0:1767320297.967827:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741504
00000100:00100000:0.0:1767320297.967846:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239
00000100:00100000:0.0:1767320297.967852:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940741376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.967896:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940741376:12345-0@lo:400:kworker.0 Request processed in 43us (666us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320297.967902:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239
00000100:00100000:0.0:1767320297.967913:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240
00000100:00100000:0.0:1767320297.967919:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940741504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.967946:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940741504:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320297.967951:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240
00000100:00100000:0.0:1767320297.968003:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940741504:0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.968014:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940741376:0@lo:400:kworker.0
00000100:00080000:0.0:1767320297.968043:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320297.968100:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940741632:0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.968129:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320297.968155:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741632
00000100:00100000:0.0:1767320297.968158:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741632
00000100:00100000:0.0:1767320297.968188:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009
00000100:00100000:0.0:1767320297.968194:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b831050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940741632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.968233:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b831050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940741632:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320297.968239:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009
00000100:00100000:1.0:1767320297.968515:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940741248:12345-0@lo:38:kworker.0 Request processed in 1012us (1185us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320297.968524:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274
00000100:00080000:1.0:1767320297.968549:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320297.968574:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940741632:0@lo:400:kworker.0
00000100:00100000:2.0:1767320297.970396:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320297.970446:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940742016:0@lo:38:kworker.0
00000100:00100000:0.0:1767320297.970456:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741760
00000100:00100000:0.0:1767320297.970465:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741760
00000100:00100000:2.0:1767320297.970483:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320297.970651:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742016
00000100:00100000:0.0:1767320297.970656:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742016
00000100:00100000:0.0:1767320297.970682:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17759
00000100:00100000:0.0:1767320297.970689:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940741760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320297.970709:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320297.970743:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940741760:12345-0@lo:38:kworker.0 Request processed in 54us (353us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320297.970749:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17759
00000100:00100000:0.0:1767320297.970762:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17760
00000100:00100000:0.0:1767320297.970765:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940742016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320297.970786:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320297.970806:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940742016:12345-0@lo:38:kworker.0 Request processed in 40us (324us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320297.970811:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17760
00000100:00100000:3.0:1767320297.971111:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320297.971153:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940741888
00000100:00100000:0.0:1767320297.971158:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940741888
00000100:00080000:2.0:1767320297.971187:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320297.971195:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320297.971201:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940741120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320297.971208:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010
00000100:00100000:0.0:1767320297.971216:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940741888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320297.971254:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940741888:12345-0@lo:400:kworker.0 Request processed in 40us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320297.971260:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010
00000100:00080000:0.0:1767320297.971287:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320297.971306:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940741888:0@lo:400:kworker.0
00000100:00080000:2.0:1767320297.971348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320297.971351:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320297.971353:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940741248:0@lo:38:kworker.0
00000100:00080000:2.0:1767320297.971361:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320297.971363:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320297.971365:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940741760:0@lo:38:kworker.0
00000100:00080000:2.0:1767320297.971422:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320297.971425:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320297.971427:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940742016:0@lo:38:kworker.0
00000100:00100000:1.0:1767320298.565894:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320298.566056:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367104
00000100:00100000:0.0:1767320298.566067:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367104
00000100:00100000:3.0:1767320298.566357:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:1.0:1767320298.567425:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320298.571898:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894366976
00000100:00100000:0.0:1767320298.571916:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894366976
00000100:00100000:2.0:1767320298.574055:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5011
00000100:00100000:2.0:1767320298.574080:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894367104:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320298.574183:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894367104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 114us (8301us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320298.574191:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5011
00000100:00100000:2.0:1767320298.574736:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17761
00000100:00100000:2.0:1767320298.574743:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894366976:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320298.574765:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320298.574920:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894366976:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 175us (8563us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320298.574928:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17761
00000100:00100000:2.0:1767320298.669898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320298.925065:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320299.693634:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320299.948961:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320300.525047:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940742144:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320300.525122:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320300.525265:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742144
00000100:00100000:3.0:1767320300.525273:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742144
00000100:00080000:1.0:1767320300.525305:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320300.525337:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804
00000100:00100000:3.0:1767320300.525348:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940742144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320300.525377:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320300.530845:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940742144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5489us (5712us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320300.530862:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804
00000100:00100000:0.0:1767320300.532219:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940742144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320300.718687:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320300.973108:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320301.549074:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940742272:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320301.549154:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320301.549294:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742272
00000100:00100000:2.0:1767320301.549304:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742272
00000100:00080000:0.0:1767320301.549348:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320301.549379:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805
00000100:00100000:2.0:1767320301.549391:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940742272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320301.549420:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320301.571073:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940742272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 21676us (21908us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320301.571090:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805
00000100:00100000:1.0:1767320301.571131:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940742272:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320301.743050:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320301.997039:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320302.764883:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320303.027020:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320303.085443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320303.085453:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320303.085456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320303.085460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320303.085464:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320303.085471:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5548
00000100:00080000:3.0:1767320303.085476:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320303.085482:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320303.085521:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940742400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320303.085559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320303.085563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320303.085564:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320303.085568:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5548
00000100:00080000:3.0:1767320303.085570:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320303.085574:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320303.085587:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b100 x1853163940742528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320303.085725:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940742656:0@lo:400:kworker.0
00000100:00100000:1.0:1767320303.085811:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320303.085890:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742656
00000100:00100000:2.0:1767320303.085898:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742656
00000100:00100000:0.0:1767320303.085918:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940742400:0@lo:38:kworker.0
00000100:00100000:0.0:1767320303.085951:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320303.085956:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241
00000100:00100000:2.0:1767320303.085965:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940742656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320303.085970:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940742528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320303.085994:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320303.086097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320303.086113:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742400
00000100:00100000:0.0:1767320303.086116:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742400
00000100:00100000:0.0:1767320303.086138:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17762
00000100:00100000:0.0:1767320303.086143:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940742400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320303.086162:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320303.086193:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940742400:12345-0@lo:38:kworker.0 Request processed in 49us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320303.086200:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17762
00000100:00080000:0.0:1767320303.086233:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320303.086237:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320303.086240:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940742400:0@lo:38:kworker.0
00000100:00100000:0.0:1767320303.086271:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742528
00000100:00100000:0.0:1767320303.086275:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742528
00000100:00100000:0.0:1767320303.086292:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275
00000100:00100000:0.0:1767320303.086295:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d079282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940742528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320303.086305:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320303.086333:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d079282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940742528:12345-0@lo:38:kworker.0 Request processed in 36us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320303.086339:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275
00000100:00080000:0.0:1767320303.086521:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320303.086526:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320303.086529:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940742528:0@lo:38:kworker.0
00000100:00100000:2.0:1767320303.090870:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940742656:12345-0@lo:400:kworker.0 Request processed in 4898us (5051us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320303.090885:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241
00000100:00100000:2.0:1767320303.090955:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940742784:0@lo:400:kworker.0
00000100:00100000:2.0:1767320303.091016:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320303.095128:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742784
00000100:00100000:0.0:1767320303.095144:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742784
00000100:00100000:0.0:1767320303.095272:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242
00000100:00100000:0.0:1767320303.095284:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940742784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320303.096144:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940742656:0@lo:400:kworker.0
00000100:00100000:0.0:1767320303.096568:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940742784:12345-0@lo:400:kworker.0 Request processed in 1284us (5549us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320303.096578:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242
00000100:00080000:2.0:1767320303.097181:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320303.100207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320303.100213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320303.100216:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320303.100223:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5548
00000100:00080000:3.0:1767320303.100227:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320303.100233:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320303.100254:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018380 x1853163940743040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320303.100287:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940743040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320303.100288:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940742912:0@lo:400:kworker.0
00000100:00100000:2.0:1767320303.102113:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320303.102218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320303.102224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320303.102227:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320303.102232:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5548
00000100:00080000:2.0:1767320303.102236:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320303.102253:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320303.102264:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320303.102274:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940743168:0@lo:400:kworker.0
00000100:00100000:2.0:1767320303.102303:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320303.102340:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cf100 x1853163940743296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320303.102547:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940742912
00000100:00100000:0.0:1767320303.102556:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940742912
00000100:00100000:0.0:1767320303.102631:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743168
00000100:00100000:0.0:1767320303.102635:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743168
00000100:00100000:0.0:1767320303.102663:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012
00000100:00100000:0.0:1767320303.102672:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940742912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320303.102918:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940742912:12345-0@lo:400:kworker.0 Request processed in 245us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320303.102926:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012
00000100:00100000:0.0:1767320303.102945:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013
00000100:00100000:0.0:1767320303.102952:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940743168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320303.102982:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940743168:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320303.102988:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013
00000100:00100000:0.0:1767320303.103038:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940743168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320303.103051:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940742912:0@lo:400:kworker.0
00000100:00080000:2.0:1767320303.103417:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320303.104736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320303.104811:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940743296:0@lo:38:kworker.0
00000100:00100000:3.0:1767320303.104846:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320303.104921:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743040
00000100:00100000:2.0:1767320303.104928:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743040
00000100:00100000:2.0:1767320303.104956:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17763
00000100:00100000:2.0:1767320303.104963:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940743040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320303.104982:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320303.104987:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940742784:0@lo:400:kworker.0
00000100:00100000:2.0:1767320303.105019:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940743040:12345-0@lo:38:kworker.0 Request processed in 56us (290us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320303.105026:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17763
00000100:00100000:2.0:1767320303.105039:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743296
00000100:00100000:2.0:1767320303.105043:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743296
00000100:00100000:2.0:1767320303.105070:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17764
00000100:00100000:2.0:1767320303.105074:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940743296:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320303.105084:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320303.105107:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940743296:12345-0@lo:38:kworker.0 Request processed in 31us (260us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320303.105116:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17764
00000100:00080000:3.0:1767320303.105678:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320303.105685:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320303.105689:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940743296:0@lo:38:kworker.0
00000100:00080000:3.0:1767320303.105698:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320303.105701:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320303.105704:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940743040:0@lo:38:kworker.0
00000100:00100000:3.0:1767320303.690384:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:3.0:1767320303.690424:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894367232 offset 0 length 520: 4
00000100:00100000:3.0:1767320303.690446:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320303.690638:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367488
00000100:00100000:2.0:1767320303.690647:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367488
00000100:00100000:2.0:1767320303.690714:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367360
00000100:00100000:2.0:1767320303.690717:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367360
00000100:00100000:2.0:1767320303.690737:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5014
00000100:00100000:2.0:1767320303.690745:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894367488:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320303.690836:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894367488:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (461us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320303.690842:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5014
00000100:00100000:2.0:1767320303.690858:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17765
00000100:00100000:2.0:1767320303.690861:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894367360:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320303.690878:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320303.690898:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894367360:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 35us (451us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320303.690904:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17765
00000100:00080000:3.0:1767320303.691448:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320303.793888:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320304.049628:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320304.812907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320305.071930:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320305.645132:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940743424:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320305.645206:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320305.645359:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743424
00000100:00100000:3.0:1767320305.645370:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743424
00000100:00100000:3.0:1767320305.645436:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806
00000100:00100000:3.0:1767320305.645448:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940743424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320305.645479:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320305.645536:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940743424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320305.645543:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806
00000100:00100000:0.0:1767320305.645635:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940743424:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320305.645752:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320305.836913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320306.092942:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320306.670219:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320306.671608:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940743552:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320306.671685:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320306.671762:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743552
00000100:00100000:1.0:1767320306.671791:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743552
00000100:00100000:1.0:1767320306.671856:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807
00000100:00100000:1.0:1767320306.671866:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940743552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320306.671906:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767320306.671908:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320306.671960:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940743552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320306.671969:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807
00000100:00100000:0.0:1767320306.672000:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940743552:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320306.860979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320307.121600:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320307.885610:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320308.141752:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320308.205039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320308.205050:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320308.205053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320308.205057:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320308.205061:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320308.205068:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5553
00000100:00080000:1.0:1767320308.205073:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320308.205079:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320308.205125:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340ca80 x1853163940743680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320308.205148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320308.205152:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320308.205153:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320308.205156:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5553
00000100:00080000:1.0:1767320308.205158:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320308.205161:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320308.205174:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340e300 x1853163940743808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320308.205235:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940743936:0@lo:400:kworker.0
00000100:00100000:2.0:1767320308.205314:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320308.205333:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940744064:0@lo:400:kworker.0
00000100:00100000:3.0:1767320308.205373:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320308.205404:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743936
00000100:00100000:2.0:1767320308.205412:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743936
00000100:00100000:2.0:1767320308.205468:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744064
00000100:00100000:2.0:1767320308.205480:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744064
00000100:00100000:0.0:1767320308.205511:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243
00000100:00100000:0.0:1767320308.205524:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940743936:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320308.205678:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320308.205682:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320308.205684:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320308.205688:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5553
00000100:00080000:1.0:1767320308.205691:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320308.205695:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320308.205708:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340fb80 x1853163940744320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320308.205723:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320308.205727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320308.205728:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320308.205732:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5553
00000100:00080000:1.0:1767320308.205735:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320308.205738:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320308.205749:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340d180 x1853163940744576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320308.205801:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940744448:0@lo:400:kworker.0
00000100:00100000:2.0:1767320308.205811:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244
00000100:00100000:2.0:1767320308.205820:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940744064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320308.205887:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320308.206665:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320308.206674:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940744192:0@lo:400:kworker.0
00000100:00100000:1.0:1767320308.206701:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320308.206732:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744448
00000100:00100000:1.0:1767320308.206736:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744448
00000100:00100000:1.0:1767320308.206767:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744192
00000100:00100000:1.0:1767320308.206770:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744192
00000100:00100000:1.0:1767320308.206827:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5015
00000100:00100000:1.0:1767320308.206840:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940744448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320308.206841:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940744064:12345-0@lo:400:kworker.0 Request processed in 1016us (1463us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320308.206853:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244
00000100:00080000:2.0:1767320308.206875:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320308.206880:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320308.206883:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320308.206897:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016
00000100:00100000:1.0:1767320308.206900:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940744448:12345-0@lo:400:kworker.0 Request processed in 64us (1047us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320308.206907:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940744192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320308.206937:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940744192:12345-0@lo:400:kworker.0 Request processed in 34us (235us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320308.206943:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016
00000100:00100000:2.0:1767320308.207002:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940743680:0@lo:38:kworker.0
00000100:00100000:2.0:1767320308.207029:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320308.207046:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940743808:0@lo:38:kworker.0
00000100:00100000:2.0:1767320308.207069:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320308.207086:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940744320:0@lo:38:kworker.0
00000100:00100000:1.0:1767320308.207101:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5015
00000100:00100000:2.0:1767320308.207107:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320308.207121:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940744576:0@lo:38:kworker.0
00000100:00100000:1.0:1767320308.207125:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743680
00000100:00100000:1.0:1767320308.207130:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743680
00000100:00100000:2.0:1767320308.207139:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320308.207161:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744320
00000100:00100000:1.0:1767320308.207166:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744320
00000100:00100000:1.0:1767320308.207180:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744576
00000100:00100000:1.0:1767320308.207183:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744576
00000100:00100000:2.0:1767320308.207187:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17766
00000100:00100000:2.0:1767320308.207193:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940743680:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320308.207202:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17767
00000100:00100000:1.0:1767320308.207207:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940744320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320308.207216:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767320308.207221:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320308.207258:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940743680:12345-0@lo:38:kworker.0 Request processed in 64us (227us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320308.207265:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940744320:12345-0@lo:38:kworker.0 Request processed in 54us (156us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320308.207269:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17766
00000100:00100000:1.0:1767320308.207279:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17767
00000100:00100000:1.0:1767320308.207293:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17768
00000100:00100000:1.0:1767320308.207296:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940744576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320308.207305:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320308.207327:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940744576:12345-0@lo:38:kworker.0 Request processed in 30us (189us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320308.207333:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17768
00000100:00080000:2.0:1767320308.207393:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320308.207399:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320308.207404:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940743680:0@lo:38:kworker.0
00000100:00080000:2.0:1767320308.207413:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320308.207417:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320308.207420:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940744320:0@lo:38:kworker.0
00000100:00080000:2.0:1767320308.207432:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320308.207437:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940743936:12345-0@lo:400:kworker.0 Request processed in 1912us (2120us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320308.207438:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320308.207445:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940744576:0@lo:38:kworker.0
00000100:00100000:0.0:1767320308.207454:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243
00000100:00100000:0.0:1767320308.207481:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940743808
00000100:00100000:0.0:1767320308.207485:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940743808
00000100:00100000:1.0:1767320308.207562:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940744192:0@lo:400:kworker.0
00000100:00100000:1.0:1767320308.207586:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940744448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320308.207610:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940743936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320308.208160:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276
00000100:00100000:0.0:1767320308.208165:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940743808:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320308.208176:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320308.208215:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940743808:12345-0@lo:38:kworker.0 Request processed in 48us (1144us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320308.208221:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276
00000100:00080000:2.0:1767320308.208255:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320308.208262:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320308.208266:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940743808:0@lo:38:kworker.0
00000100:00100000:3.0:1767320308.209027:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940744064:0@lo:400:kworker.0
00000100:00100000:3.0:1767320308.811426:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320308.811469:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320308.816094:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367616
00000100:00100000:2.0:1767320308.816112:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367616
00000100:00100000:2.0:1767320308.816172:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367744
00000100:00100000:2.0:1767320308.816175:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367744
00000100:00100000:2.0:1767320308.816235:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5017
00000100:00100000:2.0:1767320308.816245:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894367744:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767320308.816294:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320308.816316:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17769
00000100:00100000:2.0:1767320308.816325:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894367744:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (4853us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320308.816326:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894367616:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:2.0:1767320308.816342:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5017
00010000:00020000:1.0:1767320308.816364:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320308.816407:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894367616:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 83us (4990us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320308.816414:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17769
00000100:00100000:2.0:1767320308.908964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320309.166134:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320309.932911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320310.189562:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320310.765306:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940744704:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320310.765379:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320310.768817:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744704
00000100:00100000:0.0:1767320310.768831:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744704
00000100:00100000:0.0:1767320310.768911:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808
00000100:00100000:0.0:1767320310.768920:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940744704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320310.768951:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320310.769023:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940744704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (3643us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320310.769029:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808
00000100:00080000:2.0:1767320310.769144:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320310.769242:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940744704:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320310.956899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320311.213174:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320311.789023:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940744832:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320311.789097:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320311.789208:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940744832
00000100:00100000:3.0:1767320311.789218:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940744832
00000100:00100000:3.0:1767320311.789353:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809
00000100:00100000:3.0:1767320311.789366:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940744832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320311.789398:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320311.789466:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940744832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (358us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320311.789474:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809
00000100:00100000:0.0:1767320311.789537:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940744832:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320311.790159:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320311.980899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320312.237340:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320312.303589:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320287/real 1767320287]  req@ffff93d07340d500 x1853163940738432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320312.303732:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d07340d500 x1853163940738432/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320312.303750:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320312.303769:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320312.303786:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940738432:0@lo:250:kworker.0
00000100:00080000:2.0:1767320312.303892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320312.303898:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320312.303902:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320312.303907:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5537
00000100:00080000:2.0:1767320312.303911:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320312.303917:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320312.303946:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cd500 x1853163940744960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320312.303972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320312.303976:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320312.303978:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320312.303982:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5558
00000100:00080000:2.0:1767320312.303984:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320312.303987:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320312.304001:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cdc00 x1853163940745088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320312.304009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320312.304022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320312.304024:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320312.304027:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5558
00000100:00080000:2.0:1767320312.304030:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320312.304033:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320312.304044:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cc700 x1853163940745216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320312.304112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320312.304115:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320312.304116:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320312.304119:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5558
00000100:00080000:2.0:1767320312.304121:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320312.304125:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320312.304134:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340e300 x1853163940745728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320312.304147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320312.304150:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320312.304162:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320312.304166:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5558
00000100:00080000:2.0:1767320312.304169:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320312.304172:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320312.304183:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340df80 x1853163940745984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320312.304389:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940745344:0@lo:400:kworker.0
00000100:00100000:3.0:1767320312.304449:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320312.304537:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320312.304543:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940745472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320312.304576:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.304828:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940744960:0@lo:250:kworker.0
00000400:00000100:0.0:1767320312.304851:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940744960 offset 0 length 520: 4
00000100:00100000:0.0:1767320312.304870:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940745088:0@lo:38:kworker.0
00000100:00100000:0.0:1767320312.304894:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.304921:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940745216:0@lo:38:kworker.0
00000100:00100000:0.0:1767320312.304943:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.304958:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940745728:0@lo:38:kworker.0
00000100:00100000:0.0:1767320312.304977:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.304991:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940745984:0@lo:38:kworker.0
00000100:00100000:0.0:1767320312.305008:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.305233:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940745856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320312.305258:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320312.305275:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320312.305281:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940745600:0@lo:400:kworker.0
00000100:00100000:0.0:1767320312.305301:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320312.305379:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745088
00000100:00100000:3.0:1767320312.305386:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745088
00000100:00100000:3.0:1767320312.305422:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745728
00000100:00100000:3.0:1767320312.305425:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745728
00000100:00100000:3.0:1767320312.305435:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745984
00000100:00100000:3.0:1767320312.305437:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745984
00000100:00100000:3.0:1767320312.305444:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745856
00000100:00100000:3.0:1767320312.305446:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745856
00000100:00100000:3.0:1767320312.305488:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745600
00000100:00100000:3.0:1767320312.305492:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745600
00000100:00100000:3.0:1767320312.305509:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018
00000100:00100000:3.0:1767320312.305517:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940745856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320312.305579:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940745856:12345-0@lo:400:kworker.0 Request processed in 63us (320us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320312.305586:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018
00000100:00100000:3.0:1767320312.305603:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019
00000100:00100000:3.0:1767320312.305761:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940745600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320312.305882:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17770
00000100:00100000:0.0:1767320312.305888:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940745088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320312.305909:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320312.305947:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940745088:12345-0@lo:38:kworker.0 Request processed in 57us (1052us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320312.305953:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17770
00000100:00100000:0.0:1767320312.305968:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17771
00000100:00100000:0.0:1767320312.305971:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940745728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320312.305979:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320312.305999:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940745728:12345-0@lo:38:kworker.0 Request processed in 27us (1022us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320312.306004:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17771
00000100:00100000:3.0:1767320312.306116:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940745600:12345-0@lo:400:kworker.0 Request processed in 506us (813us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320312.306122:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019
00000100:00100000:3.0:1767320312.306135:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17772
00000100:00100000:3.0:1767320312.306139:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940745984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320312.306149:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320312.306240:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940745984:12345-0@lo:38:kworker.0 Request processed in 99us (1231us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320312.306247:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17772
00000100:00080000:3.0:1767320312.306268:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320312.306296:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940745600:0@lo:400:kworker.0
00000100:00100000:3.0:1767320312.306307:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940745856:0@lo:400:kworker.0
00000100:00080000:3.0:1767320312.306348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320312.306353:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320312.306356:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940745088:0@lo:38:kworker.0
00000100:00080000:3.0:1767320312.306365:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320312.306368:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320312.306370:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940745728:0@lo:38:kworker.0
00000100:00080000:3.0:1767320312.306377:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320312.306380:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320312.306382:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940745984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320312.306470:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745344
00000100:00100000:2.0:1767320312.306475:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745344
00000100:00100000:2.0:1767320312.306514:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745472
00000100:00100000:2.0:1767320312.306517:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745472
00000100:00100000:2.0:1767320312.306534:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245
00000100:00100000:2.0:1767320312.306540:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940745344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320312.306589:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940745344:12345-0@lo:400:kworker.0 Request processed in 49us (2139us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320312.306596:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245
00000100:00100000:2.0:1767320312.306893:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246
00000100:00100000:2.0:1767320312.306902:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940745472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320312.306933:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940745472:12345-0@lo:400:kworker.0 Request processed in 33us (2357us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320312.306939:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246
00000100:00080000:3.0:1767320312.307400:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320312.307430:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940745472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320312.307441:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940745344:0@lo:400:kworker.0
00000100:00100000:1.0:1767320312.307973:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940745216
00000100:00100000:1.0:1767320312.307979:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940745216
00000100:00100000:1.0:1767320312.308010:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277
00000100:00100000:1.0:1767320312.308014:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940745216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320312.308028:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320312.308067:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940745216:12345-0@lo:38:kworker.0 Request processed in 53us (3124us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320312.308072:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277
00000100:00080000:3.0:1767320312.309619:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320312.309628:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320312.309633:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940745216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320313.007673:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320313.262293:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320313.926040:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320313.926195:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320313.927745:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368000
00000100:00100000:1.0:1767320313.927757:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368000
00000100:00100000:1.0:1767320313.927854:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894367872
00000100:00100000:1.0:1767320313.927858:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894367872
00000100:00100000:1.0:1767320313.927885:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5020
00000100:00100000:1.0:1767320313.927894:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368000:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320313.927973:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368000:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (1943us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320313.927980:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5020
00000100:00100000:1.0:1767320313.927999:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17773
00000100:00100000:1.0:1767320313.928003:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894367872:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320313.928023:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320313.928049:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894367872:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (1854us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320313.928054:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17773
00000100:00080000:3.0:1767320313.931236:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320314.029387:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320314.287938:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320315.055675:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320315.311555:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320315.885085:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320315.885257:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940746112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320315.885345:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320315.889511:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746112
00000100:00100000:0.0:1767320315.889619:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746112
00000100:00100000:0.0:1767320315.889807:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810
00000100:00100000:0.0:1767320315.889817:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940746112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320315.889849:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320315.889923:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940746112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (4586us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320315.889930:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810
00000100:00100000:2.0:1767320315.890674:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940746112:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320315.892048:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320316.079346:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320316.335990:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320316.916720:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940746240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320316.917085:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320316.917847:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746240
00000100:00100000:1.0:1767320316.917855:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746240
00000100:00100000:1.0:1767320316.917912:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811
00000100:00100000:1.0:1767320316.917921:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940746240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320316.917951:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320316.918007:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940746240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (922us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320316.918013:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811
00000100:00100000:1.0:1767320316.918073:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940746240:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320316.918385:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320317.101283:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320317.360112:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320317.421040:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320317.421050:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320317.421053:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320317.421057:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320317.421061:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320317.421068:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320317.421073:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320317.421079:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320317.421117:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940746368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320317.421132:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320317.421135:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320317.421137:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320317.421140:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320317.421142:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320317.421145:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320317.421156:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044019f80 x1853163940746496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320317.421228:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940746624:0@lo:400:kworker.0
00000100:00100000:1.0:1767320317.421297:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320317.421390:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746624
00000100:00100000:2.0:1767320317.421397:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746624
00000100:00100000:2.0:1767320317.421478:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247
00000100:00100000:2.0:1767320317.421485:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940746624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320317.421752:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940746368:0@lo:38:kworker.0
00000100:00100000:0.0:1767320317.421808:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320317.421827:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940746496:0@lo:38:kworker.0
00000100:00100000:0.0:1767320317.421848:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320317.421873:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746496
00000100:00100000:0.0:1767320317.421877:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746496
00000100:00100000:0.0:1767320317.421896:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278
00000100:00100000:0.0:1767320317.421901:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940746496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320317.421920:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320317.421948:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940746496:12345-0@lo:38:kworker.0 Request processed in 46us (99us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320317.421955:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278
00000100:00080000:0.0:1767320317.421985:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320317.421988:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320317.421992:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940746496:0@lo:38:kworker.0
00000100:00080000:0.0:1767320317.422037:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320317.422053:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746368
00000100:00100000:0.0:1767320317.422056:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746368
00000100:00100000:0.0:1767320317.422073:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17774
00000100:00100000:0.0:1767320317.422078:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940746368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320317.422087:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320317.422110:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940746368:12345-0@lo:38:kworker.0 Request processed in 31us (302us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320317.422115:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17774
00000100:00080000:0.0:1767320317.422137:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320317.422141:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320317.422144:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940746368:0@lo:38:kworker.0
00000100:00100000:0.0:1767320317.422167:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940746752:0@lo:400:kworker.0
00000100:00100000:0.0:1767320317.422190:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320317.422222:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746752
00000100:00100000:0.0:1767320317.422225:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746752
00000100:00100000:0.0:1767320317.422247:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248
00000100:00100000:0.0:1767320317.422252:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940746752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320317.422281:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940746752:12345-0@lo:400:kworker.0 Request processed in 29us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320317.422287:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248
00000100:00100000:0.0:1767320317.422309:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940746752:0@lo:400:kworker.0
00000100:00100000:2.0:1767320317.425833:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940746624:12345-0@lo:400:kworker.0 Request processed in 4336us (4523us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320317.425850:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247
00000100:00080000:3.0:1767320317.426334:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320317.426339:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320317.426343:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320317.426349:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320317.426353:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320317.426359:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320317.426381:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cd180 x1853163940747008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320317.426425:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320317.426428:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320317.426430:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320317.426433:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320317.426436:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320317.426439:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320317.426449:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38380 x1853163940747264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320317.426485:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940747008:0@lo:38:kworker.0
00000100:00100000:3.0:1767320317.426549:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320317.426578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940747264:0@lo:38:kworker.0
00000100:00100000:3.0:1767320317.426610:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320317.426642:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747008
00000100:00100000:3.0:1767320317.426649:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747008
00000100:00100000:3.0:1767320317.426679:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747264
00000100:00100000:3.0:1767320317.426682:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747264
00000100:00100000:3.0:1767320317.426699:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17775
00000100:00100000:3.0:1767320317.426706:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940747008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320317.426729:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320317.426770:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940747008:12345-0@lo:38:kworker.0 Request processed in 63us (221us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320317.427018:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17775
00000100:00100000:3.0:1767320317.427036:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17776
00000100:00100000:3.0:1767320317.427041:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940747264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320317.427051:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320317.427079:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940747264:12345-0@lo:38:kworker.0 Request processed in 37us (468us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320317.427084:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17776
00000100:00080000:3.0:1767320317.427119:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320317.427124:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320317.427128:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940747008:0@lo:38:kworker.0
00000100:00080000:3.0:1767320317.427137:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320317.427140:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320317.427143:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940747264:0@lo:38:kworker.0
00000100:00100000:0.0:1767320317.427261:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940746880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320317.427292:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320317.427323:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320317.427330:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940747136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320317.427349:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320317.427421:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940746880
00000100:00100000:3.0:1767320317.427425:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940746880
00000100:00100000:3.0:1767320317.427472:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747136
00000100:00100000:3.0:1767320317.427475:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747136
00000100:00100000:3.0:1767320317.427497:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5021
00000100:00100000:3.0:1767320317.427504:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940746880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320317.427546:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940746880:12345-0@lo:400:kworker.0 Request processed in 42us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320317.427552:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5021
00000100:00100000:3.0:1767320317.427564:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5022
00000100:00100000:3.0:1767320317.427571:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940747136:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320317.427696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320317.427737:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940746880:0@lo:400:kworker.0
00000100:00100000:3.0:1767320317.428006:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940747136:12345-0@lo:400:kworker.0 Request processed in 435us (655us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320317.428013:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5022
00000100:00100000:0.0:1767320317.428090:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940747136:0@lo:400:kworker.0
00000100:00100000:1.0:1767320317.429750:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940746624:0@lo:400:kworker.0
00000100:00100000:3.0:1767320318.124888:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320318.381234:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320319.050636:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320319.050977:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320319.061767:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368256
00000100:00100000:3.0:1767320319.061794:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368256
00000100:00080000:0.0:1767320319.061894:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320319.063918:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368128
00000100:00100000:1.0:1767320319.063932:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368128
00000100:00100000:3.0:1767320319.064044:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5023
00000100:00100000:3.0:1767320319.064065:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894368256:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320319.064160:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894368256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 106us (13534us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320319.064168:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5023
00000100:00100000:3.0:1767320319.064190:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17777
00000100:00100000:3.0:1767320319.064194:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894368128:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320319.064216:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320319.064239:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894368128:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (13263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320319.064245:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17777
00000100:00100000:3.0:1767320319.148901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320319.405235:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320320.172904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320320.433119:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320321.005036:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940747392:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320321.005108:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320321.005614:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747392
00000100:00100000:0.0:1767320321.005623:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747392
00000100:00100000:0.0:1767320321.005709:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812
00000100:00100000:0.0:1767320321.005720:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940747392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320321.005754:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:2.0:1767320321.005868:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320321.011445:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940747392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5716us (6324us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320321.011462:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812
00000100:00100000:1.0:1767320321.015519:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940747392:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320321.197024:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320321.454230:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320322.030013:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320322.030036:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940747520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320322.030103:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320322.030182:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747520
00000100:00100000:3.0:1767320322.030189:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747520
00000100:00100000:3.0:1767320322.030241:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813
00000100:00100000:3.0:1767320322.030252:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940747520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320322.030280:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320322.030320:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940747520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (217us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320322.030327:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813
00000100:00100000:3.0:1767320322.030389:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940747520:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320322.030621:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320322.220914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320322.479660:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320322.546811:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320322.546824:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320322.546827:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320322.546831:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320322.546836:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320322.546844:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5567
00000100:00080000:2.0:1767320322.546849:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320322.546855:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320322.546893:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340fb80 x1853163940747648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320322.546923:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320322.546926:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320322.546928:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320322.546931:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5567
00000100:00080000:2.0:1767320322.546933:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320322.546936:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320322.546951:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340ca80 x1853163940747776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320322.547007:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320322.547010:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320322.547011:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320322.547015:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5567
00000100:00080000:2.0:1767320322.547017:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320322.547021:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320322.547031:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340df80 x1853163940748160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320322.547067:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320322.547071:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320322.547072:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320322.547076:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5567
00000100:00080000:2.0:1767320322.547078:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320322.547082:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320322.547093:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340d880 x1853163940748416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320322.547126:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940748032:0@lo:400:kworker.0
00000100:00100000:1.0:1767320322.547152:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940747904:0@lo:400:kworker.0
00000100:00100000:0.0:1767320322.547261:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320322.547276:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940748288:0@lo:400:kworker.0
00000100:00100000:3.0:1767320322.547345:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940747648:0@lo:38:kworker.0
00000100:00100000:1.0:1767320322.551916:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320322.552064:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747904
00000100:00100000:1.0:1767320322.552076:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747904
00000100:00100000:1.0:1767320322.553396:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249
00000100:00100000:1.0:1767320322.553416:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940747904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320322.553514:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940747904:12345-0@lo:400:kworker.0 Request processed in 108us (1607us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320322.553523:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249
00000100:00100000:1.0:1767320322.553582:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940747904:0@lo:400:kworker.0
00000100:00100000:2.0:1767320322.559319:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320322.559533:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748032
00000100:00100000:1.0:1767320322.559542:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748032
00000100:00100000:1.0:1767320322.559609:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5024
00000100:00100000:1.0:1767320322.559619:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940748032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320322.559796:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940748032:12345-0@lo:400:kworker.0 Request processed in 157us (462us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320322.559804:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5024
00000100:00080000:2.0:1767320322.559863:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320322.559898:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940748032:0@lo:400:kworker.0
00000100:00100000:1.0:1767320322.567316:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320322.567400:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748288
00000100:00100000:2.0:1767320322.567410:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748288
00000100:00100000:1.0:1767320322.567550:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5025
00000100:00100000:1.0:1767320322.567560:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940748288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320322.567625:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940748288:12345-0@lo:400:kworker.0 Request processed in 66us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320322.567632:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5025
00000100:00100000:1.0:1767320322.567688:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940748288:0@lo:400:kworker.0
00000100:00080000:0.0:1767320322.567739:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320322.572844:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320322.572920:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940747776:0@lo:38:kworker.0
00000100:00100000:3.0:1767320322.572960:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320322.572987:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940748160:0@lo:38:kworker.0
00000100:00100000:3.0:1767320322.573007:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320322.573031:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940748416:0@lo:38:kworker.0
00000100:00100000:3.0:1767320322.573060:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320322.573174:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747648
00000100:00100000:2.0:1767320322.573183:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747648
00000100:00100000:0.0:1767320322.573210:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940747776
00000100:00100000:0.0:1767320322.573215:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940747776
00000100:00100000:2.0:1767320322.573219:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748160
00000100:00100000:2.0:1767320322.573221:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748160
00000100:00100000:0.0:1767320322.573259:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279
00000100:00100000:0.0:1767320322.573267:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940747776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320322.573289:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320322.582862:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748416
00000100:00100000:2.0:1767320322.582878:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748416
00000100:00100000:0.0:1767320322.589466:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940747776:12345-0@lo:38:kworker.0 Request processed in 16186us (16492us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320322.589483:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279
00000100:00100000:3.0:1767320322.590316:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17778
00000100:00100000:3.0:1767320322.590325:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940747648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320322.590351:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320322.590385:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17779
00000100:00100000:3.0:1767320322.590390:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940748160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320322.590401:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320322.590473:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940748160:12345-0@lo:38:kworker.0 Request processed in 81us (17464us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320322.590480:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17779
00000100:00100000:3.0:1767320322.590499:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17780
00000100:00100000:3.0:1767320322.590504:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940748416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320322.590513:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320322.590538:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940748416:12345-0@lo:38:kworker.0 Request processed in 33us (17477us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320322.590545:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17780
00000100:00080000:3.0:1767320322.590602:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320322.590607:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320322.590611:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940747776:0@lo:38:kworker.0
00000100:00080000:3.0:1767320322.590623:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320322.590627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320322.590630:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940748160:0@lo:38:kworker.0
00000100:00080000:3.0:1767320322.590639:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320322.590643:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320322.590646:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940748416:0@lo:38:kworker.0
00000100:00100000:3.0:1767320322.590707:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940747648:12345-0@lo:38:kworker.0 Request processed in 381us (17872us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320322.590714:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17778
00000100:00080000:3.0:1767320322.590737:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320322.590741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320322.590744:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940747648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320323.244906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320323.501023:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320324.174337:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320324.174389:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320324.174486:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368512
00000100:00100000:0.0:1767320324.174496:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368512
00000100:00100000:0.0:1767320324.174569:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368384
00000100:00100000:0.0:1767320324.174572:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368384
00000100:00100000:0.0:1767320324.174590:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5026
00000100:00100000:0.0:1767320324.174598:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368512:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320324.174669:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (342us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320324.174676:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5026
00000100:00100000:0.0:1767320324.174822:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17781
00000100:00100000:0.0:1767320324.174827:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894368384:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320324.174847:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320324.174878:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894368384:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 49us (488us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320324.174885:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17781
00000100:00080000:3.0:1767320324.175192:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320324.268892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320324.525105:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320325.294008:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320325.551028:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320326.125020:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940748544:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320326.132011:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320326.132232:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748544
00000100:00100000:3.0:1767320326.132242:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748544
00000100:00100000:3.0:1767320326.132324:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814
00000100:00100000:3.0:1767320326.132345:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940748544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320326.132379:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00080000:0.0:1767320326.132450:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320326.140072:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940748544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7706us (8043us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320326.140088:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814
00000100:00100000:1.0:1767320326.140626:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940748544:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320326.316939:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320326.573034:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320327.149570:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320327.154953:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940748672:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320327.155174:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320327.158201:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748672
00000100:00100000:3.0:1767320327.158216:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748672
00000100:00100000:3.0:1767320327.158311:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815
00000100:00100000:3.0:1767320327.158330:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940748672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320327.158365:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320327.158464:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940748672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (3289us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320327.158471:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815
00000100:00100000:2.0:1767320327.158706:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940748672:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320327.158819:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320327.340889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320327.598132:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320327.661006:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320327.661017:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320327.661020:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320327.661023:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320327.661028:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320327.661037:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5572
00000100:00080000:0.0:1767320327.661042:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320327.661048:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320327.661088:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9f80 x1853163940748800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320327.661118:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320327.661122:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320327.661124:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320327.661127:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5572
00000100:00080000:0.0:1767320327.661130:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320327.661133:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320327.661150:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044018700 x1853163940748928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320327.661194:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320327.661198:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320327.661200:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320327.661203:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5572
00000100:00080000:0.0:1767320327.661205:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320327.661209:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320327.661219:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26300 x1853163940749312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320327.661234:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320327.661236:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320327.661238:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320327.661242:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5572
00000100:00080000:0.0:1767320327.661244:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320327.661247:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320327.661256:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940749568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320327.661286:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940749184:0@lo:400:kworker.0
00000100:00100000:0.0:1767320327.661359:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320327.661419:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320327.661425:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940749440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320327.661446:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320327.661618:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940749056:0@lo:400:kworker.0
00000100:00100000:1.0:1767320327.661650:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320327.661757:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749184
00000100:00100000:2.0:1767320327.661765:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749184
00000100:00100000:2.0:1767320327.661838:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749440
00000100:00100000:2.0:1767320327.661842:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749440
00000100:00100000:2.0:1767320327.661866:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5027
00000100:00100000:2.0:1767320327.661875:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940749184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320327.661926:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940749184:12345-0@lo:400:kworker.0 Request processed in 52us (567us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320327.661933:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5027
00000100:00100000:2.0:1767320327.661949:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5028
00000100:00100000:2.0:1767320327.661955:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940749440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320327.661983:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940749440:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320327.661989:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5028
00000100:00100000:2.0:1767320327.662041:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940749440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320327.662052:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940749184:0@lo:400:kworker.0
00000100:00080000:1.0:1767320327.662168:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320327.662228:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940748800:0@lo:38:kworker.0
00000100:00100000:3.0:1767320327.662262:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320327.662289:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940748928:0@lo:38:kworker.0
00000100:00100000:3.0:1767320327.662309:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320327.662343:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940749312:0@lo:38:kworker.0
00000100:00100000:3.0:1767320327.662365:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320327.662383:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940749568:0@lo:38:kworker.0
00000100:00100000:3.0:1767320327.662401:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320327.662428:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748800
00000100:00100000:3.0:1767320327.662432:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748800
00000100:00100000:3.0:1767320327.662451:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749312
00000100:00100000:3.0:1767320327.662453:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749312
00000100:00100000:3.0:1767320327.662460:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749568
00000100:00100000:3.0:1767320327.662462:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749568
00000100:00100000:3.0:1767320327.662471:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17782
00000100:00100000:3.0:1767320327.662474:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940748800:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320327.662492:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320327.662524:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940748800:12345-0@lo:38:kworker.0 Request processed in 48us (261us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320327.662530:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17782
00000100:00100000:3.0:1767320327.662544:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17783
00000100:00100000:3.0:1767320327.662547:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940749312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320327.662557:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320327.662578:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940749312:12345-0@lo:38:kworker.0 Request processed in 29us (213us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320327.662585:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17783
00000100:00100000:3.0:1767320327.662596:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17784
00000100:00100000:3.0:1767320327.662599:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940749568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320327.662606:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320327.662626:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940749568:12345-0@lo:38:kworker.0 Request processed in 25us (223us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320327.662630:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17784
00000100:00080000:3.0:1767320327.662658:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320327.662662:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320327.662665:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940748800:0@lo:38:kworker.0
00000100:00080000:3.0:1767320327.662673:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320327.662676:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320327.662678:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940749312:0@lo:38:kworker.0
00000100:00080000:3.0:1767320327.662685:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320327.662688:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320327.662691:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940749568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320327.662760:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940748928
00000100:00100000:1.0:1767320327.662765:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940748928
00000100:00100000:1.0:1767320327.662815:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280
00000100:00100000:1.0:1767320327.662820:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940748928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320327.662830:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320327.662863:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940748928:12345-0@lo:38:kworker.0 Request processed in 42us (553us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320327.662868:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280
00000100:00080000:1.0:1767320327.662890:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320327.662894:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320327.662897:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940748928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320327.662965:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749056
00000100:00100000:0.0:1767320327.662969:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749056
00000100:00100000:0.0:1767320327.663173:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250
00000100:00100000:0.0:1767320327.663182:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940749056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320327.663226:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940749056:12345-0@lo:400:kworker.0 Request processed in 46us (1575us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320327.663232:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250
00000100:00100000:2.0:1767320327.663286:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940749056:0@lo:400:kworker.0
00000100:00100000:3.0:1767320328.262304:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320328.262491:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368896
00000100:00100000:2.0:1767320328.262503:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368896
00000100:00100000:2.0:1767320328.262595:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5029
00000100:00100000:2.0:1767320328.262606:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368896:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320328.262695:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894368896:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (400us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320328.262703:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5029
00000400:00000100:3.0:1767320328.262742:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894368640 offset 0 length 520: 4
00000100:00100000:3.0:1767320328.262881:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320328.262936:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894368768
00000100:00100000:2.0:1767320328.262941:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894368768
00000100:00100000:2.0:1767320328.262963:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17785
00000100:00100000:2.0:1767320328.262969:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894368768:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320328.262989:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320328.263024:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894368768:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (142us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320328.263030:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17785
00000100:00080000:1.0:1767320328.263055:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320328.364904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320328.621038:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320329.388947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320329.645262:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320330.412904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320330.671326:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320331.253617:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940749696:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320331.253699:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320331.254589:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749696
00000100:00100000:0.0:1767320331.254598:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749696
00000100:00100000:0.0:1767320331.254678:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816
00000100:00100000:0.0:1767320331.254688:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940749696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320331.254722:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320331.254841:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940749696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (1140us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320331.254849:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816
00000100:00100000:2.0:1767320331.254970:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940749696:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320331.255107:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320331.436901:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320331.693009:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320332.271031:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320332.271057:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940749824:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320332.271147:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320332.271607:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749824
00000100:00100000:0.0:1767320332.271617:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749824
00000100:00100000:0.0:1767320332.271697:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817
00000100:00100000:0.0:1767320332.271707:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940749824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320332.271739:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320332.271818:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940749824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (670us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320332.271825:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817
00000100:00100000:1.0:1767320332.272684:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940749824:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320332.273016:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320332.460978:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320332.717210:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320332.780971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320332.780982:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320332.780985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320332.780988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320332.780993:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320332.781001:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5577
00000100:00080000:3.0:1767320332.781005:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320332.781013:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320332.781053:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3100 x1853163940749952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320332.781076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320332.781080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320332.781082:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320332.781085:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5577
00000100:00080000:3.0:1767320332.781088:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320332.781091:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320332.781107:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940750080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320332.781158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320332.781162:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320332.781164:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320332.781167:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5577
00000100:00080000:3.0:1767320332.781170:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320332.781174:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320332.781186:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940750464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320332.781191:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940750208:0@lo:400:kworker.0
00000100:00080000:3.0:1767320332.781223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320332.781226:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320332.781228:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320332.781231:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5577
00000100:00080000:3.0:1767320332.781233:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320332.781236:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320332.781251:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940750720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320332.781262:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320332.781297:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940750592:0@lo:400:kworker.0
00000100:00100000:3.0:1767320332.781326:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320332.781332:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320332.781337:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940750336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320332.781357:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320332.781358:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750592
00000100:00100000:3.0:1767320332.781365:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750592
00000100:00100000:2.0:1767320332.781384:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750336
00000100:00100000:2.0:1767320332.781387:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750336
00000100:00100000:1.0:1767320332.781482:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940749952:0@lo:38:kworker.0
00000100:00100000:1.0:1767320332.781511:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320332.781568:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750208
00000100:00100000:0.0:1767320332.781572:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750208
00000100:00100000:0.0:1767320332.781600:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251
00000100:00100000:0.0:1767320332.781608:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940750208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320332.781664:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940750208:12345-0@lo:400:kworker.0 Request processed in 57us (401us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320332.781671:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251
00000100:00100000:0.0:1767320332.781709:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940750208:0@lo:400:kworker.0
00000100:00080000:0.0:1767320332.781737:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320332.788738:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030
00000100:00100000:2.0:1767320332.788768:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940750592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320332.788893:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940750592:12345-0@lo:400:kworker.0 Request processed in 142us (7564us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320332.788900:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030
00000100:00100000:1.0:1767320332.790316:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940750080:0@lo:38:kworker.0
00000100:00100000:1.0:1767320332.790371:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320332.790391:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940750464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320332.790412:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320332.794361:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940749952
00000100:00100000:3.0:1767320332.794381:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940749952
00000100:00100000:3.0:1767320332.794426:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031
00000100:00100000:3.0:1767320332.794463:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940750336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320332.794599:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940750336:12345-0@lo:400:kworker.0 Request processed in 163us (13240us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320332.794606:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031
00000100:00100000:3.0:1767320332.794682:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17786
00000100:00100000:3.0:1767320332.794686:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940749952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320332.794710:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320332.794744:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940749952:12345-0@lo:38:kworker.0 Request processed in 56us (13232us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320332.794753:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17786
00000100:00100000:3.0:1767320332.794852:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940750592:0@lo:400:kworker.0
00000100:00100000:3.0:1767320332.795012:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940750336:0@lo:400:kworker.0
00000100:00100000:3.0:1767320332.795042:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750080
00000100:00100000:3.0:1767320332.795046:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750080
00000100:00100000:3.0:1767320332.795074:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281
00000100:00100000:3.0:1767320332.795079:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940750080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320332.795091:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320332.795122:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940750080:12345-0@lo:38:kworker.0 Request processed in 41us (4751us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320332.795128:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281
00000100:00100000:1.0:1767320332.797188:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940750720:0@lo:38:kworker.0
00000100:00100000:1.0:1767320332.797257:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320332.797319:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320332.797325:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320332.797328:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940749952:0@lo:38:kworker.0
00000100:00080000:1.0:1767320332.797340:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320332.797343:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320332.797346:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940750080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320332.797601:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750464
00000100:00100000:0.0:1767320332.797609:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750464
00000100:00100000:0.0:1767320332.797658:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750720
00000100:00100000:0.0:1767320332.797661:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750720
00000100:00100000:0.0:1767320332.797691:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17787
00000100:00100000:0.0:1767320332.797698:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940750464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320332.797718:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320332.797759:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940750464:12345-0@lo:38:kworker.0 Request processed in 60us (7345us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320332.797765:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17787
00000100:00100000:0.0:1767320332.797802:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17788
00000100:00100000:0.0:1767320332.797806:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940750720:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320332.797815:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320332.797838:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940750720:12345-0@lo:38:kworker.0 Request processed in 31us (582us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320332.797844:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17788
00000100:00080000:1.0:1767320332.798013:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320332.798017:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320332.798021:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940750464:0@lo:38:kworker.0
00000100:00080000:1.0:1767320332.798029:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320332.798033:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320332.798036:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940750720:0@lo:38:kworker.0
00000100:00100000:0.0:1767320333.382241:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320333.382298:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320333.382381:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369024
00000100:00100000:3.0:1767320333.382393:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369024
00000100:00100000:3.0:1767320333.382441:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369152
00000100:00100000:3.0:1767320333.382444:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369152
00000100:00100000:3.0:1767320333.382496:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5032
00000100:00100000:1.0:1767320333.382517:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17789
00000100:00100000:3.0:1767320333.382522:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369152:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320333.382530:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894369024:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320333.382556:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320333.382610:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369152:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (309us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320333.382618:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5032
00000100:00080000:0.0:1767320333.382887:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320333.386838:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894369024:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 4295us (4593us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320333.386853:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17789
00000100:00100000:3.0:1767320333.484900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320333.741310:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320334.509095:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320334.765000:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320335.532907:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320335.793713:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320336.367688:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940750848:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320336.367824:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320336.370290:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750848
00000100:00100000:1.0:1767320336.370305:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750848
00000100:00100000:1.0:1767320336.370398:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818
00000100:00100000:1.0:1767320336.370412:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940750848:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320336.370457:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320336.370571:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940750848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (2746us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320336.370578:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818
00000100:00100000:3.0:1767320336.370836:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940750848:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320336.371004:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320336.556898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320336.814819:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320337.389995:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320337.393423:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940750976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320337.393588:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320337.399480:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940750976
00000100:00100000:2.0:1767320337.399497:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940750976
00000100:00100000:2.0:1767320337.399604:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819
00000100:00100000:2.0:1767320337.399615:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940750976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320337.399655:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320337.399752:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940750976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (6163us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320337.399760:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819
00000100:00080000:0.0:1767320337.399874:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320337.399972:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940750976:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320337.581565:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320337.837150:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320337.901090:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320312/real 1767320312]  req@ffff93d0469cd500 x1853163940744960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320337.901204:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d0469cd500 x1853163940744960/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320337.901252:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320337.901314:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320337.901319:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940744960:0@lo:250:kworker.0
00000100:00080000:0.0:1767320337.906250:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320337.906261:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320337.906265:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320337.906273:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5562
00000100:00080000:0.0:1767320337.906278:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320337.906286:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320337.906326:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4433ca80 x1853163940751104/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320337.906490:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940751104:0@lo:250:kworker.0
00000400:00000100:1.0:1767320337.906546:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940751104 offset 0 length 520: 4
00000100:00080000:0.0:1767320337.906610:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320337.906615:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320337.906617:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320337.906621:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5582
00000100:00080000:0.0:1767320337.906624:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320337.906629:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320337.906646:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0e00 x1853163940751232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320337.910904:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940751232:0@lo:38:kworker.0
00000100:00100000:1.0:1767320337.910970:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320337.911052:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751232
00000100:00100000:3.0:1767320337.911062:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751232
00000100:00100000:3.0:1767320337.911114:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17790
00000100:00100000:3.0:1767320337.911122:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940751232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320337.911144:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320337.911536:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940751232:12345-0@lo:38:kworker.0 Request processed in 412us (563us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320337.911545:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17790
00000100:00080000:2.0:1767320337.911621:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320337.911627:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320337.911631:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940751232:0@lo:38:kworker.0
00000100:00080000:0.0:1767320337.912466:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320337.912472:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320337.912475:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320337.912481:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5582
00000100:00080000:0.0:1767320337.912485:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320337.912490:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320337.912532:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb3800 x1853163940751360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320337.912583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940751360:0@lo:38:kworker.0
00000100:00080000:0.0:1767320337.912611:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320337.912615:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320337.912617:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320337.912620:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5582
00000100:00080000:0.0:1767320337.912622:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320337.912626:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320337.912637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb1500 x1853163940751744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320337.912645:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320337.912652:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320337.912654:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320337.912656:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320337.912659:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5582
00000100:00080000:0.0:1767320337.912661:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320337.912664:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320337.912670:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940751744:0@lo:38:kworker.0
00000100:00100000:0.0:1767320337.912674:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09f80 x1853163940752000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320337.912700:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320337.912718:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940752000:0@lo:38:kworker.0
00000100:00100000:2.0:1767320337.912736:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320337.912815:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940751872:0@lo:400:kworker.0
00000100:00100000:3.0:1767320337.912843:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320337.912871:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320337.912877:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940751616:0@lo:400:kworker.0
00000100:00100000:3.0:1767320337.912897:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320337.912923:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751360
00000100:00100000:3.0:1767320337.912929:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751360
00000100:00100000:3.0:1767320337.912959:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282
00000100:00100000:3.0:1767320337.912965:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940751360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320337.912982:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320337.913036:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940751360:12345-0@lo:38:kworker.0 Request processed in 70us (389us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320337.913042:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282
00000100:00100000:3.0:1767320337.913068:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751744
00000100:00100000:3.0:1767320337.913071:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751744
00000100:00100000:3.0:1767320337.913086:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752000
00000100:00100000:3.0:1767320337.913088:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752000
00000100:00100000:3.0:1767320337.913098:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751872
00000100:00100000:3.0:1767320337.913100:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751872
00000100:00100000:2.0:1767320337.913161:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751616
00000100:00100000:2.0:1767320337.913165:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751616
00000100:00100000:1.0:1767320337.913498:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17791
00000100:00100000:1.0:1767320337.913504:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940751744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320337.913515:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320337.913546:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940751744:12345-0@lo:38:kworker.0 Request processed in 41us (845us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320337.913552:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17791
00000100:00100000:1.0:1767320337.913566:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17792
00000100:00100000:1.0:1767320337.913570:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940752000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320337.913579:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320337.913602:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940752000:12345-0@lo:38:kworker.0 Request processed in 29us (863us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320337.913606:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17792
00000100:00100000:1.0:1767320337.913622:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320337.913630:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940751488:0@lo:400:kworker.0
00000100:00100000:1.0:1767320337.913656:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320337.915828:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5033
00000100:00100000:3.0:1767320337.915846:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940751872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320337.915928:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940751872:12345-0@lo:400:kworker.0 Request processed in 89us (3083us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320337.915936:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5033
00000100:00100000:3.0:1767320337.915999:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940751872:0@lo:400:kworker.0
00000100:00080000:3.0:1767320337.916088:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320337.916094:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320337.916098:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940752000:0@lo:38:kworker.0
00000100:00080000:3.0:1767320337.916108:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320337.916111:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320337.916115:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940751744:0@lo:38:kworker.0
00000100:00080000:3.0:1767320337.916125:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320337.916127:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320337.916130:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940751360:0@lo:38:kworker.0
00000100:00100000:2.0:1767320337.916877:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5034
00000100:00100000:2.0:1767320337.916886:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940751616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320337.916936:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940751616:12345-0@lo:400:kworker.0 Request processed in 51us (4037us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320337.916942:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5034
00000100:00100000:2.0:1767320337.916986:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940751616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320337.918019:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940751488
00000100:00100000:1.0:1767320337.918029:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940751488
00000100:00100000:1.0:1767320337.918081:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252
00000100:00100000:1.0:1767320337.918090:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940751488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320337.918151:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940751488:12345-0@lo:400:kworker.0 Request processed in 62us (4494us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320337.918158:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252
00000100:00100000:1.0:1767320337.918191:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940751488:0@lo:400:kworker.0
00000100:00080000:3.0:1767320337.920855:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320338.506431:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320338.506525:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320338.506612:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369280
00000100:00100000:1.0:1767320338.506622:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369280
00000100:00100000:1.0:1767320338.506674:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369408
00000100:00100000:1.0:1767320338.506681:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369408
00000100:00100000:1.0:1767320338.506758:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5035
00000100:00100000:3.0:1767320338.506815:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17793
00000100:00100000:1.0:1767320338.506824:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369408:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320338.506825:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894369280:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320338.506853:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320338.506916:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894369280:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 91us (494us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320338.506925:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17793
00000100:00080000:0.0:1767320338.507002:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320338.510729:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369408:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3944us (4190us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320338.510746:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5035
00000100:00100000:3.0:1767320338.605328:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320338.864941:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320339.628897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320339.885030:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320340.652863:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320340.908994:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320341.485028:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320341.485054:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940752128:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320341.485129:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320341.485196:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752128
00000100:00100000:1.0:1767320341.485205:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752128
00000100:00080000:0.0:1767320341.485242:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320341.485279:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820
00000100:00100000:1.0:1767320341.485288:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940752128:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320341.485322:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320341.485382:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940752128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320341.485389:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820
00000100:00100000:3.0:1767320341.485630:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940752128:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320341.676935:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320341.933076:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320342.508958:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940752256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320342.509022:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320342.509126:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752256
00000100:00100000:2.0:1767320342.509134:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752256
00000100:00100000:2.0:1767320342.509205:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821
00000100:00100000:2.0:1767320342.509213:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940752256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320342.509243:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320342.509334:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320342.509509:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940752256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 296us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320342.509516:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821
00000100:00100000:1.0:1767320342.509523:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940752256:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320342.700860:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320342.958237:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320343.022520:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320343.022530:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320343.022533:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320343.022538:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320343.022542:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320343.022550:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5587
00000100:00080000:0.0:1767320343.022565:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320343.022574:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320343.022630:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc0a680 x1853163940752384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320343.022657:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320343.022660:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320343.022662:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320343.022665:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5587
00000100:00080000:0.0:1767320343.022667:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320343.022671:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320343.022684:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08000 x1853163940752512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320343.022749:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320343.022753:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320343.022755:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320343.022759:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5587
00000100:00080000:0.0:1767320343.022761:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320343.022765:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320343.022804:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc09880 x1853163940753024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320343.022819:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320343.022822:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320343.022824:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320343.022827:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5587
00000100:00080000:0.0:1767320343.022829:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320343.022832:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320343.022840:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc08380 x1853163940753280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320343.022870:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940753152:0@lo:400:kworker.0
00000100:00100000:0.0:1767320343.022936:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320343.023002:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320343.023008:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940752896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320343.023032:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320343.023061:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753152
00000100:00100000:0.0:1767320343.023068:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753152
00000100:00100000:0.0:1767320343.023114:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752896
00000100:00100000:0.0:1767320343.023118:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752896
00000100:00100000:0.0:1767320343.023153:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5036
00000100:00100000:0.0:1767320343.023162:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940753152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320343.023239:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940753152:12345-0@lo:400:kworker.0 Request processed in 78us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320343.023248:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5036
00000100:00100000:0.0:1767320343.023510:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5037
00000100:00100000:0.0:1767320343.023517:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940752896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320343.023549:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940752896:12345-0@lo:400:kworker.0 Request processed in 33us (516us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320343.023679:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940752768:0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.023713:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320343.023743:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320343.023750:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940752640:0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.023794:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320343.023832:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752768
00000100:00100000:2.0:1767320343.023836:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752768
00000100:00100000:2.0:1767320343.023865:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752640
00000100:00100000:2.0:1767320343.023868:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752640
00000100:00100000:2.0:1767320343.023890:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3253
00000100:00100000:2.0:1767320343.023896:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940752768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.023932:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940752768:12345-0@lo:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320343.023938:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3253
00000100:00100000:2.0:1767320343.023950:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254
00000100:00100000:2.0:1767320343.023955:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940752640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.023982:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940752640:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320343.023988:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254
00000100:00100000:2.0:1767320343.024030:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940752640:0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.024041:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940752768:0@lo:400:kworker.0
00000100:00080000:2.0:1767320343.024081:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320343.024085:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320343.024102:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940752896:0@lo:400:kworker.0
00000100:00100000:2.0:1767320343.024112:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940753152:0@lo:400:kworker.0
00000100:00100000:0.0:1767320343.024367:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5037
00000100:00100000:3.0:1767320343.027375:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940752384:0@lo:38:kworker.0
00000100:00100000:3.0:1767320343.027456:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320343.027488:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940752512:0@lo:38:kworker.0
00000100:00100000:3.0:1767320343.027511:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320343.027526:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940753024:0@lo:38:kworker.0
00000100:00100000:3.0:1767320343.027542:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320343.027570:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940753280:0@lo:38:kworker.0
00000100:00100000:3.0:1767320343.027590:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320343.027627:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752384
00000100:00100000:3.0:1767320343.027634:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752384
00000100:00100000:3.0:1767320343.027664:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753024
00000100:00100000:3.0:1767320343.027666:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753024
00000100:00100000:3.0:1767320343.027678:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753280
00000100:00100000:3.0:1767320343.027680:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753280
00000100:00100000:3.0:1767320343.027694:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17794
00000100:00100000:3.0:1767320343.027701:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940752384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320343.027722:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320343.027764:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940752384:12345-0@lo:38:kworker.0 Request processed in 62us (307us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320343.027788:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17794
00000100:00100000:3.0:1767320343.027807:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17795
00000100:00100000:3.0:1767320343.027812:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940753024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320343.027821:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320343.027842:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940753024:12345-0@lo:38:kworker.0 Request processed in 30us (299us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320343.027848:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17795
00000100:00100000:3.0:1767320343.027858:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17796
00000100:00100000:3.0:1767320343.027862:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940753280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320343.027870:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320343.027891:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940753280:12345-0@lo:38:kworker.0 Request processed in 27us (300us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320343.027896:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17796
00000100:00100000:2.0:1767320343.027982:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940752512
00000100:00100000:2.0:1767320343.027988:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940752512
00000100:00100000:2.0:1767320343.028015:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283
00000100:00100000:2.0:1767320343.028020:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940752512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320343.028029:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320343.028060:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940752512:12345-0@lo:38:kworker.0 Request processed in 39us (548us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320343.028066:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283
00000100:00080000:3.0:1767320343.028349:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320343.028354:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320343.028358:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940752384:0@lo:38:kworker.0
00000100:00080000:3.0:1767320343.028367:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320343.028369:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320343.028372:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940752512:0@lo:38:kworker.0
00000100:00080000:3.0:1767320343.028379:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320343.028382:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320343.028384:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940753024:0@lo:38:kworker.0
00000100:00080000:3.0:1767320343.028390:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320343.028394:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320343.028396:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940753280:0@lo:38:kworker.0
00000100:00100000:3.0:1767320343.621891:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320343.622139:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369664
00000100:00100000:0.0:1767320343.622149:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369664
00000100:00100000:0.0:1767320343.622234:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5038
00000100:00100000:0.0:1767320343.622242:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894369664:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320343.622330:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894369664:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (449us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320343.622337:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5038
00000100:00100000:0.0:1767320343.622908:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00080000:2.0:1767320343.623149:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320343.623238:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369536
00000100:00100000:3.0:1767320343.623246:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369536
00000100:00100000:3.0:1767320343.623282:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17797
00000100:00100000:3.0:1767320343.623288:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894369536:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320343.623309:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320343.623357:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894369536:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 67us (450us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320343.623363:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17797
00000100:00100000:3.0:1767320343.724921:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320343.981191:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320344.749216:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320345.006926:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320345.773199:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320346.029096:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320346.606738:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940753408:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320346.606823:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320346.606958:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753408
00000100:00100000:2.0:1767320346.606965:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753408
00000100:00100000:2.0:1767320346.607017:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822
00000100:00100000:2.0:1767320346.607023:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940753408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320346.607050:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320346.607093:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940753408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320346.607100:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822
00000100:00080000:0.0:1767320346.607182:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320346.607259:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940753408:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320346.796981:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320347.053033:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320347.633338:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320347.633363:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940753536:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320347.633434:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320347.633563:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753536
00000100:00100000:3.0:1767320347.633571:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753536
00000100:00100000:3.0:1767320347.633629:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823
00000100:00100000:3.0:1767320347.633639:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940753536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320347.633666:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320347.633707:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940753536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320347.633714:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823
00000100:00100000:1.0:1767320347.633816:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940753536:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320347.635872:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320347.820897:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320348.077953:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320348.143895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320348.143905:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320348.143908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320348.143912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320348.143917:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320348.143925:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5593
00000100:00080000:3.0:1767320348.143930:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320348.143938:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320348.144001:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45222680 x1853163940753664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320348.144101:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940753664:0@lo:38:kworker.0
00000100:00080000:3.0:1767320348.144166:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320348.144171:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320348.144173:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320348.144177:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5593
00000100:00080000:3.0:1767320348.144179:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320348.144183:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320348.144200:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220e00 x1853163940753792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320348.144218:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320348.144276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320348.144281:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320348.144284:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320348.144288:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5593
00000100:00080000:3.0:1767320348.144291:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320348.144298:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320348.144312:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221180 x1853163940754304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320348.144316:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753664
00000100:00100000:0.0:1767320348.144317:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940753792:0@lo:38:kworker.0
00000100:00100000:1.0:1767320348.144334:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753664
00000100:00080000:3.0:1767320348.144345:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320348.144349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320348.144352:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320348.144353:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320348.144355:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5593
00000100:00080000:3.0:1767320348.144357:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320348.144361:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320348.144372:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0000 x1853163940754560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320348.144378:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940754304:0@lo:38:kworker.0
00000100:00100000:0.0:1767320348.144415:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320348.144416:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17798
00000100:00100000:3.0:1767320348.144438:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940753920:0@lo:400:kworker.0
00000100:00100000:1.0:1767320348.144440:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940753664:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320348.144447:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940754560:0@lo:38:kworker.0
00000100:00100000:0.0:1767320348.144485:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767320348.144486:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320348.144486:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320348.144519:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320348.144526:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754304
00000100:00100000:3.0:1767320348.144528:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940754048:0@lo:400:kworker.0
00000100:00100000:0.0:1767320348.144532:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754304
00000100:00100000:0.0:1767320348.144566:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754560
00000100:00100000:0.0:1767320348.144569:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754560
00000100:00100000:0.0:1767320348.144590:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17799
00000100:00100000:0.0:1767320348.144597:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940754304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320348.144614:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320348.144649:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753792
00000100:00100000:2.0:1767320348.144654:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753792
00000100:00100000:2.0:1767320348.144678:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284
00000100:00100000:2.0:1767320348.144684:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940753792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320348.144697:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320348.145836:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320348.145910:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17800
00000100:00100000:3.0:1767320348.145917:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940754560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320348.145934:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320348.146022:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940753664:12345-0@lo:38:kworker.0 Request processed in 1584us (1799us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320348.146035:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17798
00000100:00100000:0.0:1767320348.146095:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940754304:12345-0@lo:38:kworker.0 Request processed in 1494us (1686us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320348.146103:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17799
00000100:00080000:0.0:1767320348.146181:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320348.146187:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320348.146191:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940754560:0@lo:38:kworker.0
00000100:00080000:0.0:1767320348.146204:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320348.146219:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320348.146224:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940754304:0@lo:38:kworker.0
00000100:00080000:0.0:1767320348.146238:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320348.146242:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320348.146245:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940753664:0@lo:38:kworker.0
00000100:00100000:1.0:1767320348.146280:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940753920
00000100:00100000:1.0:1767320348.146290:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940753920
00000100:00100000:0.0:1767320348.146311:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940754432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320348.146352:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320348.146361:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754048
00000100:00100000:1.0:1767320348.146367:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754048
00000100:00100000:0.0:1767320348.146389:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320348.146399:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940754176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320348.146407:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255
00000100:00100000:1.0:1767320348.146429:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940753920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320348.146444:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320348.146475:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940754560:12345-0@lo:38:kworker.0 Request processed in 555us (1992us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320348.146482:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17800
00000100:00100000:3.0:1767320348.146503:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754432
00000100:00100000:3.0:1767320348.146507:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754432
00000100:00100000:1.0:1767320348.146532:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940753920:12345-0@lo:400:kworker.0 Request processed in 106us (2047us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320348.146542:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255
00000100:00100000:3.0:1767320348.146553:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754176
00000100:00100000:3.0:1767320348.146559:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754176
00000100:00100000:1.0:1767320348.146568:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256
00000100:00100000:1.0:1767320348.146585:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940754048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320348.146601:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5039
00000100:00100000:3.0:1767320348.146631:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940754432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320348.146632:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940754048:12345-0@lo:400:kworker.0 Request processed in 46us (791us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320348.146650:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256
00000100:00080000:1.0:1767320348.146689:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320348.146696:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320348.146705:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940754432:12345-0@lo:400:kworker.0 Request processed in 72us (339us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320348.146713:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5040
00000100:00100000:3.0:1767320348.146726:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5039
00000100:00100000:1.0:1767320348.146732:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940754176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320348.146818:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940754176:12345-0@lo:400:kworker.0 Request processed in 91us (374us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320348.146820:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940754048:0@lo:400:kworker.0
00000100:00100000:3.0:1767320348.146842:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940753920:0@lo:400:kworker.0
00000100:00100000:0.0:1767320348.147260:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940754176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320348.147271:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940754432:0@lo:400:kworker.0
00000100:00100000:1.0:1767320348.147287:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5040
00000100:00100000:2.0:1767320348.148561:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940753792:12345-0@lo:38:kworker.0 Request processed in 3869us (4199us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320348.148576:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284
00000100:00080000:0.0:1767320348.148613:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320348.148619:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320348.148624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940753792:0@lo:38:kworker.0
00000100:00100000:1.0:1767320348.742709:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320348.742756:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320348.742811:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369920
00000100:00100000:3.0:1767320348.742823:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369920
00000100:00100000:2.0:1767320348.742893:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894369792
00000100:00080000:1.0:1767320348.742913:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320348.742919:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5041
00000100:00100000:3.0:1767320348.742931:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369920:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320348.743010:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894369920:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320348.743020:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5041
00000100:00100000:2.0:1767320348.743219:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894369792
00000100:00100000:2.0:1767320348.743282:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17801
00000100:00100000:2.0:1767320348.743291:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894369792:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320348.743324:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320348.743401:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894369792:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 108us (643us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320348.743409:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17801
00000100:00100000:3.0:1767320348.844928:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320349.102000:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320349.868990:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320350.126126:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320350.892933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320351.152799:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320351.726693:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320351.726719:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940754688:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320351.726839:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320351.727503:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754688
00000100:00100000:1.0:1767320351.727512:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754688
00000100:00100000:1.0:1767320351.727584:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824
00000100:00100000:1.0:1767320351.727594:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940754688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320351.727626:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320351.727686:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940754688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (846us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320351.727693:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824
00000100:00100000:2.0:1767320351.730221:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940754688:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320351.731329:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320351.916931:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320352.174134:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320352.749008:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320352.749032:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940754816:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320352.749112:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320352.749231:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754816
00000100:00100000:1.0:1767320352.749239:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754816
00000100:00100000:1.0:1767320352.749309:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825
00000100:00100000:1.0:1767320352.749319:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940754816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320352.749348:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320352.749394:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940754816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320352.749411:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825
00000100:00100000:3.0:1767320352.749444:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940754816:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320352.749507:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320352.940930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320353.196955:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320353.261094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320353.261106:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320353.261109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320353.261113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320353.261117:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320353.261125:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5598
00000100:00080000:2.0:1767320353.261130:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320353.261137:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320353.261176:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eada680 x1853163940754944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320353.261199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320353.261202:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320353.261204:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320353.261207:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5598
00000100:00080000:2.0:1767320353.261209:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320353.261213:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320353.261225:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4eada300 x1853163940755072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320353.261369:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940754944:0@lo:38:kworker.0
00000100:00100000:0.0:1767320353.261443:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320353.261510:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940755072:0@lo:38:kworker.0
00000100:00100000:0.0:1767320353.261535:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320353.261585:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755072
00000100:00100000:0.0:1767320353.261592:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755072
00000100:00100000:0.0:1767320353.261633:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285
00000100:00100000:0.0:1767320353.261640:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940755072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320353.261660:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320353.261795:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940754944
00000100:00100000:1.0:1767320353.261800:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940754944
00000100:00100000:1.0:1767320353.261827:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17802
00000100:00100000:1.0:1767320353.261831:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940754944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320353.261842:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320353.261887:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940754944:12345-0@lo:38:kworker.0 Request processed in 54us (444us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320353.261894:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17802
00000100:00080000:1.0:1767320353.261950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320353.261955:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320353.261958:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940754944:0@lo:38:kworker.0
00000100:00100000:0.0:1767320353.262137:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940755072:12345-0@lo:38:kworker.0 Request processed in 497us (601us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320353.262144:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285
00000100:00080000:1.0:1767320353.262354:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320353.262359:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320353.262361:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940755072:0@lo:38:kworker.0
00000100:00100000:3.0:1767320353.262571:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940755456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320353.262618:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320353.262929:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940755200:0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.262964:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320353.262995:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320353.263002:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940755328:0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.263024:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320353.263068:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755200
00000100:00100000:1.0:1767320353.263073:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755200
00000100:00100000:1.0:1767320353.263134:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755328
00000100:00100000:1.0:1767320353.263137:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755328
00000100:00100000:1.0:1767320353.263156:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257
00000100:00100000:1.0:1767320353.263163:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940755200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.263206:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940755200:12345-0@lo:400:kworker.0 Request processed in 44us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320353.263213:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257
00000100:00100000:1.0:1767320353.263226:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258
00000100:00100000:1.0:1767320353.263232:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940755328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.263272:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940755328:12345-0@lo:400:kworker.0 Request processed in 40us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320353.263278:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258
00000100:00080000:1.0:1767320353.263298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320353.263324:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940755328:0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.263333:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940755200:0@lo:400:kworker.0
00000100:00080000:2.0:1767320353.263578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320353.263583:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320353.263587:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320353.263592:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5598
00000100:00080000:2.0:1767320353.263596:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320353.263600:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320353.263633:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8000 x1853163940755584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320353.263732:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755456
00000100:00100000:0.0:1767320353.263737:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755456
00000100:00100000:0.0:1767320353.263792:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042
00000100:00100000:0.0:1767320353.263800:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940755456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320353.264880:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940755584:0@lo:38:kworker.0
00000100:00100000:1.0:1767320353.264948:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320353.265224:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320353.265349:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755584
00000100:00100000:1.0:1767320353.265983:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755584
00000100:00100000:1.0:1767320353.266038:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17803
00000100:00100000:1.0:1767320353.266045:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940755584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320353.266067:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320353.267558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320353.267567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320353.267571:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320353.267579:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5598
00000100:00080000:2.0:1767320353.267583:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320353.267589:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320353.267623:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8380 x1853163940755840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320353.267761:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940755712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320353.267816:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320353.267865:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755712
00000100:00100000:2.0:1767320353.267871:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755712
00000100:00100000:2.0:1767320353.268015:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043
00000100:00100000:2.0:1767320353.268024:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940755712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320353.268069:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940755712:12345-0@lo:400:kworker.0 Request processed in 47us (253us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320353.268076:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043
00000100:00080000:2.0:1767320353.268108:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320353.268138:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940755712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320353.268198:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940755840:0@lo:38:kworker.0
00000100:00100000:2.0:1767320353.268225:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320353.268788:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940755584:12345-0@lo:38:kworker.0 Request processed in 2740us (3837us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320353.268798:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17803
00000100:00100000:1.0:1767320353.268829:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755840
00000100:00100000:1.0:1767320353.268834:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755840
00000100:00100000:1.0:1767320353.268857:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17804
00000100:00100000:1.0:1767320353.268862:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940755840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320353.268881:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320353.268919:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940755840:12345-0@lo:38:kworker.0 Request processed in 55us (693us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320353.268926:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17804
00000100:00100000:0.0:1767320353.270543:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940755456:12345-0@lo:400:kworker.0 Request processed in 6738us (7917us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320353.270555:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042
00000100:00100000:3.0:1767320353.270655:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940755456:0@lo:400:kworker.0
00000100:00080000:2.0:1767320353.271033:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320353.271040:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320353.271044:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940755584:0@lo:38:kworker.0
00000100:00080000:2.0:1767320353.271069:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320353.271073:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320353.271075:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940755840:0@lo:38:kworker.0
00000400:00000100:3.0:1767320353.864160:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894370048 offset 0 length 520: 4
00000100:00100000:3.0:1767320353.864222:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320353.864572:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370176
00000100:00100000:0.0:1767320353.864583:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370176
00000100:00100000:1.0:1767320353.864654:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320353.868413:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370304
00000100:00100000:0.0:1767320353.868428:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370304
00000100:00100000:0.0:1767320353.868517:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5044
00000100:00100000:0.0:1767320353.868527:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370304:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320353.868606:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370304:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (3961us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320353.868614:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5044
00000100:00100000:0.0:1767320353.868634:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17805
00000100:00100000:0.0:1767320353.868639:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370176:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320353.868660:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320353.868686:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370176:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (4464us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320353.868692:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17805
00000100:00080000:1.0:1767320353.869687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320353.965694:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320354.221024:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320354.988922:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320355.246675:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320356.012956:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320356.269035:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320356.845071:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320356.845112:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940755968:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320356.845188:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320356.845569:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940755968
00000100:00100000:2.0:1767320356.845579:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940755968
00000100:00100000:2.0:1767320356.845651:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1767320356.845661:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940755968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320356.845692:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320356.845742:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940755968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (554us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320356.845750:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1767320356.845818:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940755968:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320356.845951:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320357.037607:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320357.293034:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320357.870311:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940756096:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320357.870386:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320357.870546:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756096
00000100:00100000:0.0:1767320357.870555:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756096
00000100:00100000:0.0:1767320357.870617:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827
00000100:00100000:0.0:1767320357.870626:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940756096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320357.870656:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320357.870700:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940756096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320357.870708:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827
00000100:00100000:2.0:1767320357.870825:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940756096:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320357.871504:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320358.060877:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320358.317027:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320358.381844:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320358.381853:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320358.381855:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320358.381858:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320358.381862:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320358.381870:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5603
00000100:00080000:3.0:1767320358.381874:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320358.381881:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320358.381919:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeb0000 x1853163940756224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320358.381947:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320358.381950:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320358.381952:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320358.381955:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5603
00000100:00080000:3.0:1767320358.381956:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320358.381959:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320358.381972:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9e9f80 x1853163940756352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320358.382025:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320358.382028:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320358.382040:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320358.382043:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5603
00000100:00080000:3.0:1767320358.382045:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320358.382049:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320358.382058:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965880 x1853163940756864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320358.382072:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320358.382074:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320358.382076:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320358.382078:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5603
00000100:00080000:3.0:1767320358.382080:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320358.382083:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320358.382090:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965f80 x1853163940757120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320358.382113:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940756736:0@lo:400:kworker.0
00000100:00100000:3.0:1767320358.382193:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320358.382347:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940756224:0@lo:38:kworker.0
00000100:00100000:1.0:1767320358.382376:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320358.382417:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940756352:0@lo:38:kworker.0
00000100:00100000:1.0:1767320358.382438:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320358.382452:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940756864:0@lo:38:kworker.0
00000100:00100000:1.0:1767320358.382468:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320358.382479:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940757120:0@lo:38:kworker.0
00000100:00100000:1.0:1767320358.382492:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320358.382523:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756736
00000100:00100000:1.0:1767320358.382530:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756736
00000100:00100000:1.0:1767320358.382581:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756224
00000100:00100000:1.0:1767320358.382583:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756224
00000100:00100000:1.0:1767320358.382594:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756864
00000100:00100000:1.0:1767320358.382596:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756864
00000100:00100000:1.0:1767320358.382601:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757120
00000100:00100000:1.0:1767320358.382603:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757120
00000100:00100000:1.0:1767320358.382615:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5045
00000100:00100000:1.0:1767320358.382622:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940756736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320358.382669:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940756736:12345-0@lo:400:kworker.0 Request processed in 47us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320358.382675:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5045
00000100:00100000:1.0:1767320358.382691:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17806
00000100:00100000:1.0:1767320358.382695:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940756224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320358.382713:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320358.382741:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940756224:12345-0@lo:38:kworker.0 Request processed in 44us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320358.382747:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17806
00000100:00100000:1.0:1767320358.382759:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17807
00000100:00100000:1.0:1767320358.382762:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940756864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320358.382799:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320358.382822:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940756864:12345-0@lo:38:kworker.0 Request processed in 58us (353us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320358.382828:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17807
00000100:00100000:1.0:1767320358.382840:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17808
00000100:00100000:1.0:1767320358.382843:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940757120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320358.382852:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320358.382872:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940757120:12345-0@lo:38:kworker.0 Request processed in 27us (379us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320358.382877:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17808
00000100:00100000:1.0:1767320358.382894:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756352
00000100:00100000:1.0:1767320358.382898:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756352
00000100:00100000:1.0:1767320358.382915:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286
00000100:00100000:1.0:1767320358.382919:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940756352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320358.382929:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320358.382951:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940756352:12345-0@lo:38:kworker.0 Request processed in 30us (512us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320358.382957:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286
00000100:00080000:1.0:1767320358.382977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320358.383002:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320358.383006:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320358.383010:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940756224:0@lo:38:kworker.0
00000100:00080000:1.0:1767320358.383020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320358.383022:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320358.383025:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940756352:0@lo:38:kworker.0
00000100:00080000:1.0:1767320358.383047:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320358.383051:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320358.383053:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940756864:0@lo:38:kworker.0
00000100:00080000:1.0:1767320358.383062:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320358.383064:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320358.383067:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940757120:0@lo:38:kworker.0
00000100:00100000:2.0:1767320358.383171:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940756608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383204:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320358.383249:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320358.383255:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940756480:0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383275:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320358.383308:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756608
00000100:00100000:2.0:1767320358.383312:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756608
00000100:00100000:2.0:1767320358.383339:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756480
00000100:00100000:2.0:1767320358.383342:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756480
00000100:00100000:2.0:1767320358.383367:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259
00000100:00100000:2.0:1767320358.383373:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940756608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383408:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940756608:12345-0@lo:400:kworker.0 Request processed in 35us (202us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320358.383414:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259
00000100:00100000:2.0:1767320358.383426:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260
00000100:00100000:2.0:1767320358.383432:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940756480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383457:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940756480:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320358.383466:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260
00000100:00080000:2.0:1767320358.383482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320358.383499:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940756480:0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383509:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940756608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383536:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940756992:0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383558:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320358.383584:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940756992
00000100:00100000:2.0:1767320358.383588:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940756992
00000100:00100000:2.0:1767320358.383614:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5046
00000100:00100000:2.0:1767320358.383618:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940756992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320358.383649:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940756992:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320358.383655:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5046
00000100:00080000:2.0:1767320358.383670:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320358.383684:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940756992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320358.383890:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940756736:0@lo:400:kworker.0
00000100:00100000:3.0:1767320358.982216:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320358.982389:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320358.982522:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370560
00000100:00100000:0.0:1767320358.982532:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370560
00000100:00100000:0.0:1767320358.982597:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370432
00000100:00100000:0.0:1767320358.982599:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370432
00000100:00100000:0.0:1767320358.982618:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5047
00000100:00100000:0.0:1767320358.982626:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370560:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320358.982699:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370560:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 72us (491us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320358.982705:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320358.982706:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5047
00000100:00100000:0.0:1767320358.982724:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17809
00000100:00100000:0.0:1767320358.982728:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370432:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320358.982762:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320358.986144:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370432:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 3402us (3743us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320358.986157:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17809
00000100:00100000:3.0:1767320359.084856:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320359.341736:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320360.110004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320360.365821:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320361.132869:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320361.389135:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320361.965098:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940757248:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320361.965180:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320361.965327:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757248
00000100:00100000:2.0:1767320361.965336:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757248
00000100:00100000:2.0:1767320361.965404:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828
00000100:00100000:2.0:1767320361.965413:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940757248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320361.965442:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320361.965493:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940757248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320361.965501:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828
00000100:00080000:0.0:1767320361.966036:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320361.966077:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940757248:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320362.156891:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320362.412965:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320362.476937:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320337/real 1767320337]  req@ffff93cf4433ca80 x1853163940751104/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320362.476971:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4433ca80 x1853163940751104/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320362.476990:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320362.477022:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320362.477026:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4433ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940751104:0@lo:250:kworker.0
00000100:00080000:3.0:1767320362.477355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320362.477361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320362.477365:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320362.477369:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5587
00000100:00080000:3.0:1767320362.477373:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320362.477380:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320362.477415:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967100 x1853163940757376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320362.477477:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940757376:0@lo:250:kworker.0
00000400:00000100:1.0:1767320362.477521:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940757376 offset 0 length 520: 4
00000100:00080000:3.0:1767320362.477579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320362.477583:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320362.477585:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320362.477588:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5608
00000100:00080000:3.0:1767320362.477591:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320362.477595:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320362.477620:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47965500 x1853163940757504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320362.486666:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940757504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320362.486751:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320362.487017:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757504
00000100:00100000:0.0:1767320362.487026:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757504
00000100:00100000:0.0:1767320362.487076:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17810
00000100:00100000:0.0:1767320362.487084:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940757504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320362.487107:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320362.487171:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940757504:12345-0@lo:38:kworker.0 Request processed in 87us (419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320362.487179:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17810
00000100:00080000:2.0:1767320362.487720:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320362.487727:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320362.487730:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940757504:0@lo:38:kworker.0
00000100:00080000:3.0:1767320362.487924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320362.487930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320362.487933:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320362.487937:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5608
00000100:00080000:3.0:1767320362.487941:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320362.487946:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320362.487976:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47967b80 x1853163940757632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320362.488063:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940757760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320362.488108:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320362.488166:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757760
00000100:00100000:1.0:1767320362.488172:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757760
00000100:00100000:1.0:1767320362.488216:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261
00000100:00100000:1.0:1767320362.488234:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940757760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320362.488308:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940757632:0@lo:38:kworker.0
00000100:00100000:2.0:1767320362.488338:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320362.488568:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757632
00000100:00100000:3.0:1767320362.488573:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757632
00000100:00100000:3.0:1767320362.488609:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287
00000100:00100000:3.0:1767320362.488614:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940757632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320362.488634:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320362.488672:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940757632:12345-0@lo:38:kworker.0 Request processed in 57us (333us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320362.488679:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287
00000100:00080000:3.0:1767320362.488710:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320362.488714:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320362.488718:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940757632:0@lo:38:kworker.0
00000100:00080000:2.0:1767320362.488835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320362.488838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320362.488840:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320362.488845:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5608
00000100:00080000:2.0:1767320362.488847:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320362.488851:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320362.488863:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8700 x1853163940758144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320362.488920:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940757888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.488945:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320362.488964:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320362.488969:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940758016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.488990:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320362.489025:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940758144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320362.489045:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320362.489086:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940758272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489108:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320362.489139:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940757888
00000100:00100000:3.0:1767320362.489143:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940757888
00000100:00100000:3.0:1767320362.489178:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262
00000100:00100000:3.0:1767320362.489186:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940757888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489234:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940757888:12345-0@lo:400:kworker.0 Request processed in 50us (287us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320362.489241:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262
00000100:00080000:3.0:1767320362.489258:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320362.489278:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940757888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489315:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758016
00000100:00100000:3.0:1767320362.489318:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758016
00000100:00100000:3.0:1767320362.489347:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758144
00000100:00100000:3.0:1767320362.489349:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758144
00000100:00100000:3.0:1767320362.489363:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758272
00000100:00100000:3.0:1767320362.489365:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758272
00000100:00100000:3.0:1767320362.489384:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5048
00000100:00100000:3.0:1767320362.489390:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940758016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489421:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940758016:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320362.489427:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5048
00000100:00100000:3.0:1767320362.489439:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5049
00000100:00100000:3.0:1767320362.489444:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940758272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489474:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940758272:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320362.489480:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5049
00000100:00100000:3.0:1767320362.489492:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17811
00000100:00100000:3.0:1767320362.489496:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940758144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320362.489509:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320362.489537:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940758144:12345-0@lo:38:kworker.0 Request processed in 39us (491us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320362.489542:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17811
00000100:00080000:3.0:1767320362.489561:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320362.489577:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940758016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.489597:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940758272:0@lo:400:kworker.0
00000100:00080000:3.0:1767320362.489618:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320362.489622:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320362.489626:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940758144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320362.491072:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940757760:12345-0@lo:400:kworker.0 Request processed in 2831us (2955us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320362.491084:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261
00000100:00080000:2.0:1767320362.491350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320362.491355:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320362.491358:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320362.491362:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5608
00000100:00080000:2.0:1767320362.491366:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320362.491370:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320362.491402:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ead8700 x1853163940758400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320362.491486:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940758400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320362.491534:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320362.491613:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758400
00000100:00100000:2.0:1767320362.491758:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758400
00000100:00100000:2.0:1767320362.491804:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17812
00000100:00100000:2.0:1767320362.491810:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940758400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320362.491828:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320362.491871:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940758400:12345-0@lo:38:kworker.0 Request processed in 60us (337us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320362.491877:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17812
00000100:00080000:1.0:1767320362.491950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320362.491954:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320362.491958:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940758400:0@lo:38:kworker.0
00000100:00100000:0.0:1767320362.492129:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940757760:0@lo:400:kworker.0
00000100:00100000:3.0:1767320362.989282:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320362.989306:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940758528:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320362.989373:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320362.989533:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758528
00000100:00100000:1.0:1767320362.989541:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758528
00000100:00100000:1.0:1767320362.989598:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1767320362.989609:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940758528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320362.989639:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320362.989685:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940758528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (311us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320362.989692:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1767320362.989747:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940758528:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320363.181865:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320363.437691:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320364.108323:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320364.108416:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320364.108528:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370816
00000100:00100000:1.0:1767320364.108539:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370816
00000100:00100000:2.0:1767320364.108547:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370688
00000100:00100000:2.0:1767320364.108555:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370688
00000100:00100000:2.0:1767320364.108683:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5050
00000100:00100000:2.0:1767320364.108699:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370816:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767320364.108709:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320364.108817:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894370816:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 121us (502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320364.108824:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5050
00000100:00100000:2.0:1767320364.108843:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17813
00000100:00100000:2.0:1767320364.108848:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370688:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320364.108867:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320364.108892:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370688:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 42us (476us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320364.108897:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17813
00000100:00100000:3.0:1767320364.205068:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320364.461268:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320365.229009:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320365.485021:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320366.253004:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320366.509006:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320367.085026:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320367.085050:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940758656:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320367.085117:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320367.085283:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758656
00000100:00100000:2.0:1767320367.085292:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758656
00000100:00100000:2.0:1767320367.085359:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830
00000100:00100000:2.0:1767320367.085369:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940758656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320367.085409:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320367.085458:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940758656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (340us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320367.085464:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830
00000100:00100000:2.0:1767320367.085514:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940758656:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320367.085915:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320367.276929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320367.535381:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320367.596988:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320367.597000:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320367.597003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320367.597007:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320367.597011:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320367.597019:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5612
00000100:00080000:0.0:1767320367.597024:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320367.597031:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320367.597074:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221f80 x1853163940758784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320367.597098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320367.597102:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320367.597104:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320367.597107:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5612
00000100:00080000:0.0:1767320367.597109:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320367.597112:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320367.597123:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45220e00 x1853163940758912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320367.597179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320367.597182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320367.597183:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320367.597187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5612
00000100:00080000:0.0:1767320367.597189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320367.597193:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320367.597204:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb95f80 x1853163940759296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320367.597219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320367.597222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320367.597223:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320367.597227:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5612
00000100:00080000:0.0:1767320367.597229:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320367.597232:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320367.597242:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb97480 x1853163940759552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320367.597271:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940759424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.597344:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320367.597411:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320367.597417:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940759168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.597439:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320367.597468:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759424
00000100:00100000:0.0:1767320367.597476:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759424
00000100:00100000:0.0:1767320367.597522:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759168
00000100:00100000:0.0:1767320367.597525:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759168
00000100:00100000:0.0:1767320367.597549:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5051
00000100:00100000:0.0:1767320367.597556:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940759424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.597601:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940759424:12345-0@lo:400:kworker.0 Request processed in 45us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320367.597607:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5051
00000100:00100000:0.0:1767320367.597635:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052
00000100:00100000:0.0:1767320367.597641:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940759168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.597667:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940759168:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320367.597672:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052
00000100:00080000:0.0:1767320367.597688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320367.597715:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940759168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.597724:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940759424:0@lo:400:kworker.0
00000100:00100000:3.0:1767320367.597885:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320367.597894:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320367.597927:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320367.598022:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759040
00000100:00100000:0.0:1767320367.598026:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759040
00000100:00100000:1.0:1767320367.598130:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940758784:0@lo:38:kworker.0
00000100:00100000:1.0:1767320367.598157:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320367.598173:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940758912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320367.598191:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320367.598206:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940759296:0@lo:38:kworker.0
00000100:00100000:1.0:1767320367.598223:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320367.598238:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940759552:0@lo:38:kworker.0
00000100:00100000:1.0:1767320367.598258:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320367.598293:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758784
00000100:00100000:1.0:1767320367.598296:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758784
00000100:00100000:1.0:1767320367.598317:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759296
00000100:00100000:1.0:1767320367.598319:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759296
00000100:00100000:1.0:1767320367.598326:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759552
00000100:00100000:1.0:1767320367.598329:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759552
00000100:00100000:1.0:1767320367.598337:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17814
00000100:00100000:1.0:1767320367.598342:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940758784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320367.598358:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320367.598403:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940758784:12345-0@lo:38:kworker.0 Request processed in 59us (244us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320367.598408:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17814
00000100:00100000:1.0:1767320367.598420:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17815
00000100:00100000:1.0:1767320367.598424:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940759296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320367.598432:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320367.598453:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940759296:12345-0@lo:38:kworker.0 Request processed in 27us (229us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320367.598458:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17815
00000100:00100000:1.0:1767320367.598468:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17816
00000100:00100000:1.0:1767320367.598471:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940759552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320367.598480:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320367.598501:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940759552:12345-0@lo:38:kworker.0 Request processed in 28us (243us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320367.598506:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17816
00000100:00100000:1.0:1767320367.598522:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940758912
00000100:00100000:1.0:1767320367.598525:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940758912
00000100:00100000:1.0:1767320367.598544:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288
00000100:00100000:1.0:1767320367.598547:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940758912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320367.598555:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320367.598576:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940758912:12345-0@lo:38:kworker.0 Request processed in 28us (384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320367.598806:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263
00000100:00100000:0.0:1767320367.598818:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320367.598874:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759040:12345-0@lo:400:kworker.0 Request processed in 62us (946us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320367.598885:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263
00000100:00080000:0.0:1767320367.598994:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320367.598999:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320367.599005:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940758784:0@lo:38:kworker.0
00000100:00080000:0.0:1767320367.599019:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320367.599025:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320367.599030:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940758912:0@lo:38:kworker.0
00000100:00080000:0.0:1767320367.599043:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320367.599046:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320367.599051:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940759296:0@lo:38:kworker.0
00000100:00080000:0.0:1767320367.599059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320367.599063:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320367.599066:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940759552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320367.599246:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759040:0@lo:400:kworker.0
00000100:00100000:1.0:1767320367.600618:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288
00000100:00080000:3.0:1767320367.603819:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320368.109058:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759680:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320368.109132:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320368.109341:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759680
00000100:00100000:1.0:1767320368.109349:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759680
00000100:00100000:1.0:1767320368.109396:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831
00000100:00100000:1.0:1767320368.109405:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320368.109542:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320368.109630:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 226us (497us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320368.109637:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831
00000100:00100000:2.0:1767320368.114671:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759680:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320368.300880:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320368.557116:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320369.223508:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320369.223560:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320369.223665:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371072
00000100:00100000:2.0:1767320369.223676:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371072
00000100:00100000:0.0:1767320369.223713:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894370944
00000100:00100000:0.0:1767320369.223719:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894370944
00000100:00080000:3.0:1767320369.223792:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320369.223861:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5053
00000100:00100000:2.0:1767320369.223872:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894371072:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320369.223971:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894371072:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 101us (483us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320369.223979:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5053
00000100:00100000:2.0:1767320369.224138:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17817
00000100:00100000:2.0:1767320369.224143:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370944:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320369.224164:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320369.224202:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894370944:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (641us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320369.224208:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17817
00000100:00100000:3.0:1767320369.326815:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320369.581356:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320370.348915:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320370.605512:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320371.372904:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320371.629023:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320372.211237:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320372.211263:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759808:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320372.211336:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320372.211515:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759808
00000100:00100000:1.0:1767320372.211524:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759808
00000100:00080000:3.0:1767320372.211573:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320372.211593:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832
00000100:00100000:1.0:1767320372.211604:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320372.211638:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320372.211706:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940759808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320372.211718:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832
00000100:00100000:2.0:1767320372.211966:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940759808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320372.396968:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320372.653063:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320372.717571:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320372.717581:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320372.717585:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320372.717597:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320372.717601:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320372.717610:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5617
00000100:00080000:3.0:1767320372.717614:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320372.717622:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320372.717671:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399df80 x1853163940759936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320372.717699:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320372.717703:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320372.717705:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320372.717708:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5617
00000100:00080000:3.0:1767320372.717711:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320372.717715:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320372.717730:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399fb80 x1853163940760064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320372.717738:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940759936:0@lo:38:kworker.0
00000100:00080000:3.0:1767320372.717815:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320372.717818:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320372.717820:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320372.717824:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5617
00000100:00080000:3.0:1767320372.717826:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320372.717830:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320372.717840:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399dc00 x1853163940760448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320372.717861:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320372.717864:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320372.717866:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320372.717869:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5617
00000100:00080000:3.0:1767320372.717871:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320372.717874:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320372.717883:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4399c700 x1853163940760704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320372.718173:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940760192:0@lo:400:kworker.0
00000100:00100000:2.0:1767320372.718231:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940760576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320372.718273:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940760320:0@lo:400:kworker.0
00000100:00100000:1.0:1767320372.718537:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320372.719186:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320372.719270:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940759936
00000100:00100000:3.0:1767320372.719288:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940759936
00000100:00100000:3.0:1767320372.719338:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17818
00000100:00100000:3.0:1767320372.719345:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940759936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320372.719367:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320372.719409:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940759936:12345-0@lo:38:kworker.0 Request processed in 62us (872us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320372.719416:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17818
00000100:00100000:3.0:1767320372.719448:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760192
00000100:00100000:3.0:1767320372.719452:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760192
00000100:00100000:3.0:1767320372.719492:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264
00000100:00100000:3.0:1767320372.719501:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940760192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320372.719542:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940760192:12345-0@lo:400:kworker.0 Request processed in 44us (356us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320372.719551:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264
00000100:00080000:3.0:1767320372.719571:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320372.719598:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940760192:0@lo:400:kworker.0
00000100:00080000:1.0:1767320372.721073:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320372.721441:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320372.723936:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320372.724219:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320372.726150:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760576
00000100:00100000:3.0:1767320372.726164:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760576
00000100:00100000:3.0:1767320372.726220:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760320
00000100:00100000:3.0:1767320372.726223:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760320
00000100:00100000:3.0:1767320372.726246:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5054
00000100:00100000:3.0:1767320372.726254:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940760576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320372.726428:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055
00000100:00100000:0.0:1767320372.726438:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940760320:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320372.726497:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940760320:12345-0@lo:400:kworker.0 Request processed in 62us (2279us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320372.726505:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055
00000100:00080000:0.0:1767320372.726528:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320372.726558:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940760320:0@lo:400:kworker.0
00000100:00100000:3.0:1767320372.727211:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940760576:12345-0@lo:400:kworker.0 Request processed in 955us (6126us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320372.727219:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5054
00000100:00100000:0.0:1767320372.729610:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940760576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320372.734303:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940759936:0@lo:38:kworker.0
00000100:00100000:1.0:1767320372.734349:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940760064:0@lo:38:kworker.0
00000100:00100000:1.0:1767320372.734418:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320372.734533:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940760448:0@lo:38:kworker.0
00000100:00100000:1.0:1767320372.734557:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320372.734584:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940760704:0@lo:38:kworker.0
00000100:00100000:1.0:1767320372.734601:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320372.736278:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760448
00000100:00100000:0.0:1767320372.736290:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760448
00000100:00100000:0.0:1767320372.736341:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760704
00000100:00100000:0.0:1767320372.736343:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760704
00000100:00100000:0.0:1767320372.736366:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17819
00000100:00100000:0.0:1767320372.736373:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940760448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320372.736396:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320372.736456:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940760448:12345-0@lo:38:kworker.0 Request processed in 83us (1897us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320372.736462:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17819
00000100:00100000:0.0:1767320372.736477:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17820
00000100:00100000:0.0:1767320372.736481:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940760704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320372.736489:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320372.736508:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940760704:12345-0@lo:38:kworker.0 Request processed in 27us (1907us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320372.736513:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17820
00000100:00080000:1.0:1767320372.736615:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320372.736620:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320372.736624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940760448:0@lo:38:kworker.0
00000100:00080000:1.0:1767320372.736631:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320372.736634:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320372.736636:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940760704:0@lo:38:kworker.0
00000100:00100000:3.0:1767320372.743649:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760064
00000100:00100000:3.0:1767320372.743664:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760064
00000100:00100000:3.0:1767320372.743726:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289
00000100:00100000:3.0:1767320372.743734:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940760064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320372.743760:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320372.743872:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940760064:12345-0@lo:38:kworker.0 Request processed in 137us (9452us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320372.743879:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289
00000100:00080000:1.0:1767320372.744028:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320372.744033:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320372.744037:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4399fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940760064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320373.229055:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320373.229077:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940760832:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320373.229141:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320373.229324:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760832
00000100:00100000:1.0:1767320373.229332:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760832
00000100:00100000:1.0:1767320373.229375:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833
00000100:00100000:1.0:1767320373.229383:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940760832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320373.229410:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320373.229458:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940760832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320373.229465:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833
00000100:00100000:0.0:1767320373.229537:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940760832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320373.421118:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320373.677231:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320374.352666:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320374.352724:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320374.354312:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371328
00000100:00100000:2.0:1767320374.354329:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371328
00000100:00100000:1.0:1767320374.354352:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371200
00000100:00100000:1.0:1767320374.354359:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371200
00000100:00100000:1.0:1767320374.354425:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5056
00000100:00080000:0.0:1767320374.354434:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320374.354437:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894371328:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320374.354525:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894371328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 92us (1869us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320374.354532:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5056
00000100:00100000:1.0:1767320374.354550:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17821
00000100:00100000:1.0:1767320374.354553:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894371200:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320374.354573:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320374.354612:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894371200:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (1888us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320374.354618:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17821
00000100:00100000:3.0:1767320374.445397:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320374.701115:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320375.469210:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320375.725137:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320376.492979:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320376.749046:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320377.325052:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320377.325076:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940760960:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320377.325144:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320377.325247:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940760960
00000100:00100000:3.0:1767320377.325256:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940760960
00000100:00080000:1.0:1767320377.325307:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320377.325366:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834
00000100:00100000:3.0:1767320377.325379:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940760960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320377.325409:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320377.325461:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940760960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (317us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320377.325469:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834
00000100:00100000:1.0:1767320377.325507:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940760960:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320377.516896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320377.776201:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320377.837984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320377.837993:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320377.837996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320377.838000:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320377.838004:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320377.838011:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5622
00000100:00080000:2.0:1767320377.838016:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320377.838022:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320377.838061:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cca80 x1853163940761088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320377.838091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320377.838095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320377.838097:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320377.838100:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5622
00000100:00080000:2.0:1767320377.838103:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320377.838106:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320377.838120:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337100 x1853163940761216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320377.838198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320377.838201:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320377.838203:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320377.838207:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5622
00000100:00080000:2.0:1767320377.838210:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320377.838214:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320377.838223:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320377.838228:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334380 x1853163940761600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320377.838242:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940761344:0@lo:400:kworker.0
00000100:00100000:0.0:1767320377.838313:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320377.838396:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940761472:0@lo:400:kworker.0
00000100:00100000:0.0:1767320377.838421:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320377.838549:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940761088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320377.838581:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320377.838585:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761344
00000100:00100000:3.0:1767320377.838595:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761344
00000100:00100000:1.0:1767320377.838609:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940761216:0@lo:38:kworker.0
00000100:00100000:1.0:1767320377.838634:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320377.838653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940761600:0@lo:38:kworker.0
00000100:00100000:3.0:1767320377.838660:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265
00000100:00100000:1.0:1767320377.838675:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320377.838675:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940761344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320377.838703:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761216
00000100:00100000:1.0:1767320377.838707:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761216
00000100:00100000:1.0:1767320377.838728:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290
00000100:00100000:1.0:1767320377.838734:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940761216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320377.838752:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320377.838817:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940761216:12345-0@lo:38:kworker.0 Request processed in 81us (182us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320377.838824:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290
00000100:00100000:1.0:1767320377.838845:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761472
00000100:00100000:1.0:1767320377.838849:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761472
00000100:00100000:1.0:1767320377.838888:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761088
00000100:00100000:1.0:1767320377.838891:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761088
00000100:00100000:1.0:1767320377.838901:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761600
00000100:00100000:1.0:1767320377.838904:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761600
00000100:00100000:1.0:1767320377.838916:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5057
00000100:00100000:1.0:1767320377.838921:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940761472:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320377.838951:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17822
00000100:00100000:0.0:1767320377.838957:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940761088:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320377.838964:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940761472:12345-0@lo:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0
00010000:00020000:0.0:1767320377.838970:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320377.838971:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5057
00000100:00100000:1.0:1767320377.838988:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17823
00000100:00100000:1.0:1767320377.838993:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940761600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320377.839003:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320377.839009:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940761088:12345-0@lo:38:kworker.0 Request processed in 50us (428us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320377.839017:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17822
00000100:00100000:1.0:1767320377.839032:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940761600:12345-0@lo:38:kworker.0 Request processed in 37us (360us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320377.839039:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17823
00000100:00080000:0.0:1767320377.839075:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320377.839082:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320377.839099:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940761472:0@lo:400:kworker.0
00000100:00080000:0.0:1767320377.839107:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320377.839114:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320377.839118:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940761088:0@lo:38:kworker.0
00000100:00080000:0.0:1767320377.839131:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320377.839135:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320377.839139:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940761216:0@lo:38:kworker.0
00000100:00080000:0.0:1767320377.839148:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320377.839151:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320377.839154:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940761600:0@lo:38:kworker.0
00000100:00080000:2.0:1767320377.839415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320377.839419:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320377.839422:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320377.839426:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5622
00000100:00080000:2.0:1767320377.839429:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320377.839434:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320377.839450:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044334e00 x1853163940761856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320377.839595:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940761344:12345-0@lo:400:kworker.0 Request processed in 925us (1281us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320377.839604:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265
00000100:00100000:1.0:1767320377.839718:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320377.839729:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940761728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320377.839757:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320377.839845:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761728
00000100:00100000:3.0:1767320377.839850:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761728
00000100:00100000:3.0:1767320377.839900:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058
00000100:00100000:3.0:1767320377.839907:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940761728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320377.839941:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940761728:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320377.839947:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058
00000100:00100000:0.0:1767320377.840015:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940761856:0@lo:38:kworker.0
00000100:00100000:0.0:1767320377.840042:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320377.840113:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761856
00000100:00100000:3.0:1767320377.840117:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761856
00000100:00100000:3.0:1767320377.840152:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17824
00000100:00100000:3.0:1767320377.840156:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940761856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320377.840171:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320377.840204:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940761856:12345-0@lo:38:kworker.0 Request processed in 46us (160us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320377.840210:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17824
00000100:00080000:3.0:1767320377.840237:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320377.840241:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320377.840398:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940761856:0@lo:38:kworker.0
00000100:00080000:1.0:1767320377.840458:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320377.840490:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940761728:0@lo:400:kworker.0
00000100:00100000:2.0:1767320377.848946:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940761344:0@lo:400:kworker.0
00000100:00100000:2.0:1767320378.349442:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940761984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320378.349516:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320378.350041:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940761984
00000100:00100000:3.0:1767320378.350052:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940761984
00000100:00100000:3.0:1767320378.350390:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835
00000100:00100000:3.0:1767320378.350402:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940761984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320378.350434:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320378.350508:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940761984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (992us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320378.350515:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835
00000100:00100000:0.0:1767320378.350611:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940761984:0@lo:13:osp-pre-0-1.0
00000400:00000100:3.0:1767320378.445673:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894371456 offset 0 length 520: 4
00000100:00100000:3.0:1767320378.445737:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320378.445927:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320378.448957:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371584
00000100:00100000:0.0:1767320378.448976:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371584
00000100:00100000:0.0:1767320378.449048:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371712
00000100:00100000:0.0:1767320378.449051:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371712
00000100:00100000:0.0:1767320378.449105:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5059
00000100:00100000:0.0:1767320378.449113:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894371712:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320378.449156:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17825
00000100:00100000:2.0:1767320378.449171:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894371584:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320378.449199:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320378.449230:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894371712:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 113us (3299us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320378.449251:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5059
00000100:00100000:2.0:1767320378.449281:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894371584:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 108us (3541us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320378.449292:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17825
00000100:00080000:1.0:1767320378.453126:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320378.540923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320378.797248:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320379.564893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320379.821713:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320380.588984:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320380.845026:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320381.612917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320381.869588:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320382.446143:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320382.446179:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940762112:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320382.446284:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.460660:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762112
00000100:00100000:3.0:1767320382.460690:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762112
00000100:00100000:3.0:1767320382.460853:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836
00000100:00100000:3.0:1767320382.460868:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940762112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320382.460923:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320382.461430:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940762112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 564us (15144us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320382.461443:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836
00000100:00080000:1.0:1767320382.465182:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320382.465490:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940762112:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320382.637165:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320382.894053:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320382.957569:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320382.957586:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320382.957590:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320382.957595:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320382.957601:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320382.957612:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5627
00000100:00080000:0.0:1767320382.957619:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320382.957627:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320382.957687:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07bb96300 x1853163940762240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320382.957717:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320382.957721:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320382.957723:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320382.957727:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5627
00000100:00080000:0.0:1767320382.957729:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320382.957733:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320382.957753:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cca80 x1853163940762368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320382.957850:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320382.957854:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320382.957856:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320382.957860:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5627
00000100:00080000:0.0:1767320382.957863:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320382.957867:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320382.957880:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45221f80 x1853163940762752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320382.957915:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320382.957919:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320382.957921:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320382.957925:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5627
00000100:00080000:0.0:1767320382.957928:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320382.957932:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320382.957944:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760d500 x1853163940763008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320382.957976:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320382.957999:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940762880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320382.958095:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320382.958232:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940762624:0@lo:400:kworker.0
00000100:00100000:2.0:1767320382.958267:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320382.958300:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320382.958305:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940762496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320382.958333:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.958468:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940762240:0@lo:38:kworker.0
00000100:00100000:3.0:1767320382.958506:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.958524:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940762368:0@lo:38:kworker.0
00000100:00100000:3.0:1767320382.958555:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.958571:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940762752:0@lo:38:kworker.0
00000100:00100000:3.0:1767320382.958589:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.958609:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940763008:0@lo:38:kworker.0
00000100:00100000:3.0:1767320382.958629:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.958668:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762496
00000100:00100000:3.0:1767320382.958678:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762496
00000100:00100000:3.0:1767320382.958756:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266
00000100:00100000:3.0:1767320382.958767:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940762496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320382.958864:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940762496:12345-0@lo:400:kworker.0 Request processed in 97us (527us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320382.958873:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266
00000100:00100000:3.0:1767320382.958904:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762880
00000100:00100000:3.0:1767320382.958908:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762880
00000100:00100000:3.0:1767320382.958935:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762624
00000100:00100000:3.0:1767320382.958938:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762624
00000100:00100000:3.0:1767320382.958952:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762240
00000100:00100000:3.0:1767320382.958955:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762240
00000100:00100000:3.0:1767320382.958964:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762752
00000100:00100000:3.0:1767320382.958966:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762752
00000100:00100000:3.0:1767320382.958974:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763008
00000100:00100000:3.0:1767320382.958976:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763008
00000100:00100000:3.0:1767320382.958986:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060
00000100:00100000:3.0:1767320382.958993:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940762880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320382.959031:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940762880:12345-0@lo:400:kworker.0 Request processed in 38us (935us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320382.959038:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060
00000100:00100000:3.0:1767320382.959051:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061
00000100:00100000:3.0:1767320382.959057:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940762624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320382.959083:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940762624:12345-0@lo:400:kworker.0 Request processed in 27us (815us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320382.959088:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061
00000100:00100000:3.0:1767320382.959101:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17826
00000100:00100000:3.0:1767320382.959105:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940762240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320382.959128:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320382.959163:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940762240:12345-0@lo:38:kworker.0 Request processed in 56us (655us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320382.959169:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17826
00000100:00100000:3.0:1767320382.959181:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17827
00000100:00100000:3.0:1767320382.959185:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940762752:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320382.959195:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320382.959217:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940762752:12345-0@lo:38:kworker.0 Request processed in 30us (626us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320382.959223:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17827
00000100:00100000:3.0:1767320382.959234:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17828
00000100:00100000:3.0:1767320382.959238:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940763008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320382.959247:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320382.959269:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940763008:12345-0@lo:38:kworker.0 Request processed in 30us (639us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320382.959276:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17828
00000100:00080000:3.0:1767320382.959327:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320382.959332:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320382.959336:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07bb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940762240:0@lo:38:kworker.0
00000100:00080000:3.0:1767320382.959346:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320382.959349:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320382.959352:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940762752:0@lo:38:kworker.0
00000100:00080000:3.0:1767320382.959360:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320382.959364:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320382.959367:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940763008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320382.959620:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940762496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320382.959632:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940762624:0@lo:400:kworker.0
00000100:00100000:1.0:1767320382.962231:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940762368
00000100:00100000:1.0:1767320382.962254:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940762368
00000100:00100000:1.0:1767320382.962328:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291
00000100:00100000:1.0:1767320382.962338:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940762368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320382.962368:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320382.962565:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320382.962574:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320382.963020:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940762368:12345-0@lo:38:kworker.0 Request processed in 680us (4460us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320382.963029:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291
00000100:00080000:2.0:1767320382.963145:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320382.963152:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320382.963156:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940762368:0@lo:38:kworker.0
00000100:00100000:0.0:1767320382.963830:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940762880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320383.470162:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940763136:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320383.470278:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320383.470474:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763136
00000100:00100000:1.0:1767320383.470485:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763136
00000100:00100000:1.0:1767320383.470557:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837
00000100:00100000:1.0:1767320383.470567:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940763136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320383.470610:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320383.470664:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940763136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (386us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320383.470672:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837
00000100:00100000:0.0:1767320383.470865:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940763136:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320383.559054:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320383.559104:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320383.560438:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371840
00000100:00100000:1.0:1767320383.560458:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371840
00000100:00100000:1.0:1767320383.560534:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894371968
00000100:00100000:1.0:1767320383.560539:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894371968
00000100:00100000:1.0:1767320383.560625:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5062
00000100:00100000:1.0:1767320383.560638:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894371968:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320383.560746:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894371968:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 111us (1640us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320383.560756:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5062
00000100:00100000:1.0:1767320383.560823:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17829
00000100:00100000:1.0:1767320383.560827:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894371840:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320383.560855:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320383.560901:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2501:x1853163894371840:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 71us (1861us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320383.560908:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17829
00000100:00080000:3.0:1767320383.563467:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320383.662353:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320383.917591:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320384.684906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320384.941241:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320385.710461:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320385.965931:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320386.732918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320386.991202:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320387.053131:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320362/real 1767320362]  req@ffff93cf47967100 x1853163940757376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320387.053169:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf47967100 x1853163940757376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320387 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320387.053189:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320387.053210:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320387.053214:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940757376:0@lo:250:kworker.0
00000100:00080000:2.0:1767320387.053632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320387.053639:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320387.053644:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320387.053650:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5612
00000100:00080000:2.0:1767320387.053655:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320387.053668:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320387.053712:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044337100 x1853163940763264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320387.053738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320387.053741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320387.053743:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320387.053747:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5632
00000100:00080000:2.0:1767320387.053749:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320387.053752:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320387.053768:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335880 x1853163940763392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320387.053825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320387.053829:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320387.053831:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320387.053835:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5632
00000100:00080000:2.0:1767320387.053837:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320387.053841:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320387.053857:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d0469cca80 x1853163940763520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320387.053919:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320387.053923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320387.053925:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320387.053928:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5632
00000100:00080000:2.0:1767320387.053930:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320387.053934:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320387.053946:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940764032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320387.053960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320387.053963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320387.053965:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320387.053968:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5632
00000100:00080000:2.0:1767320387.053971:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320387.053974:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320387.053983:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f9f80 x1853163940764288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320387.054009:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940763776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320387.054152:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320387.054214:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320387.054219:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940763648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320387.054247:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320387.054271:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940763904:0@lo:400:kworker.0
00000100:00100000:2.0:1767320387.054299:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320387.054317:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320387.054321:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940764160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320387.054341:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320387.054371:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763776
00000100:00100000:2.0:1767320387.054379:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763776
00000100:00100000:2.0:1767320387.054435:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763648
00000100:00100000:2.0:1767320387.054439:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763648
00000100:00100000:2.0:1767320387.054462:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267
00000100:00100000:2.0:1767320387.054472:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940763776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.054662:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763904
00000100:00100000:0.0:1767320387.054666:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763904
00000100:00100000:0.0:1767320387.054701:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764160
00000100:00100000:0.0:1767320387.054705:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764160
00000100:00100000:0.0:1767320387.054728:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5063
00000100:00100000:0.0:1767320387.054735:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940763904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.054809:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940763904:12345-0@lo:400:kworker.0 Request processed in 73us (508us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320387.054816:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5063
00000100:00100000:0.0:1767320387.054832:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5064
00000100:00100000:0.0:1767320387.054838:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940764160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.054864:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940764160:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320387.054870:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5064
00000100:00100000:0.0:1767320387.054913:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940764160:0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.054924:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940763904:0@lo:400:kworker.0
00000100:00080000:0.0:1767320387.054960:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320387.054965:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320387.054967:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320387.054991:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268
00000100:00100000:0.0:1767320387.054998:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d074d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940763648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.055028:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d074d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940763648:12345-0@lo:400:kworker.0 Request processed in 31us (780us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320387.055045:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268
00000100:00100000:0.0:1767320387.055079:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940763648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320387.055089:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940763776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320387.055435:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940763776:12345-0@lo:400:kworker.0 Request processed in 962us (1281us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320387.055443:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267
00000100:00100000:3.0:1767320387.055653:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940763264:0@lo:250:kworker.0
00000400:00000100:3.0:1767320387.055684:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940763264 offset 0 length 520: 4
00000100:00100000:3.0:1767320387.055707:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940763392:0@lo:38:kworker.0
00000100:00100000:3.0:1767320387.055730:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320387.055765:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940763520:0@lo:38:kworker.0
00000100:00100000:3.0:1767320387.055821:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320387.055841:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940764032:0@lo:38:kworker.0
00000100:00100000:3.0:1767320387.055861:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320387.055879:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940764288:0@lo:38:kworker.0
00000100:00100000:3.0:1767320387.055899:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320387.055932:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763520
00000100:00100000:3.0:1767320387.055937:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763520
00000100:00100000:3.0:1767320387.055961:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292
00000100:00100000:3.0:1767320387.055967:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940763520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320387.055986:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320387.056019:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940763520:12345-0@lo:38:kworker.0 Request processed in 51us (198us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320387.056025:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292
00000100:00100000:2.0:1767320387.056435:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940763392
00000100:00100000:2.0:1767320387.056441:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940763392
00000100:00100000:2.0:1767320387.056459:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764032
00000100:00100000:2.0:1767320387.056462:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764032
00000100:00100000:2.0:1767320387.056475:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764288
00000100:00100000:2.0:1767320387.056477:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764288
00000100:00100000:2.0:1767320387.056492:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17830
00000100:00100000:2.0:1767320387.056496:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940763392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320387.056508:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320387.056552:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940763392:12345-0@lo:38:kworker.0 Request processed in 54us (821us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320387.056558:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17830
00000100:00100000:2.0:1767320387.056570:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17831
00000100:00100000:2.0:1767320387.056574:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940764032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320387.056583:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320387.056604:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940764032:12345-0@lo:38:kworker.0 Request processed in 29us (742us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320387.056609:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17831
00000100:00100000:2.0:1767320387.056619:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17832
00000100:00100000:2.0:1767320387.056622:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940764288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320387.056630:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320387.056651:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940764288:12345-0@lo:38:kworker.0 Request processed in 27us (750us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320387.056659:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17832
00000100:00080000:2.0:1767320387.056707:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320387.056712:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320387.056715:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940763392:0@lo:38:kworker.0
00000100:00080000:2.0:1767320387.056725:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320387.056728:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320387.056731:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d0469cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940763520:0@lo:38:kworker.0
00000100:00080000:2.0:1767320387.056738:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320387.056741:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320387.061262:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940764032:0@lo:38:kworker.0
00000100:00080000:2.0:1767320387.061315:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320387.061320:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320387.061323:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940764288:0@lo:38:kworker.0
00000100:00100000:0.0:1767320387.569915:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940764416:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320387.569995:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320387.570342:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764416
00000100:00100000:1.0:1767320387.570351:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764416
00000100:00100000:1.0:1767320387.570412:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838
00000100:00100000:1.0:1767320387.570422:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940764416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320387.570452:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320387.570510:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940764416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (514us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320387.570518:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838
00000100:00100000:0.0:1767320387.570607:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940764416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320387.756929:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320388.013458:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320388.589415:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940764544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320388.589489:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320388.589618:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764544
00000100:00100000:1.0:1767320388.589627:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764544
00000100:00100000:1.0:1767320388.589681:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839
00000100:00100000:1.0:1767320388.589691:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940764544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320388.589721:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320388.589801:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940764544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (311us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320388.589809:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839
00000100:00100000:3.0:1767320388.589905:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940764544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320388.682592:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320388.682697:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320388.683206:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372224
00000100:00100000:1.0:1767320388.683216:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372224
00000100:00100000:1.0:1767320388.683288:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372096
00000100:00100000:1.0:1767320388.683292:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372096
00000100:00080000:3.0:1767320388.683300:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320388.683314:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5065
00000100:00100000:1.0:1767320388.683325:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894372224:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320388.683340:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17833
00000100:00100000:3.0:1767320388.683348:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372096:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320388.683371:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320388.683491:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894372224:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 167us (909us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320388.683499:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5065
00000100:00100000:3.0:1767320388.689226:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372096:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 5863us (6516us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320388.689242:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17833
00000100:00100000:3.0:1767320388.781020:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320389.037020:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320389.804913:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320390.061094:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320390.829148:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320391.085003:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320391.853078:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320392.112996:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320392.180347:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320392.180358:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320392.180361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320392.180365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320392.180370:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320392.180377:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5637
00000100:00080000:0.0:1767320392.180381:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320392.180388:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320392.180425:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760e680 x1853163940764672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320392.180496:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940764672:0@lo:38:kworker.0
00000100:00100000:2.0:1767320392.180561:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320392.180953:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764672
00000100:00100000:3.0:1767320392.180961:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764672
00000100:00100000:3.0:1767320392.181051:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17834
00000100:00100000:3.0:1767320392.181060:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940764672:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320392.181081:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320392.181148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320392.181163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320392.181165:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320392.181169:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5637
00000100:00080000:0.0:1767320392.181172:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320392.181176:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320392.181195:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04760c380 x1853163940764800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320392.189654:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940764800:0@lo:38:kworker.0
00000100:00100000:2.0:1767320392.189751:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320392.190413:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764800
00000100:00100000:1.0:1767320392.190423:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764800
00000100:00100000:1.0:1767320392.190469:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293
00000100:00100000:1.0:1767320392.190477:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940764800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320392.192693:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320392.192804:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940764800:12345-0@lo:38:kworker.0 Request processed in 2324us (3051us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320392.193131:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293
00000100:00100000:3.0:1767320392.196475:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940764672:12345-0@lo:38:kworker.0 Request processed in 15406us (15905us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320392.196500:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17834
00000100:00080000:2.0:1767320392.200897:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320392.200911:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320392.200916:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940764672:0@lo:38:kworker.0
00000100:00080000:2.0:1767320392.200967:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320392.200971:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320392.200974:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04760c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940764800:0@lo:38:kworker.0
00000100:00080000:1.0:1767320392.202617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320392.202633:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320392.202637:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320392.202644:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320392.202649:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320392.202850:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940764928:0@lo:400:kworker.0
00000100:00100000:0.0:1767320392.202912:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320392.202967:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320392.202973:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940765056:0@lo:400:kworker.0
00000100:00100000:0.0:1767320392.203005:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320392.203038:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940765184:0@lo:400:kworker.0
00000100:00100000:2.0:1767320392.203054:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940764928
00000100:00100000:2.0:1767320392.203061:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940764928
00000100:00100000:0.0:1767320392.203062:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320392.203087:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765056
00000100:00100000:0.0:1767320392.203090:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765056
00000100:00100000:2.0:1767320392.203114:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269
00000100:00100000:2.0:1767320392.203122:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940764928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320392.203186:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940764928:12345-0@lo:400:kworker.0 Request processed in 64us (273us total) trans 0 rc 0/0
00000100:00080000:1.0:1767320392.203237:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320392.203263:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3df80 x1853163940765312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320392.203288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320392.203291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320392.203293:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320392.203297:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320392.203300:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320392.203304:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320392.203314:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3d880 x1853163940765568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320392.203366:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940764928:0@lo:400:kworker.0
00000100:00100000:3.0:1767320392.203411:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940765440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320392.203441:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320392.203470:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765184
00000100:00100000:3.0:1767320392.203473:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765184
00000100:00100000:3.0:1767320392.203500:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765440
00000100:00100000:3.0:1767320392.203503:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765440
00000100:00100000:3.0:1767320392.203524:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5066
00000100:00100000:3.0:1767320392.203531:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940765184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320392.203562:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940765184:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320392.203569:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5066
00000100:00100000:3.0:1767320392.203586:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067
00000100:00100000:3.0:1767320392.203592:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940765440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320392.203617:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940765440:12345-0@lo:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320392.203634:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067
00000100:00100000:3.0:1767320392.203671:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940765440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320392.204017:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270
00000100:00100000:0.0:1767320392.204027:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940765056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320392.204059:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940765056:12345-0@lo:400:kworker.0 Request processed in 36us (1054us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320392.204065:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270
00000100:00100000:0.0:1767320392.204091:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940765184:0@lo:400:kworker.0
00000100:00080000:0.0:1767320392.204144:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320392.204149:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320392.204151:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320392.204161:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940765312:0@lo:38:kworker.0
00000100:00100000:0.0:1767320392.204185:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320392.204202:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940765568:0@lo:38:kworker.0
00000100:00100000:0.0:1767320392.204220:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320392.204242:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765312
00000100:00100000:0.0:1767320392.204245:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765312
00000100:00100000:0.0:1767320392.204259:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765568
00000100:00100000:0.0:1767320392.204261:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765568
00000100:00100000:0.0:1767320392.204272:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17835
00000100:00100000:0.0:1767320392.204276:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940765312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320392.204293:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320392.204320:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940765312:12345-0@lo:38:kworker.0 Request processed in 43us (135us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320392.204326:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17835
00000100:00100000:0.0:1767320392.204335:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17836
00000100:00100000:0.0:1767320392.204339:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940765568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320392.204347:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320392.204366:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940765568:12345-0@lo:38:kworker.0 Request processed in 25us (145us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320392.204371:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17836
00000100:00080000:0.0:1767320392.204393:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320392.204397:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320392.204400:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940765312:0@lo:38:kworker.0
00000100:00080000:0.0:1767320392.204407:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320392.204409:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320392.204412:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940765568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320392.204943:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940765056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320392.207623:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269
00000100:00100000:3.0:1767320392.686650:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320392.686669:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940765696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320392.686769:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320392.686967:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765696
00000100:00100000:2.0:1767320392.686974:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765696
00000100:00100000:2.0:1767320392.687023:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840
00000100:00100000:2.0:1767320392.687032:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940765696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320392.687061:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320392.687100:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940765696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (331us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320392.687105:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840
00000100:00100000:3.0:1767320392.687215:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940765696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320392.880225:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320393.133012:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320393.710378:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940765824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320393.710456:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320393.710724:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765824
00000100:00100000:2.0:1767320393.710733:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765824
00000100:00100000:2.0:1767320393.710801:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841
00000100:00100000:2.0:1767320393.710811:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940765824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320393.710839:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320393.711079:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940765824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 269us (622us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320393.711086:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841
00000100:00100000:3.0:1767320393.711141:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940765824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320393.798393:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320393.798504:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372352
00000100:00100000:2.0:1767320393.798521:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372352
00000100:00100000:2.0:1767320393.798559:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17837
00000100:00100000:2.0:1767320393.798565:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372352:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320393.798585:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320393.798643:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372352:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 77us (257us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320393.798648:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17837
00000100:00100000:2.0:1767320393.800739:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320393.800952:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372480
00000100:00100000:0.0:1767320393.800960:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372480
00000100:00100000:0.0:1767320393.801054:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5068
00000100:00100000:0.0:1767320393.801061:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894372480:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320393.801173:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894372480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 111us (442us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320393.801185:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5068
00000100:00080000:3.0:1767320393.801304:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320393.900964:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320394.157187:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320394.925151:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320395.181050:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320395.948940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320396.205016:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320396.972892:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320397.229055:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320397.292901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320397.292912:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320397.292916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320397.292919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320397.292924:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320397.292932:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320397.292937:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320397.292944:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320397.292985:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340f800 x1853163940765952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320397.293022:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320397.293026:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320397.293028:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320397.293032:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320397.293035:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320397.293039:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320397.293053:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07340ed80 x1853163940766080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320397.293126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320397.293139:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320397.293141:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320397.293144:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320397.293147:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320397.293151:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320397.293164:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4e9ebb80 x1853163940766592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320397.293180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320397.293182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320397.293184:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320397.293187:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320397.293189:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320397.293192:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320397.293202:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4ba26d80 x1853163940766848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320397.293291:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766336:0@lo:400:kworker.0
00000100:00100000:3.0:1767320397.293361:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320397.293439:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320397.293446:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766208:0@lo:400:kworker.0
00000100:00100000:3.0:1767320397.293471:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320397.293497:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940766720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320397.293522:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320397.293539:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320397.293545:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940766464:0@lo:400:kworker.0
00000100:00100000:3.0:1767320397.293567:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320397.293728:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766720
00000100:00100000:2.0:1767320397.293728:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766336
00000100:00100000:1.0:1767320397.293735:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766720
00000100:00100000:2.0:1767320397.293735:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766336
00000100:00100000:0.0:1767320397.293815:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940765952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320397.293847:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320397.293853:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766464
00000100:00100000:1.0:1767320397.293857:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766464
00000100:00100000:0.0:1767320397.293864:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940766080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320397.293891:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320397.293909:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940766592:0@lo:38:kworker.0
00000100:00100000:0.0:1767320397.293930:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320397.293947:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940766848:0@lo:38:kworker.0
00000100:00100000:0.0:1767320397.293971:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320397.294006:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940765952
00000100:00100000:0.0:1767320397.294010:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940765952
00000100:00100000:0.0:1767320397.294025:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766592
00000100:00100000:0.0:1767320397.294028:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766592
00000100:00100000:0.0:1767320397.294037:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766848
00000100:00100000:0.0:1767320397.294040:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766848
00000100:00100000:0.0:1767320397.294052:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5069
00000100:00100000:0.0:1767320397.294062:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940766720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320397.294114:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940766720:12345-0@lo:400:kworker.0 Request processed in 53us (589us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320397.294121:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5069
00000100:00100000:0.0:1767320397.294139:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17838
00000100:00100000:0.0:1767320397.294143:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940765952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320397.294162:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320397.294193:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940765952:12345-0@lo:38:kworker.0 Request processed in 48us (345us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320397.294199:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17838
00000100:00100000:0.0:1767320397.294213:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17839
00000100:00100000:0.0:1767320397.294217:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940766592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320397.294227:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320397.294267:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940766592:12345-0@lo:38:kworker.0 Request processed in 48us (335us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320397.294273:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17839
00000100:00100000:0.0:1767320397.294285:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17840
00000100:00100000:0.0:1767320397.294289:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940766848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320397.294299:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320397.294321:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940766848:12345-0@lo:38:kworker.0 Request processed in 30us (349us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320397.294326:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17840
00000100:00100000:0.0:1767320397.294349:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766080
00000100:00100000:0.0:1767320397.294353:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766080
00000100:00100000:0.0:1767320397.294374:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294
00000100:00100000:0.0:1767320397.294379:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940766080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320397.294389:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320397.294414:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940766080:12345-0@lo:38:kworker.0 Request processed in 34us (522us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320397.294420:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294
00000100:00080000:0.0:1767320397.294455:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320397.294460:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320397.294463:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940765952:0@lo:38:kworker.0
00000100:00080000:0.0:1767320397.294473:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320397.294476:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320397.294479:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940766080:0@lo:38:kworker.0
00000100:00080000:0.0:1767320397.294487:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320397.294490:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320397.294493:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4e9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940766592:0@lo:38:kworker.0
00000100:00080000:0.0:1767320397.294500:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320397.294503:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320397.294506:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940766848:0@lo:38:kworker.0
00000100:00100000:0.0:1767320397.294548:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4ba25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940766720:0@lo:400:kworker.0
00000100:00100000:0.0:1767320397.294593:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766208
00000100:00100000:0.0:1767320397.294597:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766208
00000100:00100000:2.0:1767320397.299912:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271
00000100:00100000:2.0:1767320397.299938:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320397.300060:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766336:12345-0@lo:400:kworker.0 Request processed in 134us (6697us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320397.300072:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271
00000100:00100000:2.0:1767320397.300351:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766336:0@lo:400:kworker.0
00000100:00080000:3.0:1767320397.304048:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320397.304064:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320397.304069:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320397.306712:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070
00000100:00100000:1.0:1767320397.306730:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940766464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320397.306861:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940766464:12345-0@lo:400:kworker.0 Request processed in 136us (13292us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320397.306872:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070
00000100:00100000:3.0:1767320397.306969:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940766464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320397.309910:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272
00000100:00100000:0.0:1767320397.309928:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320397.310027:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766208:12345-0@lo:400:kworker.0 Request processed in 106us (16554us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320397.310035:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272
00000100:00100000:1.0:1767320397.310296:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766208:0@lo:400:kworker.0
00000100:00100000:2.0:1767320397.805360:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320397.805385:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320397.805470:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320397.806053:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940766976
00000100:00100000:1.0:1767320397.806062:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940766976
00000100:00100000:1.0:1767320397.806119:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842
00000100:00100000:1.0:1767320397.806128:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320397.806167:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320397.806229:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940766976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (758us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320397.806237:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842
00000100:00100000:3.0:1767320397.806295:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940766976:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320397.996936:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320398.253298:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320398.831520:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320398.831540:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940767104:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320398.831608:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320398.831873:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767104
00000100:00100000:0.0:1767320398.831881:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767104
00000100:00100000:0.0:1767320398.831935:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843
00000100:00100000:0.0:1767320398.831945:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940767104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320398.831975:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320398.832031:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940767104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (422us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320398.832039:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843
00000100:00100000:1.0:1767320398.832086:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940767104:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320398.923081:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320398.923128:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320398.923207:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372736
00000100:00100000:2.0:1767320398.923218:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372736
00000100:00100000:1.0:1767320398.923227:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372608
00000100:00100000:1.0:1767320398.923232:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372608
00000100:00100000:1.0:1767320398.923275:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5071
00000100:00100000:1.0:1767320398.923290:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894372736:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:3.0:1767320398.923312:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320398.923524:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894372736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 239us (452us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320398.924459:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17841
00000100:00100000:2.0:1767320398.924469:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372608:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320398.924494:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320398.924543:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07bb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894372608:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 75us (1414us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320398.925133:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17841
00000100:00100000:1.0:1767320398.929828:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5071
00000100:00100000:3.0:1767320399.023377:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320399.277187:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320400.044942:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320400.303951:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320401.069455:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320401.325089:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320402.092885:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320402.349334:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320402.413560:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320402.413571:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320402.413574:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320402.413578:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320402.413820:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320402.413829:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5647
00000100:00080000:3.0:1767320402.413834:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320402.413842:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320402.413895:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430dc00 x1853163940767232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320402.421117:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320402.421124:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320402.421127:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320402.421135:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5647
00000100:00080000:3.0:1767320402.421140:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320402.421148:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320402.421200:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ea00 x1853163940767360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320402.421277:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940767488:0@lo:400:kworker.0
00000100:00100000:1.0:1767320402.421354:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320402.421487:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767488
00000100:00100000:2.0:1767320402.421498:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767488
00000100:00100000:2.0:1767320402.421560:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273
00000100:00100000:2.0:1767320402.421570:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940767488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320402.424954:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940767232:0@lo:38:kworker.0
00000100:00100000:0.0:1767320402.425045:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320402.425091:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940767360:0@lo:38:kworker.0
00000100:00100000:0.0:1767320402.425123:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320402.425180:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767360
00000100:00100000:0.0:1767320402.425188:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767360
00000100:00100000:0.0:1767320402.425224:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295
00000100:00100000:0.0:1767320402.425230:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940767360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320402.425253:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320402.425294:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4e9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940767360:12345-0@lo:38:kworker.0 Request processed in 62us (168us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320402.425300:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295
00000100:00080000:0.0:1767320402.425341:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320402.425346:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320402.425349:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940767360:0@lo:38:kworker.0
00000100:00100000:0.0:1767320402.425404:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767232
00000100:00100000:0.0:1767320402.425407:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767232
00000100:00100000:0.0:1767320402.425429:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17842
00000100:00100000:0.0:1767320402.425433:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940767232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320402.425443:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320402.425471:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04760d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940767232:12345-0@lo:38:kworker.0 Request processed in 36us (426us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320402.425476:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17842
00000100:00080000:0.0:1767320402.425505:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320402.425509:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320402.425512:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940767232:0@lo:38:kworker.0
00000100:00080000:0.0:1767320402.425539:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320402.425557:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940767616:0@lo:400:kworker.0
00000100:00100000:0.0:1767320402.425580:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320402.425615:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767616
00000100:00100000:0.0:1767320402.425637:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767616
00000100:00100000:0.0:1767320402.425680:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274
00000100:00100000:0.0:1767320402.425687:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940767616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320402.425726:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940767616:12345-0@lo:400:kworker.0 Request processed in 39us (143us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320402.425732:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274
00000100:00100000:0.0:1767320402.425760:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940767616:0@lo:400:kworker.0
00000100:00080000:0.0:1767320402.425800:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320402.426559:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940767488:12345-0@lo:400:kworker.0 Request processed in 4978us (5193us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320402.426568:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273
00000100:00080000:3.0:1767320402.429380:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320402.429387:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320402.429390:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320402.429398:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5647
00000100:00080000:3.0:1767320402.429403:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320402.429409:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320402.429428:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940767872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320402.429466:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940767872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320402.429521:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320402.429580:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767872
00000100:00100000:3.0:1767320402.429592:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767872
00000100:00100000:3.0:1767320402.429628:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17843
00000100:00100000:3.0:1767320402.429642:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940767872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320402.429664:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320402.429702:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940767872:12345-0@lo:38:kworker.0 Request processed in 58us (180us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320402.429709:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17843
00000100:00080000:3.0:1767320402.429749:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320402.429754:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320402.429757:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940767872:0@lo:38:kworker.0
00000100:00080000:3.0:1767320402.429806:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320402.429809:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320402.429811:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320402.429814:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5647
00000100:00080000:3.0:1767320402.429816:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320402.429820:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320402.429830:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940768128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320402.429850:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940768128:0@lo:38:kworker.0
00000100:00100000:3.0:1767320402.429873:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320402.429895:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768128
00000100:00100000:3.0:1767320402.429898:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768128
00000100:00100000:3.0:1767320402.429917:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17844
00000100:00100000:3.0:1767320402.429921:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940768128:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320402.429931:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320402.429957:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940768128:12345-0@lo:38:kworker.0 Request processed in 35us (83us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320402.429966:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17844
00000100:00080000:3.0:1767320402.429987:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320402.429991:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320402.429994:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940768128:0@lo:38:kworker.0
00000100:00100000:2.0:1767320402.431959:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940768000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.432027:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320402.432079:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320402.432086:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940767744:0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.432125:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320402.432166:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768000
00000100:00100000:2.0:1767320402.432173:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768000
00000100:00100000:2.0:1767320402.432224:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940767744
00000100:00100000:2.0:1767320402.432227:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940767744
00000100:00100000:2.0:1767320402.432253:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5072
00000100:00100000:2.0:1767320402.432261:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940768000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.432312:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ba26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940768000:12345-0@lo:400:kworker.0 Request processed in 51us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320402.432319:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5072
00000100:00100000:2.0:1767320402.432335:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5073
00000100:00100000:2.0:1767320402.432341:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940767744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.432365:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940767744:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320402.432371:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5073
00000100:00100000:2.0:1767320402.432823:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940767744:0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.432842:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940768000:0@lo:400:kworker.0
00000100:00080000:0.0:1767320402.441313:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320402.442888:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940767488:0@lo:400:kworker.0
00000100:00100000:2.0:1767320402.925125:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320402.925150:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940768256:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320402.925219:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320402.927140:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768256
00000100:00100000:1.0:1767320402.927152:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768256
00000100:00100000:1.0:1767320402.927221:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844
00000100:00100000:1.0:1767320402.927231:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940768256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320402.927258:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320402.927322:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940768256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320402.927327:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844
00000100:00100000:0.0:1767320402.927440:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940768256:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320403.019813:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:1.0:1767320403.019850:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894372864 offset 0 length 520: 4
00000100:00100000:1.0:1767320403.019878:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320403.020041:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373120
00000100:00100000:3.0:1767320403.020054:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373120
00000100:00100000:3.0:1767320403.020140:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894372992
00000100:00100000:3.0:1767320403.020144:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894372992
00000100:00100000:3.0:1767320403.020162:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5074
00000100:00100000:3.0:1767320403.020173:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894373120:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320403.020247:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894373120:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (483us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320403.020255:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5074
00000100:00100000:3.0:1767320403.020275:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17845
00000100:00100000:3.0:1767320403.020279:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894372992:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320403.020300:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320403.020326:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894372992:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320403.020332:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17845
00000100:00080000:1.0:1767320403.020499:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320403.116914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320403.375032:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320403.949020:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940768384:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320403.949092:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320403.949340:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768384
00000100:00100000:1.0:1767320403.949348:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768384
00000100:00100000:1.0:1767320403.949402:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845
00000100:00100000:1.0:1767320403.949412:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940768384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320403.949442:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320403.949823:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940768384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 412us (730us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320403.949831:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845
00000100:00100000:0.0:1767320403.950179:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940768384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320404.141128:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320404.398894:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320405.166474:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320405.422880:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320406.188968:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320406.445103:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320407.212924:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320407.469431:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320407.532928:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320407.532941:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320407.532945:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320407.532949:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320407.532954:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320407.532962:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5652
00000100:00080000:3.0:1767320407.532967:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320407.532975:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320407.533018:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940768512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320407.533036:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320407.533040:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320407.533041:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320407.533045:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5652
00000100:00080000:3.0:1767320407.533048:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320407.533052:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320407.533067:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940768640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320407.533140:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320407.533157:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320407.533159:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320407.533163:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5652
00000100:00080000:3.0:1767320407.533166:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320407.533170:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320407.533182:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d880 x1853163940769152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320407.533198:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320407.533200:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320407.533202:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320407.533205:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5652
00000100:00080000:3.0:1767320407.533207:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320407.533210:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320407.533220:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430dc00 x1853163940769408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320407.533318:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940768768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533385:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.533472:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320407.533478:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940768896:0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533499:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.533539:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768768
00000100:00100000:1.0:1767320407.533547:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768768
00000100:00100000:1.0:1767320407.533627:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768896
00000100:00100000:1.0:1767320407.533631:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768896
00000100:00100000:1.0:1767320407.533655:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275
00000100:00100000:1.0:1767320407.533663:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940768768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533712:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940768768:12345-0@lo:400:kworker.0 Request processed in 49us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320407.533719:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275
00000100:00100000:1.0:1767320407.533734:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276
00000100:00100000:1.0:1767320407.533740:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940768896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533763:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940768896:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320407.533768:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276
00000100:00100000:0.0:1767320407.533821:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940769280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533843:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940768896:0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.533856:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940768768:0@lo:400:kworker.0
00000100:00100000:0.0:1767320407.533862:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320407.533884:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320407.533887:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:1.0:1767320407.533890:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320407.533896:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940769024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320407.533919:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.533923:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940768512:0@lo:38:kworker.0
00000100:00100000:1.0:1767320407.533957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.533991:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940768640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320407.534014:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.534032:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940769152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320407.534052:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.534067:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940769408:0@lo:38:kworker.0
00000100:00100000:1.0:1767320407.534089:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320407.534117:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768640
00000100:00100000:1.0:1767320407.534122:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768640
00000100:00100000:1.0:1767320407.534142:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296
00000100:00100000:1.0:1767320407.534147:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940768640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320407.534164:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320407.534196:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940768640:12345-0@lo:38:kworker.0 Request processed in 48us (181us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320407.534202:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296
00000100:00100000:1.0:1767320407.534222:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769280
00000100:00100000:1.0:1767320407.534226:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769280
00000100:00100000:0.0:1767320407.534229:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769024
00000100:00100000:0.0:1767320407.534235:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769024
00000100:00100000:1.0:1767320407.534258:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940768512
00000100:00100000:1.0:1767320407.534263:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940768512
00000100:00100000:0.0:1767320407.534276:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769152
00000100:00100000:1.0:1767320407.534278:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769408
00000100:00100000:0.0:1767320407.534281:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769152
00000100:00100000:1.0:1767320407.534283:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769408
00000100:00100000:0.0:1767320407.534313:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5075
00000100:00100000:0.0:1767320407.534321:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940769280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320407.534367:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940769280:12345-0@lo:400:kworker.0 Request processed in 47us (506us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320407.534445:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1767320407.534453:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940769024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.534483:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940769024:12345-0@lo:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320407.534488:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1767320407.534502:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17846
00000100:00100000:1.0:1767320407.534506:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940768512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320407.534516:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320407.534540:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940768512:12345-0@lo:38:kworker.0 Request processed in 32us (582us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320407.534545:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17846
00000100:00100000:1.0:1767320407.534556:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17847
00000100:00100000:1.0:1767320407.534560:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940769152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320407.534568:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320407.534605:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940769152:12345-0@lo:38:kworker.0 Request processed in 43us (552us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320407.534612:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17847
00000100:00100000:1.0:1767320407.534625:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17848
00000100:00100000:1.0:1767320407.534629:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940769408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320407.534638:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320407.534660:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940769408:12345-0@lo:38:kworker.0 Request processed in 30us (570us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320407.534665:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17848
00000100:00080000:1.0:1767320407.534700:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320407.534706:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320407.534709:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940768512:0@lo:38:kworker.0
00000100:00080000:1.0:1767320407.534717:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320407.534720:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320407.534722:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940768640:0@lo:38:kworker.0
00000100:00080000:1.0:1767320407.534728:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320407.534731:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320407.534734:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940769152:0@lo:38:kworker.0
00000100:00080000:1.0:1767320407.534740:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320407.534744:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320407.534746:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940769408:0@lo:38:kworker.0
00000100:00080000:1.0:1767320407.534770:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320407.534816:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940769024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320407.534826:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940769280:0@lo:400:kworker.0
00000100:00100000:0.0:1767320407.541665:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5075
00000100:00100000:2.0:1767320408.045896:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320408.045923:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940769536:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320408.046012:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320408.046276:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769536
00000100:00100000:3.0:1767320408.046285:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769536
00000100:00100000:3.0:1767320408.046337:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846
00000100:00100000:3.0:1767320408.046346:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940769536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320408.046375:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320408.046448:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940769536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320408.046456:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846
00000100:00100000:0.0:1767320408.046527:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940769536:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320408.137744:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320408.137871:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320408.138054:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373248
00000100:00100000:1.0:1767320408.138066:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373248
00000100:00100000:1.0:1767320408.138117:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373376
00000100:00100000:1.0:1767320408.138120:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373376
00000100:00100000:0.0:1767320408.138154:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17849
00000100:00100000:0.0:1767320408.138166:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894373248:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:1.0:1767320408.138187:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5077
00010000:00020000:0.0:1767320408.138193:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320408.138199:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894373376:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320408.138266:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894373248:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 100us (530us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320408.138274:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17849
00000100:00080000:3.0:1767320408.138322:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320408.149392:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894373376:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 11181us (11505us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320408.149409:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5077
00000100:00100000:3.0:1767320408.237666:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320408.493112:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320409.069116:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320409.069142:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940769664:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320409.069214:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320409.069368:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769664
00000100:00100000:3.0:1767320409.069378:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769664
00000100:00080000:1.0:1767320409.069440:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320409.069445:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847
00000100:00100000:3.0:1767320409.069457:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940769664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320409.069487:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320409.069542:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940769664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320409.069549:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847
00000100:00100000:1.0:1767320409.069600:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940769664:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320409.261163:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320409.517280:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320410.285347:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320410.547141:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320411.308933:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320411.565024:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320412.332951:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320412.588995:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320412.652921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.652931:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320412.652934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.652938:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320412.652942:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320412.652951:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5657
00000100:00080000:3.0:1767320412.652956:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320412.652963:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320412.652990:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320387/real 1767320387]  req@ffff93d044337100 x1853163940763264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320412.653015:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940769792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320412.653024:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93d044337100 x1853163940763264/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320412.653033:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.653038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320412.653040:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320412.653044:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5657
00000100:00080000:3.0:1767320412.653047:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320412.653052:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320412.653053:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940769792:0@lo:38:kworker.0
00000100:00100000:3.0:1767320412.653068:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430dc00 x1853163940769920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320412.653120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320412.653183:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320412.653194:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320412.653198:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940763264:0@lo:250:kworker.0
00000100:00100000:1.0:1767320412.653219:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940769920:0@lo:38:kworker.0
00000100:00100000:1.0:1767320412.653245:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320412.653282:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769920
00000100:00100000:1.0:1767320412.653290:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769920
00000100:00100000:1.0:1767320412.653327:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297
00000100:00100000:1.0:1767320412.653337:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940769920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320412.653360:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320412.653399:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940769920:12345-0@lo:38:kworker.0 Request processed in 63us (153us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320412.653406:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297
00000100:00080000:1.0:1767320412.653442:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320412.653446:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320412.653449:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940769920:0@lo:38:kworker.0
00000100:00100000:0.0:1767320412.653489:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940769792
00000100:00100000:0.0:1767320412.653494:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940769792
00000100:00100000:0.0:1767320412.653522:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17850
00000100:00100000:0.0:1767320412.653527:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940769792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320412.653573:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320412.653614:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940769792:12345-0@lo:38:kworker.0 Request processed in 85us (494us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320412.653621:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17850
00000100:00080000:1.0:1767320412.653713:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320412.653718:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320412.653721:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940769792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320412.654130:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940770048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320412.654166:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320412.654245:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770048
00000100:00100000:0.0:1767320412.654250:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770048
00000100:00100000:0.0:1767320412.654297:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277
00000100:00100000:0.0:1767320412.654303:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940770048:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320412.654816:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320412.655707:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940770176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320412.655755:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320412.655828:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770176
00000100:00100000:1.0:1767320412.655835:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770176
00000100:00100000:1.0:1767320412.655875:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278
00000100:00100000:1.0:1767320412.655883:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940770176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320412.655927:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940770176:12345-0@lo:400:kworker.0 Request processed in 44us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320412.655935:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278
00000100:00080000:1.0:1767320412.655957:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320412.655983:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940770176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.659010:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940770048:12345-0@lo:400:kworker.0 Request processed in 4697us (4833us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320412.659027:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277
00000100:00080000:3.0:1767320412.661295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.661304:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320412.661308:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320412.661316:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5657
00000100:00080000:3.0:1767320412.661321:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320412.661327:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320412.661349:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430f480 x1853163940770432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320412.661382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.661385:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320412.661386:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320412.661391:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5657
00000100:00080000:3.0:1767320412.661393:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320412.661396:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320412.661408:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430c700 x1853163940770688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320412.661427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320412.661430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320412.661432:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320412.661435:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5637
00000100:00080000:3.0:1767320412.661438:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320412.661441:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320412.661453:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430ce00 x1853163940770816/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320412.661487:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940770432:0@lo:38:kworker.0
00000100:00100000:3.0:1767320412.661582:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320412.661617:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940770688:0@lo:38:kworker.0
00000100:00100000:3.0:1767320412.661641:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320412.661659:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940770816:0@lo:250:kworker.0
00000400:00000100:3.0:1767320412.661676:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940770816 offset 0 length 520: 4
00000100:00100000:3.0:1767320412.661722:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770432
00000100:00100000:3.0:1767320412.661730:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770432
00000100:00100000:3.0:1767320412.661764:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770688
00000100:00100000:3.0:1767320412.661767:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770688
00000100:00100000:3.0:1767320412.661811:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17851
00000100:00100000:3.0:1767320412.661818:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940770432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320412.661840:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320412.661880:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940770432:12345-0@lo:38:kworker.0 Request processed in 61us (298us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320412.661887:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17851
00000100:00100000:3.0:1767320412.661905:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17852
00000100:00100000:3.0:1767320412.661910:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940770688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320412.661919:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320412.661941:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940770688:12345-0@lo:38:kworker.0 Request processed in 30us (299us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320412.661947:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17852
00000100:00080000:3.0:1767320412.661989:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320412.662219:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940770560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.662250:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320412.662286:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320412.662292:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940770304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.662314:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320412.662338:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770560
00000100:00100000:0.0:1767320412.662342:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770560
00000100:00100000:0.0:1767320412.662380:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770304
00000100:00100000:0.0:1767320412.662385:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770304
00000100:00100000:0.0:1767320412.662408:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078
00000100:00100000:0.0:1767320412.662414:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940770560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.662457:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940770560:12345-0@lo:400:kworker.0 Request processed in 42us (205us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320412.662463:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078
00000100:00100000:0.0:1767320412.662477:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079
00000100:00100000:0.0:1767320412.662483:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940770304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.662509:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940770304:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320412.662517:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079
00000100:00080000:0.0:1767320412.662535:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320412.662569:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940770304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320412.662581:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940770560:0@lo:400:kworker.0
00000100:00080000:3.0:1767320412.663432:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320412.663438:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940770432:0@lo:38:kworker.0
00000100:00080000:3.0:1767320412.663462:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320412.663467:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320412.663469:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940770688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320412.666066:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940770048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320413.170103:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940770944:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320413.170182:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320413.175177:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940770944
00000100:00100000:3.0:1767320413.175195:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940770944
00000100:00100000:3.0:1767320413.175341:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848
00000100:00100000:3.0:1767320413.175354:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940770944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320413.175407:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320413.175511:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940770944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (5328us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320413.175519:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848
00000100:00100000:2.0:1767320413.175628:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940770944:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320413.254069:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320413.254152:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373632
00000100:00100000:0.0:1767320413.254162:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373632
00000100:00100000:0.0:1767320413.254242:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5080
00000100:00100000:0.0:1767320413.254251:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894373632:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320413.254331:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894373632:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320413.254339:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5080
00000100:00080000:1.0:1767320413.254555:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320413.256468:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320413.256557:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373504
00000100:00100000:3.0:1767320413.256567:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373504
00000100:00100000:3.0:1767320413.256611:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17853
00000100:00100000:3.0:1767320413.256626:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894373504:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320413.256648:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320413.256759:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894373504:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 132us (299us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320413.256766:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17853
00000100:00100000:3.0:1767320413.357029:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320413.613097:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320414.189237:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940771072:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320414.189318:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320414.189469:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771072
00000100:00100000:3.0:1767320414.189477:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771072
00000100:00100000:3.0:1767320414.189627:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849
00000100:00100000:3.0:1767320414.189639:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940771072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320414.189670:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320414.189736:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940771072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (417us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320414.189746:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849
00000100:00100000:2.0:1767320414.190967:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940771072:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320414.193999:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320414.380895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320414.637830:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320415.405537:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320415.660966:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320416.428888:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320416.685567:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320417.452932:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320417.710722:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320417.772981:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320417.772994:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320417.772997:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320417.773001:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320417.773006:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320417.773015:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320417.773021:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320417.773029:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320417.773078:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf50a7ed80 x1853163940771200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320417.773117:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320417.773128:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320417.773130:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320417.773134:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320417.773136:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320417.773140:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320417.773157:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430d880 x1853163940771328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320417.773229:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320417.773233:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320417.773235:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320417.773239:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320417.773241:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320417.773245:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320417.773255:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4430e300 x1853163940771840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320417.773271:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320417.773273:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320417.773275:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320417.773278:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320417.773280:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320417.773283:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320417.773292:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4fc38e00 x1853163940772096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320417.773412:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940771456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320417.773477:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320417.773520:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940771584:0@lo:400:kworker.0
00000100:00100000:2.0:1767320417.773548:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320417.773571:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771456
00000100:00100000:1.0:1767320417.773578:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771456
00000100:00100000:2.0:1767320417.773584:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940771712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320417.773611:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320417.773626:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771584
00000100:00100000:2.0:1767320417.773626:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320417.773629:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771584
00000100:00100000:2.0:1767320417.773631:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940771968:0@lo:400:kworker.0
00000100:00100000:2.0:1767320417.773651:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320417.773654:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279
00000100:00100000:1.0:1767320417.773662:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940771456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320417.773692:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280
00000100:00100000:2.0:1767320417.773700:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940771584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320417.773709:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940771456:12345-0@lo:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320417.773716:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279
00000100:00100000:2.0:1767320417.773730:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940771584:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320417.773736:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280
00000100:00080000:2.0:1767320417.773750:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320417.773754:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320417.773793:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940771584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320417.773795:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940771456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320417.773938:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940771200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.773967:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320417.773995:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940771328:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.774016:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320417.774040:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940771840:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.774061:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320417.774078:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940772096:0@lo:38:kworker.0
00000100:00100000:2.0:1767320417.774082:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771328
00000100:00100000:2.0:1767320417.774086:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771328
00000100:00100000:3.0:1767320417.774096:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320417.774106:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298
00000100:00100000:2.0:1767320417.774111:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940771328:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320417.774130:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320417.774133:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771712
00000100:00100000:3.0:1767320417.774136:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771712
00000100:00100000:2.0:1767320417.774165:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940771328:12345-0@lo:38:kworker.0 Request processed in 52us (147us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320417.774165:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771968
00000100:00100000:3.0:1767320417.774168:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771968
00000100:00100000:2.0:1767320417.774172:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298
00000100:00100000:3.0:1767320417.774181:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771200
00000100:00100000:3.0:1767320417.774184:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771200
00000100:00100000:3.0:1767320417.774192:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5081
00000100:00100000:2.0:1767320417.774197:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940771840
00000100:00100000:3.0:1767320417.774198:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940771712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320417.774199:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940771840
00000100:00100000:2.0:1767320417.774210:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772096
00000100:00100000:2.0:1767320417.774212:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772096
00000100:00100000:2.0:1767320417.774221:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082
00000100:00100000:2.0:1767320417.774227:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940771968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320417.774233:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940771712:12345-0@lo:400:kworker.0 Request processed in 36us (622us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320417.774238:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5081
00000100:00100000:2.0:1767320417.774252:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940771968:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320417.774252:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17854
00000100:00100000:3.0:1767320417.774256:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940771200:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320417.774258:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082
00000100:00100000:2.0:1767320417.774267:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17855
00010000:00020000:3.0:1767320417.774268:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320417.774271:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940771840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320417.774279:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320417.774287:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940771200:12345-0@lo:38:kworker.0 Request processed in 30us (319us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320417.774293:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17854
00000100:00100000:2.0:1767320417.774295:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940771840:12345-0@lo:38:kworker.0 Request processed in 23us (234us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320417.774300:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17855
00000100:00100000:3.0:1767320417.774302:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17856
00000100:00100000:3.0:1767320417.774306:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940772096:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767320417.774311:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:3.0:1767320417.774314:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320417.774333:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320417.774334:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940772096:12345-0@lo:38:kworker.0 Request processed in 27us (237us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767320417.774337:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320417.774340:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940771200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.774340:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17856
00000100:00080000:2.0:1767320417.774348:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320417.774352:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320417.774355:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940771328:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.774360:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940771968:0@lo:400:kworker.0
00000100:00080000:2.0:1767320417.774361:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320417.774364:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320417.774366:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940771840:0@lo:38:kworker.0
00000100:00100000:3.0:1767320417.774368:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940771712:0@lo:400:kworker.0
00000100:00080000:2.0:1767320417.774373:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320417.774376:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320417.774379:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940772096:0@lo:38:kworker.0
00000100:00100000:2.0:1767320418.285606:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940772224:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320418.285693:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320418.286761:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772224
00000100:00100000:0.0:1767320418.286782:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772224
00000100:00100000:0.0:1767320418.286848:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850
00000100:00100000:0.0:1767320418.286858:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940772224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320418.286897:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320418.287648:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d0469cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940772224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 789us (1952us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320418.287657:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850
00000100:00100000:2.0:1767320418.287741:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940772224:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320418.377899:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320418.378011:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320418.380091:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373888
00000100:00100000:1.0:1767320418.380107:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373888
00000100:00100000:1.0:1767320418.380370:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894373760
00000100:00100000:1.0:1767320418.380374:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894373760
00000100:00080000:2.0:1767320418.380413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320418.380543:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5083
00000100:00100000:3.0:1767320418.380559:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894373888:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320418.380654:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894373888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 100us (2764us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320418.380662:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5083
00000100:00100000:3.0:1767320418.380682:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17857
00000100:00100000:3.0:1767320418.380686:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894373760:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320418.380717:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320418.380745:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894373760:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 57us (2734us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320418.380750:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17857
00000100:00100000:3.0:1767320418.476976:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320418.733824:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320419.310593:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940772352:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320419.310664:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.310841:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772352
00000100:00100000:0.0:1767320419.310860:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772352
00000100:00100000:0.0:1767320419.310934:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851
00000100:00100000:0.0:1767320419.310944:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940772352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320419.310974:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320419.311032:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940772352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (366us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320419.311039:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851
00000100:00100000:3.0:1767320419.311073:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940772352:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320419.311237:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320419.500923:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320419.757012:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320420.524988:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320420.781358:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320421.552400:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320421.805601:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320422.572905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320422.829150:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320422.893686:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320422.893696:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320422.893698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320422.893702:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320422.893707:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320422.893714:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5667
00000100:00080000:3.0:1767320422.893719:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320422.893726:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320422.893767:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219dc00 x1853163940772480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320422.893827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320422.893837:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320422.893839:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320422.893842:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5667
00000100:00080000:3.0:1767320422.893845:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320422.893849:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320422.893863:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219e300 x1853163940772608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320422.893940:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320422.898996:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940772480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320422.899084:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320422.899145:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940772608:0@lo:38:kworker.0
00000100:00100000:2.0:1767320422.899173:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320422.899211:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772608
00000100:00100000:2.0:1767320422.899218:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772608
00000100:00100000:2.0:1767320422.899250:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299
00000100:00100000:2.0:1767320422.899257:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940772608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320422.899277:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320422.899315:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940772608:12345-0@lo:38:kworker.0 Request processed in 57us (140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320422.899321:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299
00000100:00080000:2.0:1767320422.899357:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320422.899362:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320422.899365:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940772608:0@lo:38:kworker.0
00000100:00100000:0.0:1767320422.900500:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772480
00000100:00100000:0.0:1767320422.900509:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772480
00000100:00100000:0.0:1767320422.900572:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17858
00000100:00100000:0.0:1767320422.900578:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940772480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320422.900598:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320422.900654:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940772480:12345-0@lo:38:kworker.0 Request processed in 75us (1571us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320422.900664:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17858
00000100:00080000:2.0:1767320422.900857:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320422.900862:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320422.900866:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940772480:0@lo:38:kworker.0
00000100:00100000:1.0:1767320422.903810:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940772864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320422.904210:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320422.904268:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940772736:0@lo:400:kworker.0
00000100:00100000:1.0:1767320422.904292:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320422.904397:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772864
00000100:00100000:0.0:1767320422.904406:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772864
00000100:00100000:0.0:1767320422.904483:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772736
00000100:00100000:0.0:1767320422.904487:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772736
00000100:00100000:0.0:1767320422.904513:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281
00000100:00100000:0.0:1767320422.904522:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940772864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320422.904595:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940772864:12345-0@lo:400:kworker.0 Request processed in 73us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320422.904602:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281
00000100:00100000:0.0:1767320422.904617:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282
00000100:00100000:0.0:1767320422.904622:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940772736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320422.904646:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940772736:12345-0@lo:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320422.904651:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282
00000100:00080000:1.0:1767320422.904810:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320422.904815:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320422.905093:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940772864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320422.905106:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940772736:0@lo:400:kworker.0
00000100:00080000:3.0:1767320422.905598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320422.905603:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320422.905607:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320422.905613:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5667
00000100:00080000:3.0:1767320422.905616:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320422.905621:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320422.905641:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219ed80 x1853163940773120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320422.905668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320422.905671:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320422.905673:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320422.905677:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5667
00000100:00080000:3.0:1767320422.905679:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320422.905683:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320422.905692:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5219fb80 x1853163940773376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320422.905720:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940773248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320422.905762:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320422.905809:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320422.905815:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940772992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320422.905854:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320422.905881:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773248
00000100:00100000:3.0:1767320422.905886:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773248
00000100:00100000:2.0:1767320422.906203:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940773120:0@lo:38:kworker.0
00000100:00100000:2.0:1767320422.906232:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320422.906258:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940773376:0@lo:38:kworker.0
00000100:00100000:2.0:1767320422.906280:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320422.906456:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940772992
00000100:00100000:0.0:1767320422.906461:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940772992
00000100:00100000:0.0:1767320422.906508:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773120
00000100:00100000:0.0:1767320422.906511:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773120
00000100:00100000:0.0:1767320422.906536:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773376
00000100:00100000:0.0:1767320422.906539:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773376
00000100:00100000:0.0:1767320422.906551:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5084
00000100:00100000:0.0:1767320422.906558:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940772992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320422.906608:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940772992:12345-0@lo:400:kworker.0 Request processed in 50us (752us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320422.906614:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5084
00000100:00100000:0.0:1767320422.906628:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17859
00000100:00100000:0.0:1767320422.906632:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940773120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320422.906650:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320422.906677:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940773120:12345-0@lo:38:kworker.0 Request processed in 43us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320422.906682:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17859
00000100:00100000:0.0:1767320422.906692:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17860
00000100:00100000:0.0:1767320422.906695:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940773376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320422.906703:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320422.906721:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940773376:12345-0@lo:38:kworker.0 Request processed in 25us (441us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320422.906726:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17860
00000100:00100000:0.0:1767320422.906796:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940772992:0@lo:400:kworker.0
00000100:00080000:2.0:1767320422.907187:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320422.907193:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320422.907196:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940773120:0@lo:38:kworker.0
00000100:00080000:2.0:1767320422.907205:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320422.907208:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320422.907210:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940773376:0@lo:38:kworker.0
00000100:00100000:3.0:1767320422.907300:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5085
00000100:00100000:3.0:1767320422.907311:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940773248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320422.907359:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940773248:12345-0@lo:400:kworker.0 Request processed in 52us (1596us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320422.907366:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5085
00000100:00080000:1.0:1767320422.908308:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320422.908403:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5219d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940773248:0@lo:400:kworker.0
00000100:00100000:2.0:1767320423.405080:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320423.405105:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940773504:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320423.405187:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320423.409172:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773504
00000100:00100000:1.0:1767320423.409188:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773504
00000100:00100000:1.0:1767320423.409265:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852
00000100:00100000:1.0:1767320423.409277:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940773504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320423.409321:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320423.409417:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940773504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (4228us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320423.409424:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852
00000100:00100000:2.0:1767320423.409807:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf52011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940773504:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320423.502158:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320423.502215:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320423.502283:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374144
00000100:00100000:2.0:1767320423.502293:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374144
00000100:00100000:3.0:1767320423.502350:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374016
00000100:00100000:3.0:1767320423.502356:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374016
00000100:00080000:1.0:1767320423.502482:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320423.502523:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5086
00000100:00100000:2.0:1767320423.502535:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894374144:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320423.502614:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894374144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (465us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320423.502621:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5086
00000100:00100000:2.0:1767320423.502637:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17861
00000100:00100000:2.0:1767320423.502640:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894374016:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320423.502658:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320423.502681:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf52011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894374016:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 39us (466us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320423.502687:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17861
00000100:00100000:3.0:1767320423.596925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320423.853027:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320424.430147:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320424.430171:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940773632:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320424.430241:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320424.430627:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773632
00000100:00100000:1.0:1767320424.430636:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773632
00000100:00100000:1.0:1767320424.430754:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853
00000100:00100000:1.0:1767320424.430764:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940773632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320424.430833:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320424.430894:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940773632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (652us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320424.430902:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853
00000100:00100000:3.0:1767320424.431175:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940773632:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320424.433655:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320424.620887:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320424.877054:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320425.645152:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320425.905043:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320426.669237:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320426.924989:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320427.693197:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320427.949042:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320428.013253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320428.013262:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320428.013265:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320428.013268:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320428.013273:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320428.013279:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5672
00000100:00080000:2.0:1767320428.013284:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320428.013291:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320428.014238:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044335c00 x1853163940773760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320428.014315:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940773760:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.014386:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320428.014506:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773760
00000100:00100000:1.0:1767320428.014515:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773760
00000100:00100000:1.0:1767320428.014558:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17862
00000100:00100000:1.0:1767320428.014566:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940773760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320428.014588:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320428.014636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320428.014640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320428.014642:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320428.014646:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5672
00000100:00080000:2.0:1767320428.014649:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320428.014654:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320428.014673:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d044336a00 x1853163940773888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320428.018909:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940773888:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.018988:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320428.019106:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940773760:12345-0@lo:38:kworker.0 Request processed in 4537us (4717us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320428.019127:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17862
00000100:00100000:0.0:1767320428.019323:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940773888
00000100:00100000:0.0:1767320428.019332:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940773888
00000100:00100000:0.0:1767320428.019372:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300
00000100:00100000:0.0:1767320428.019379:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940773888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320428.019412:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320428.019455:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940773888:12345-0@lo:38:kworker.0 Request processed in 76us (467us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320428.019461:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300
00000100:00080000:2.0:1767320428.019771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320428.019789:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320428.019793:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320428.019798:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5672
00000100:00080000:2.0:1767320428.019802:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320428.019807:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320428.019816:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320428.019827:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940774272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320428.019860:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320428.019923:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401ad80 x1853163940774400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320428.019942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320428.019945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320428.019947:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320428.019951:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5672
00000100:00080000:2.0:1767320428.019953:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320428.019958:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320428.019967:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940774528:0@lo:400:kworker.0
00000100:00100000:2.0:1767320428.019990:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320428.020134:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774144:0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020169:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320428.020196:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320428.020201:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020220:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320428.020246:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774144
00000100:00100000:0.0:1767320428.020250:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774144
00000100:00100000:0.0:1767320428.020295:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774016
00000100:00100000:0.0:1767320428.020440:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774016
00000100:00100000:0.0:1767320428.020469:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283
00000100:00100000:0.0:1767320428.020476:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774144:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020522:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774144:12345-0@lo:400:kworker.0 Request processed in 46us (352us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320428.020528:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283
00000100:00100000:0.0:1767320428.020543:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284
00000100:00100000:0.0:1767320428.020549:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020575:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774016:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320428.020581:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284
00000100:00100000:0.0:1767320428.020610:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774272
00000100:00100000:0.0:1767320428.020613:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774272
00000100:00100000:0.0:1767320428.020640:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774528
00000100:00100000:0.0:1767320428.020643:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774528
00000100:00100000:0.0:1767320428.020664:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5087
00000100:00100000:0.0:1767320428.020669:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940774272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020709:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940774272:12345-0@lo:400:kworker.0 Request processed in 39us (848us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320428.020714:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5087
00000100:00100000:0.0:1767320428.020728:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5088
00000100:00100000:0.0:1767320428.020734:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940774528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020768:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940774528:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320428.020795:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5088
00000100:00100000:0.0:1767320428.020834:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940774528:0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020845:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940774272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020876:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320428.020885:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774144:0@lo:400:kworker.0
00000100:00080000:0.0:1767320428.020907:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320428.020912:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320428.020913:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320428.021243:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d04401b800 x1853163940774656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320428.022203:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320428.022209:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320428.022211:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940773760:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.022231:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940774400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.022267:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320428.022390:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940774656:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.022427:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320428.024608:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320428.024619:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320428.024624:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940773888:0@lo:38:kworker.0
00000100:00100000:1.0:1767320428.030794:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774400
00000100:00100000:1.0:1767320428.030811:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774400
00000100:00100000:1.0:1767320428.030879:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774656
00000100:00100000:1.0:1767320428.030883:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774656
00000100:00100000:1.0:1767320428.030907:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17863
00000100:00100000:1.0:1767320428.030916:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940774400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320428.030940:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320428.031204:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5219ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940774400:12345-0@lo:38:kworker.0 Request processed in 287us (8934us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320428.031211:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17863
00000100:00100000:1.0:1767320428.031229:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17864
00000100:00100000:1.0:1767320428.031233:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940774656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320428.031243:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320428.031270:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940774656:12345-0@lo:38:kworker.0 Request processed in 35us (8843us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320428.031276:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17864
00000100:00080000:3.0:1767320428.031530:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320428.031536:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320428.031540:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940774400:0@lo:38:kworker.0
00000100:00080000:3.0:1767320428.031550:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320428.031553:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320428.031556:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d04401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940774656:0@lo:38:kworker.0
00000100:00100000:3.0:1767320428.526160:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320428.526184:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320428.526258:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320428.527501:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774784
00000100:00100000:1.0:1767320428.527512:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774784
00000100:00100000:1.0:1767320428.527573:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854
00000100:00100000:1.0:1767320428.527583:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320428.528429:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320428.528518:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 936us (2258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320428.528527:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854
00000100:00100000:3.0:1767320428.529015:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774784:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320428.615382:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000400:00000100:2.0:1767320428.615432:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894374272 offset 0 length 520: 4
00000100:00100000:2.0:1767320428.615457:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320428.615852:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374528
00000100:00100000:3.0:1767320428.615861:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374528
00000100:00100000:3.0:1767320428.615932:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374400
00000100:00100000:3.0:1767320428.615936:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374400
00000100:00100000:3.0:1767320428.615956:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5089
00000100:00100000:3.0:1767320428.615966:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894374528:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320428.616043:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894374528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (672us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320428.616052:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5089
00000100:00100000:3.0:1767320428.616071:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17865
00000100:00100000:3.0:1767320428.616076:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894374400:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320428.616095:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320428.616122:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894374400:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 43us (664us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320428.616129:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17865
00000100:00080000:2.0:1767320428.616967:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320428.720592:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320428.978072:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320429.549547:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320429.549620:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320429.549761:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940774912
00000100:00100000:1.0:1767320429.549770:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940774912
00000100:00100000:1.0:1767320429.549854:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855
00000100:00100000:1.0:1767320429.549863:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320429.549891:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320429.549940:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940774912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (319us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320429.549947:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855
00000100:00100000:0.0:1767320429.550189:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d044336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940774912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320429.740893:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320429.997032:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320430.764894:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320431.021340:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320431.788899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320432.047893:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320432.813027:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320433.070257:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320433.136546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320433.136557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320433.136560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320433.136564:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320433.136568:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320433.136581:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5678
00000100:00080000:3.0:1767320433.136585:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320433.136592:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320433.136637:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93480 x1853163940775040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320433.136655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320433.136658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320433.136660:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320433.136664:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5678
00000100:00080000:3.0:1767320433.136666:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320433.136670:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320433.136686:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940775168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320433.136768:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940775296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320433.136858:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320433.137023:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940775424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.137056:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320433.137104:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775296
00000100:00100000:0.0:1767320433.137112:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775296
00000100:00100000:0.0:1767320433.137159:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775424
00000100:00100000:0.0:1767320433.137163:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775424
00000100:00100000:1.0:1767320433.137172:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285
00000100:00100000:1.0:1767320433.137185:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940775296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.137190:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286
00000100:00100000:0.0:1767320433.137200:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940775424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.137254:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940775424:12345-0@lo:400:kworker.0 Request processed in 56us (196us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320433.137261:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286
00000100:00100000:0.0:1767320433.137308:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940775424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.137333:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940775040:0@lo:38:kworker.0
00000100:00100000:0.0:1767320433.137377:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320433.137397:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940775168:0@lo:38:kworker.0
00000100:00100000:0.0:1767320433.137420:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320433.137454:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775168
00000100:00100000:0.0:1767320433.137459:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775168
00000100:00100000:0.0:1767320433.137476:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301
00000100:00100000:0.0:1767320433.137481:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940775168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320433.137501:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320433.137534:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940775168:12345-0@lo:38:kworker.0 Request processed in 51us (113us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320433.137540:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301
00000100:00080000:0.0:1767320433.137566:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320433.137571:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320433.137574:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940775168:0@lo:38:kworker.0
00000100:00080000:0.0:1767320433.137593:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320433.137596:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320433.137608:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775040
00000100:00100000:0.0:1767320433.137611:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775040
00000100:00100000:0.0:1767320433.137630:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17866
00000100:00100000:0.0:1767320433.137634:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940775040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320433.137644:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320433.137673:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940775040:12345-0@lo:38:kworker.0 Request processed in 38us (296us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320433.137679:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17866
00000100:00080000:0.0:1767320433.137700:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320433.137704:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320433.137706:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940775040:0@lo:38:kworker.0
00000100:00100000:1.0:1767320433.137944:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940775296:12345-0@lo:400:kworker.0 Request processed in 763us (1085us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320433.137951:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285
00000100:00080000:3.0:1767320433.137957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320433.137962:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320433.137964:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320433.137969:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5678
00000100:00080000:3.0:1767320433.137972:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767320433.137974:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:3.0:1767320433.137978:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320433.137991:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91500 x1853163940775680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320433.138011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320433.138014:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320433.138015:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320433.138019:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5678
00000100:00080000:3.0:1767320433.138021:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320433.138024:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320433.138032:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b93b80 x1853163940775936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320433.138050:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940775552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320433.138055:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940775680:0@lo:38:kworker.0
00000100:00100000:3.0:1767320433.138088:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320433.138106:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940775936:0@lo:38:kworker.0
00000100:00100000:3.0:1767320433.138127:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320433.138150:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775680
00000100:00100000:3.0:1767320433.138154:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775680
00000100:00100000:3.0:1767320433.138172:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775936
00000100:00100000:3.0:1767320433.138175:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775936
00000100:00100000:3.0:1767320433.138189:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17867
00000100:00100000:3.0:1767320433.138194:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940775680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320433.138205:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320433.138235:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940775680:12345-0@lo:38:kworker.0 Request processed in 39us (146us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320433.138241:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17867
00000100:00100000:3.0:1767320433.138254:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17868
00000100:00100000:3.0:1767320433.138258:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940775936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320433.138267:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320433.138287:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940775936:12345-0@lo:38:kworker.0 Request processed in 28us (159us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320433.138292:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17868
00000100:00080000:3.0:1767320433.138317:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320433.138321:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320433.138324:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940775680:0@lo:38:kworker.0
00000100:00080000:3.0:1767320433.138331:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320433.138333:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320433.138336:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940775936:0@lo:38:kworker.0
00000100:00100000:0.0:1767320433.138407:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320433.138416:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940775808:0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.138441:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320433.138490:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775808
00000100:00100000:0.0:1767320433.138493:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775808
00000100:00100000:0.0:1767320433.138525:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5090
00000100:00100000:0.0:1767320433.138531:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940775808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320433.138568:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940775808:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320433.138574:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5090
00000100:00080000:0.0:1767320433.138586:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320433.138603:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940775808:0@lo:400:kworker.0
00000100:00100000:1.0:1767320433.138742:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320433.138862:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940775296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320433.142874:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940775552
00000100:00100000:3.0:1767320433.142886:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940775552
00000100:00100000:3.0:1767320433.142960:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091
00000100:00100000:3.0:1767320433.142967:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940775552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320433.143044:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940775552:12345-0@lo:400:kworker.0 Request processed in 78us (4302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320433.143049:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091
00000100:00100000:1.0:1767320433.145031:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940775552:0@lo:400:kworker.0
00000100:00080000:1.0:1767320433.145062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320433.645244:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320433.645271:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940776064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320433.645371:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320433.645629:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776064
00000100:00100000:3.0:1767320433.645638:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776064
00000100:00100000:3.0:1767320433.645706:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856
00000100:00100000:3.0:1767320433.645719:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940776064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320433.645760:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320433.645843:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940776064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (497us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320433.645850:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856
00000100:00100000:0.0:1767320433.646000:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940776064:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320433.747235:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320433.747338:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374656
00000100:00100000:2.0:1767320433.747381:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374656
00000100:00100000:3.0:1767320433.747529:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17869
00000100:00100000:3.0:1767320433.747538:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894374656:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320433.747566:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320433.747645:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894374656:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 105us (422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320433.747652:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17869
00000100:00100000:3.0:1767320433.748764:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320433.748869:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374784
00000100:00100000:2.0:1767320433.748877:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374784
00000100:00100000:2.0:1767320433.748948:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5092
00000100:00100000:2.0:1767320433.748958:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894374784:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320433.749040:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894374784:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320433.749048:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5092
00000100:00080000:1.0:1767320433.749274:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320433.838729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320434.093038:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320434.669064:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940776192:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320434.669136:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320434.669273:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776192
00000100:00100000:0.0:1767320434.669282:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776192
00000100:00100000:0.0:1767320434.669344:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857
00000100:00100000:0.0:1767320434.669354:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940776192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320434.669384:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320434.669441:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940776192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320434.669448:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857
00000100:00100000:2.0:1767320434.669539:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940776192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320434.860889:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320435.117113:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320435.885495:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320436.140977:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320436.908938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320437.165028:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320437.228905:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320412/real 1767320412]  req@ffff93cf4430ce00 x1853163940770816/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320437.228942:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf4430ce00 x1853163940770816/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320437.228961:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320437.228992:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320437.229008:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940770816:0@lo:250:kworker.0
00000100:00080000:0.0:1767320437.229124:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320437.229131:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320437.229134:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320437.229139:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320437.229144:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320437.229150:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320437.229186:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fa680 x1853163940776320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320437.229214:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320437.229217:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320437.229219:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320437.229222:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5683
00000100:00080000:0.0:1767320437.229225:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320437.229228:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320437.229245:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fb480 x1853163940776448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320437.229255:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320437.229258:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320437.229260:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320437.229264:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5683
00000100:00080000:0.0:1767320437.229267:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320437.229271:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320437.229283:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459f8000 x1853163940776576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320437.229289:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940776320:0@lo:250:kworker.0
00000400:00000100:3.0:1767320437.229354:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940776320 offset 0 length 520: 4
00000100:00080000:0.0:1767320437.229388:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320437.229392:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320437.229399:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320437.229404:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5683
00000100:00080000:0.0:1767320437.229407:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320437.229411:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320437.229423:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf459fad80 x1853163940777088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320437.229443:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320437.229447:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320437.229449:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320437.229452:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5683
00000100:00080000:0.0:1767320437.229455:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320437.229459:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320437.229472:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b800 x1853163940777344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320437.229477:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940776448:0@lo:38:kworker.0
00000100:00100000:0.0:1767320437.229505:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940776960:0@lo:400:kworker.0
00000100:00100000:3.0:1767320437.229523:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320437.229548:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320437.229555:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940776576:0@lo:38:kworker.0
00000100:00100000:0.0:1767320437.229576:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320437.229585:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940777216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320437.229586:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320437.229610:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940777088:0@lo:38:kworker.0
00000100:00100000:0.0:1767320437.229630:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320437.229667:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776448
00000100:00100000:3.0:1767320437.229675:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776448
00000100:00100000:1.0:1767320437.229701:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940776704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320437.229798:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940776832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.239428:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320437.239496:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776704
00000100:00100000:1.0:1767320437.239504:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776704
00000100:00100000:1.0:1767320437.239564:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287
00000100:00100000:1.0:1767320437.239574:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940776704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.239641:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940776704:12345-0@lo:400:kworker.0 Request processed in 68us (218us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320437.239649:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287
00000100:00080000:1.0:1767320437.239672:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320437.239704:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940776704:0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.239846:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776576
00000100:00100000:1.0:1767320437.239851:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776576
00000100:00100000:1.0:1767320437.239873:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302
00000100:00100000:1.0:1767320437.239880:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940776576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320437.239899:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320437.239933:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940776576:12345-0@lo:38:kworker.0 Request processed in 53us (10348us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320437.239939:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302
00000100:00100000:2.0:1767320437.240189:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320437.244371:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776832
00000100:00100000:0.0:1767320437.244551:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776832
00000100:00100000:0.0:1767320437.244626:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288
00000100:00100000:0.0:1767320437.244635:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940776832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320437.244742:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d044018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940776832:12345-0@lo:400:kworker.0 Request processed in 108us (4553us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320437.244751:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288
00000100:00080000:0.0:1767320437.244792:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320437.244850:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940776832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320437.244901:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320437.259232:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940776960
00000100:00100000:1.0:1767320437.259248:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940776960
00000100:00100000:1.0:1767320437.259364:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777216
00000100:00100000:1.0:1767320437.259367:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777216
00000100:00100000:1.0:1767320437.262477:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777088
00000100:00100000:1.0:1767320437.262490:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777088
00000100:00100000:1.0:1767320437.262506:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5093
00000100:00100000:1.0:1767320437.262516:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940776960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.262619:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940776960:12345-0@lo:400:kworker.0 Request processed in 105us (33072us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320437.262627:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5093
00000100:00100000:1.0:1767320437.262644:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094
00000100:00100000:1.0:1767320437.262651:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940777216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.262683:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940777216:12345-0@lo:400:kworker.0 Request processed in 33us (33054us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320437.262688:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094
00000100:00100000:1.0:1767320437.262700:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17870
00000100:00100000:1.0:1767320437.262704:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940776448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320437.262923:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320437.262957:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940776448:12345-0@lo:38:kworker.0 Request processed in 251us (33435us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320437.262964:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17870
00000100:00100000:1.0:1767320437.262981:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17871
00000100:00100000:1.0:1767320437.262985:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940777088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320437.262996:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320437.263019:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940777088:12345-0@lo:38:kworker.0 Request processed in 33us (18118us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320437.263028:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17871
00000100:00080000:1.0:1767320437.263058:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320437.263096:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940777216:0@lo:400:kworker.0
00000100:00100000:1.0:1767320437.263107:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940776960:0@lo:400:kworker.0
00000100:00080000:1.0:1767320437.263160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320437.263165:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320437.263169:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940777088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320437.263179:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940777344:0@lo:38:kworker.0
00000100:00100000:1.0:1767320437.263212:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320437.263235:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777344
00000100:00100000:1.0:1767320437.263239:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777344
00000100:00100000:1.0:1767320437.263257:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17872
00000100:00100000:1.0:1767320437.263262:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940777344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320437.263271:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320437.263294:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940777344:12345-0@lo:38:kworker.0 Request processed in 31us (81us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320437.263299:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17872
00000100:00080000:1.0:1767320437.263333:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320437.263337:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320437.263340:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940777344:0@lo:38:kworker.0
00000100:00080000:1.0:1767320437.263349:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320437.263352:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320437.263355:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940776448:0@lo:38:kworker.0
00000100:00080000:1.0:1767320437.263524:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320437.263529:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320437.263533:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940776576:0@lo:38:kworker.0
00000100:00100000:3.0:1767320437.933487:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320438.189070:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320438.765371:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940777472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320438.765440:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320438.765506:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777472
00000100:00100000:3.0:1767320438.765515:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777472
00000100:00100000:3.0:1767320438.765572:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858
00000100:00100000:3.0:1767320438.765582:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940777472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320438.765613:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320438.765670:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d04401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940777472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (229us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320438.765678:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858
00000100:00100000:2.0:1767320438.765797:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4430ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940777472:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320438.854729:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320438.854899:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375040
00000100:00100000:2.0:1767320438.854918:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375040
00000100:00100000:2.0:1767320438.855000:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5095
00000100:00100000:2.0:1767320438.855010:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894375040:12345-192.168.202.21@tcp:400:kworker.0
00000100:00080000:1.0:1767320438.855062:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320438.855097:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894375040:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320438.855106:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5095
00000100:00100000:0.0:1767320438.866819:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320438.866945:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894374912
00000100:00100000:3.0:1767320438.866957:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894374912
00000100:00100000:3.0:1767320438.867063:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17873
00000100:00100000:3.0:1767320438.867071:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894374912:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320438.867098:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320438.867171:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894374912:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 98us (403us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320438.867181:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17873
00000100:00100000:3.0:1767320438.961178:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320439.213018:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320439.795188:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940777600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320439.795257:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.796125:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777600
00000100:00100000:0.0:1767320439.796136:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777600
00000100:00100000:0.0:1767320439.796209:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859
00000100:00100000:0.0:1767320439.796218:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940777600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320439.796250:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320439.796330:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940777600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1071us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320439.796338:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859
00000100:00080000:1.0:1767320439.796411:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320439.796586:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940777600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320439.980918:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320440.238899:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320441.005169:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320441.261219:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320442.028947:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320442.285539:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320442.348953:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320442.348962:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320442.348966:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320442.348970:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320442.348974:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320442.348981:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5687
00000100:00080000:0.0:1767320442.348985:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320442.348991:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320442.349030:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705a680 x1853163940777728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320442.349055:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320442.349058:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320442.349060:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320442.349063:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5687
00000100:00080000:0.0:1767320442.349065:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320442.349068:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320442.349079:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47059500 x1853163940777856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320442.349148:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320442.349151:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320442.349153:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320442.349156:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5687
00000100:00080000:0.0:1767320442.349158:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320442.349162:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320442.349170:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf4705b800 x1853163940778368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320442.349190:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320442.349193:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320442.349194:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320442.349197:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5687
00000100:00080000:0.0:1767320442.349199:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320442.349202:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320442.349210:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170380 x1853163940778624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320442.349238:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940778240:0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.349313:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320442.349386:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320442.349392:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940778496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.349413:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320442.349644:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940777984:0@lo:400:kworker.0
00000100:00100000:2.0:1767320442.349679:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320442.349703:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320442.349709:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320442.349731:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320442.349791:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778240
00000100:00100000:2.0:1767320442.349799:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778240
00000100:00100000:2.0:1767320442.349846:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778496
00000100:00100000:2.0:1767320442.349848:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778496
00000100:00100000:2.0:1767320442.349870:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5096
00000100:00100000:2.0:1767320442.349877:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940778240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320442.349925:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940778240:12345-0@lo:400:kworker.0 Request processed in 47us (610us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320442.349931:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5096
00000100:00100000:2.0:1767320442.349946:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5097
00000100:00100000:2.0:1767320442.349952:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940778496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320442.349976:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940778496:12345-0@lo:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320442.349981:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5097
00000100:00100000:1.0:1767320442.350088:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940777728:0@lo:38:kworker.0
00000100:00100000:1.0:1767320442.350118:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320442.350132:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940777856:0@lo:38:kworker.0
00000100:00100000:1.0:1767320442.350153:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320442.350170:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940778368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320442.350190:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320442.350205:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940778624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320442.350224:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320442.350249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320442.350260:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777728
00000100:00100000:1.0:1767320442.350263:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777728
00000100:00100000:1.0:1767320442.350296:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778368
00000100:00100000:1.0:1767320442.350300:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778368
00000100:00100000:1.0:1767320442.350307:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778624
00000100:00100000:1.0:1767320442.350309:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778624
00000100:00100000:1.0:1767320442.350318:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17874
00000100:00100000:1.0:1767320442.350323:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940777728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320442.350356:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320442.350390:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940777728:12345-0@lo:38:kworker.0 Request processed in 65us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320442.350400:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17874
00000100:00100000:1.0:1767320442.350412:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17875
00000100:00100000:1.0:1767320442.350416:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940778368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320442.350425:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320442.350447:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940778368:12345-0@lo:38:kworker.0 Request processed in 29us (256us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320442.350452:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17875
00000100:00100000:1.0:1767320442.350462:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17876
00000100:00100000:1.0:1767320442.350465:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940778624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320442.350474:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320442.350552:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940778624:12345-0@lo:38:kworker.0 Request processed in 84us (326us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320442.350557:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17876
00000100:00100000:1.0:1767320442.350574:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777856
00000100:00100000:1.0:1767320442.350577:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777856
00000100:00100000:1.0:1767320442.350594:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303
00000100:00100000:1.0:1767320442.350598:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940777856:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320442.350607:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320442.350627:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4430ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940777856:12345-0@lo:38:kworker.0 Request processed in 27us (472us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320442.350632:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303
00000100:00080000:1.0:1767320442.350673:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320442.350678:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320442.350681:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940777728:0@lo:38:kworker.0
00000100:00080000:1.0:1767320442.350690:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320442.350693:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320442.350695:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940777856:0@lo:38:kworker.0
00000100:00080000:1.0:1767320442.350701:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320442.350703:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320442.350706:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4705b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940778368:0@lo:38:kworker.0
00000100:00080000:1.0:1767320442.350711:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320442.350714:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320442.350716:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940778624:0@lo:38:kworker.0
00000100:00100000:0.0:1767320442.351070:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940777984
00000100:00100000:0.0:1767320442.351075:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940777984
00000100:00100000:0.0:1767320442.351127:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778112
00000100:00100000:0.0:1767320442.351131:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778112
00000100:00100000:0.0:1767320442.351161:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289
00000100:00100000:0.0:1767320442.351168:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940777984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.351214:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940777984:12345-0@lo:400:kworker.0 Request processed in 47us (1534us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320442.351221:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289
00000100:00100000:0.0:1767320442.351234:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290
00000100:00100000:0.0:1767320442.351239:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.351264:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778112:12345-0@lo:400:kworker.0 Request processed in 25us (1532us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320442.351283:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290
00000100:00100000:0.0:1767320442.351315:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.351324:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940777984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.351361:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940778496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320442.351371:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940778240:0@lo:400:kworker.0
00000100:00080000:1.0:1767320442.351617:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320442.351621:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320443.052898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320443.309654:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320443.885028:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778752:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320443.885107:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320443.885281:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778752
00000100:00100000:1.0:1767320443.885290:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778752
00000100:00100000:1.0:1767320443.885347:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860
00000100:00100000:1.0:1767320443.885356:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320443.885386:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320443.885425:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320443.885431:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860
00000100:00100000:3.0:1767320443.885645:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778752:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320443.975025:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320443.975069:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320443.975126:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375296
00000100:00100000:3.0:1767320443.975137:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375296
00000100:00100000:2.0:1767320443.975224:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375168
00000100:00100000:2.0:1767320443.975229:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375168
00000100:00100000:2.0:1767320443.975289:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5098
00000100:00100000:2.0:1767320443.975300:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894375296:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320443.975374:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894375296:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320443.975381:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5098
00000100:00100000:2.0:1767320443.975403:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17877
00000100:00100000:2.0:1767320443.975407:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894375168:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320443.975428:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320443.975454:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894375168:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 44us (384us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320443.975461:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17877
00000100:00080000:1.0:1767320443.975539:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320444.077140:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320444.333393:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320444.909277:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320444.909301:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320444.909371:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320444.909886:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940778880
00000100:00100000:2.0:1767320444.909895:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940778880
00000100:00080000:1.0:1767320444.910295:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320444.910645:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861
00000100:00100000:2.0:1767320444.910656:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320444.910686:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320444.910767:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940778880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1395us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320444.910798:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861
00000100:00100000:3.0:1767320444.912980:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940778880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320445.101055:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320445.359463:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320446.125581:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320446.381130:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320447.148899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320447.405075:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320447.469131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320447.469142:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320447.469146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320447.469149:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320447.469153:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320447.469161:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5692
00000100:00080000:2.0:1767320447.469166:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767320447.469174:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320447.469231:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838e00 x1853163940779008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320447.469259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320447.469263:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320447.469265:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320447.469268:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5692
00000100:00080000:2.0:1767320447.469271:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767320447.469274:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320447.469290:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183a680 x1853163940779136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320447.469386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320447.469390:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320447.469392:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320447.469395:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5692
00000100:00080000:2.0:1767320447.469398:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767320447.469402:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320447.469414:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838380 x1853163940779648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320447.469431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320447.469434:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320447.469435:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767320447.469439:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940779008:0@lo:38:kworker.0
00000100:00080000:2.0:1767320447.469439:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5692
00000100:00080000:2.0:1767320447.469441:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320447.469444:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320447.469454:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940779904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320447.469475:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940779776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320447.469507:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320447.469529:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320447.469599:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940779264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.469633:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320447.469664:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320447.469670:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940779392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.469690:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320447.469723:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779264
00000100:00100000:0.0:1767320447.469731:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779264
00000100:00100000:0.0:1767320447.469799:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779392
00000100:00100000:0.0:1767320447.469802:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779392
00000100:00100000:0.0:1767320447.469830:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291
00000100:00100000:0.0:1767320447.469838:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940779264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.469889:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940779264:12345-0@lo:400:kworker.0 Request processed in 50us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320447.469895:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291
00000100:00100000:0.0:1767320447.469912:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292
00000100:00100000:0.0:1767320447.469919:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940779392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.469948:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940779392:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320447.469954:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292
00000100:00080000:0.0:1767320447.469973:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320447.469977:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320447.470027:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940779392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.470037:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940779264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.470078:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779776
00000100:00100000:0.0:1767320447.470082:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779776
00000100:00080000:0.0:1767320447.470097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320447.470122:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779008
00000100:00100000:0.0:1767320447.470126:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779008
00000100:00100000:0.0:1767320447.470141:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5099
00000100:00100000:0.0:1767320447.470148:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940779776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320447.470178:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940779776:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320447.470183:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5099
00000100:00100000:0.0:1767320447.470195:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17878
00000100:00100000:0.0:1767320447.470198:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320447.470216:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320447.470257:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779008:12345-0@lo:38:kworker.0 Request processed in 56us (726us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320447.470263:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17878
00000100:00100000:3.0:1767320447.470375:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940779520:0@lo:400:kworker.0
00000100:00100000:3.0:1767320447.470407:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320447.470454:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779520
00000100:00100000:3.0:1767320447.470458:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779520
00000100:00100000:3.0:1767320447.470495:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5100
00000100:00100000:3.0:1767320447.470500:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940779520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320447.470534:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940779520:12345-0@lo:400:kworker.0 Request processed in 34us (126us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320447.470540:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5100
00000100:00080000:3.0:1767320447.470556:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320447.470573:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940779520:0@lo:400:kworker.0
00000100:00100000:2.0:1767320447.471112:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940779776:0@lo:400:kworker.0
00000100:00080000:1.0:1767320447.478422:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320447.478436:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320447.478441:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940779008:0@lo:38:kworker.0
00000100:00100000:1.0:1767320447.478456:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940779136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320447.478528:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320447.478567:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940779648:0@lo:38:kworker.0
00000100:00100000:1.0:1767320447.478594:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320447.478633:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940779904:0@lo:38:kworker.0
00000100:00100000:1.0:1767320447.478657:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320447.478860:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779648
00000100:00100000:3.0:1767320447.478867:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779648
00000100:00100000:3.0:1767320447.478911:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779904
00000100:00100000:3.0:1767320447.478915:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779904
00000100:00100000:3.0:1767320447.478944:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17879
00000100:00100000:3.0:1767320447.478952:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320447.478975:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320447.479031:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779648:12345-0@lo:38:kworker.0 Request processed in 78us (435us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320447.479039:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17879
00000100:00100000:3.0:1767320447.479059:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17880
00000100:00100000:3.0:1767320447.479063:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320447.479073:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320447.479097:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940779904:12345-0@lo:38:kworker.0 Request processed in 32us (439us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320447.479103:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17880
00000100:00100000:2.0:1767320447.479383:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940779136
00000100:00100000:2.0:1767320447.479389:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940779136
00000100:00100000:2.0:1767320447.479422:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304
00000100:00100000:2.0:1767320447.479427:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940779136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320447.479445:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320447.479476:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940779136:12345-0@lo:38:kworker.0 Request processed in 48us (948us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320447.479481:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304
00000100:00080000:1.0:1767320447.480154:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320447.480161:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320447.480165:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940779904:0@lo:38:kworker.0
00000100:00080000:1.0:1767320447.480178:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320447.480181:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320447.480184:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940779136:0@lo:38:kworker.0
00000100:00080000:1.0:1767320447.480193:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320447.480195:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320447.480198:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940779648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320448.172895:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320448.428994:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320449.007265:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940780032:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320449.007339:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320449.007563:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780032
00000100:00100000:1.0:1767320449.007572:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780032
00000100:00100000:1.0:1767320449.007644:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862
00000100:00100000:1.0:1767320449.007654:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940780032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320449.007686:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:1.0:1767320449.007739:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940780032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (399us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320449.007746:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862
00000100:00080000:3.0:1767320449.007805:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320449.008101:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940780032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320449.096014:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320449.096357:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375424
00000100:00100000:3.0:1767320449.096368:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375424
00000100:00100000:2.0:1767320449.096390:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320449.097606:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375552
00000100:00100000:0.0:1767320449.097615:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375552
00000100:00080000:2.0:1767320449.097688:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320449.097690:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5101
00000100:00100000:0.0:1767320449.097700:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894375552:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320449.097718:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17881
00000100:00100000:2.0:1767320449.097725:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894375424:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320449.097746:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320449.097793:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894375552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (1401us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320449.097795:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894375424:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 71us (1791us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320449.097800:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5101
00000100:00100000:2.0:1767320449.097803:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17881
00000100:00100000:3.0:1767320449.197114:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320449.454935:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320450.029132:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940780160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320450.029231:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320450.029398:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780160
00000100:00100000:2.0:1767320450.029405:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780160
00000100:00100000:2.0:1767320450.029473:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863
00000100:00100000:2.0:1767320450.029484:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940780160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320450.029516:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320450.029604:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320450.033538:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940780160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4043us (4294us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320450.033555:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863
00000100:00100000:3.0:1767320450.034153:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940780160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320450.220916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320450.477731:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320451.245019:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320451.501255:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320452.270166:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320452.528796:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320452.590267:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320452.590277:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320452.590280:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320452.590284:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320452.590288:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320452.590296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5697
00000100:00080000:3.0:1767320452.590302:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767320452.590310:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320452.590349:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940780288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320452.590413:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940780288:0@lo:38:kworker.0
00000100:00100000:1.0:1767320452.590481:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320452.591997:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780288
00000100:00100000:2.0:1767320452.592008:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780288
00000100:00100000:2.0:1767320452.592072:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17882
00000100:00100000:2.0:1767320452.592080:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940780288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320452.592103:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320452.594289:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320452.594298:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320452.594302:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320452.594309:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5697
00000100:00080000:3.0:1767320452.594315:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767320452.594322:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320452.594359:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b90380 x1853163940780416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320452.599300:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940780416:0@lo:38:kworker.0
00000100:00100000:1.0:1767320452.599377:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320452.600696:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940780288:12345-0@lo:38:kworker.0 Request processed in 8611us (10209us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320452.600708:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17882
00000100:00100000:2.0:1767320452.601061:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780416
00000100:00100000:2.0:1767320452.601070:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780416
00000100:00100000:2.0:1767320452.601104:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305
00000100:00100000:2.0:1767320452.601110:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940780416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320452.601132:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320452.601195:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940780416:12345-0@lo:38:kworker.0 Request processed in 84us (1818us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320452.601202:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305
00000100:00080000:1.0:1767320452.603859:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320452.603870:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320452.603876:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940780288:0@lo:38:kworker.0
00000100:00080000:1.0:1767320452.603911:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320452.603915:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320452.603919:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940780416:0@lo:38:kworker.0
00000100:00080000:3.0:1767320452.604272:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320452.604277:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320452.604280:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320452.604284:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5697
00000100:00080000:3.0:1767320452.604288:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767320452.604294:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320452.604312:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70380 x1853163940780928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320452.604329:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320452.604332:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320452.604333:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320452.604337:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5697
00000100:00080000:3.0:1767320452.604339:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320452.604342:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320452.604352:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72a00 x1853163940781184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320452.604378:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940781056:0@lo:400:kworker.0
00000100:00100000:3.0:1767320452.604437:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320452.604487:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320452.604493:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940780800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320452.604515:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320452.604583:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940780928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320452.604609:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320452.604638:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940781184:0@lo:38:kworker.0
00000100:00100000:1.0:1767320452.604657:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320452.604820:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940780544:0@lo:400:kworker.0
00000100:00100000:0.0:1767320452.604853:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320452.604886:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320452.604892:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940780672:0@lo:400:kworker.0
00000100:00100000:0.0:1767320452.604913:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320452.604949:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781056
00000100:00100000:0.0:1767320452.604955:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781056
00000100:00100000:0.0:1767320452.604996:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780800
00000100:00100000:0.0:1767320452.604999:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780800
00000100:00100000:0.0:1767320452.605013:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780928
00000100:00100000:0.0:1767320452.605016:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780928
00000100:00100000:0.0:1767320452.605024:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781184
00000100:00100000:0.0:1767320452.605026:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781184
00000100:00100000:0.0:1767320452.605038:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5102
00000100:00100000:0.0:1767320452.605045:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940781056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320452.605818:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780544
00000100:00100000:1.0:1767320452.605824:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780544
00000100:00100000:1.0:1767320452.605859:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940780672
00000100:00100000:1.0:1767320452.605863:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940780672
00000100:00100000:1.0:1767320452.605885:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293
00000100:00100000:1.0:1767320452.605892:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940780544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320452.605942:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940780544:12345-0@lo:400:kworker.0 Request processed in 50us (1088us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320452.605949:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293
00000100:00100000:1.0:1767320452.605965:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294
00000100:00100000:1.0:1767320452.605971:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940780672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320452.605998:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940780672:12345-0@lo:400:kworker.0 Request processed in 28us (1085us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320452.606004:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294
00000100:00080000:1.0:1767320452.606020:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320452.606024:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320452.606027:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320452.606038:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5103
00000100:00100000:1.0:1767320452.606046:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940780800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320452.606280:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17883
00000100:00100000:3.0:1767320452.606287:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940780928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320452.606307:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320452.606345:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4705a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940780928:12345-0@lo:38:kworker.0 Request processed in 57us (1735us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320452.606351:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17883
00000100:00100000:3.0:1767320452.606368:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17884
00000100:00100000:3.0:1767320452.606372:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940781184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320452.606382:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320452.606405:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940781184:12345-0@lo:38:kworker.0 Request processed in 32us (1747us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320452.606410:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17884
00000100:00100000:3.0:1767320452.606474:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940780672:0@lo:400:kworker.0
00000100:00100000:3.0:1767320452.606485:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940780544:0@lo:400:kworker.0
00000100:00100000:0.0:1767320452.606613:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940781056:12345-0@lo:400:kworker.0 Request processed in 1567us (2173us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320452.606620:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5102
00000100:00080000:0.0:1767320452.606655:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320452.606660:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320452.606663:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940780928:0@lo:38:kworker.0
00000100:00080000:0.0:1767320452.606672:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320452.606675:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320452.606678:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940781184:0@lo:38:kworker.0
00000100:00100000:1.0:1767320452.607261:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7028:x1853163940780800:12345-0@lo:400:kworker.0 Request processed in 1214us (2742us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320452.607268:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5103
00000100:00100000:3.0:1767320452.607347:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7028:1853163940780800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320452.607358:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940781056:0@lo:400:kworker.0
00000400:00000100:1.0:1767320453.193507:0:7018:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894375680 offset 0 length 520: 4
00000100:00100000:2.0:1767320453.196412:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320453.196603:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375808
00000100:00100000:1.0:1767320453.196614:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375808
00000100:00100000:1.0:1767320453.196668:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17885
00000100:00100000:1.0:1767320453.196677:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894375808:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:3.0:1767320453.196692:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00010000:00020000:1.0:1767320453.196703:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320453.196807:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2501:x1853163894375808:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 94us (370us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320453.196815:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17885
00000100:00100000:2.0:1767320453.198479:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894375936
00000100:00100000:2.0:1767320453.198493:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894375936
00000100:00100000:2.0:1767320453.198559:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5104
00000100:00100000:2.0:1767320453.198568:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894375936:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320453.198647:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894375936:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (1955us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320453.198654:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5104
00000100:00080000:0.0:1767320453.199769:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320453.292906:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320453.549010:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320454.128070:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320454.129992:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940781312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320454.130070:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320454.130600:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781312
00000100:00100000:0.0:1767320454.130608:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781312
00000100:00100000:0.0:1767320454.130668:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864
00000100:00100000:0.0:1767320454.130677:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940781312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320454.130711:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320454.130767:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940781312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (697us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320454.130793:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864
00000100:00100000:3.0:1767320454.130885:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940781312:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320454.134457:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320454.316898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320454.573021:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320455.149363:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320455.149387:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940781440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320455.149452:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320455.149573:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781440
00000100:00100000:2.0:1767320455.149581:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781440
00000100:00100000:2.0:1767320455.149635:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865
00000100:00100000:2.0:1767320455.149643:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940781440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320455.149673:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320455.149718:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940781440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (265us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320455.149724:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865
00000100:00080000:1.0:1767320455.149846:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320455.149880:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940781440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320455.340917:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320455.597089:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320456.364919:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320456.621673:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320457.388905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320457.645014:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320457.709025:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320457.709035:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320457.709038:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320457.709041:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320457.709046:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320457.709053:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5702
00000100:00080000:3.0:1767320457.709059:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767320457.709067:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320457.709120:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70a80 x1853163940781568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320457.709156:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320457.709160:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320457.709162:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320457.709165:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5702
00000100:00080000:3.0:1767320457.709168:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767320457.709172:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320457.709188:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71880 x1853163940781696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320457.709256:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320457.709260:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320457.709261:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320457.709265:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5702
00000100:00080000:3.0:1767320457.709268:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767320457.709271:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320457.709283:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b72680 x1853163940782208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320457.709297:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320457.709300:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320457.709303:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320457.709306:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5702
00000100:00080000:3.0:1767320457.709308:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320457.709312:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320457.709326:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70e00 x1853163940782464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320457.709352:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940782336:0@lo:400:kworker.0
00000100:00100000:3.0:1767320457.709412:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320457.709467:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320457.709472:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940782080:0@lo:400:kworker.0
00000100:00100000:3.0:1767320457.709492:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320457.709520:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782336
00000100:00100000:3.0:1767320457.709527:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782336
00000100:00100000:3.0:1767320457.709577:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782080
00000100:00100000:3.0:1767320457.709581:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782080
00000100:00100000:3.0:1767320457.709609:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5105
00000100:00100000:3.0:1767320457.709618:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940782336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320457.709663:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940782336:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320457.709682:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5105
00000100:00100000:3.0:1767320457.709700:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5106
00000100:00100000:3.0:1767320457.709706:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940782080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320457.709732:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940782080:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320457.709738:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5106
00000100:00100000:3.0:1767320457.709798:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940782080:0@lo:400:kworker.0
00000100:00100000:3.0:1767320457.709811:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940782336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320457.709890:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940781568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320457.709920:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320457.709959:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940781696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320457.709984:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320457.710002:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940782208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320457.710022:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320457.710037:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940782464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320457.710068:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320457.710097:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781696
00000100:00100000:1.0:1767320457.710101:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781696
00000100:00100000:1.0:1767320457.710121:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306
00000100:00100000:1.0:1767320457.710134:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940781696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320457.710153:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320457.710187:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940781696:12345-0@lo:38:kworker.0 Request processed in 60us (202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320457.710193:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306
00000100:00100000:1.0:1767320457.710211:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781568
00000100:00100000:1.0:1767320457.710214:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781568
00000100:00100000:1.0:1767320457.710229:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782208
00000100:00100000:1.0:1767320457.710232:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782208
00000100:00100000:1.0:1767320457.710242:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782464
00000100:00100000:1.0:1767320457.710244:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782464
00000100:00100000:1.0:1767320457.710252:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17886
00000100:00100000:1.0:1767320457.710256:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940781568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320457.710266:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320457.710291:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940781568:12345-0@lo:38:kworker.0 Request processed in 33us (370us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320457.710297:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17886
00000100:00100000:1.0:1767320457.710307:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17887
00000100:00100000:1.0:1767320457.710311:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940782208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320457.710320:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320457.710341:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940782208:12345-0@lo:38:kworker.0 Request processed in 29us (318us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320457.710346:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17887
00000100:00100000:1.0:1767320457.710356:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17888
00000100:00100000:1.0:1767320457.710360:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940782464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320457.710369:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320457.710389:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940782464:12345-0@lo:38:kworker.0 Request processed in 28us (321us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320457.710395:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17888
00000100:00080000:1.0:1767320457.710410:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320457.710436:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320457.710441:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320457.710444:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940781568:0@lo:38:kworker.0
00000100:00080000:1.0:1767320457.710451:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320457.710454:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320457.710457:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940781696:0@lo:38:kworker.0
00000100:00080000:1.0:1767320457.710463:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320457.710466:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320457.710469:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940782208:0@lo:38:kworker.0
00000100:00080000:1.0:1767320457.710475:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320457.710478:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320457.710480:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940782464:0@lo:38:kworker.0
00000100:00100000:0.0:1767320457.710572:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940781824:0@lo:400:kworker.0
00000100:00100000:0.0:1767320457.710604:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320457.710639:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320457.710645:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940781952:0@lo:400:kworker.0
00000100:00100000:0.0:1767320457.710665:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320457.710695:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781824
00000100:00100000:0.0:1767320457.710699:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781824
00000100:00100000:0.0:1767320457.710731:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940781952
00000100:00100000:0.0:1767320457.710734:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940781952
00000100:00100000:0.0:1767320457.710756:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295
00000100:00100000:0.0:1767320457.710763:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940781824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320457.710829:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940781824:12345-0@lo:400:kworker.0 Request processed in 67us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320457.710835:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295
00000100:00100000:0.0:1767320457.710847:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296
00000100:00100000:0.0:1767320457.710853:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940781952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320457.710878:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940781952:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320457.710883:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296
00000100:00080000:0.0:1767320457.710918:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320457.710921:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320457.710938:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940781952:0@lo:400:kworker.0
00000100:00100000:0.0:1767320457.710946:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940781824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320458.310524:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320458.310659:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320458.316480:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376064
00000100:00100000:2.0:1767320458.316506:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376064
00000100:00100000:2.0:1767320458.316598:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376192
00000100:00100000:2.0:1767320458.316602:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376192
00000100:00100000:2.0:1767320458.316686:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5107
00000100:00100000:2.0:1767320458.316698:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894376192:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:2.0:1767320458.316842:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894376192:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 145us (6182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320458.316851:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5107
00000100:00100000:2.0:1767320458.316874:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17889
00000100:00100000:2.0:1767320458.316879:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894376064:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:2.0:1767320458.316918:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320458.316949:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894376064:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 69us (6442us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320458.316956:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17889
00000100:00080000:1.0:1767320458.317239:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320458.415886:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320458.670133:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320459.245150:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940782592:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320459.245263:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320459.245337:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782592
00000100:00100000:2.0:1767320459.245348:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782592
00000100:00080000:3.0:1767320459.245677:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320459.246301:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866
00000100:00100000:3.0:1767320459.246470:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940782592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320459.246512:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320459.246591:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940782592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (1328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320459.246667:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940782592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320459.253642:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866
00000100:00100000:3.0:1767320459.438413:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320459.693989:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320460.269193:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320460.269225:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940782720:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320460.269320:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320460.269723:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782720
00000100:00100000:2.0:1767320460.269734:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782720
00000100:00100000:2.0:1767320460.269851:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867
00000100:00100000:2.0:1767320460.269862:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940782720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320460.269907:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320460.269967:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940782720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (647us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320460.269976:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867
00000100:00080000:1.0:1767320460.270153:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320460.270205:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940782720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320460.460943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320460.727537:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320461.484930:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320461.741575:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320462.509439:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320462.765061:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320462.829028:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320437/real 1767320437]  req@ffff93cf459fa680 x1853163940776320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320462 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320462.829074:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf459fa680 x1853163940776320/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320462 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320462.829110:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320462.829141:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320462.829145:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf459fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940776320:0@lo:250:kworker.0
00000100:00080000:2.0:1767320462.829255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320462.829262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320462.829266:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320462.829272:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5687
00000100:00080000:2.0:1767320462.829277:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320462.829284:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320462.829327:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51839c00 x1853163940782848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320462.829354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320462.829358:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320462.829360:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320462.829364:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5707
00000100:00080000:2.0:1767320462.829366:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320462.829370:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320462.829387:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51838e00 x1853163940782976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320462.829397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320462.829400:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320462.829402:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320462.829406:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5707
00000100:00080000:2.0:1767320462.829409:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320462.829413:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320462.829427:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf5183b100 x1853163940783104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320462.829512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320462.829516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320462.829518:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320462.829521:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5707
00000100:00080000:2.0:1767320462.829524:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320462.829528:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320462.829544:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc2a00 x1853163940783616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320462.829559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320462.829562:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320462.829564:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320462.829568:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5707
00000100:00080000:2.0:1767320462.829571:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320462.829574:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320462.829591:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf43dc1180 x1853163940783872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320462.829736:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940783488:0@lo:400:kworker.0
00000100:00100000:1.0:1767320462.829859:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.829929:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320462.829937:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940783744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320462.829961:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.829988:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940782848:0@lo:250:kworker.0
00000400:00000100:1.0:1767320462.830011:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940782848 offset 0 length 520: 4
00000100:00100000:1.0:1767320462.830029:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940782976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320462.830051:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.830069:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940783104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320462.830105:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.830122:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940783616:0@lo:38:kworker.0
00000100:00100000:1.0:1767320462.830145:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.830160:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940783872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320462.830182:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320462.830236:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783488
00000100:00100000:1.0:1767320462.830244:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783488
00000100:00100000:1.0:1767320462.830310:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783744
00000100:00100000:1.0:1767320462.830313:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783744
00000100:00100000:1.0:1767320462.830336:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108
00000100:00100000:1.0:1767320462.830344:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940783488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320462.830404:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940783488:12345-0@lo:400:kworker.0 Request processed in 60us (545us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320462.830413:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108
00000100:00100000:1.0:1767320462.830431:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940782976
00000100:00100000:1.0:1767320462.830435:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940782976
00000100:00100000:1.0:1767320462.830444:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783616
00000100:00100000:1.0:1767320462.830447:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783616
00000100:00100000:1.0:1767320462.830951:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783872
00000100:00100000:1.0:1767320462.830956:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783872
00000100:00100000:1.0:1767320462.830969:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109
00000100:00100000:1.0:1767320462.830977:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940783744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320462.831018:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7027:x1853163940783744:12345-0@lo:400:kworker.0 Request processed in 43us (1056us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320462.831024:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109
00000100:00100000:1.0:1767320462.831039:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17890
00000100:00100000:1.0:1767320462.831044:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940782976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320462.831069:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320462.831119:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940782976:12345-0@lo:38:kworker.0 Request processed in 74us (1067us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320462.831126:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17890
00000100:00100000:1.0:1767320462.831138:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17891
00000100:00100000:1.0:1767320462.831142:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940783616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320462.831151:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320462.831175:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940783616:12345-0@lo:38:kworker.0 Request processed in 32us (1029us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320462.831180:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17891
00000100:00100000:1.0:1767320462.831192:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17892
00000100:00100000:1.0:1767320462.831196:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940783872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320462.831205:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320462.831226:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940783872:12345-0@lo:38:kworker.0 Request processed in 29us (1044us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320462.831232:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17892
00000100:00080000:1.0:1767320462.831262:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320462.831313:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7027:1853163940783744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320462.831326:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf4fc08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940783488:0@lo:400:kworker.0
00000100:00080000:1.0:1767320462.831367:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320462.831372:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320462.831375:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940782976:0@lo:38:kworker.0
00000100:00080000:1.0:1767320462.831385:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320462.831388:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320462.831391:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940783616:0@lo:38:kworker.0
00000100:00080000:1.0:1767320462.831398:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320462.831402:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320462.831404:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940783872:0@lo:38:kworker.0
00000100:00100000:2.0:1767320462.831580:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783104
00000100:00100000:2.0:1767320462.831586:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783104
00000100:00100000:2.0:1767320462.831617:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307
00000100:00100000:2.0:1767320462.831624:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940783104:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320462.831635:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320462.831676:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940783104:12345-0@lo:38:kworker.0 Request processed in 51us (1569us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320462.831682:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307
00000100:00080000:2.0:1767320462.831708:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320462.831712:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320462.831715:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940783104:0@lo:38:kworker.0
00000100:00100000:3.0:1767320462.831836:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940783232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320462.831881:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320462.831909:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320462.831915:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940783360:0@lo:400:kworker.0
00000100:00100000:3.0:1767320462.831932:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320462.831966:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783232
00000100:00100000:3.0:1767320462.831970:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783232
00000100:00100000:3.0:1767320462.832006:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940783360
00000100:00100000:3.0:1767320462.832008:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940783360
00000100:00100000:3.0:1767320462.832025:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297
00000100:00100000:3.0:1767320462.832033:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940783232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320462.832068:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940783232:12345-0@lo:400:kworker.0 Request processed in 38us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320462.832073:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297
00000100:00100000:3.0:1767320462.832100:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298
00000100:00100000:3.0:1767320462.832107:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940783360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320462.832132:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940783360:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320462.832137:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298
00000100:00080000:3.0:1767320462.832151:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320462.832154:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320462.832170:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940783360:0@lo:400:kworker.0
00000100:00100000:3.0:1767320462.832180:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940783232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320463.433518:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320463.433577:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320463.433747:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376448
00000100:00100000:3.0:1767320463.433762:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376448
00000100:00100000:3.0:1767320463.433890:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376320
00000100:00100000:3.0:1767320463.433895:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376320
00000100:00100000:3.0:1767320463.433921:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5110
00000100:00100000:3.0:1767320463.433937:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894376448:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320463.434043:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894376448:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 112us (540us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320463.434052:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5110
00000100:00100000:3.0:1767320463.434086:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17893
00000100:00100000:3.0:1767320463.434090:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894376320:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320463.434117:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320463.434145:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894376320:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 53us (568us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320463.434151:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17893
00000100:00080000:2.0:1767320463.434361:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320463.533107:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320463.789058:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320464.366468:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320464.366503:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940784000:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320464.366603:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320464.366761:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784000
00000100:00100000:2.0:1767320464.366801:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784000
00000100:00100000:2.0:1767320464.366889:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868
00000100:00100000:2.0:1767320464.366900:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940784000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320464.366944:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320464.367003:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940784000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (399us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320464.367011:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868
00000100:00100000:2.0:1767320464.367080:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf520d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940784000:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320464.367167:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320464.556937:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320464.813810:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320465.390034:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320465.390075:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940784128:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320465.390187:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320465.390469:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784128
00000100:00100000:0.0:1767320465.390481:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784128
00000100:00100000:0.0:1767320465.390569:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869
00000100:00100000:0.0:1767320465.390581:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940784128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320465.390620:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320465.390672:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940784128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (485us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320465.390680:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869
00000100:00080000:3.0:1767320465.390797:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320465.390843:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940784128:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320465.580943:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320465.837557:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320466.604927:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320466.862285:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320467.628940:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320467.885086:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320467.949495:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320467.949508:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320467.949511:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320467.949515:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320467.949520:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320467.949531:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5712
00000100:00080000:0.0:1767320467.949537:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320467.949545:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320467.949600:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47170380 x1853163940784256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320467.949638:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320467.949642:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320467.949644:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320467.949648:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5712
00000100:00080000:0.0:1767320467.949651:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320467.949655:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320467.949672:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf47173b80 x1853163940784384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320467.949747:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320467.949751:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320467.949753:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320467.949756:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5712
00000100:00080000:0.0:1767320467.949759:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320467.949763:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320467.949802:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ace00 x1853163940784896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320467.949821:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320467.949825:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320467.949826:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320467.949830:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5712
00000100:00080000:0.0:1767320467.949833:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320467.949837:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320467.949848:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519af480 x1853163940785152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320467.950106:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940784256:0@lo:38:kworker.0
00000100:00100000:1.0:1767320467.950196:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950280:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940784384:0@lo:38:kworker.0
00000100:00100000:1.0:1767320467.950309:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950327:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940784896:0@lo:38:kworker.0
00000100:00100000:1.0:1767320467.950349:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950364:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940785152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320467.950384:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950423:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940785024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320467.950451:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950472:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320467.950477:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940784768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320467.950498:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320467.950532:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784256
00000100:00100000:1.0:1767320467.950541:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784256
00000100:00100000:1.0:1767320467.950581:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784896
00000100:00100000:1.0:1767320467.950583:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784896
00000100:00100000:1.0:1767320467.950592:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785152
00000100:00100000:1.0:1767320467.950593:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785152
00000100:00100000:1.0:1767320467.950601:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785024
00000100:00100000:1.0:1767320467.950603:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785024
00000100:00100000:1.0:1767320467.950640:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784768
00000100:00100000:1.0:1767320467.950643:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784768
00000100:00100000:1.0:1767320467.950664:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5111
00000100:00100000:1.0:1767320467.950673:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940785024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320467.950732:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940785024:12345-0@lo:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320467.950740:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5111
00000100:00100000:1.0:1767320467.950760:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5112
00000100:00100000:1.0:1767320467.950766:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940784768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320467.950831:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940784768:12345-0@lo:400:kworker.0 Request processed in 64us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320467.950837:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5112
00000100:00100000:1.0:1767320467.950850:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17894
00000100:00100000:1.0:1767320467.950854:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940784256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320467.950878:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320467.950913:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940784256:12345-0@lo:38:kworker.0 Request processed in 57us (717us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320467.950920:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17894
00000100:00100000:1.0:1767320467.950931:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17895
00000100:00100000:1.0:1767320467.950935:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940784896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320467.950944:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320467.950965:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940784896:12345-0@lo:38:kworker.0 Request processed in 28us (615us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320467.950970:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17895
00000100:00100000:1.0:1767320467.950980:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17896
00000100:00100000:1.0:1767320467.950984:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940785152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320467.950993:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320467.951014:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940785152:12345-0@lo:38:kworker.0 Request processed in 28us (629us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320467.951020:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17896
00000100:00100000:1.0:1767320467.951082:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940784768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320467.951094:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940785024:0@lo:400:kworker.0
00000100:00080000:1.0:1767320467.951130:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320467.951136:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320467.951139:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940784256:0@lo:38:kworker.0
00000100:00080000:1.0:1767320467.951147:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320467.951150:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320467.951153:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940784896:0@lo:38:kworker.0
00000100:00080000:1.0:1767320467.951160:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320467.951164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320467.951167:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940785152:0@lo:38:kworker.0
00000100:00100000:2.0:1767320467.952074:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784384
00000100:00100000:2.0:1767320467.952097:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784384
00000100:00100000:2.0:1767320467.952161:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308
00000100:00100000:2.0:1767320467.952170:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940784384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320467.952196:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320467.952241:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940784512:0@lo:400:kworker.0
00000100:00100000:2.0:1767320467.952278:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf520d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940784384:12345-0@lo:38:kworker.0 Request processed in 109us (1967us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320467.952289:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308
00000100:00100000:3.0:1767320467.952298:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320467.952349:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940784640:0@lo:400:kworker.0
00000100:00080000:3.0:1767320467.952358:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320467.952376:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784512
00000100:00100000:2.0:1767320467.952377:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320467.952379:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784512
00000100:00100000:2.0:1767320467.952413:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940784640
00000100:00100000:2.0:1767320467.952417:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940784640
00000100:00100000:3.0:1767320467.952421:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299
00000100:00100000:3.0:1767320467.952429:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940784512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320467.952442:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300
00000100:00100000:2.0:1767320467.952448:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940784640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320467.952471:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940784512:12345-0@lo:400:kworker.0 Request processed in 45us (172us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320467.952476:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940784640:12345-0@lo:400:kworker.0 Request processed in 28us (98us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320467.952478:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299
00000100:00100000:2.0:1767320467.952481:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300
00000100:00080000:3.0:1767320467.952502:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320467.952504:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320467.952514:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940784640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320467.952516:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940784512:0@lo:400:kworker.0
00000100:00080000:1.0:1767320467.952610:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320467.952616:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320467.952620:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf47173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940784384:0@lo:38:kworker.0
00000100:00100000:2.0:1767320468.551587:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320468.551642:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320468.551822:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376576
00000100:00100000:3.0:1767320468.551835:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376576
00000100:00100000:3.0:1767320468.551890:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376704
00000100:00100000:3.0:1767320468.551893:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376704
00000100:00100000:3.0:1767320468.551952:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5113
00000100:00100000:3.0:1767320468.551959:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894376704:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320468.552016:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17897
00000100:00100000:0.0:1767320468.552025:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894376576:12345-192.168.202.21@tcp:38:kworker.0
00000100:00100000:3.0:1767320468.552059:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894376704:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (410us total) trans 0 rc 0/0
00010000:00020000:0.0:1767320468.552064:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320468.552074:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5113
00000100:00100000:0.0:1767320468.552106:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894376576:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 80us (531us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320468.552115:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17897
00000100:00080000:1.0:1767320468.552406:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320468.654134:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320468.909617:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320469.485389:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320469.486093:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940785280:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320469.486187:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320469.486409:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785280
00000100:00100000:0.0:1767320469.486421:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785280
00000100:00100000:0.0:1767320469.486524:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870
00000100:00100000:0.0:1767320469.486535:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940785280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320469.486573:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320469.486641:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940785280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (453us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320469.486649:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870
00000100:00080000:1.0:1767320469.486651:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320469.488681:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940785280:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320469.676868:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320469.933360:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320470.509403:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940785408:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320470.509526:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320470.510188:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785408
00000100:00100000:2.0:1767320470.510201:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785408
00000100:00100000:2.0:1767320470.510338:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871
00000100:00100000:2.0:1767320470.510349:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940785408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320470.510394:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:1.0:1767320470.510736:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320470.510827:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940785408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 479us (1300us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320470.510924:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871
00000100:00100000:3.0:1767320470.511095:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940785408:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320470.701510:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320470.957052:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320471.724900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320471.985441:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320472.750256:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320473.005099:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320473.069371:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320473.069385:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320473.069389:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320473.069394:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320473.069400:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320473.069411:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5717
00000100:00080000:3.0:1767320473.069417:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320473.069425:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320473.069491:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b71880 x1853163940785536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320473.069522:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320473.069526:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320473.069528:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320473.069532:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5717
00000100:00080000:3.0:1767320473.069535:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320473.069539:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320473.069559:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d042b70a80 x1853163940785664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320473.069650:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320473.069654:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320473.069655:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320473.069659:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5717
00000100:00080000:3.0:1767320473.069662:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320473.069666:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320473.069678:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45b91f80 x1853163940786176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320473.069697:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320473.069700:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320473.069702:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320473.069705:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5717
00000100:00080000:3.0:1767320473.069708:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320473.069712:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320473.069723:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07b0c3800 x1853163940786432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320473.069751:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940785920:0@lo:400:kworker.0
00000100:00100000:3.0:1767320473.069754:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940786048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320473.069861:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940785536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320473.069925:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940785792:0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.073176:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320473.073330:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785920
00000100:00100000:1.0:1767320473.073343:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785920
00000100:00100000:1.0:1767320473.073431:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301
00000100:00100000:1.0:1767320473.073443:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940785920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.073517:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940785920:12345-0@lo:400:kworker.0 Request processed in 76us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320473.073525:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301
00000100:00080000:1.0:1767320473.073553:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320473.073602:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940785920:0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.073667:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940786304:0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.073710:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320473.073746:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786304
00000100:00100000:1.0:1767320473.073751:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786304
00000100:00100000:1.0:1767320473.075111:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5114
00000100:00100000:1.0:1767320473.075133:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940786304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.075219:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940786304:12345-0@lo:400:kworker.0 Request processed in 97us (1508us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320473.075230:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5114
00000100:00080000:1.0:1767320473.075266:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320473.075309:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940786304:0@lo:400:kworker.0
00000100:00100000:2.0:1767320473.077557:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320473.077749:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940785664:0@lo:38:kworker.0
00000100:00100000:2.0:1767320473.077819:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320473.077854:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940786176:0@lo:38:kworker.0
00000100:00100000:2.0:1767320473.077879:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320473.077900:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940786432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320473.077922:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320473.078000:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785664
00000100:00100000:2.0:1767320473.078011:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785664
00000100:00100000:2.0:1767320473.078061:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309
00000100:00100000:2.0:1767320473.078069:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940785664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320473.078097:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320473.078145:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940785664:12345-0@lo:38:kworker.0 Request processed in 75us (325us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320473.078153:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309
00000100:00100000:2.0:1767320473.078180:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785536
00000100:00100000:2.0:1767320473.078184:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785536
00000100:00100000:2.0:1767320473.078207:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786176
00000100:00100000:2.0:1767320473.078210:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786176
00000100:00100000:2.0:1767320473.078225:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786432
00000100:00100000:2.0:1767320473.078228:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786432
00000100:00100000:2.0:1767320473.078245:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17898
00000100:00100000:2.0:1767320473.078249:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940785536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320473.078260:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320473.078287:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940785536:12345-0@lo:38:kworker.0 Request processed in 37us (740us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320473.078298:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17898
00000100:00100000:2.0:1767320473.078309:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17899
00000100:00100000:2.0:1767320473.078312:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940786176:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320473.078321:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320473.078348:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940786176:12345-0@lo:38:kworker.0 Request processed in 34us (469us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320473.078354:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17899
00000100:00100000:2.0:1767320473.078364:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17900
00000100:00100000:2.0:1767320473.078367:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940786432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320473.078376:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320473.078399:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940786432:12345-0@lo:38:kworker.0 Request processed in 30us (475us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320473.078405:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17900
00000100:00080000:2.0:1767320473.079014:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320473.079023:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320473.079027:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940785536:0@lo:38:kworker.0
00000100:00080000:2.0:1767320473.079042:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320473.079046:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320473.079050:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940785664:0@lo:38:kworker.0
00000100:00080000:2.0:1767320473.079059:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320473.079063:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320473.079067:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940786176:0@lo:38:kworker.0
00000100:00080000:2.0:1767320473.079078:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320473.079082:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320473.079085:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940786432:0@lo:38:kworker.0
00000100:00100000:3.0:1767320473.079216:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320473.079308:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786048
00000100:00100000:1.0:1767320473.079315:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786048
00000100:00100000:1.0:1767320473.079400:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115
00000100:00100000:1.0:1767320473.079409:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940786048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.079481:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940786048:12345-0@lo:400:kworker.0 Request processed in 73us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320473.079488:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115
00000100:00100000:3.0:1767320473.079575:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940786048:0@lo:400:kworker.0
00000100:00080000:2.0:1767320473.079862:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320473.079954:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320473.080075:0:40543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940785792
00000100:00100000:1.0:1767320473.080079:0:40543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940785792
00000100:00100000:1.0:1767320473.080167:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302
00000100:00100000:1.0:1767320473.080175:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940785792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320473.080227:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940785792:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320473.080233:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302
00000100:00100000:0.0:1767320473.080303:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d042b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940785792:0@lo:400:kworker.0
00000100:00080000:2.0:1767320473.080382:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320473.676182:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320473.676331:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376832
00000100:00100000:3.0:1767320473.676346:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376832
00000100:00100000:3.0:1767320473.676419:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17901
00000100:00100000:3.0:1767320473.676429:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894376832:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320473.676461:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320473.676555:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894376832:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 126us (388us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320473.676563:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17901
00000100:00100000:2.0:1767320473.677219:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320473.677287:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894376960
00000100:00100000:3.0:1767320473.677293:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894376960
00000100:00080000:2.0:1767320473.677423:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320473.677463:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5116
00000100:00100000:3.0:1767320473.677474:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894376960:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320473.677550:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894376960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320473.677558:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5116
00000100:00100000:3.0:1767320473.773707:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320474.029460:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320474.605458:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940786560:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320474.605568:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320474.605736:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786560
00000100:00100000:3.0:1767320474.605748:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786560
00000100:00100000:3.0:1767320474.605842:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872
00000100:00100000:3.0:1767320474.605862:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940786560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320474.605904:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320474.605969:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf519af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940786560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320474.605987:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872
00000100:00100000:3.0:1767320474.606051:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf5183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940786560:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320474.796938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320475.054070:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320475.635014:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320475.638889:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940786688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320475.639009:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320475.640659:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786688
00000100:00100000:1.0:1767320475.640676:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786688
00000100:00100000:1.0:1767320475.640836:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873
00000100:00100000:1.0:1767320475.640849:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940786688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320475.640895:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:1.0:1767320475.641019:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940786688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (2008us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320475.641029:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873
00000100:00080000:2.0:1767320475.641185:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320475.641314:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940786688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320475.820938:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320476.077089:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320476.845355:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320477.101809:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320477.869543:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320478.125345:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320478.190676:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320478.190691:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320478.190694:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320478.190699:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320478.190706:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320478.190718:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5723
00000100:00080000:0.0:1767320478.190724:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320478.190733:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320478.190808:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519afb80 x1853163940786816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320478.190829:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320478.190833:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320478.190835:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320478.190839:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5723
00000100:00080000:0.0:1767320478.190842:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320478.190846:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320478.190860:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940786944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320478.190929:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320478.190934:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320478.190935:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320478.190951:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5723
00000100:00080000:0.0:1767320478.190954:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320478.190959:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320478.190973:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac700 x1853163940787456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320478.190999:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320478.191002:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320478.191005:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320478.191009:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5723
00000100:00080000:0.0:1767320478.191011:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320478.191015:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320478.191025:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2300 x1853163940787712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320478.191065:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940787328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320478.191158:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320478.191575:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320478.191662:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940787584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320478.192580:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940786816:0@lo:38:kworker.0
00000100:00100000:3.0:1767320478.195728:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320478.195847:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320478.195863:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787200:0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.195911:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320478.195977:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787072
00000100:00100000:3.0:1767320478.195987:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787072
00000100:00100000:3.0:1767320478.196053:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787200
00000100:00100000:3.0:1767320478.196056:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787200
00000100:00100000:3.0:1767320478.196080:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303
00000100:00100000:3.0:1767320478.196090:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.196158:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787072:12345-0@lo:400:kworker.0 Request processed in 71us (440us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320478.196166:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303
00000100:00100000:3.0:1767320478.196188:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304
00000100:00100000:3.0:1767320478.196195:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.196221:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787200:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320478.196226:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304
00000100:00080000:3.0:1767320478.196249:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320478.196252:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320478.196297:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787200:0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.196329:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787072:0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.196645:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787328
00000100:00100000:3.0:1767320478.196650:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787328
00000100:00100000:3.0:1767320478.196690:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5117
00000100:00100000:3.0:1767320478.196698:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940787328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.196737:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940787328:12345-0@lo:400:kworker.0 Request processed in 40us (5580us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320478.196743:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5117
00000100:00080000:3.0:1767320478.196758:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320478.199339:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320478.199425:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787584
00000100:00100000:3.0:1767320478.199565:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787584
00000100:00100000:3.0:1767320478.199699:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118
00000100:00100000:3.0:1767320478.199711:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940787584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320478.199769:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940787328:0@lo:400:kworker.0
00000100:00100000:3.0:1767320478.199812:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940787584:12345-0@lo:400:kworker.0 Request processed in 103us (484us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320478.199821:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118
00000100:00100000:3.0:1767320478.199875:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940787584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320478.199914:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320478.199961:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940786944:0@lo:38:kworker.0
00000100:00100000:3.0:1767320478.199978:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786816
00000100:00100000:3.0:1767320478.199984:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786816
00000100:00100000:1.0:1767320478.200007:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320478.200018:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17902
00000100:00100000:3.0:1767320478.200024:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940786816:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320478.200033:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940787456:0@lo:38:kworker.0
00010000:00020000:3.0:1767320478.200048:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320478.200061:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320478.200086:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940787712:0@lo:38:kworker.0
00000100:00100000:3.0:1767320478.200092:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf5183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940786816:12345-0@lo:38:kworker.0 Request processed in 65us (176us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320478.200100:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17902
00000100:00100000:3.0:1767320478.200111:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787456
00000100:00100000:3.0:1767320478.200115:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787456
00000100:00100000:1.0:1767320478.200120:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320478.201244:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320478.201277:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940786944
00000100:00100000:2.0:1767320478.201284:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940786944
00000100:00080000:1.0:1767320478.201295:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320478.201305:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320478.201310:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940786816:0@lo:38:kworker.0
00000100:00100000:2.0:1767320478.201340:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310
00000100:00100000:2.0:1767320478.201351:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940786944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320478.201369:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320478.201423:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787712
00000100:00100000:3.0:1767320478.201428:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787712
00000100:00100000:3.0:1767320478.201451:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17903
00000100:00100000:3.0:1767320478.201455:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940787456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320478.201464:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320478.201508:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940787456:12345-0@lo:38:kworker.0 Request processed in 51us (1447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320478.201514:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17903
00000100:00100000:3.0:1767320478.201527:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17904
00000100:00100000:3.0:1767320478.201530:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940787712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320478.201537:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320478.201555:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7024:x1853163940787712:12345-0@lo:38:kworker.0 Request processed in 24us (1438us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320478.201560:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17904
00000100:00100000:2.0:1767320478.201902:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940786944:12345-0@lo:38:kworker.0 Request processed in 550us (1894us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320478.201909:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310
00000100:00080000:0.0:1767320478.202020:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320478.202027:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320478.202030:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940786944:0@lo:38:kworker.0
00000100:00080000:0.0:1767320478.202040:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320478.202044:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320478.202047:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940787456:0@lo:38:kworker.0
00000100:00080000:0.0:1767320478.202056:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320478.202059:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320478.202062:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940787712:0@lo:38:kworker.0
00000100:00100000:2.0:1767320478.791469:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320478.791526:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320478.791633:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377216
00000100:00100000:1.0:1767320478.791646:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377216
00000100:00100000:1.0:1767320478.791731:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377088
00000100:00100000:1.0:1767320478.791734:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377088
00000100:00100000:1.0:1767320478.791762:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5119
00000100:00100000:1.0:1767320478.791835:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894377216:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320478.791869:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17905
00000100:00100000:3.0:1767320478.791883:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894377088:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320478.791911:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320478.791948:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894377216:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 165us (483us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320478.791959:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5119
00000100:00100000:3.0:1767320478.792002:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894377088:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 117us (471us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320478.792031:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17905
00000100:00080000:2.0:1767320478.792406:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767320478.804846:0:7019:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894377344 offset 0 length 520: 4
00000100:00100000:3.0:1767320478.893060:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320479.149534:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320479.728887:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787840:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320479.729048:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320479.729155:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787840
00000100:00100000:3.0:1767320479.729167:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787840
00000100:00100000:3.0:1767320479.729232:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874
00000100:00100000:3.0:1767320479.729242:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320479.729285:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320479.729336:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320479.729350:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874
00000100:00100000:3.0:1767320479.729409:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf43dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787840:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320479.917221:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320480.173122:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320480.750611:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320480.750647:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787968:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320480.750732:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320480.750906:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940787968
00000100:00100000:0.0:1767320480.750925:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940787968
00000100:00100000:0.0:1767320480.751008:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875
00000100:00100000:0.0:1767320480.751019:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320480.751076:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320480.751132:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940787968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320480.751140:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875
00000100:00100000:3.0:1767320480.751625:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940787968:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320480.752280:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320480.941250:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320481.197542:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320481.966925:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320482.221088:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320482.988980:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320483.245918:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320483.309749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320483.309759:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320483.309762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320483.309765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320483.309770:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320483.309791:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5728
00000100:00080000:0.0:1767320483.309796:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320483.309803:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320483.309848:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3800 x1853163940788096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320483.309863:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320483.309866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320483.309867:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320483.309870:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5728
00000100:00080000:0.0:1767320483.309872:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320483.309874:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320483.309887:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940788224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320483.309971:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940788352:0@lo:400:kworker.0
00000100:00100000:2.0:1767320483.310053:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320483.310127:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788352
00000100:00100000:3.0:1767320483.310137:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788352
00000100:00100000:1.0:1767320483.310185:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940788096:0@lo:38:kworker.0
00000100:00100000:3.0:1767320483.310210:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305
00000100:00100000:3.0:1767320483.310219:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940788352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.310222:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320483.310244:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940788224:0@lo:38:kworker.0
00000100:00100000:1.0:1767320483.310274:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320483.310366:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788096
00000100:00100000:1.0:1767320483.310370:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788096
00000100:00100000:1.0:1767320483.310397:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17906
00000100:00100000:1.0:1767320483.310402:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940788096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320483.310423:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320483.310455:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d042b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940788096:12345-0@lo:38:kworker.0 Request processed in 51us (231us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320483.310462:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17906
00000100:00080000:1.0:1767320483.310502:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320483.310506:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320483.310509:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940788096:0@lo:38:kworker.0
00000100:00100000:1.0:1767320483.310553:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940788480:0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.310575:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320483.310607:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788480
00000100:00100000:1.0:1767320483.310610:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788480
00000100:00100000:1.0:1767320483.310633:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306
00000100:00100000:1.0:1767320483.310639:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940788480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.310667:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940788480:12345-0@lo:400:kworker.0 Request processed in 28us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320483.310673:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306
00000100:00080000:1.0:1767320483.310687:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320483.310691:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320483.310707:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940788480:0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.310742:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788224
00000100:00100000:1.0:1767320483.310745:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788224
00000100:00100000:1.0:1767320483.310761:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311
00000100:00100000:1.0:1767320483.310765:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940788224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320483.310798:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320483.310824:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf47173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940788224:12345-0@lo:38:kworker.0 Request processed in 57us (549us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320483.310830:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311
00000100:00080000:1.0:1767320483.310846:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320483.310849:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320483.310851:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940788224:0@lo:38:kworker.0
00000100:00100000:3.0:1767320483.312197:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf43dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940788352:12345-0@lo:400:kworker.0 Request processed in 1972us (2137us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320483.312210:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305
00000100:00080000:0.0:1767320483.312224:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320483.312230:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320483.312234:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320483.312238:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5728
00000100:00080000:0.0:1767320483.312243:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320483.312249:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320483.312271:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2d80 x1853163940788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320483.312312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320483.312315:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320483.312317:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320483.312321:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5728
00000100:00080000:0.0:1767320483.312323:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320483.312327:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320483.312340:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3b80 x1853163940788992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320483.312380:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940788864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.312389:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940788608:0@lo:400:kworker.0
00000100:00100000:3.0:1767320483.312577:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940788736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320483.314540:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940788352:0@lo:400:kworker.0
00000100:00100000:0.0:1767320483.315595:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320483.316417:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788864
00000100:00100000:2.0:1767320483.316432:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788864
00000100:00100000:2.0:1767320483.316530:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5120
00000100:00100000:2.0:1767320483.316543:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940788864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.316725:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320483.316800:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788608
00000100:00100000:1.0:1767320483.316804:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788608
00000100:00100000:1.0:1767320483.316836:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5121
00000100:00100000:1.0:1767320483.316842:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940788608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.316899:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf4fc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940788608:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320483.316906:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5121
00000100:00100000:0.0:1767320483.316948:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940788864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320483.316948:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940788608:0@lo:400:kworker.0
00000100:00080000:0.0:1767320483.317246:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320483.317540:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320483.317578:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940788992:0@lo:38:kworker.0
00000100:00100000:3.0:1767320483.317613:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320483.317650:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788736
00000100:00100000:3.0:1767320483.317654:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788736
00000100:00100000:3.0:1767320483.317677:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940788992
00000100:00100000:3.0:1767320483.317680:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940788992
00000100:00100000:3.0:1767320483.317697:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17907
00000100:00100000:3.0:1767320483.317702:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940788736:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320483.317713:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17908
00000100:00100000:0.0:1767320483.317717:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940788992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320483.317732:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320483.317785:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940788736:12345-0@lo:38:kworker.0 Request processed in 68us (232us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320483.317792:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17907
00000100:00080000:3.0:1767320483.317833:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320483.317839:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320483.317843:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940788736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320483.317984:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940788864:12345-0@lo:400:kworker.0 Request processed in 100us (1048us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320483.317993:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5120
00010000:00020000:0.0:1767320483.318046:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320483.318091:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940788992:12345-0@lo:38:kworker.0 Request processed in 373us (476us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320483.318102:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17908
00000100:00080000:3.0:1767320483.318154:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320483.318159:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320483.318162:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940788992:0@lo:38:kworker.0
00000100:00100000:2.0:1767320483.910596:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320483.910711:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320483.911367:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377600
00000100:00100000:0.0:1767320483.911378:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377600
00000100:00100000:0.0:1767320483.911494:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377472
00000100:00100000:0.0:1767320483.911498:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377472
00000100:00080000:2.0:1767320483.911538:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320483.911580:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5122
00000100:00100000:1.0:1767320483.911593:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894377600:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320483.911680:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2505:x1853163894377600:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (1087us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320483.911688:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5122
00000100:00100000:1.0:1767320483.911707:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17909
00000100:00100000:1.0:1767320483.911712:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894377472:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320483.911733:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320483.911758:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894377472:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 45us (1048us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320483.911765:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17909
00000100:00100000:3.0:1767320484.014033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320484.269389:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320484.845946:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940789120:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320484.846018:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320484.846222:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789120
00000100:00100000:3.0:1767320484.846230:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789120
00000100:00100000:3.0:1767320484.846282:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876
00000100:00100000:3.0:1767320484.846291:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940789120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320484.846321:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320484.846369:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940789120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (351us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320484.846380:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876
00000100:00100000:2.0:1767320484.846828:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940789120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320485.036914:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320485.293037:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320485.869201:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940789248:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320485.869277:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320485.869836:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789248
00000100:00100000:2.0:1767320485.869855:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789248
00000100:00100000:2.0:1767320485.869936:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1767320485.869947:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940789248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320485.869985:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:0.0:1767320485.870184:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320485.870757:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf459fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940789248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 810us (1477us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320485.870767:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877
00000100:00100000:1.0:1767320485.871060:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940789248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320486.061011:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320486.317302:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320487.084934:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320487.341449:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320487.406237:0:7024:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320462/real 1767320462]  req@ffff93cf51839c00 x1853163940782848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320487 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320487.406272:0:7024:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff93cf51839c00 x1853163940782848/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320487 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320487.406291:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320487.406313:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320487.406317:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940782848:0@lo:250:kworker.0
00000100:00080000:3.0:1767320487.406380:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320487.406386:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320487.406389:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07417b800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320487.406393:0:53664:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 5712
00000100:00080000:3.0:1767320487.406397:0:53664:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320487.406403:0:53664:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff93d07417b800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320487.406435:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac700 x1853163940789376/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320487.406459:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320487.406463:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320487.406464:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320487.406468:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5733
00000100:00080000:3.0:1767320487.406470:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320487.406473:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320487.406486:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519ac000 x1853163940789504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320487.406494:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320487.406497:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320487.406498:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320487.406501:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5733
00000100:00080000:3.0:1767320487.406502:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320487.406506:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320487.406515:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf519afb80 x1853163940789632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320487.406581:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320487.406584:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320487.406586:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320487.406589:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5733
00000100:00080000:3.0:1767320487.406591:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320487.406595:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320487.406605:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea4700 x1853163940790144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320487.406618:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320487.406620:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320487.406622:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320487.406624:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5733
00000100:00080000:3.0:1767320487.406626:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320487.406629:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320487.406637:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf51ea5500 x1853163940790400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320487.406659:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940790016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320487.406723:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320487.406793:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320487.406799:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940790272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320487.406820:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320487.406852:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790016
00000100:00100000:3.0:1767320487.406869:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790016
00000100:00100000:3.0:1767320487.406929:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790272
00000100:00100000:3.0:1767320487.406933:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790272
00000100:00100000:3.0:1767320487.406960:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5123
00000100:00100000:3.0:1767320487.406969:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940790016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320487.407021:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940790016:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320487.407029:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5123
00000100:00100000:3.0:1767320487.407047:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5124
00000100:00100000:3.0:1767320487.407053:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940790272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320487.407080:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940790272:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320487.407085:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5124
00000100:00100000:3.0:1767320487.407122:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940790272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320487.407131:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940790016:0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407216:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940789888:0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407254:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320487.407286:0:7028:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320487.407291:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940789760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407309:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320487.407333:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789888
00000100:00100000:2.0:1767320487.407336:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789888
00000100:00100000:2.0:1767320487.407358:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789760
00000100:00100000:2.0:1767320487.407361:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789760
00000100:00100000:2.0:1767320487.407376:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307
00000100:00100000:2.0:1767320487.407381:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940789888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407411:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940789888:12345-0@lo:400:kworker.0 Request processed in 29us (156us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320487.407416:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307
00000100:00100000:2.0:1767320487.407425:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308
00000100:00100000:2.0:1767320487.407430:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940789760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407450:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940789760:12345-0@lo:400:kworker.0 Request processed in 20us (140us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320487.407455:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308
00000100:00100000:2.0:1767320487.407474:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940789760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320487.407481:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940789888:0@lo:400:kworker.0
00000100:00080000:0.0:1767320487.407807:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320487.407812:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320487.407814:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320487.407829:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba10f3aa-654c-41e2-a9c0-7ecfe92b4015:7024:1853163940789376:0@lo:250:kworker.0
00000400:00000100:0.0:1767320487.407867:0:7024:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853163940789376 offset 0 length 520: 4
00000100:00100000:0.0:1767320487.407887:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940789504:0@lo:38:kworker.0
00000100:00100000:0.0:1767320487.407907:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320487.407933:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940789632:0@lo:38:kworker.0
00000100:00100000:0.0:1767320487.407957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320487.407972:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940790144:0@lo:38:kworker.0
00000100:00100000:0.0:1767320487.407990:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320487.408014:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940790400:0@lo:38:kworker.0
00000100:00100000:0.0:1767320487.408034:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320487.408064:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789504
00000100:00100000:0.0:1767320487.408068:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789504
00000100:00100000:0.0:1767320487.408090:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790144
00000100:00100000:0.0:1767320487.408093:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790144
00000100:00100000:0.0:1767320487.408105:0:15468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790400
00000100:00100000:0.0:1767320487.408108:0:15468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790400
00000100:00100000:0.0:1767320487.408120:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17910
00000100:00100000:0.0:1767320487.408124:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940789504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320487.408146:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320487.408179:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940789504:12345-0@lo:38:kworker.0 Request processed in 53us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320487.408184:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17910
00000100:00100000:0.0:1767320487.408197:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17911
00000100:00100000:0.0:1767320487.408201:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940790144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320487.408211:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320487.408232:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940790144:12345-0@lo:38:kworker.0 Request processed in 30us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320487.408237:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17911
00000100:00100000:0.0:1767320487.408247:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17912
00000100:00100000:0.0:1767320487.408250:0:15468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940790400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320487.408257:0:15468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320487.408275:0:15468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7024:x1853163940790400:12345-0@lo:38:kworker.0 Request processed in 24us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320487.408280:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17912
00000100:00080000:0.0:1767320487.408307:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320487.408311:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320487.408314:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940789504:0@lo:38:kworker.0
00000100:00080000:0.0:1767320487.408320:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320487.408322:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320487.408324:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940790144:0@lo:38:kworker.0
00000100:00080000:0.0:1767320487.408330:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320487.408333:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320487.408335:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940790400:0@lo:38:kworker.0
00000100:00100000:1.0:1767320487.408433:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940789632
00000100:00100000:1.0:1767320487.408438:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940789632
00000100:00100000:1.0:1767320487.408464:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312
00000100:00100000:1.0:1767320487.408469:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940789632:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320487.408478:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320487.408508:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940789632:12345-0@lo:38:kworker.0 Request processed in 38us (550us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320487.408513:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312
00000100:00080000:1.0:1767320487.408534:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320487.408538:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320487.408541:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf519afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940789632:0@lo:38:kworker.0
00000100:00100000:3.0:1767320488.108941:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320488.365261:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320489.030355:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320489.030486:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377856
00000100:00100000:1.0:1767320489.030498:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377856
00000100:00100000:1.0:1767320489.030592:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5125
00000100:00100000:1.0:1767320489.030603:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894377856:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320489.030698:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2502:x1853163894377856:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (351us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320489.030706:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5125
00000100:00080000:0.0:1767320489.030823:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320489.033310:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320489.033491:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377728
00000100:00100000:3.0:1767320489.033503:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377728
00000100:00100000:3.0:1767320489.033608:0:15467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17913
00000100:00100000:3.0:1767320489.033616:0:15467:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894377728:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:3.0:1767320489.033638:0:15467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320489.034506:0:15467:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2501:x1853163894377728:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 885us (1203us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320489.034517:0:15467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17913
00000100:00100000:3.0:1767320489.133729:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320489.389213:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320489.965074:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940790528:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320489.965189:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320489.965338:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790528
00000100:00100000:2.0:1767320489.965349:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790528
00000100:00080000:0.0:1767320489.965384:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320489.965418:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878
00000100:00100000:2.0:1767320489.965428:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940790528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320489.965468:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:2.0:1767320489.965527:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940790528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320489.965534:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878
00000100:00100000:1.0:1767320489.965702:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940790528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320490.156898:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320490.413280:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320490.991683:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940790656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320490.991757:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320490.992582:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790656
00000100:00100000:1.0:1767320490.992592:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790656
00000100:00100000:1.0:1767320490.992669:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879
00000100:00100000:1.0:1767320490.992678:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940790656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320490.992712:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00080000:2.0:1767320490.992801:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320491.001864:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940790656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9176us (10096us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320491.001880:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879
00000100:00100000:3.0:1767320491.002191:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940790656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320491.181033:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320491.437237:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320492.206541:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320492.461621:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320492.525077:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320492.525088:0:53664:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320492.525090:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320492.525094:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320492.525099:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320492.525108:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320492.525113:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320492.525120:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320492.525163:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a3480 x1853163940790784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320492.525190:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320492.525193:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320492.525195:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320492.525198:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320492.525200:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320492.525204:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320492.525217:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0e00 x1853163940790912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320492.525279:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940790784:0@lo:38:kworker.0
00000100:00080000:0.0:1767320492.525288:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320492.525291:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320492.525293:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320492.525296:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320492.525299:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320492.525303:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320492.525314:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940791424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320492.525329:0:53664:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320492.525332:0:53664:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320492.525334:0:53664:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320492.525336:0:53664:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320492.525338:0:53664:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320492.525342:0:53664:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:0.0:1767320492.525355:0:53664:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf470fce00 x1853163940791680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320492.525356:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320492.525411:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940790912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320492.525440:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320492.525442:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320492.525478:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320492.525506:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320492.525512:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940791424:0@lo:38:kworker.0
00000100:00100000:3.0:1767320492.525512:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320492.525532:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320492.525533:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320492.525553:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940791680:0@lo:38:kworker.0
00000100:00100000:3.0:1767320492.525560:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940791552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320492.525573:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320492.525588:0:15467:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790784
00000100:00100000:3.0:1767320492.525595:0:15467:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790784
00000100:00100000:1.0:1767320492.525599:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791424
00000100:00100000:1.0:1767320492.525601:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791424
00000100:00100000:2.0:1767320492.525669:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940791296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320492.525698:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320492.525849:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940790912
00000100:00100000:0.0:1767320492.525853:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940790912
00000100:00100000:0.0:1767320492.525876:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313
00000100:00100000:0.0:1767320492.525882:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940790912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320492.525901:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320492.525941:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940790912:12345-0@lo:38:kworker.0 Request processed in 58us (500us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320492.525948:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313
00000100:00100000:1.0:1767320492.526483:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791680
00000100:00100000:1.0:1767320492.526489:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791680
00000100:00100000:1.0:1767320492.526503:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791296
00000100:00100000:1.0:1767320492.526506:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791296
00000100:00100000:1.0:1767320492.526538:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5126
00000100:00100000:1.0:1767320492.526545:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940791296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320492.526589:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940791296:12345-0@lo:400:kworker.0 Request processed in 44us (889us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320492.526595:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5126
00000100:00100000:1.0:1767320492.526608:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17914
00000100:00100000:1.0:1767320492.526611:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940791424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320492.526623:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320492.526646:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940791424:12345-0@lo:38:kworker.0 Request processed in 34us (1114us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320492.526652:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17914
00000100:00100000:1.0:1767320492.526661:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17915
00000100:00100000:1.0:1767320492.526664:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940790784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320492.526672:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320492.526694:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940790784:12345-0@lo:38:kworker.0 Request processed in 27us (1337us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320492.526699:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17915
00000100:00100000:1.0:1767320492.526712:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17916
00000100:00100000:1.0:1767320492.526715:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940791680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320492.526724:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320492.526745:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940791680:12345-0@lo:38:kworker.0 Request processed in 28us (1172us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320492.526751:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17916
00000100:00100000:3.0:1767320492.526761:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791040
00000100:00100000:3.0:1767320492.526765:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791040
00000100:00100000:3.0:1767320492.526820:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791168
00000100:00100000:1.0:1767320492.526822:0:40543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309
00000100:00100000:3.0:1767320492.526823:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791168
00000100:00100000:1.0:1767320492.526830:0:40543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320492.526844:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310
00000100:00100000:3.0:1767320492.526851:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320492.526865:0:40543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791040:12345-0@lo:400:kworker.0 Request processed in 37us (1387us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320492.526871:0:40543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309
00000100:00100000:3.0:1767320492.526878:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791168:12345-0@lo:400:kworker.0 Request processed in 30us (1346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320492.526884:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310
00000100:00100000:3.0:1767320492.526903:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320492.526907:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791168:0@lo:400:kworker.0
00000100:00100000:1.0:1767320492.526917:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320492.526928:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791552
00000100:00100000:3.0:1767320492.526931:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791552
00000100:00080000:1.0:1767320492.526950:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320492.526954:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127
00000100:00080000:1.0:1767320492.526955:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320492.526959:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940791424:0@lo:38:kworker.0
00000100:00100000:3.0:1767320492.526959:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940791552:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320492.526967:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320492.526970:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320492.526973:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940791680:0@lo:38:kworker.0
00000100:00080000:1.0:1767320492.526981:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320492.526983:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320492.526986:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940790784:0@lo:38:kworker.0
00000100:00100000:3.0:1767320492.526990:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940791552:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0
00000100:00080000:1.0:1767320492.526993:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320492.526995:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127
00000100:00080000:1.0:1767320492.527013:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320492.527016:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940790912:0@lo:38:kworker.0
00000100:00080000:1.0:1767320492.527063:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320492.527067:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320492.527069:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320492.527082:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940791296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320492.527082:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf51839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940791552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320493.229041:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320493.485014:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320494.155428:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:0.0:1767320494.155484:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320494.158928:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894378112
00000100:00100000:1.0:1767320494.158948:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894378112
00000100:00080000:0.0:1767320494.159435:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320494.159614:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894377984
00000100:00100000:1.0:1767320494.159619:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894377984
00000100:00100000:1.0:1767320494.159655:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5128
00000100:00100000:1.0:1767320494.159665:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894378112:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:1.0:1767320494.159763:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894378112:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (4345us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320494.159771:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5128
00000100:00100000:1.0:1767320494.159841:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17917
00000100:00100000:1.0:1767320494.159846:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894377984:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320494.159869:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320494.159896:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2501:x1853163894377984:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 48us (4412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320494.159902:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17917
00000100:00100000:3.0:1767320494.253602:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320494.509034:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320495.085562:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791808:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320495.085644:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320495.085966:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791808
00000100:00100000:0.0:1767320495.085974:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791808
00000100:00100000:0.0:1767320495.086052:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880
00000100:00100000:0.0:1767320495.086062:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320495.086106:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320495.086167:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf49a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940791808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (522us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320495.086184:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880
00000100:00080000:1.0:1767320495.086355:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320495.086471:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940791808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320495.276900:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320495.538550:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320496.110373:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940791936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320496.110457:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320496.110755:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940791936
00000100:00100000:2.0:1767320496.110765:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940791936
00000100:00080000:1.0:1767320496.110856:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320496.110876:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881
00000100:00100000:2.0:1767320496.110885:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940791936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320496.110915:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:2.0:1767320496.111113:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940791936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (655us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320496.111120:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881
00000100:00100000:3.0:1767320496.111306:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf470fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940791936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320496.300905:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320496.559342:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320497.326007:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320497.585819:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320497.647362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320497.647372:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320497.647375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320497.647379:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320497.647384:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320497.647392:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320497.647396:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320497.647404:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320497.647449:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a8b800 x1853163940792064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320497.647480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320497.647485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320497.647486:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320497.647490:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320497.647493:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320497.647497:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320497.647510:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf49a88380 x1853163940792192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320497.647583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320497.647586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320497.647587:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320497.647590:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5742
00000100:00100000:3.0:1767320497.647591:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940792320:0@lo:400:kworker.0
00000100:00080000:1.0:1767320497.647593:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320497.647596:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320497.647607:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a0a80 x1853163940792704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320497.647621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320497.647623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320497.647625:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320497.647629:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320497.647631:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320497.647634:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320497.647642:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf514a2300 x1853163940792960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320497.647663:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940792576:0@lo:400:kworker.0
00000100:00100000:3.0:1767320497.647664:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320497.647723:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940792064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320497.647812:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940792448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.649430:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320497.649513:0:7025:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320497.649525:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940792832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.649559:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320497.649625:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792320
00000100:00100000:1.0:1767320497.649633:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792320
00000100:00100000:3.0:1767320497.649659:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792576
00000100:00100000:3.0:1767320497.649664:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792576
00000100:00100000:1.0:1767320497.649687:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311
00000100:00100000:3.0:1767320497.649687:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792832
00000100:00100000:3.0:1767320497.649690:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792832
00000100:00100000:1.0:1767320497.649695:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940792320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320497.649710:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5129
00000100:00100000:3.0:1767320497.649716:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940792576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.649748:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf51839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940792320:12345-0@lo:400:kworker.0 Request processed in 52us (2083us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320497.649748:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7025:x1853163940792576:12345-0@lo:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320497.649756:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311
00000100:00100000:3.0:1767320497.649756:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5129
00000100:00080000:1.0:1767320497.649812:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320497.649818:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320497.649843:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130
00000100:00100000:1.0:1767320497.649850:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940792832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.649882:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7025:x1853163940792832:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320497.649887:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130
00000100:00100000:3.0:1767320497.650065:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940792320:0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.654211:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7025:1853163940792832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.654258:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7025:1853163940792576:0@lo:400:kworker.0
00000100:00100000:2.0:1767320497.656957:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320497.657032:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940792192:0@lo:38:kworker.0
00000100:00100000:2.0:1767320497.657077:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320497.657104:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940792704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320497.657128:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320497.657154:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940792960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320497.657174:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320497.657226:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792064
00000100:00100000:2.0:1767320497.657234:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792064
00000100:00100000:2.0:1767320497.657265:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792704
00000100:00100000:2.0:1767320497.657269:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792704
00000100:00100000:2.0:1767320497.657284:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792960
00000100:00100000:2.0:1767320497.657286:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792960
00000100:00100000:2.0:1767320497.657303:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17918
00000100:00100000:2.0:1767320497.657310:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320497.657332:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320497.657373:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792064:12345-0@lo:38:kworker.0 Request processed in 62us (433us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320497.657381:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17918
00000100:00100000:2.0:1767320497.657398:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17919
00000100:00100000:2.0:1767320497.657402:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320497.657411:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320497.657434:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792704:12345-0@lo:38:kworker.0 Request processed in 31us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320497.657440:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17919
00000100:00100000:2.0:1767320497.657451:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17920
00000100:00100000:2.0:1767320497.657455:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320497.657464:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320497.657486:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7024:x1853163940792960:12345-0@lo:38:kworker.0 Request processed in 29us (310us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320497.657491:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17920
00000100:00080000:2.0:1767320497.657533:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320497.657539:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320497.657543:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940792064:0@lo:38:kworker.0
00000100:00080000:2.0:1767320497.657553:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320497.657557:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320497.657559:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940792704:0@lo:38:kworker.0
00000100:00080000:2.0:1767320497.657567:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320497.657570:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320497.657573:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940792960:0@lo:38:kworker.0
00000100:00100000:1.0:1767320497.657945:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792192
00000100:00100000:1.0:1767320497.657950:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792192
00000100:00100000:1.0:1767320497.657984:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314
00000100:00100000:1.0:1767320497.657989:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940792192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320497.658000:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320497.658037:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940792192:12345-0@lo:38:kworker.0 Request processed in 47us (960us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320497.658042:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314
00000100:00080000:2.0:1767320497.662161:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320497.662177:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320497.662183:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940792192:0@lo:38:kworker.0
00000100:00100000:0.0:1767320497.662658:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320497.666150:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940792448
00000100:00100000:1.0:1767320497.666165:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940792448
00000100:00100000:1.0:1767320497.666236:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312
00000100:00100000:1.0:1767320497.666247:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940792448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320497.666353:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf470fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940792448:12345-0@lo:400:kworker.0 Request processed in 108us (3695us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320497.666360:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312
00000100:00100000:0.0:1767320497.666538:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf514a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940792448:0@lo:400:kworker.0
00000100:00100000:3.0:1767320498.348916:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320498.605018:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320499.271753:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320499.271870:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:3.0:1767320499.272001:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894378368
00000100:00100000:3.0:1767320499.272011:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894378368
00000100:00100000:1.0:1767320499.272053:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894378240
00000100:00100000:1.0:1767320499.272070:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894378240
00000100:00100000:3.0:1767320499.272150:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5131
00000100:00100000:3.0:1767320499.272164:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894378368:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:3.0:1767320499.272256:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9a586faf-b087-472d-9665-d3bc7d15b908+5:2503:x1853163894378368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (519us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320499.272298:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320499.274291:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17921
00000100:00100000:1.0:1767320499.274313:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894378240:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:1.0:1767320499.274338:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320499.274415:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d071211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2501:x1853163894378240:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 102us (2545us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320499.274424:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17921
00000100:00100000:3.0:1767320499.282447:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5131
00000100:00100000:3.0:1767320499.372896:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320499.630645:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320500.208367:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940793088:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320500.209135:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320500.211021:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793088
00000100:00100000:0.0:1767320500.211038:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793088
00000100:00100000:0.0:1767320500.211184:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882
00000100:00100000:0.0:1767320500.211196:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940793088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320500.211320:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:0.0:1767320500.211423:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940793088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (2289us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320500.211430:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882
00000100:00100000:3.0:1767320500.212145:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940793088:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320500.219413:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320500.397637:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320500.653017:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320501.230152:0:7027:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320501.230176:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940793216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320501.230246:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320501.230400:0:18363:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793216
00000100:00100000:0.0:1767320501.230409:0:18363:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793216
00000100:00100000:0.0:1767320501.230478:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883
00000100:00100000:0.0:1767320501.230490:0:18363:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940793216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320501.230528:0:18363:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:0.0:1767320501.230602:0:18363:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940793216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320501.230611:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883
00000100:00080000:3.0:1767320501.230902:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320501.230980:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940793216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320501.421134:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320501.678702:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320502.444908:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320502.705822:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320502.765923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320502.765934:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320502.765937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320502.765942:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320502.765946:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320502.765954:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5747
00000100:00080000:2.0:1767320502.765958:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320502.765965:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320502.766009:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071211500 x1853163940793344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320502.766045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320502.766049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320502.766051:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320502.766054:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5747
00000100:00080000:2.0:1767320502.766057:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320502.766061:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320502.766082:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d071210a80 x1853163940793472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320502.766150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320502.766154:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320502.766157:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767320502.766159:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940793600:0@lo:400:kworker.0
00000100:00080000:2.0:1767320502.766162:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5747
00000100:00080000:2.0:1767320502.766168:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320502.766176:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320502.766191:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c3a680 x1853163940793984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320502.766210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320502.766213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320502.766215:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320502.766219:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5747
00000100:00080000:2.0:1767320502.766222:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320502.766225:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940793344:0@lo:38:kworker.0
00000100:00080000:2.0:1767320502.766229:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:2.0:1767320502.766246:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93cf45c38a80 x1853163940794240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320502.766289:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940794112:0@lo:400:kworker.0
00000100:00100000:3.0:1767320502.766313:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940793856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320502.766503:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320502.767230:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320502.767513:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940793472:0@lo:38:kworker.0
00000100:00100000:0.0:1767320502.767546:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320502.767565:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940793984:0@lo:38:kworker.0
00000100:00100000:0.0:1767320502.767584:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320502.767607:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940794240:0@lo:38:kworker.0
00000100:00100000:0.0:1767320502.767636:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320502.767695:0:18373:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793472
00000100:00100000:0.0:1767320502.767703:0:18373:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793472
00000100:00100000:0.0:1767320502.767765:0:18373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315
00000100:00100000:0.0:1767320502.767787:0:18373:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940793472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320502.767820:0:18373:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320502.767863:0:18373:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940793472:12345-0@lo:38:kworker.0 Request processed in 90us (315us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320502.767871:0:18373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315
00000100:00100000:0.0:1767320502.767894:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793344
00000100:00100000:0.0:1767320502.767898:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793344
00000100:00100000:0.0:1767320502.767916:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793984
00000100:00100000:0.0:1767320502.767919:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793984
00000100:00100000:0.0:1767320502.767934:0:30968:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794240
00000100:00100000:0.0:1767320502.767936:0:30968:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794240
00000100:00100000:0.0:1767320502.767952:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17922
00000100:00100000:0.0:1767320502.767957:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940793344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320502.767967:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320502.767996:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940793344:12345-0@lo:38:kworker.0 Request processed in 37us (768us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320502.768001:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17922
00000100:00100000:0.0:1767320502.768013:0:30968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17923
00000100:00100000:2.0:1767320502.768214:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320502.768264:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940793728:0@lo:400:kworker.0
00000100:00100000:2.0:1767320502.768296:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320502.768341:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794112
00000100:00100000:2.0:1767320502.768346:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794112
00000100:00100000:2.0:1767320502.768395:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132
00000100:00100000:2.0:1767320502.768403:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940794112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320502.768446:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7028:x1853163940794112:12345-0@lo:400:kworker.0 Request processed in 45us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320502.768453:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132
00000100:00100000:2.0:1767320502.769013:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17924
00000100:00100000:2.0:1767320502.769019:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940794240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320502.769033:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320502.769047:0:30968:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940793984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320502.769060:0:30968:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320502.769091:0:30968:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7024:x1853163940793984:12345-0@lo:38:kworker.0 Request processed in 1072us (1505us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320502.769096:0:30968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17923
00000100:00080000:0.0:1767320502.769143:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320502.769148:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320502.769151:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940794240:0@lo:38:kworker.0
00000100:00080000:0.0:1767320502.769161:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320502.769164:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320502.769166:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940793344:0@lo:38:kworker.0
00000100:00080000:0.0:1767320502.769174:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320502.769177:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320502.769181:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940793472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320502.769183:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940794240:12345-0@lo:38:kworker.0 Request processed in 46us (1429us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767320502.769189:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320502.769195:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320502.769195:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17924
00000100:00100000:0.0:1767320502.769201:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940793984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320502.769240:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7028:1853163940794112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320502.769266:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793600
00000100:00100000:0.0:1767320502.769272:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793600
00000100:00080000:2.0:1767320502.769278:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320502.769284:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320502.769305:0:19232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793728
00000100:00100000:2.0:1767320502.769309:0:19232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793728
00000100:00100000:2.0:1767320502.769345:0:19232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313
00000100:00100000:2.0:1767320502.769351:0:19232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940793728:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320502.769389:0:19232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940793728:12345-0@lo:400:kworker.0 Request processed in 38us (1093us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320502.769395:0:19232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313
00000100:00100000:2.0:1767320502.769425:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940793728:0@lo:400:kworker.0
00000100:00100000:3.0:1767320502.769988:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320502.770032:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940793856
00000100:00100000:3.0:1767320502.770036:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940793856
00000100:00100000:3.0:1767320502.770073:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133
00000100:00100000:3.0:1767320502.770081:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940793856:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320502.770097:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320502.770118:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7027:x1853163940793856:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320502.770124:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133
00000100:00100000:1.0:1767320502.770147:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf49a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7027:1853163940793856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320502.770449:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314
00000100:00100000:0.0:1767320502.770456:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940793600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320502.770493:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940793600:12345-0@lo:400:kworker.0 Request processed in 38us (3991us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320502.770499:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314
00000100:00100000:1.0:1767320502.770525:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d071211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940793600:0@lo:400:kworker.0
00000400:00000100:2.0:1767320503.368875:0:7020:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.21@tcp portal 26 match 1853163894378496 offset 0 length 520: 4
00000100:00100000:2.0:1767320503.368917:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:2.0:1767320503.368948:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp)
00000100:00100000:1.0:1767320503.369018:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894378624
00000100:00100000:1.0:1767320503.369028:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894378624
00000100:00100000:1.0:1767320503.369131:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163894378752
00000100:00100000:1.0:1767320503.369135:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163894378752
00000100:00080000:2.0:1767320503.369205:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320503.369213:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5134
00000100:00100000:0.0:1767320503.369227:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894378752:12345-192.168.202.21@tcp:400:kworker.0
00000100:00100000:0.0:1767320503.369300:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a586faf-b087-472d-9665-d3bc7d15b908+5:2504:x1853163894378752:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320503.369305:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5134
00000100:00100000:0.0:1767320503.369322:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17925
00000100:00100000:0.0:1767320503.369325:0:19230:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894378624:12345-192.168.202.21@tcp:38:kworker.0
00010000:00020000:0.0:1767320503.369342:0:19230:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.21@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320503.369365:0:19230:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2501:x1853163894378624:12345-192.168.202.21@tcp:38:kworker.0 Request processed in 38us (448us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320503.369372:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17925
00000100:00100000:3.0:1767320503.468911:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320503.725967:0:18402:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320504.493477:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320504.749647:0:15461:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320505.325521:0:7025:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940794368:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320505.325614:0:7025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320505.332802:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794368
00000100:00100000:3.0:1767320505.332821:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794368
00000100:00100000:3.0:1767320505.333023:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884
00000100:00100000:3.0:1767320505.333035:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940794368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320505.333108:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 261184 pending 0 free 3919282176 avail 3687759872
00000100:00100000:3.0:1767320505.333228:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7025:x1853163940794368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (7613us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320505.333243:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884
00000100:00100000:1.0:1767320505.333294:0:7025:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf45c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7025:1853163940794368:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320505.339541:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320505.516899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:0.0:1767320505.773059:0:60696:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320506.349184:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940794496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320506.349290:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320506.349598:0:18362:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794496
00000100:00100000:3.0:1767320506.349605:0:18362:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794496
00000100:00100000:3.0:1767320506.349802:0:18362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885
00000100:00100000:3.0:1767320506.349815:0:18362:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940794496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320506.349852:0:18362:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3918245888 avail 3686723584
00000100:00100000:3.0:1767320506.349914:0:18362:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7026:x1853163940794496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (623us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320506.349921:0:18362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885
00000100:00100000:1.0:1767320506.350298:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93cf50abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7026:1853163940794496:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320506.355883:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320506.540899:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:2.0:1767320506.798925:0:60695:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320507.566814:0:16194:0:(client.c:2690:ptlrpc_set_wait()) set ffff93d04533fb40 going to sleep for 0 seconds
00010000:00010000:1.0:1767320507.822295:0:15462:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320507.885007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320507.885016:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba10f3aa-654c-41e2-a9c0-7ecfe92b4015->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320507.885019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320507.885023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320507.885027:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320507.885111:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5752
00000100:00080000:1.0:1767320507.885116:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320507.885123:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d0593d4800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320507.885421:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeac000 x1853163940794624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320507.885447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320507.885451:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320507.885453:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320507.885456:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5752
00000100:00080000:1.0:1767320507.885459:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320507.885462:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d07ac8f800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320507.885481:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeaf800 x1853163940794752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320507.885539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320507.885543:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320507.885544:0:8:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320507.885549:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5752
00000100:00080000:1.0:1767320507.885551:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320507.885556:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93cf4fc86800 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:3.0:1767320507.885566:0:7027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940794880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320507.885569:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aead880 x1853163940795264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320507.885586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320507.885589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320507.885590:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320507.885594:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5752
00000100:00080000:1.0:1767320507.885596:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320507.885599:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d0708bb000 using connection 192.168.202.121@tcp/0@lo
00000100:00100000:1.0:1767320507.885606:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff93d07aeace00 x1853163940795520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320507.885626:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940795392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320507.885661:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940794624:0@lo:38:kworker.0
00000100:00100000:2.0:1767320507.885747:0:7028:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940795008:0@lo:400:kworker.0
00000100:00100000:3.0:1767320507.886092:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320507.886337:0:48908:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794880
00000100:00100000:3.0:1767320507.886345:0:48908:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794880
00000100:00100000:3.0:1767320507.886430:0:48908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315
00000100:00100000:3.0:1767320507.886440:0:48908:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940794880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320507.886537:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320507.886584:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940794752:0@lo:38:kworker.0
00000100:00100000:0.0:1767320507.886610:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320507.886713:0:48908:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf514a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7027:x1853163940794880:12345-0@lo:400:kworker.0 Request processed in 274us (621us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320507.886722:0:48908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315
00000100:00100000:0.0:1767320507.886802:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794624
00000100:00100000:0.0:1767320507.886806:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794624
00000100:00100000:0.0:1767320507.886833:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17926
00000100:00100000:0.0:1767320507.886838:0:15469:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940794624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320507.886857:0:15469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320507.886892:0:15469:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7024:x1853163940794624:12345-0@lo:38:kworker.0 Request processed in 53us (355us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320507.886898:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17926
00000100:00100000:0.0:1767320507.886916:0:18372:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940794752
00000100:00100000:0.0:1767320507.886920:0:18372:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940794752
00000100:00100000:0.0:1767320507.886939:0:18372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316
00000100:00100000:0.0:1767320507.886944:0:18372:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940794752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320507.886953:0:18372:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320507.887010:0:18372:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7024:x1853163940794752:12345-0@lo:38:kworker.0 Request processed in 64us (398us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320507.887011:0:7027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7027:1853163940794880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320507.887024:0:18372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316
00000100:00080000:0.0:1767320507.887061:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d07ac8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320507.887066:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320507.887069:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7024:1853163940794752:0@lo:38:kworker.0
00000100:00100000:0.0:1767320507.887076:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940795264:0@lo:38:kworker.0
00000100:00100000:0.0:1767320507.887099:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320507.887115:0:7024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940795520:0@lo:38:kworker.0
00000100:00080000:3.0:1767320507.887137:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320507.887138:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320507.887161:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320507.887177:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0593d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320507.887183:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320507.887188:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7024:1853163940794624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320507.887192:0:7026:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320507.887203:0:7026:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940795136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320507.887211:0:19230:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940795264
00000100:00100000:0.0:1767320507.887216:0:19230:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940795264
00000100:00100000:1.0:1767320507.887243:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320507.887272:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940795520
00000100:00100000:3.0:1767320507.887278:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940795520
00000100:00100000:1.0:1767320507.887292:0:15469:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940795392
00000100:00100000:1.0:1767320507.887299:0:15469:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940795392
00000100:00100000:3.0:1767320507.887304:0:51212:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940795136
00000100:00100000:3.0:1767320507.887309:0:51212:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940795136
00000100:00100000:3.0:1767320507.887345:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5135
00000100:00100000:3.0:1767320507.887354:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940795136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320507.887391:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7026:x1853163940795136:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320507.887398:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5135
00000100:00100000:3.0:1767320507.887428:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5136
00000100:00100000:3.0:1767320507.887436:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940795392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320507.887700:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93d07aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7026:x1853163940795392:12345-0@lo:400:kworker.0 Request processed in 264us (539us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320507.887706:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5136
00000100:00100000:3.0:1767320507.887721:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17927
00000100:00100000:3.0:1767320507.887724:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940795520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320507.887735:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320507.888007:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940795520:12345-0@lo:38:kworker.0 Request processed in 280us (868us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320507.888013:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17927
00000100:00100000:3.0:1767320507.888027:0:51212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17928
00000100:00100000:3.0:1767320507.888031:0:51212:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940795264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320507.888040:0:51212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320507.888075:0:51212:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf50abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7024:x1853163940795264:12345-0@lo:38:kworker.0 Request processed in 42us (975us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320507.888080:0:51212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17928
00000100:00100000:2.0:1767320507.890168:0:7028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320507.890285:0:19258:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163940795008
00000100:00100000:2.0:1767320507.890294:0:19258:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163940795008
00000100:00100000:2.0:1767320507.890346:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316
00000100:00100000:2.0:1767320507.890353:0:19258:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940795008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320507.891656:0:19258:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93cf45c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:7028:x1853163940795008:12345-0@lo:400:kworker.0 Request processed in 1297us (4207us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320507.891684:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316
00000100:00100000:2.0:1767320507.891751:0:7028:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7028:1853163940795008:0@lo:400:kworker.0
00000100:00080000:2.0:1767320507.891819:0:15488:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320507.893355:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93cf4fc86800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320507.893366:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320507.893371:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7024:1853163940795264:0@lo:38:kworker.0
00000100:00080000:0.0:1767320507.893386:0:7024:0:(import.c:65:import_set_state_nolock()) ffff93d0708bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320507.893389:0:7024:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320507.893393:0:7024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7024:1853163940795520:0@lo:38:kworker.0
00000100:00100000:0.0:1767320507.893448:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7026:1853163940795136:0@lo:400:kworker.0
00000100:00100000:0.0:1767320507.893461:0:7026:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93d07aeaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7026:1853163940795392:0@lo:400:kworker.0
Debug log: 94371 lines, 94371 kept, 0 dropped, 0 bad.